2023Artificial Intelligence AdvancesOpen access

Efficient Implementation of Tanh: A Comparative Study of New Results

Samira Sorayaasa, Majid Ahmadi

Open full text 0 citations

Abstract

Hyperbolic tangent (Tanh) activation function is used in multilayered artificial neural networks (ANN). This activation function contains exponential and division terms in its expressions which makes its accurate digital implementation difficult. In this paper we present two different approximation techniques for digital implementation of Tanh function using power of two and coordinate rotation digital computer (CORDIC) methods. A comparative study of both techniques in terms of accuracy of their approximations in hardware costs as well as their speed when implemented on FPGA is also explained

Open-access reader

About this research paper

What this paper is about

Hyperbolic tangent (Tanh) activation function is used in multilayered artificial neural networks (ANN). This activation function contains exponential and division terms in its expressions which makes its accurate digital implementation difficult. In this paper we present two different approximation techniques for digital implementation of Tanh function using power of two and coordinate rotation digital computer (CORDIC) methods. A comparative study of both techniques in terms of accuracy of their approximations in hardware costs as well as their speed when implemented on FPGA is also explained

Why it matters

A significance statement is not available in the OpenAlex record.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

Hyperbolic tangent (Tanh) activation function is used in multilayered artificial neural networks (ANN). This activation function contains exponential and division terms in its expressions which makes its accurate digital implementation difficult. In this paper we present two different approximation techniques for digital implementation of Tanh function using power of two and coordinate rotation digital computer (CORDIC) methods. A comparative study of both techniques in terms of accuracy of their approximations in hardware costs as well as their speed when implemented on FPGA is also explained

Key concepts: Hyperbolic function, CORDIC, Activation function, Computer science, Field-programmable gate array, Exponential function, Artificial neural network, Function (biology)

Related papers

Back to paper searchBrowse research topicsOriginal source
Efficient Implementation of Tanh: A Comparative Study of New Results — Research Paper | ScholarLens