torch.nn.functional.gelu
- torch.nn.functional.gelu(input, approximate='none') Tensor
When the approximate argument is ‘none’, it applies element-wise the function
where is the Cumulative Distribution Function for Gaussian Distribution.
When the approximate argument is ‘tanh’, Gelu is estimated with