Add torch.nn.GELU for GELU activation (#28944)

Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/28944

Add torch.nn.GELU for GELU activation

Test Plan: buck test mode/dev-nosan //caffe2/test:nn -- "GELU"

Reviewed By: hl475, houseroad

Differential Revision: D18240946

fbshipit-source-id: 6284b30def9bd4c12bf7fb2ed08b1b2f0310bb78
This commit is contained in:
Xiaomeng Yang
2019-11-03 21:53:32 -08:00
committed by Facebook Github Bot
parent 3bffb730b6
commit 2460dced8f
23 changed files with 304 additions and 190 deletions

View File

@ -37,6 +37,7 @@ functions = [
'RReLU',
'SELU',
'CELU',
'GELU',
'Sigmoid',
'Softplus',
'Softshrink',