```{eval-rst} .. role:: hidden :class: hidden-section ``` # Aliases in torch.nn ```{eval-rst} .. automodule:: torch.nn.modules ``` The following are aliases to their counterparts in ``torch.nn`` in nested namespaces. ## torch.nn.modules The following are aliases to their counterparts in ``torch.nn`` in the ``torch.nn.modules`` namespace. ### Containers (Aliases) ```{eval-rst} .. currentmodule:: torch.nn.modules ``` ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst container.Sequential container.ModuleList container.ModuleDict container.ParameterList container.ParameterDict ``` ### Convolution Layers (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst conv.Conv1d conv.Conv2d conv.Conv3d conv.ConvTranspose1d conv.ConvTranspose2d conv.ConvTranspose3d conv.LazyConv1d conv.LazyConv2d conv.LazyConv3d conv.LazyConvTranspose1d conv.LazyConvTranspose2d conv.LazyConvTranspose3d fold.Unfold fold.Fold ``` ### Pooling layers (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst pooling.MaxPool1d pooling.MaxPool2d pooling.MaxPool3d pooling.MaxUnpool1d pooling.MaxUnpool2d pooling.MaxUnpool3d pooling.AvgPool1d pooling.AvgPool2d pooling.AvgPool3d pooling.FractionalMaxPool2d pooling.FractionalMaxPool3d pooling.LPPool1d pooling.LPPool2d pooling.LPPool3d pooling.AdaptiveMaxPool1d pooling.AdaptiveMaxPool2d pooling.AdaptiveMaxPool3d pooling.AdaptiveAvgPool1d pooling.AdaptiveAvgPool2d pooling.AdaptiveAvgPool3d ``` ### Padding Layers (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst padding.ReflectionPad1d padding.ReflectionPad2d padding.ReflectionPad3d padding.ReplicationPad1d padding.ReplicationPad2d padding.ReplicationPad3d padding.ZeroPad1d padding.ZeroPad2d padding.ZeroPad3d padding.ConstantPad1d padding.ConstantPad2d padding.ConstantPad3d padding.CircularPad1d padding.CircularPad2d padding.CircularPad3d ``` ### Non-linear Activations (weighted sum, nonlinearity) (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst activation.ELU activation.Hardshrink activation.Hardsigmoid activation.Hardtanh activation.Hardswish activation.LeakyReLU activation.LogSigmoid activation.MultiheadAttention activation.PReLU activation.ReLU activation.ReLU6 activation.RReLU activation.SELU activation.CELU activation.GELU activation.Sigmoid activation.SiLU activation.Mish activation.Softplus activation.Softshrink activation.Softsign activation.Tanh activation.Tanhshrink activation.Threshold activation.GLU ``` ### Non-linear Activations (other) (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst activation.Softmin activation.Softmax activation.Softmax2d activation.LogSoftmax adaptive.AdaptiveLogSoftmaxWithLoss ``` ### Normalization Layers (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst batchnorm.BatchNorm1d batchnorm.BatchNorm2d batchnorm.BatchNorm3d batchnorm.LazyBatchNorm1d batchnorm.LazyBatchNorm2d batchnorm.LazyBatchNorm3d normalization.GroupNorm batchnorm.SyncBatchNorm instancenorm.InstanceNorm1d instancenorm.InstanceNorm2d instancenorm.InstanceNorm3d instancenorm.LazyInstanceNorm1d instancenorm.LazyInstanceNorm2d instancenorm.LazyInstanceNorm3d normalization.LayerNorm normalization.LocalResponseNorm normalization.RMSNorm ``` ### Recurrent Layers (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst rnn.RNNBase rnn.RNN rnn.LSTM rnn.GRU rnn.RNNCell rnn.LSTMCell rnn.GRUCell ``` ### Transformer Layers (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst transformer.Transformer transformer.TransformerEncoder transformer.TransformerDecoder transformer.TransformerEncoderLayer transformer.TransformerDecoderLayer ``` ### Linear Layers (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst linear.Identity linear.Linear linear.Bilinear linear.LazyLinear ``` ### Dropout Layers (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst dropout.Dropout dropout.Dropout1d dropout.Dropout2d dropout.Dropout3d dropout.AlphaDropout dropout.FeatureAlphaDropout ``` ### Sparse Layers (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst sparse.Embedding sparse.EmbeddingBag ``` ### Distance Functions (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst distance.CosineSimilarity distance.PairwiseDistance ``` ### Loss Functions (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst loss.L1Loss loss.MSELoss loss.CrossEntropyLoss loss.CTCLoss loss.NLLLoss loss.PoissonNLLLoss loss.GaussianNLLLoss loss.KLDivLoss loss.BCELoss loss.BCEWithLogitsLoss loss.MarginRankingLoss loss.HingeEmbeddingLoss loss.MultiLabelMarginLoss loss.HuberLoss loss.SmoothL1Loss loss.SoftMarginLoss loss.MultiLabelSoftMarginLoss loss.CosineEmbeddingLoss loss.MultiMarginLoss loss.TripletMarginLoss loss.TripletMarginWithDistanceLoss ``` ### Vision Layers (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst pixelshuffle.PixelShuffle pixelshuffle.PixelUnshuffle upsampling.Upsample upsampling.UpsamplingNearest2d upsampling.UpsamplingBilinear2d ``` ### Shuffle Layers (Aliases) ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: :template: classtemplate.rst channelshuffle.ChannelShuffle ``` ## torch.nn.utils The following are aliases to their counterparts in ``torch.nn.utils`` in nested namespaces. Utility functions to clip parameter gradients. ```{eval-rst} .. currentmodule:: torch.nn.utils ``` ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: clip_grad.clip_grad_norm_ clip_grad.clip_grad_norm clip_grad.clip_grad_value_ ``` Utility functions to flatten and unflatten Module parameters to and from a single vector. ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: convert_parameters.parameters_to_vector convert_parameters.vector_to_parameters ``` Utility functions to fuse Modules with BatchNorm modules. ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: fusion.fuse_conv_bn_eval fusion.fuse_conv_bn_weights fusion.fuse_linear_bn_eval fusion.fuse_linear_bn_weights ``` Utility functions to convert Module parameter memory formats. ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: memory_format.convert_conv2d_weight_memory_format memory_format.convert_conv3d_weight_memory_format ``` Utility functions to apply and remove weight normalization from Module parameters. ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: weight_norm.weight_norm weight_norm.remove_weight_norm spectral_norm.spectral_norm spectral_norm.remove_spectral_norm ``` Utility functions for initializing Module parameters. ```{eval-rst} .. autosummary:: :toctree: generated :nosignatures: init.skip_init ```