SoftMax

Versioned name: SoftMax-1

Category: Activation function

Short description: Reference

Detailed description: Reference

Attributes

  • axis

  • Description: axis represents the axis of which the SoftMax is calculated. axis equal 1 is a default value.

  • Range of values: positive integer value
  • Type: int
  • Default value: 1
  • Required: no

Mathematical Formulation

\f[ y_{c} = \frac{e^{Z_{c}}}{\sum_{d=1}^{C}e^{Z_{d}}} \f] where \f$C\f$ is a size of tensor along axis dimension.

Inputs:

  • 1: Input tensor with enough number of dimension to be compatible with axis attribute. Required.

Outputs:

  • 1: The resulting tensor of the same shape and type as input tensor.

Example

<layer ... type="SoftMax" ... >
    <data axis="1" />
    <input> ... </input>
    <output> ... </output>
</layer>