Activation Function

In a neural network, this mathematical function determines the output of a neuron. It introduces non-linearity, allowing the network to learn complex patterns and relationships in the data.