What is an activation function? What is an activation function? The activation function of a node defines the output of that node given an input or set of inputs. Some activation function algorithms are: relu, softmax and sigmoid. What is next? What is an input layer? What is an output layer? What is a Neural Network?