Backpropagation is used in feed forward neural networks. In a feed forward neural network, connections between the nodes do not form a cycle. Rather they move in the forward direction. The word feed forward indicates that information travels in the forward direction. It first enters the nodes, moves to the hidden layers, and comes out through the output nodes. In fact, this is the first and simplest type of artificial neural network.