Neural Networks belong to the most widely used and most popular machine learning algorithms as they can be used for a variety of purposes, such as for example image recognition or predictions. However Neural Networks are often said to be very complex and rather uninterpretable. Here I want to show, by means of a simple example, that the reputation of being complex can partially be disprove, as I will code a neural Network by hand.