How to use Layers in the GIMP image editor (and why you should)

GIMP is a powerful (and free) image editor that offers all the features you need and some you might not know you need. One such feature is Layers. What are they and why should you use them?