Everyone should own at least every one of Beethoven's nine symphonies. Preferably a specific recording of them conducted by Günter Wand.
I'm so thrilled to see another Wand fan!

He's terribly, terribly underrated, in my opinion. Not by those who know what they're talking about (he got the von Bülow Medal, after all), but by the general public. (The Bryan Robson of conductors, in a way.)
It's mostly his Bruckner for me, but I do agree his Beethoven is marvellous.
I find it difficult to recommend classical music in terms of albums, but everyone should of course own, just to mention a few --
Bach - Christmas Oratorio (I'd go with Gardiner)
Bach - St Matthew Passion (ditto)
Bach - St John Passion (ditto)
Händel - Messiah (ditto

- this is all extremely subjective...)
Wagner - Der Ring des Nibelungen (Solti is the classic for the newb)
Wagner - Parsifal (Knappertsbush '62 or '64)
Strauss - Elektra (Krauss '53)
and all of Wand's Bruckner, of course.
