I have always used software to seed/organise my digital library, so way back in the beginning it was dictated by sampling of the music newsgoups, which I then ingested into BeoPlayer and so I ended up with <artist>\<album name>\<tracks>
And then I started using iTunes which also uses <artist>\<album name>\<tracks> and which after many years I am comfortable with
iTunes puts mix-albums (as identified by their meta-data) under <COMPILATIONS>\<album name>\<tracks>.
And that is what I ended up with early this year when I ripped my entire CD collection; the only adjustments I made was to get rid of the "Disc 1" "Disc 2" etc where they appeared.
FYI there are a couple of other specialised high level names in iTunes: <iTunes U>, <MOVIES>, <Podcasts> and <TV SHOWS>.
I have been a consumer of podcasts from the early days and so lived with this contamination of my music library :)
(Thank heavens iPod games and iPhone/Touch apps are stored in separate non-"music" directories !)
Although initially I did keep my movies well away from iTunes I am finding it convenient to buy the odd TV show from the iTunes store and as a result my "music" library is slowly becoming a "multi-media" library.
Since the GFC I have been subscribing to various university lectures, so all in all I am glad the clutter of the disorganisation is hidden from me and I can just use meta-data searching to find what I want !
First B&O (1976) was a Beogram 1500 ... latest (2011) change has been to couple the BL11 with the BL6Ks *sounds superb*