I hate iTunes though
I found this one program called MediaMonkey which seems to be doing what I want. I figured I might as well have different directories, and it lets me embed the album art in the tag in each MP3 individually as well, which is nice as it'll always be displayed.
iTunes doesn't know about 80% of the stuff I'm importing right now, it's more obscure stuff like kids music, spanish stuff, etc...