The Ex are the big one for me. I've liked the couple albums I have heard a lot, and I'm sure they're right up my alley, but I haven't really taken the plunge.
I know it's an old part of this thread, but for anyone looking to get more into The Fall, I'd recommend the newer book You Must Get them All: The Fall on Record. A 600 page book is a big commitment, and it can get dry, but it's a nice exhaustive guide. It pointed me toward some good post-Brix stuff that I'd never bothered to check out.