Disable apache catch-all subdomain

Question

Hi,
I have a problem with my apache2 configuration and I hope someone here can help me.

There is one server with one IP and a few domains.
http://123.123.123.123 should have /var/www/123.123.123.123 as DocumentRoot
http://www.domain1.com should have /var/www/domain1.com as DocumentRoot
http://blog.domain1.com should have /var/www/blog.domain1.com as DocumentRoot
http://www.domain2.com should have /var/www/domain2.com as DocumentRoot
and http://bullshit.domain1.com along with all other non-existing subdomains on both domains should return a 404 page.

What am I doing wrong? That can't be so hard, and I'm sure I had it working before...
In my current config all subdomains show the /var/www/123.123.123.123. I guess because thats the first VirtualHost apache is reading.