I've been looking at the real-world performance of the Google loader for jQuery, particularly, and here's what I've found:
- Google's servers are quick and plenty reliable.
- They are serving from a CDN, which means if you have a lot of overseas users they'll get much better load times.
- They are not serving gzipped files. So they're serving a lot more bytes than they need to.
If you know what you're doing in Apache, Lighttpd, or whatever you're serving files with, you could set your cache headers just like Google's and significantly reduce the amount of data your end user has to download by serving it from your own server. You could also combine your scripts at that point and reduce your overall HTTP requests.
Bottom line: Google's performance is good but not great. If you have many many overseas users then Google is probably better, if your users are mostly US-based and maximum performance is your concern, learn about caching, Etags, gzipping, etc. and serve it yourself.