I assume you are talking about js file loading time.
I suggest you to package all your jquery and plugin files into a single file using something like YUI compressor. Also use etags for your static files.
This way, your user only load the js file once, and you can use it through out your site.
Edit:
For execution performance, it depends on the code quality and implementation of the plugins you use. For example, if you use livequery plugin too much, it will slow down the app. This is an example of good quality, but implementation decision lead to slow performance. However using jQuery#live (v 1.3 or above) doesn't have the performance penalty, because the underlying design and implementation is completely different. The result is that #live is less powerful then liveQuery, but faster. So it is important to read the source code to make sure code quality and implementation limitations in order to avoid performance issues.