Faster and Better do not go together.
Faster
Pure PHP is faster and more compatible. Your distributions will be smaller. Is it the easiest to maintain? Well, it can be if done correctly. Large software projects like Drupal or Wordpress show that Framework-based projects are not any easier to maintain than pure PHP. Pure PHP still has some built-in classes, but these ultimately wrap back to functions. Autoloading is nice but larger codebases still take a performance hit.
Better
Framework-based projects tend to be better to maintain and work with in the long run. They are slower due to their nature (autoloading has a performance hit if you have a lot of different paths in your include path, or a badly ordered include path). It also gives a preset structure so that others can jump in and understand what is going on quicker. Most Zend Framework projects look the same, so you'll have a better chance of finding what piece of code is running. There's a performance hit and external helpers like opcode caches are required.
My Opinion
Go with the 'Better' option: a Framework with autoloading. A lot of the work has been done already for you so you will be out of the gate faster in terms of production time. Right now I suggest the Zend Framework plus Doctrine. Is it the fastest? No, but it is easier to maintain.
If you need flat-out speed, go core PHP or a roll-your-own low-level framework. ZF, Code Igniter, symfony, they all take a performance hit compared to core PHP.