You've got a HELL of a lot of stuff included in that page - especially for such a simple design. I count at least 14 JavaScript includes and tons of CSS files which comes to around 330 KB in total. I'm not surprised it performs poorly with all that scripting. I also note that the page doesn't render at all in IE8 (which, like it or not, is still the most widely used browser). And on browsers where it does render, the column manager makes the columns jump around when loading, which doesn't look too great.
Personally I would look at stripping out all the unnecessary JavaScript and just stick to what you actually need to execute for that page. I'd also look at just using CSS to layout the page - do you really need columnizer?