Looking for some sort of tool that would allow me to layout my page visually using some sort of GUI, then generate the necessary CSS that would allow a web page to look like that.
I am new to this sort of thing, so please tell me if this is even possible!
All of those 3 will do what you need.
(DreamWeaver is a bit of an "industry standard" I believe. Although once you get more experienced, you can do the whole thing in Notepad if you so choose!)
There's a massive list on Wikipedia here and a comparison page here
Also, I'm pretty sure Expression is the replacement for FrontPage.
Dreamweaver is the one I've spent the most time with. The New Document dialogue has a comprehensive list of CSS templates to get you started - you can select from 30 or 40 different permutations of 1, 2 and 3 fixed and fluid column layouts with or without headers and footers.
CSSEdit for Mac looks pretty win.
There's also Style Master CSS for Windows.