You can commit symbolic links just fine in SVN. The problem here however is that they won't work on Windows (obviously). The SVN repository itself doesn't store symlinks but rather stores the symlink as a versioned file whose contents point to the path the symlink was made to and also uses the svn:special property to let svn clients they may need to something special with it (e.g. convert it back to a symlink).
This link from collabnet has a small bit more detail: http://help.collab.net/index.jsp?topic=/faq/symlinks.html
Additionally, in your /releases directory in svn, you should consider making your "tags" of your releases based on the version number of your application such that finding the latest is as trivial as comparing numbers.
And on an somewhat related note: unless you are already using a /tags directory for user tags and reserving /releases for tags related to releases, I'd recommend to stick to convention and use a top level /tags directory for what you are talking about.