It depends on the OS. Straight from MSDN blog:
On down-level platforms such as
Windows XP and Windows Server 2003,
only the Display, Std, and Dlt keys
exist. The Display, Std, and Dlt key
values are localized only in the
default language of the operating
system. Because of the Windows time zone registry architecture, CurrentUICulture settings do not impact the values of these TimeZoneInfo properties.
It seems that on win xp and server 2003, you're out of luck.
On vista, win7 and server 2008, you should be able to get an other language by changing regional settings. Multilingual User Interface (MUI) support seems to be the key:
MUI-enabled operating systems such as
Windows Vista contain MUI_Display,
MUI_Std, and MUI_Dlt keys, which are
indirectly controlled by the operating
systems regional settings
EDIT: I did a quick test on win7, setting the CurrentUICulture does not change the output language of those keys. It seems changing the regional settings is the only way. This does require you to close your session to take effect though.