The previous post on a similar subject works on class files. I have not heard of a tool which does the same for source files.
You can, however, develop and compile in Java 5 and deploy on a Java 4 runtime with retroweavor or retrotranslator.
If you must convert java 5 to 4, the easiest way to do it, as far as I see, is by setting your IDE java version to 1.4 and fix all errors.
In eclipse, for instance, you can set a per-project java version by right-clicking on the project, select Properties, select Java Compiler and set the Compiler compliance level. It may be smart to use the Java 1.4 JRE system library instead of the 1.5 JRE (Java Build Path, Libraries).