Apart from the fact that communication is obviously more difficult, there can be a time zone problem.
For example I once worked on a project, where part of the team (on which I heavily depended) was in Novosibirsk(GMT+6) and I was in Moscow(GMT+3). So, when the guys at Novosibirsk came to work, they had to still wait for me for like 3 hours. In the evening, if i needed something terribly important -- whoops, no luck, they are already home and sleeping, have to wait for the next day.
Add to that the fact that we had lunch at different times and we ended up with 3-4 hours a day when we actually can communicate using VoIP or IM.
The company ended up moving those guys to Moscow eventually.