The biggest difference is that when doing large scale server development, you have total control over the environment. When developing something that the user will install on their own computer or handset, you have no idea what they might be running it on and how it might interact with other software.
Some people will have buggy versions of the operating system. Others will be using unusual color schemes that will make your UI look terrible, or screen zoomers, or screen readers, or strange input devices, or all sorts of things you never knew existed. It makes testing and debugging frustrating and difficult.
On the other hand, doing client development can awesome - you can make stuff that really makes people's lives better. Creating the best backend is worthless if the interface to the software is unusable. On the other hand, a nice UI can make up for surprisingly bad backends by staying responsive and keeping the user productive.
If you've never experienced it, you might want to give it a try. After a year, you'll know if it's for you - but I think the best programmers I've met are invariably well-rounded - they're comfortable doing both frontend and backend work.