I don't think that many people just turn javascript off anymore. However, things like NoScript --where javascript is disabled for a site initially and must be explicitly enabled-- are becoming more popular.
Additionally there are a few classes of browser that won't run your javascript as intended:
- Screen readers/accessible browsers (like for blind people)
- Mobile browsers
- Console-based browsers (Used sometimes by sysadmins from servers with no gui installed)
- Off-brand browsers or older browsers with buggy javascript engines
- Search Engines (Google)
Go ahead and use javascript. But make sure the site will fall back to something decent if the javascript doesn't work as expected.
Finally, I'll edit in a point someone else brought up below. If you do work for the government you may be required to support the first class of browser I listed above.