After wondering about the topic for some time, and looking at this question before asking on StackOverflow, it deceptively seems the main reason the languages I mention above haven't been more widely adopted is probably due to their lack of frameworks, which is of course a pity.
However that can't be the only reason IMHO. For example Python, Ruby, Perl or Php although fairly nice languages, aren't one of these mythically awesome languages, nevertheless the community has been able to develop incredible frameworks for them making these languages totally main stream.
Then you have newcomers like C# that had no inherent reason to succeed (with Java and C++ as competitors), but thanks to the investment of a huge corporation it has become a true competitor and a very viable language for development of all sorts (thanks also to Mono of course).
And then you have languages that no programmer even really considered alive anymore, like Objective-C, become all the rage thanks to another corporation investing in it, and its adoption on a killer platform (iPhone).
However Lisp, Eiffel, Haskell (popular academic languages) have not had this type of community support of Python, Ruby, Perl or even Php thing work out for them. And the other giant corporations of our era like Google, hasn't given them any love either. For example if google had said Android would work on Haskell I'm sure it would have created the critical mass necessary (like with Objective-C), or if they adopted Lisp instead of Python for their apps framework, that would have been enough to bring Lisp to the forefront of commercially mainstream languages.
But neither (Community or Corpoeration support) has been the case, so it seems that in practice the lack of frameworks is not the cause, but the result, of their failure to reach the masses, or the ones with money.
So what could be the real features these languages have that seem to work against them?
Note: When I mean mainstream here I mean languages commercial entities will invest in, not academic institutions, or for hobby purposes (areas in which the above languages have succeed to a degree).