tags:

views:

728

answers:

6

I'm looking for a regular expression in Java which matches all whitespace characters in a String. "\s" matches only some, it does not match   and similar non-ascii whitespaces. I'm looking for a regular expression which matches all (common) white-space characters which can occur in a Java String.

[Edit]

To clarify: I do not mean the string sequence " " I mean the sincle unicode character U+00A0 that is often represented by " ", e.g. in HTML, and all other unicode characters with a similar white-space meainig, e.g. "NARROW NO-BREAK SPACE" (U+202F), Word joiner encoded in Unicode 3.2 and above as U+2060, "ZERO WIDTH NO-BREAK SPACE" (U+FEFF) and any other character that can be regareded as white-space.

[Answer]

For my pupose, ie catching all whitespace characters, unicode + traditional, the following expression does the job:

[\p{Z}\s]

The answer is in the comments below but since it is a bit hidden I repeat it here.

+11  A: 

  is not a whitespace character, as far as regexpes are concerned. You need to either modify the regexp to include those strings in addition to \s, like /(\s| |%20)/, or previously parse the string contents to get the ASCII or Unicode representation of the data.

You are mixing abstraction levels here.

If, what after a careful reread of the question seems to be the case, you are after a way to match all whitespace characters referring to standard ASCII plus the whitespace codepoints, \p{Z} or \p{Zs} will do the work.

You should really clarify your question because it has misled a lot of people (even making the correct answer to have some downvotes).

Vinko Vrsalovic
Carsten
Use `\p{Z}` or `\p{Zs}` instead. I've tested it in Java, and they do match U+00A0.
Alan Moore
[\p{Z}\s] seems to do the trick! Thanks!
Carsten
But.. That's undocumented? http://java.sun.com/javase/6/docs/api/java/util/regex/Pattern.html
BalusC
Carsten
Is there a way to accept a comment as the right answer?
Carsten
No, best would be if Alan reposts his comment as answer.
BalusC
Andomar mentioned `\p{Z}` first, in a comment under his own answer.
Alan Moore
+7  A: 

The   is only whitespace in HTML. Use an HTML parser to extract the plain text. and \s should work just fine.

Andomar
The ` ` generates `\u00A0` at end.
BalusC
@BalusC: yes, but it's important that any sane definition of "whitespace character" in the context of regex can only include U+00A0 that is produced "at end", but can never include the literal "` `". That's what the "You are mixing abstraction levels here" of Vinkos answer is about (if I understood it correctly).
Joachim Sauer
@BalusC: Didn't know HTLM Parser did that. You could use `\p{Z}` instead of `\s` to match whitespace, it will match `\u00A0`
Andomar
@Joachim: Yes, also the "at end" part can produce something different from an Unicode code point, depending on various factors (mostly on who's interpreting the literal  ).
Vinko Vrsalovic
+2  A: 

  is not white space. It is a character encoding sequence that represents whitespace in HTML. You most likely want to convert HTML encoded text into plain text before running your string match against it. If that is the case, go look up javax.swing.text.html

Zak
Lol. Looks like Stack Overflow takes your starting ` ` literally.
Andomar
A: 

The regex characters are the only ones independent of encoding. Here is a list of some characters which - in Unicode - are non-printing:

http://stackoverflow.com/questions/1627481/how-many-non-printing-characters-are-in-common-use

peter.murray.rust
A: 

You clarified the question the way as I expected: you're actually not looking for the String literal   as many here seem to think and for which the solution is too obvious.

Well, unfortunately, there's no way to match them using regex. Best is to include the particular codepoints in the pattern, for example: "[\\s\\xA0]".

Edit as turned out in one of the comments, you could use the undocumented "\\p{Z}" for this. Alan, can you please leave comment how you found that out? This one is quite useful.

BalusC
It's one of the (many) standard Unicode property shorthands. They're mentioned in the Pattern API docs, though this one isn't among the examples. Here's a good overview: http://www.regular-expressions.info/unicode.html#prop But it's not as useful as it could be: it doesn't match linefeeds, tabs or (apparently) any other ASCII whitespace except the space (U+0020). Maybe that's why you never heard of it. :)
Alan Moore
Thanks for the overview. I really didn't expect that the undocumented ones would also work in Java's regex engine. That would mean that the API doc is incomplete (which I really wouldn't expect from the Sun guys, you know).
BalusC
+1  A: 

Here's a summary I made of several competing definitions of "whitespace":

http://spreadsheets.google.com/pub?key=pd8dAQyHbdewRsnE5x5GzKQ

You might end up having to explicitly list the additional ones you care about that aren't matched by one of the prefab ones.

Kevin Bourrillion