XHTML 5 is not a standard. XHTML 2 does prescribe a new doctype, though XHTML 2 is not supported by any modern browsers (as it is largely unfinished).
HTML5Doctor recommends that if targeting an "XHTML5" approach, simply use the HTML5 doctype, which makes sense. The HTML5 doctype is compatible with IE7/8.
http://html5doctor.com/html-5-xml-xhtml-5/
Remember, to use HTML5 (properly) in IE <9, you need to include the HTML 5 shiv.
http://ejohn.org/blog/html5-shiv/
Also, in terms of a MIME type for XHTML5, you MUST serve the content with application/xhtml+xml
or application/xml
, which older version of IE will NOT support. Thus, if you're trying to take a purist approach, you CANNOT have IE 6/7 support.