Apparently, to embed HTML in an RSS feed (and have it validate) one must place the HTML tags inside a CDATA area.

Valid RSS feed.