89

How can I remove all the HTML tags including &nbsp using regex in C#. My string looks like

  "<div>hello</div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div>"
2
  • 9
    Don't use a regex, check out the HTML Agility Pack. stackoverflow.com/questions/846994/how-to-use-html-agility-pack Commented Oct 22, 2013 at 16:58
  • 1
    Thanks Tim, but the application is quite big and intact, adding or downloading a html agility pack won't work. Commented Oct 22, 2013 at 17:00

10 Answers 10

214

If you can't use an HTML parser oriented solution to filter out the tags, here's a simple regex for it.

string noHTML = Regex.Replace(inputHTML, @"<[^>]+>|&nbsp;", "").Trim();

You should ideally make another pass through a regex filter that takes care of multiple spaces as

string noHTMLNormalised = Regex.Replace(noHTML, @"\s{2,}", " ");
Sign up to request clarification or add additional context in comments.

12 Comments

I haven't yet tested this as much as I will need to, but it worked better than I expected it to work. I'll post the method I wrote below.
A lazy match (<[^>]+?> as per @David S.) might make this a tad faster, but just used this solution in a live project - very happy +1 :)
Regex.Replace(inputHTML, @"<[^>]+>|&nbsp|\n;", "").Trim(); \n is not getting removed
I would recommend to ad a space rather than an empty string, we are catching out extra spaces any way Regex.Replace(inputHTML, @"<[^>]+>|&nbsp;", " ")
@Tauseef If you use a space in the first replace call, you may end up leaving spaces where there were none in the original input. Say you receive Sound<b>Cloud</b> as an input; you'll end up with Sound Cloud while it should've been stripped as SoundCloud because that's how it gets displayed in HTML.
|
34

I took @Ravi Thapliyal's code and made a method: It is simple and might not clean everything, but so far it is doing what I need it to do.

public static string ScrubHtml(string value) {
    var step1 = Regex.Replace(value, @"<[^>]+>|&nbsp;", "").Trim();
    var step2 = Regex.Replace(step1, @"\s{2,}", " ");
    return step2;
}

Comments

17

I've been using this function for a while. Removes pretty much any messy html you can throw at it and leaves the text intact.

        private static readonly Regex _tags_ = new Regex(@"<[^>]+?>", RegexOptions.Multiline | RegexOptions.Compiled);

        //add characters that are should not be removed to this regex
        private static readonly Regex _notOkCharacter_ = new Regex(@"[^\w;&#@.:/\\?=|%!() -]", RegexOptions.Compiled);

        public static String UnHtml(String html)
        {
            html = HttpUtility.UrlDecode(html);
            html = HttpUtility.HtmlDecode(html);

            html = RemoveTag(html, "<!--", "-->");
            html = RemoveTag(html, "<script", "</script>");
            html = RemoveTag(html, "<style", "</style>");

            //replace matches of these regexes with space
            html = _tags_.Replace(html, " ");
            html = _notOkCharacter_.Replace(html, " ");
            html = SingleSpacedTrim(html);

            return html;
        }

        private static String RemoveTag(String html, String startTag, String endTag)
        {
            Boolean bAgain;
            do
            {
                bAgain = false;
                Int32 startTagPos = html.IndexOf(startTag, 0, StringComparison.CurrentCultureIgnoreCase);
                if (startTagPos < 0)
                    continue;
                Int32 endTagPos = html.IndexOf(endTag, startTagPos + 1, StringComparison.CurrentCultureIgnoreCase);
                if (endTagPos <= startTagPos)
                    continue;
                html = html.Remove(startTagPos, endTagPos - startTagPos + endTag.Length);
                bAgain = true;
            } while (bAgain);
            return html;
        }

        private static String SingleSpacedTrim(String inString)
        {
            StringBuilder sb = new StringBuilder();
            Boolean inBlanks = false;
            foreach (Char c in inString)
            {
                switch (c)
                {
                    case '\r':
                    case '\n':
                    case '\t':
                    case ' ':
                        if (!inBlanks)
                        {
                            inBlanks = true;
                            sb.Append(' ');
                        }   
                        continue;
                    default:
                        inBlanks = false;
                        sb.Append(c);
                        break;
                }
            }
            return sb.ToString().Trim();
        }

3 Comments

Just to confirm: the SingleSpacedTrim() function does the same thing as string noHTMLNormalised = Regex.Replace(noHTML, @"\s{2,}", " "); from Ravi Thapliyal's answer?
@Jimmy as far as I can see, that regex doesn't catch single tabs or newlines like SingleSpacedTrim() does. That could be a desirable effect though, in that case just remove the cases as needed.
Nice, but it seems to replace single and double quotes with blank spaces as well, although they are not in the "notOkCharacter" list, or am I missing something there? Is this part of the Decoding/Encoding meethods called at the beginning? What would be necessary to keep these characters intact?
4
var noHtml = Regex.Replace(inputHTML, @"<[^>]*(>|$)|&nbsp;|&zwnj;|&raquo;|&laquo;", string.Empty).Trim();

Comments

2

I have used the @RaviThapliyal & @Don Rolling's code but made a little modification. Since we are replacing the &nbsp with empty string but instead &nbsp should be replaced with space, so added an additional step. It worked for me like a charm.

public static string FormatString(string value) {
    var step1 = Regex.Replace(value, @"<[^>]+>", "").Trim();
    var step2 = Regex.Replace(step1, @"&nbsp;", " ");
    var step3 = Regex.Replace(step2, @"\s{2,}", " ");
    return step3;
}

Used &nbps without semicolon because it was getting formatted by the Stack Overflow.

Comments

1

Sanitizing an Html document involves a lot of tricky things. This package maybe of help: https://github.com/mganss/HtmlSanitizer

2 Comments

I think it's more agains XSS attacks than to normalize html
@Revious I think you are right. Maybe my answer is not related much to the OP's question as they did not mention the purpose of removing html tags. But if the purpose is to prevent attacks, as it is in many cases, then using an already developed sanitizer may be a better approach. BTW I have no knowledge about what the meaning of normalizing html is.
0

this:

(<.+?> | &nbsp;)

will match any tag or &nbsp;

string regex = @"(<.+?>|&nbsp;)";
var x = Regex.Replace(originalString, regex, "").Trim();

then x = hello

Comments

0

HTML is in its basic form just XML. You could Parse your text in an XmlDocument object, and on the root element call InnerText to extract the text. This will strip all HTML tages in any form and also deal with special characters like &lt; &nbsp; all in one go.

Comments

0

i'm using this syntax for remove html tags with &nbsp;

SessionTitle:result[i].sessionTitle.replace(/<[^>]+>|&**nbsp**;/g, '')
--Remove(*) **nbsp**

Comments

-1
(<([^>]+)>|&nbsp;)

You can test it here: https://regex101.com/r/kB0rQ4/1

Comments

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.