Add request headers with WebClient C#

Question

I have the following code with which I download a web-page into a byte array and then print it with Response.Write:

WebClient client = new WebClient();

byte[] data = client.DownloadData(requestUri);

  /***********        Init response headers    ********/
  WebHeaderCollection responseHeaders = client.ResponseHeaders;
  for (int i = 0; i < responseHeaders.Count; i++)
       {
            Response.Headers.Add(responseHeaders.GetKey(i), responseHeaders[i]);
       }
  /***************************************************/

Besides of the response headers, I need to add request headers as well. I try to do it with the following code:

  /***********        Init request headers    ********/
  NameValueCollection requestHeaders = Request.Headers;
  foreach (string key in requestHeaders)
  {
      client.Headers.Add(key, requestHeaders[key]);
  }
  /***************************************************/

However it does not work and I get the following exception:

This header must be modified using the appropriate property.Parameter name: name

Could anybody help me with this? What's the correct way of adding request headers with WebClient?

Thank you.

What you're trying to do looks strange for me. Do you need to pass some headers from your page request to the WebClient? — Sergei B.
– Sergei B., Commented Sep 29, 2011 at 11:12
What I try to do is - download a page using WebClient. To do that correctly, I need to pass the correct request headers, like User-Agent, etc. Those should be the same headers which are being sent by the browser when I load a page in a browser window. — cycero
– cycero, Commented Sep 29, 2011 at 11:15
The exception text: This header must be modified using the appropriate property.Parameter name: name — cycero
– cycero, Commented Sep 29, 2011 at 12:11

Chris · Accepted Answer · 2011-09-29 12:10:45Z

5

The headers collection "protects" some of the possible headers as described on the msdn page here: http://msdn.microsoft.com/en-us/library/system.net.webclient.headers.aspx

That page seems to give all the answer you need but to quote the important part:

Some common headers are considered restricted and are protected by the system and cannot be set or changed in a WebHeaderCollection object. Any attempt to set one of these restricted headers in the WebHeaderCollection object associated with a WebClient object will throw an exception later when attempting to send the WebClient request.

Restricted headers protected by the system include, but are not limited to the following:
Date

Host
In addition, some other headers are also restricted when using a WebClient object. These restricted headers include, but are not limited to the following:
Accept

Connection

Content-Length

Expect (when the value is set to "100-continue"

If-Modified-Since

Range

Transfer-Encoding
The HttpWebRequest class has properties for setting some of the above headers. If it is important for an application to set these headers, then the HttpWebRequest class should be used instead of the WebRequest class.

I suspect the reason for this is that many of the headers such as Date and host must be set differently on a different request. You should not be copying them. Indeed I would personally probably suggest that you should not be copying any of them. Put in your own user agent - If the page you are getting relies on a certain value then I'd think you want to make sure you always send a valid value rather than relying on the original user to give you that information.

Essentially work out what you need to do rather than finding something that works and doing that without fully understanding what you are doing.

answered Sep 29, 2011 at 12:10

Chris

27.7k7 gold badges77 silver badges94 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Lars Udengaard Over a year ago

Excactly my problem. I have to set the Accept header, i did this instead: ((HttpWebRequest) request).Accept = "application/json"; I am using WebRequest.Create.

Morvael Over a year ago

Same issue was resolved with ((HttpWebRequest)webRequest).UserAgent = Request.UserAgent; It was a Proxy

Sergei B. · Accepted Answer · 2011-09-29 11:35:36Z

1

Looks like you're trying to set some header which is must be set using one of the WebClient properties (CachePolicy, ContentLength or ContentType)

Moreover, it's not very good to blindly copy all the headers, you need to get just those you really need.

answered Sep 29, 2011 at 11:35

Sergei B.

3,23721 silver badges18 bronze badges

Collectives™ on Stack Overflow

Add request headers with WebClient C#

2 Answers 2

2 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related