ASP.NET MVC Prevent OutputCache if request is from a spider

Question

If I receive a request from a Spider, I kick off a Phantom JS process and render back dynamic HTML. (Using a OnExecuting filter and setting the ActionResult)

But the OutputCache filter is in place on this method as well and it is getting in the way!.

E.G:

step 1. Load page with normal user agent. (Output cache caches the URL) step 2. Load page with spider user agent. (the previous cached response is sent to the spider, and my Phantom JS filter never runs)

haim770 · Accepted Answer · 2013-11-14 06:44:47Z

1

Use VaryByCustom to force a 'Cache Miss' when the request is from a Search Engine Crawler.

In your Controller/Action:

[OutputCache(VaryByCustom="Crawler")]
public ActionResult Index()
{
     // ...
     return View();
}

Then in your Global.asax:

public override string GetVaryByCustomString(HttpContext context, string arg)
{
    if (arg == "Crawler" && context.Request.Browser.Crawler)
           return Guid.NewGuid().ToString();

    return base.GetVaryByCustomString(context, arg);
}

answered Nov 14, 2013 at 6:44

haim770

49.2k7 gold badges113 silver badges139 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

LostInComputer Over a year ago

This only works if OutputCacheLocation.None or OutputCacheLocation.Server or NoStore = true atleast in MVC 5

haim770 Over a year ago

@LostInComputer, reading the OP text the previous cached response is sent to the spider, it's obvious that he uses OutputCacheLocation.Server.

LostInComputer Over a year ago

I may have misunderstood the problem. I was thinking that he wanted to disable server caching and remove client caching if requester is a crawler

Collectives™ on Stack Overflow

ASP.NET MVC Prevent OutputCache if request is from a spider

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related