Extracting Data from URL VBA getting IE not suppoting

Question

I have been using the following Excel VBA macro to bring back data from a website. It worked fine until a few days ago when the website stopped supporting IE. Of course the macro just fails now as there is no data on the webpage to bring back to Excel, Is there a way to have the "Get method" (MSXML2.XMLHTTP)

here is my Code

    Public Sub GGGG()
        Dim MSX As Object
        Dim HTML As HTMLDocument
        Dim URL As String
        Dim UrlResponse As String
        Dim N As Long
        Dim sht1, sht2 As Worksheet

       ' On Error Resume Next
        Set MSX = CreateObject("MSXML2.XMLHTTP")
        Set HTML = New HTMLDocument
        

        URL = "https://www.justdial.com/Agra/Yogi-General-Store-Opp-Eclave-Satiudum-Sadar-Bazaar/0562P5612-5612-120207212812-H5I2_BZDET"
                    
                    With MSX
                        .Open "GET", URL, False
                        .setRequestHeader "If-Modified-Since", "Sat, 1 Jan 2000 00:00:00 GMT"
                        .send
                        UrlResponse = StrConv(.responseBody, vbUnicode)
                    End With

                       ActiveCell.Offset(0, 1) = UrlResponse

                    
    End Sub

I get response like

Error An error occurred while processing your request.

Reference #97.ec8a2c31.1621136928.281f3ca8

Please anyone can support me how to get data when IE dose not support I am not an expert in coding

I tried a variety of browsers and non browser methods to no avail. — QHarr
– QHarr, Commented May 16, 2021 at 6:40
As I think it is the website I would say no. I tried in different languages - same result. Whether it affects all users or region based, I don't know. I suspect strongly it is the site. — QHarr
– QHarr, Commented May 16, 2021 at 7:03
The correct url for me is to use https://www.justdial.com/Agra/Yogi-General-Store-Sadar-Bazaar/0562P5612-5612-120207212812-H5I2_BZDET That works fine across browsers except IE. — QHarr
– QHarr, Commented May 16, 2021 at 10:31

SIM · Accepted Answer · 2021-05-16 09:47:13Z

1

Okay, try this to get the title and votes from that site using vba in combination with selenium.

Sub FetchInfo()
    Dim driver As Object, oTitle As Object
    Dim oVotes As Object
    
    Set driver = CreateObject("Selenium.ChromeDriver")
    
    driver.get "https://www.justdial.com/Agra/Yogi-General-Store-Opp-Eclave-Satiudum-Sadar-Bazaar/0562P5612-5612-120207212812-H5I2_BZDET"
    Set oTitle = driver.FindElementByCss("span.item > span", Raise:=False, timeout:=10000)
    Set oVotes = driver.FindElementByCss("span.rtngsval > span.votes", Raise:=False, timeout:=10000)
    Debug.Print oTitle.Text, oVotes.Text
End Sub

answered May 16, 2021 at 9:47

SIM

22.5k6 gold badges45 silver badges116 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

DisappointedByUnaccountableMod · Accepted Answer · 2021-05-16 07:05:20Z

0

When the webpage no longer support IE in future, you can try out web scrape using Google Chrome with new add-in installed, please see following link for the add-in installation adn how to write in VBA. However, it is in my opinion the most simple way to perform your work is to use Uipath free community version, it work for all type of web-browser.

VBA guideline: https://www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/web-scraping-selenium-chrome/

VBA library installation for Selenium: https://code.google.com/archive/p/selenium-vba/downloads

edited May 16, 2021 at 7:05

DisappointedByUnaccountableMod

6,8444 gold badges21 silver badges23 bronze badges

answered May 16, 2021 at 6:42

Kin Siang

2,6992 gold badges6 silver badges8 bronze badges

2 Comments

Lalit Patel Over a year ago

I try with selenium Chrome ... same issue still going on

Kin Siang Over a year ago

Quite bad to hear it, if VBA is giving you alot trouble, there is other tools that can always help you. Come with Web automation, VBA not always my preferred tool. Good luck and hope you can solve the problem!!

Gustav · Accepted Answer · 2021-05-16 07:15:14Z

0

You probably need to set the Feature Browser Emulation to zero as detailed by Daniel here:

Everything You Never Wanted to Know About the Access WebBrowser Control

That said, your URL fails even when opened in Edge Chromium, so the site may suffer from a general failure.

edited May 16, 2021 at 7:15

answered May 16, 2021 at 7:03

Gustav

56.4k7 gold badges33 silver badges65 bronze badges

Collectives™ on Stack Overflow

Extracting Data from URL VBA getting IE not suppoting

3 Answers 3

Comments

2 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related