Scrapy - Trouble getting output from xpath/css

Question

I'm trying to get the internet number and I have tried both css and xpaths

Here's what I've tried

productOMS = product.xpath("//span[@id='product_ID']").getall()

or

productOMS = product.css(".product_internet_number::text").getall()

and here is the html snippet I'm trying to scrape:

<span itemprop="productID" id="product_internet_number" class="" style="" xpath="1">311456581</span>

I also used a xpath selector extension on chrome which gave me

when I use CSS I have a blank field returned and when I use xpath I get something like:

"< span itemprop="productID" id="product_internet_number">312028174"

Any help would be appreciated!

Ashmit Bhattarai · Accepted Answer · 2020-03-05 22:25:06Z

1

try

response.xpath("//span[@id='product_internet_number']/text()").extract()

if you are following up in a sub-selector named product from response object then:

product.xpath(".//span[@id='product_internet_number']/text()").extract()

answered Mar 5, 2020 at 22:25

Ashmit Bhattarai

1471 silver badge5 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

that solved it! ill mark as an answer when it lets me