Parse a website and turn html content into variables within PowerShell

Question

How would I call a URL and turn the page content into variables to use in PowerShell?

The HTML page looks like this:

<!DOCTYPE html>
<html>
<head>
</head>
<body>

<span class="server1var1">8</span>
<span class="server1var2">2</span>

<span class="server2var1">5</span>
<span class="server2var2">1</span>

</body>
</html>

Then in PowerShell I want these variables:

$server1var1 = "8"
$server1var2 = "2"

$server2var1 = "5"
$server2var2 = "1"

Accepting the answer below with one modification to make it work for me. Changing $_.textContent to $_.innerhtml solved the issue.

$content = Invoke-WebRequest -Uri 'http://urltomysite'
$content.ParsedHtml.getElementsByTagName('span') | ForEach-Object { 
    New-Variable -Name $_.className -Value $_.innerhtml
    }

Martin Brandl · Accepted Answer · 2016-11-24 07:45:55Z

2

Use the Invoke-WebRequest cmdlet to retrieve the content of your website. Then use the getElementsByTagName of the ParsedHtml property to retrieve all span tags. Finally turn them into a variable using the New-Variable cmdlet:

$content = Invoke-WebRequest -Uri 'http://gameadmin.zerosurvival.com/servercodes.php'
$content.ParsedHtml.getElementsByTagName('span') | ForEach-Object { 
    New-Variable -Name $_.className -Value $_.textContent 
    }

After you run this, if you type $server1var1 you will get 8.

edited Nov 24, 2016 at 7:45

answered Nov 24, 2016 at 6:31

Martin Brandl

59.4k16 gold badges151 silver badges190 bronze badges

Sign up to request clarification or add additional context in comments.

6 Comments

Damien Over a year ago

Running that exact code (changing only the Uri to a page of mine), I get no output for $server1var1.

$content = Invoke-WebRequest -Uri 'http://urltoyoursite' $content.ParsedHtml.getElementsByTagName('span') | ForEach-Object {      New-Variable -Name $_.className -Value $_.textcontent      }  echo "$server1var1"

I get no errors either.

Martin Brandl Over a year ago

This code is working since I hosted your html in IIS and testet it. Is the URL public - can you share it? Does the HTML contains a span tag with class name server1var1? Does it have a value?

Martin Brandl Over a year ago

This is working as expected. after I run this, the $server1var1 contains 8.

Esperento57 Over a year ago

doesnt work in my pc : error : New-Variable : Impossible de lier l'argument au paramètre « Name », car il a la valeur Null.

Martin Brandl Over a year ago

What do you get if you run

(Invoke-WebRequest -Uri 'http://gameadmin.zerosurvival.com/servercodes.php').ParsedHtml.getElementsByTagName('span') | select className, textContent

|

Esperento57 · Accepted Answer · 2016-11-24 07:31:35Z

1

3 Comments

Martin Brandl Over a year ago

While this may work in the provided example, this is not the way you want to parse a html file. See: stackoverflow.com/a/1732454/1163423. Also it doesn't set variables...

Esperento57 Over a year ago

this solution is a answer which work, he can choice to use or not (but your respect condition but your solution doesnt work in my pc...)

Esperento57 Over a year ago

On the link you gave the opinions are shared

Collectives™ on Stack Overflow

Parse a website and turn html content into variables within PowerShell

2 Answers 2

6 Comments

3 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

6 Comments

3 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related