C# data scraping from websites

Question

HI I am pretty new in C# sphere. Been in php and JavaScript since the beginning of this year. I want to scrap posts and comments from a blog. The site is http://www.somewhereinblog.net

What I want to do is 1. I want to log in using a software 2. Then download the html 3. Then use regular expressions, xpath whatever comes handy to separate the contents of posts and comments

I been searching all over. Understood very little. Though I am quite sure I need to use 'htmlagilitypack'. I dont know how to add a library to c# console or form application. Can someone give me some help? I badly need this. And I am not too into C# just a week. So would be grateful if there is some detailed information. Waiting eagerly.

Thanks in advance brothers.

just google for some samples google.com/search?q=crawler+with+htmlagilitypack — Sameh Deabes
– Sameh Deabes, Commented Sep 21, 2012 at 5:43

Alberto León · Accepted Answer · 2012-09-21 05:40:28Z

5

Using Webclient you can login and download
Instead html-agility-pack I like CsQuery because lets you use jQuery syntax inside a string in C# code, so you can download to a string the html, and search and do things in it like with jQuery and HTML page.

answered Sep 21, 2012 at 5:40

Alberto León

2,9112 gold badges28 silver badges27 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

FlatLander Over a year ago

I love jquery. You made it super easy bro. Can you please leave me your email? I think I would need a little more help while developing the application.

Alberto León Over a year ago

@FlatLander Sure, but I think if you ask here you can get more feedback that only mine. leontiscar ----at---- gmail ---- dot ----- com

Collectives™ on Stack Overflow

C# data scraping from websites

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related