How can I Parse an HTML response without response headers using Ruby

Question

How can I grab an HTML response when there are no response headers?

I've got this:

require 'hpricot'
require 'open-uri'

doc = Hpricot(open('http://192.168.100.1/phy.htm'))

The server in this case is a cable modem that is not returning HTTP Response headers.

The above code is failing with:

C:/Ruby/lib/ruby/1.8/net/http.rb:2022:in `read_status_line': wrong status line: "" (Net::HTTPBadResponse)

from C:/Ruby/lib/ruby/1.8/net/http.rb:2009:in `read_new'

from C:/Ruby/lib/ruby/1.8/net/http.rb:1050:in `request'

from C:/Ruby/lib/ruby/1.8/open-uri.rb:248:in `open_http'

You should first determine what it IS sending with curl or your favorite packet sniffer. It would probably be easier and more helpful to simply test your cable from the service drop forward. — Azeem.Butt
– Azeem.Butt, Commented Dec 15, 2009 at 22:41
What I'm trying to do is irrelevant to the question -- I've edited the question to remove the reason I'm trying to do this. — John Naegle
– John Naegle, Commented Dec 15, 2009 at 23:23

Mladen Jablanović · Accepted Answer · 2009-12-15 23:41:39Z

4

So if your server is not HTTP compliant, maybe you should drop HTTP idea altogether and work with Socket directly...

Then you can use hpricot with a string returned.

answered Dec 15, 2009 at 23:41

Mladen Jablanović

44.2k13 gold badges92 silver badges113 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Brock Adams · Accepted Answer · 2011-12-07 20:36:24Z

0

I see a similar problem and am reluctantly coming to the same conclusion. I'm talking to a device that returns raw XML without bothering to wrap it in an HTML response.

There is a work around:

resultxml = %x{wget -qO- "http://192.168.100.1/state.xml"}

edited Dec 7, 2011 at 20:36

Brock Adams

94k23 gold badges242 silver badges312 bronze badges

answered Aug 9, 2010 at 21:29

SmallBand

1

Collectives™ on Stack Overflow

How can I Parse an HTML response without response headers using Ruby

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related