Request URL in Python

Question

To trigger the update you have to visit a url in the browser. This script was made in shell to do it:

#!/bin/bash
# Bash to initiate Solr Delta Import Handler

# Setup Variables
hostName=localhost
portNum=8080
SOLRPATH=/solr
SOLR='delta-import&clean=false'
STATUS='dataimport?command=status'
urlCmd='http://${hostName}:${portNum}${SOLRPATH}/dataimport?command=${SOLRCMD}"

# Operations
curl $URLCMD

I have tried to write this in Python, this is how far I got:

#!/usr/bin/env python
# -*- coding: utf-8 -*-

# Setup Variables
hostName='localhost'
portNum='8080'
SOLRPATH='/solr'
SOLRCMD='delta-import&clean=false'
STATUSCMD='dataimport?command=status'
urlCmd='http://${hostName}:${portNum}${SOLRPATH}/dataimport?command=${SOLRCMD}'

# Alternative to Curl {URLCMD}

So basically I have two questions:

Is my python code ok so far?
What is a simple alterantive to Curl in python? The event is normally triggered just by visiting the URL but I dont know how to do this in Python simply.

It's not really important for your code to work. But I really think you should use other naming conventions like PEP-8 suggests if you gonna write it in python: python.org/dev/peps/pep-0008 — Niclas Nilsson
– Niclas Nilsson, Commented Nov 18, 2012 at 21:48

tehmisvh · Accepted Answer · 2012-11-18 21:46:15Z

First of all, use one of these kinds of string formatting in Python:

urlCmd='http://{0}:{1}{2}/dataimport?command={3}'.format(hostName,portnum, SOLRPATH, SOLRCMD)
#or
urlCmd='http://%s:%s%s/dataimport?command=%s' % (hostName,portnum, SOLRPATH, SOLRCMD)

While there is pycurl in python that uses libcurl, you should use a builtin module like urllib2 to access the URL you generated if you want your script to stay portable.

import urllib2
req = urllib2.urlopen(urlCmd)

Now there are several things you can do with your request:

req.close      req.fileno     req.getcode    req.headers    req.msg  
req.read       req.readlines  req.code       req.fp         req.geturl   
req.info       req.next       req.readline   req.url

While most of the methods are self explanatory, refer to the urllib2 docs for a detailed explanation of what they do.

Constantinius · Accepted Answer · 2012-11-18 21:47:45Z

2

Is my python code ok so far?

No, its not. Please have a look at string formatting in Python.

Try this:

...
urlCmd='http://%s:%d%s/dataimport?command=%s' % (hostName, portNum, SOLRPATH, SOLRCMD)

What is a simple alterantive to Curl in python? The event is normally triggered just by visiting the URL but I dont know how to do this in Python simply.

Try the urllib module:

import urllib    
urllib.urlopen(url)

edited Nov 18, 2012 at 21:47

answered Nov 18, 2012 at 21:42

Constantinius

35.2k9 gold badges79 silver badges85 bronze badges

2 Comments

Jimmy Over a year ago

Is urllib included in python 2.7 or do I need to install it? Also, thank you for the hint on the string format

Constantinius Over a year ago

urllib is included with Python since version 2.3. So this should work for you.

Collectives™ on Stack Overflow

Request URL in Python

2 Answers 2

Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related