Python script to loop through file and call api with requests then store results to text file

Question

Trying to loop through titles of movies in a text file to call API and store the response to a text file.

file contains one title on every line ex.

Titanic
Avatar
A Star Is Born

the api i am trying to use is from www.odmpapi.com

This is what i have to correctly join and create the weblink

import requests
import sys

prefixURL = 'http://www.omdbapi.com/?t='
suffixURL = '&apikey=xxx4s23'

text_file = open("url.txt", "w")

with open('print.txt', 'r') as f:
    for i in f:
        uri = prefixURL + i.rstrip(' \n\t') + suffixURL
        print uri
        text_file.write(url)
        text_file.write('\n')

text_file.close()

text_file = open("responses.txt", "w")


with open('url.txt', 'r') as f2:
    for i in f2:
        url = i.strip(' \n\t')
        batch = requests.get(i.rstrip(' \n\t'))
        data = batch.text
        print data
    text_file.write(data)
    text_file.write('\n')

text_file.close()

This writes to responses.txt only the last title in the list.

There is no reference to par1 & part2 I think you need to refactor these to prefixURL & suffixURL. — Madison Courto
– Madison Courto, Commented Feb 26, 2019 at 23:00
You have a loop, and looks like you know how to write to a file. What are you having problems with? Are you trying to figure out how to make the request? Have you looked through the urllib.requests docs or the Requests: HTTP for Humans docs? — wwii
– wwii, Commented Feb 26, 2019 at 23:07
I think you might benefit from looking into context managers in order to avoid leaking file descriptors. Maybe not relevant here, but good for future. — ferrix
– ferrix, Commented Feb 26, 2019 at 23:10
@wwii I am doing this but it only writes to responses.txt only the last title in the list ``` text_file = open("responses.txt", "w") #send every uri to the api and write the respsones to a textfile with open('url.txt', 'r') as f2: for i in f2: url = i.strip(' \n\t') batch = requests.get(i.rstrip(' \n\t')) data = batch.text print data text_file.write(data) text_file.write('\n') text_file.close() ``` — Dht98111
– Dht98111, Commented Feb 26, 2019 at 23:12

Martin Evans · Accepted Answer · 2019-02-27 14:49:48Z

3

Try the following kind of approach:

import requests
import sys

base_url = 'http://www.omdbapi.com/?t={}&apikey=xxx4s23'

with open('print.txt', 'r') as f_input, open('responses.txt', 'w') as f_output:
    for line in f_input:
        search_term = line.strip(' \n\t')
        url = base_url.format(search_term)
        print url
        batch = requests.get(url)
        f_output.write("{},{}\n".format(url, batch.text))

This writes the URL and the result into the output file. Python's .format() command can be used to put your search time into the base_url without having to split it up and use string concatenation. It works by replacing each {} with a passed argument.

edited Feb 27, 2019 at 14:49

answered Feb 27, 2019 at 7:35

Martin Evans

46.9k17 gold badges88 silver badges104 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Python script to loop through file and call api with requests then store results to text file

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related