How do I download a linked pdf file from its url using python?

Question

I have multiple URL's like 'https://static.nseindia.com/s3fs-public/2022-09/ind_prs01092022.pdf' and I want to loop through an array of these and download them to a local folder. I saw that I may need to use s3fs, but I am unsure what the bucket name should be. (download file using s3fs)

Do you know the URLs anyhow? If so, you can just open a requests.Session and get the files one by one in a loop or in parallel using aiohttp. — StSav012
– StSav012, Commented Sep 13, 2022 at 9:13

StSav012 · Accepted Answer · 2022-09-14 09:11:21Z

0

It appears the web server doesn't respond unless a user agent is among the request headers. The behavior is fairly common.

import requests

with requests.Session() as s:
    s.get('https://static.nseindia.com/s3fs-public/2022-09/ind_prs01092022.pdf',
           headers={'User-Agent': 'Python'}  # or any non-empty string
    )

answered Sep 14, 2022 at 9:11

StSav012

7966 silver badges16 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How do I download a linked pdf file from its url using python?

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related