Download Public Github repository using Python function

Question

I have a CSV file with one column. This column consists of around 100 GitHub public repo addresses (for example, NCIP/c3pr-docs)

I want to know if there is any way to download all these 100 public repo inside my computer using Python. I don't want to use any command on the terminal, I need a function for it.

I use a very simple code to access to user and repo. Here it is:

import csv
import requests
#replace the name with your actual csv file name
file_name = "dataset.csv"
f = open(file_name)
csv_file = csv.reader(f)
second_column = [] #empty list to store second column values
for line in csv_file:
    if line[1] == "Java":
     second_column.append(line[0])
     print(line[0]) #index 1 for second column

So by doing this I read a CSV file and get access to the users and repo. I need a piece of code to help me download all these repo

AmzRise · Accepted Answer · 2022-12-18 14:04:40Z

1

Try this:

import requests

def download(user_and_repo, branch):
    URL = f"https://github.com/{user_and_repo}/archive/{branch}.tar.gz"
    response = requests.get(URL)
    open(f"{user_and_repo.split('/')[1]}.tar.gz", "wb").write(response.content)

download("AmazingRise/hugo-theme-diary", "main")

Tested under Python 3.9.

edited Dec 18, 2022 at 14:04

answered Dec 18, 2022 at 13:02

AmzRise

263 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Z Bokaee Over a year ago

Thank you for your response,

import csv import requests #replace the name with your actual csv file name file_name = "dataset.csv" f = open(file_name) csv_file = csv.reader(f) second_column = [] #empty list to store second column values for line in csv_file:     if line[1] == "Java":      second_column.append(line[0])      print(line[0]) #index 1 for second column

This is my code and I just have user and repo like NCIP/c3pr-docs in such case how can I download these repo?

AmzRise Over a year ago

@ZBokaee I've modified the answer. Just pass that NCIP/c3pr-docs into the function download.

Z Bokaee Over a year ago

Thank you very much. Shouldn't repo in this line open(f"{repo}.tar.gz", "wb").write(response.content) be changed to user_and_repo, is so my program shows me this error: FileNotFoundError: [Errno 2] No such file or directory: 'AmazingRise/hugo-theme-diary.tar.gz'

Z Bokaee Over a year ago

do you have any idea about that?

Collectives™ on Stack Overflow

Download Public Github repository using Python function

1 Answer 1

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related