Skip to content

Commit aef8946

Browse files
authored
Update README.md
1 parent a11a761 commit aef8946

File tree

1 file changed

+9
-2
lines changed

1 file changed

+9
-2
lines changed

README.md

Lines changed: 9 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,23 +1,30 @@
11
# schedule-python-script-using-Google-Cloud
22
Use Case: Automates live Chicago traffic data and flows it into Bigquery for interactive real-time analysis
3+
34
Technical Concept: Schedules a Python script to append data into Bigquery using Google Cloud's App Engine with a cron job.
45

56
Reference: http://zablo.net/blog/post/python-apache-beam-google-dataflow-cron
67

78
Shout out to Mylin Ackerman for all his help. Saved me weeks of research with his personal touch.
89
https://www.linkedin.com/in/mylin-ackermann-25a00445/
910

10-
Order of Operations
11+
Order of Operations:
1112
1. Develop scripts with Google cloud shell or SDK
1213
2. Deploy on appengine
1314
3. Deploy cron job
1415
4. Check BigQuery
1516
5. Connect with dataviz tool such as Tableau
1617

17-
Specific Instructions:
18+
Setup Prerequisites:
19+
20+
Development Instructions:
1821
1. Copy github repository into SDK or Google cloud shell(thankfully it has persistent storage, so you don't have to recopy the folder structure)
1922
2.
2023

24+
Deploy Instructions:
25+
1. Install all required packages into local lib folder: pip install -r requirements.txt -t lib
26+
2. To deploy App Engine app, run: gcloud app deploy app.yaml
27+
3. To deploy App Engine CRON, run: gcloud app deploy cron.yaml
2128

2229

2330
Document Context:

0 commit comments

Comments
 (0)