File upload Amazon very Slow using Django storages

Question

I am using Django-Storages for file upload to Amazon S3 but the upload speed is very slow.

Is there any way I can get nice upload speed ?

I am using

Django == 1.4

Django-storages == 1.1.8

boto == 2.6.0

Django settings:

DEFAULT_FILE_STORAGE = 'storages.backends.s3boto.S3BotoStorage'

AWS_ACCESS_KEY_ID = 'XXXXXXXXX'

AWS_SECRET_ACCESS_KEY = 'XXXXXXX'

AWS_STORAGE_BUCKET_NAME = 'XXXdev'

AWS_QUERYSTRING_AUTH = False

We need your internet speed like Priyank suggests and we could also use how big all the files you're trying to send up are together. — stormlifter
– stormlifter, Commented Mar 11, 2014 at 19:51
Should I use Browser based uploads using Post, to upload files directly to S3, to speed up the uploads ? — user1839132
– user1839132, Commented Mar 12, 2014 at 6:12
The django-stroages boto connection seems extremely slow, same problem here, still looking for solution — Wade Williams
– Wade Williams, Commented Apr 2, 2014 at 3:11

Amit Talmor · Accepted Answer · 2014-05-11 12:22:30Z

0

I don't think django is influencing a lot in here. you can upload or download directly from S3 via the browser and see it is also not so fast. If you upload from EC2 to S3, the fastest way is if the EC2 & S3 are on the same region. Also, The fastest way is when your using the closest region from you. (PC ==> EC2 ==> S3).

I read once this article, was a nice one: http://www.takipiblog.com/2013/03/20/aws-olypmics-speed-testing-amazon-ec2-s3-across-regions/

answered May 11, 2014 at 12:22

Amit Talmor

8,3324 gold badges28 silver badges30 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

File upload Amazon very Slow using Django storages

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related