Calling function using Timeit

Question

I'm trying to time several things in python, including upload time to Amazon's S3 Cloud Storage, and am having a little trouble. I can time my hash, and a few other things, but not the upload. I thought this post would finally, get me there, but I can't seem to find salvation. Any help would be appreciated. Very new to python, thanks!

import timeit

accKey = r"xxxxxxxxxxx";
secKey = r"yyyyyyyyyyyyyyyyyyyyyyyyy";

bucket_name = 'sweet_data'

c = boto.connect_s3(accKey, secKey)
b = c.get_bucket(bucket_name);
k = Key(b);

p = '/my/aws.path'
f = 'C:\\my.file'

def upload_data(p, f):
    k.key = p
    k.set_contents_from_filename(f)
    return

t = timeit.Timer(lambda: upload_data(p, f), "from aws_lib import upload_data; p=%r; f = %r" % (p,f))

# Just calling the function works fine
#upload_data(p, f)

Community · Accepted Answer · 2017-05-23 12:28:59Z

2

I know this is heresy in the Python community, but I actually recommend not to use timeit, especially for something like this. For your purposes, I believe it will be good enough (and possibly even better than timeit!) if you simply use time.time() to time things. In other words, do something like

from time import time

t0 = time()
myfunc()
t1 = time()
print t1 - t0

Note that depending on your platform, you might want to try time.clock() instead (see Stack Overflow questions such as this and this), and if you're on Python 3.3, then you have better options, due to PEP 418.

edited May 23, 2017 at 12:28

CommunityBot

11 silver badge

answered Jul 3, 2013 at 21:42

John Y

14.6k2 gold badges51 silver badges76 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

user2407064 Over a year ago

That is so much easier. Thanks a lot!

Sau001 Over a year ago

Thanks for the suggestion. Coming from a .NET/C# background, I found timeit very un-intuitive, especially with large functions and chunks of code. Just want to add that - I am currently on Python 3.8 and found the function time.time_ns() very useful. docs.python.org/3/library/time.html#time.time

moooeeeep · Accepted Answer · 2013-07-04 17:46:58Z

1

You can use the command line interface to timeit.

Just save your code as a module without the timing stuff. For example:

# file: test.py
data = range(5)
def foo(l):
    return sum(l)

Then you can run the timing code from the command line, like this:

$ python -mtimeit -s 'import test;' 'test.foo(test.data)'

1 Comment

user2407064 Over a year ago

I'm sure that this works great, but it's a little more complicated than what I'm looking for. I was really looking to add a few lines to test parts of a function (module) instead of significantly altering my code. Thanks though, I'm sure that this will come in handy another time.

Collectives™ on Stack Overflow

Calling function using Timeit

2 Answers 2

2 Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related