How to time functions with timeit and save results

Question

I'm trying to compare the speed of my functions using timeit but saving the results of these and I can't achieve that. Let me show you a toy example, trying to compare diferent matrix multiplication functions:

from timeit import timeit
import numpy as np

def prod_tensorial (A,B)  : return np.tensordot(A,B,(-1,0))
def prod_punto (A,B)      : return np.dot(A,B)
def prod_sumeinsten (A,B) : return np.einsum('ij,jk->ik',A,B)

A = np.random.rand(1000,2000)
B = np.random.rand(2000,3000)

fs = ( prod_tensorial, prod_punto, prod_sumeinsten )
ts = [ ]
ps = [ ]

for f in fs:
    ts += [ timeit('ps += [f(A,B)]',number=1) ]     # error: ps & f didn't recognized
    #ts += [ timeit(lambda: f(A,B),number=1) ]      # it works but lossing results
    print( ts[-1] )

print(np.allclose(*ps))

How you can see, I can't save the results. Do you know how could I do that?

DYZ · Accepted Answer · 2021-07-20 18:07:43Z

3

Function timeit does not have direct access to the global variables. You must provide the dictionary of the global variabes through the globals keyword. Since the variable ps is first read in the timed statement, it is by default considered local. Mark it as global:

# This part is only for testing
ps = []
def f(x,y): return x+y
A, B = 10, 11

timeit('global ps; ps += [f(A,B)]', number=1, globals=globals())

edited Jul 20, 2021 at 18:07

answered Jul 17, 2021 at 3:42

DYZ

57.3k10 gold badges73 silver badges101 bronze badges

Sign up to request clarification or add additional context in comments.

7 Comments

Ali Rojas Over a year ago

I'm still getting the same error. Could you check it please? colab.research.google.com/drive/…

Ali Rojas Over a year ago

Thanks a lot @DYZ! Just to leave all solved here, I add the complete line for my example: ts += [ timeit('global ps,f; ps += [f(A,B)]', number=1, globals=globals()) ]

DYZ Over a year ago

f is already global, there is no need to mark it. But whatever.

Ali Rojas Over a year ago

You are right, it's enough declaring ds as global. Thanks again! ts += [ timeit('global ps; ps += [f(A,B)]', number=1, globals=globals()) ]

Ali Rojas Over a year ago

I have just readed about that. It's because ps is being assiged inside the script, just like a function. Otherwise, it would be enough adding the globals=globals() parameter.

|

Collectives™ on Stack Overflow

How to time functions with timeit and save results

1 Answer 1

7 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

7 Comments

Your Answer

Sign up or log in

Post as a guest

Related