Running update of Pandas dataframe

Question

I'd like to use a DataFrame to manage data from many trials of an experiment I'm controlling with Python code. Ideally I will have one master dataframe with a row for each trial that lives in the main function namespace, and then a separate dict (or dataframe) returned from the function that I call to execute the important bits of code for each trial.

What is the best way to do a running update of the master dataframe with this returned set of data? So far I've come up with:

df = df.append(df_trial, ignore_index=True)

or

df = pd.concat([df, df_trial])

But neither seem ideal (and both take a relatively long time according to %timeit). Is there a more Pandonic way?

Wes McKinney · Accepted Answer · 2013-01-08 03:44:25Z

1

You should build a list of the pieces and concatenate them all in one shot at the end.

answered Jan 8, 2013 at 3:44

Wes McKinney

106k32 gold badges146 silver badges109 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Running update of Pandas dataframe

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related