Combine data from multiple DataFrames into single plot w/o combining DataFrames

Question

Due to memory constraints, I cannot have all data loaded into my jupyter notebook at once to generate a desired plot. The solution I came up with is to incrementally load my data and update the plot with data from each DataFrame. Here is a dummy example of what I tried:

import pandas as pd
import seaborn as sbn

df1 = pd.DataFrame({100 : [1,2,3], 200: [2,3,4]})
df2 = pd.DataFrame({300 : [4,5,6], 400: [5,6,7]})
df3 = pd.DataFrame({500 : [11,12,13,14], 600: [12,13,14,15]})

ax = plt.subplot(111)

sbn.boxplot(x = 'variable', y = 'value', color = 'yellow',
            data = pd.melt(df1), ax = ax)

sbn.boxplot(x = 'variable', y = 'value', color = 'yellow',
            data = pd.melt(df2), ax = ax)

sbn.boxplot(x = 'variable', y = 'value', color = 'yellow', 
            data = pd.melt(df3), ax = ax)

which results in this plot:

I would like the end product to look like this:

Any insight would be very welcomed. Thank you!

mwaskom · Accepted Answer · 2021-03-22 19:10:55Z

1

Define order = [100, 200, 300, 400, 500, 600] and pass it in each call to boxplot.

answered Mar 22, 2021 at 19:10

mwaskom

49.3k16 gold badges135 silver badges137 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

JohanC · Accepted Answer · 2021-03-22 18:44:13Z

0

You can concatenate the dataframes before calling melt:

import pandas as pd
import seaborn as sns

df1 = pd.DataFrame({100 : [1,2,3], 200: [2,3,4]})
df2 = pd.DataFrame({300 : [4,5,6], 400: [5,6,7]})
df3 = pd.DataFrame({500 : [11,12,13,14], 600: [12,13,14,15]})

fig, ax = plt.subplots()
sns.boxplot(x = 'variable', y = 'value', color = 'yellow',
            data = pd.concat([df1, df2, df3]).melt(), ax = ax)

answered Mar 22, 2021 at 18:44

JohanC

81.4k8 gold badges54 silver badges90 bronze badges

Collectives™ on Stack Overflow

Combine data from multiple DataFrames into single plot w/o combining DataFrames

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related