Finding the correlation between variables using python

Question

I am trying to find the correlation of all the columns in this dataset excluding qualityand then plot the frequency distribution of wine quality.

I am doing it the following way, but how do I remove quality?

import pandas as pd
df = pd.read_csv('http://archive.ics.uci.edu/ml/machine-learning-databases/wine-quality/winequality-white.csv', sep=';')
df.corr()

It returns this output:

How can I graph the frequency distribution of wine quality with pandas?

I previously used R for correlation and it worked fine for me but on this dataset I am learning use of pandas and python:

winecor = cor(wine[-12])
hist(wine$quality)

So in R I am getting the following output and I am looking for same in Python.

Could you please reword what you are trying to achieve? Could you also post a sample picture of the histogram you want to get? — Arturo Sbr
– Arturo Sbr, Commented Jun 6, 2021 at 17:19
It is not clear where the numbers 3 through 9 come from. You do not have them anywhere in your dataset. — DYZ
– DYZ, Commented Jun 6, 2021 at 17:32
it is in the quality column, archive.ics.uci.edu/ml/machine-learning-databases/wine-quality/… — AHF
– AHF, Commented Jun 6, 2021 at 17:35

Arturo Sbr · Accepted Answer · 2021-06-06 17:38:34Z

2

1. Histogram

# Import plotting library
import matplotlib.pyplot as plt

### Option 1 - histogram
plt.hist(df['quality'], bins=range(3, 10))
plt.show()

### Option 2 - bar plot (looks nicer)
# Get frequency per quality group
x = df.groupby('quality').size()
# Plot
plt.bar(x.index, x.values)
plt.show()

2. Correlation matrix

In order to get the correlation matrix of features, excluding quality:

# Option 1 - very similar to R
df.iloc[:, :-1].corr()

# Option 2 - more Pythonic
df.drop('quality', axis=1).corr()

edited Jun 6, 2021 at 17:38

answered Jun 6, 2021 at 17:28

Arturo Sbr

6,41111 gold badges51 silver badges101 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

AHF Over a year ago

Thank you, I tried to clear my question more, I edit it, my major focus is on 2 parts, 1. What is the correlation between the attributes other than Quality? and Graph the frequency distribution of wine quality by using Quality.

Arturo Sbr Over a year ago

Awesome. Thanks for clearing up the question. I edited my answer. Did that help?

BleakHeart · Accepted Answer · 2021-06-06 17:30:07Z

1

You can plot histograms with:

import matplotlib.pyplot as plt 

plt.hist(x=df['quality'], bins=30)
plt.show()

Read the docs of plt.hist() in order to understand better all the attributes

answered Jun 6, 2021 at 17:30

BleakHeart

514 bronze badges

Collectives™ on Stack Overflow

Finding the correlation between variables using python

2 Answers 2

1. Histogram

2. Correlation matrix

2 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1. Histogram

2. Correlation matrix

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related