python- get column dataType from a dataframe

Question

I am trying to get a column data type from a dataframe

Here is a sample code:

    print training_data.schema
    print 'fields'
    print training_data.schema.fields
    print 'names'
    print training_data.schema.names

The above code prints as shown below: StructType(List(StructField(id,LongType,true),StructField(text,StringType,true),StructField(label,DoubleType,true))) fields [StructField(id,LongType,true), StructField(text,StringType,true), StructField(label,DoubleType,true)] names ['id', 'text', 'label']

But how can I get the datatype for label column ? Thanks a lot for your time.

Regards

check this,stackoverflow.com/questions/37335307/…

Suresh
– Suresh

2018-07-02 06:29:15 +00:00
Commented Jul 2, 2018 at 6:29 — Suresh
– Suresh, Commented Jul 2, 2018 at 6:29

James · Accepted Answer · 2018-07-02 05:07:49Z

1

df['col label'].dtype

Is one option.

Edit

name_dtype = df['col label'].dtype.name

edited Jul 2, 2018 at 5:07

answered Jul 2, 2018 at 5:01

James

2744 silver badges12 bronze badges

Sign up to request clarification or add additional context in comments.

6 Comments

Pratap D Over a year ago

I tried this, but it prints: Column<label['dtype']>

Pratap D Over a year ago

tried, it prints <bound method Column.alias of Column<label['dtype']>>

James Over a year ago

Oops, I think we might be talking about different dataframes. My answer was with regards to Pandas dataframes and not SQL dataframes. My bad. If you have Pandas installed, you could always convert your SQL dataframe to a Pandas dataframe and try my solution.

Pratap D Over a year ago

oh,ok I will try that. Sorry I am new to this python. What is the difference between SQL dataframe and pandas dataframe?

Pratap D Over a year ago

How do I get the data type in SQL dataframe?

|

Hrvoje · Accepted Answer · 2020-09-03 01:35:42Z

1

Here is copy-paste example of how to get column names and colum types for pandas dataframe:

import pandas as pd

list = [['Tom',34, 45.5], ['Jack',23, 60.5]]
df = pd.DataFrame(list, columns=["Name","Age","Pay"])

for column in df.columns:
    print("Column ", column, "is dtype:", df[column].dtype.name)

result:

Column  Name is dtype: object
Column  Age is dtype: int64
Column  Pay is dtype: float64

answered Sep 3, 2020 at 1:35

Hrvoje

15.4k11 gold badges104 silver badges121 bronze badges

Comments

Pratap D · Accepted Answer · 2018-07-02 06:58:45Z

0

Thanks for all the responses. I found the below solution, hoping it will be helpful to any one looking for the answer:

       for f, v in zip(df.schema.fields, df.schema.names):
          if v == colname:
            datatype = f.dataType

answered Jul 2, 2018 at 6:58

Pratap D

3215 gold badges8 silver badges16 bronze badges

Collectives™ on Stack Overflow

python- get column dataType from a dataframe

3 Answers 3

6 Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

6 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related