how to add column name in a dataframe created from a csv file?

Question

I have Hive db table csv extract which has no header. I loaded csv as dataframe andit has no column name. Since length of column will change as per datatable, how can I assign col name according to column length?

i know the way to assign column for fixed column length.

>>> df1 = pd.read_csv('/home/j/HiveOP_06June_1.csv', header = None)
>>> df1.columns = ['Col1','Col2', 'Col3']
>>> df1
   Col1 Col2                 Col3
0  XPRN    A  2019-12-16 00:00:00

If I am exporting data table with 25 columns then how can i name all col on the fly?

if you can tweak the requirement so that column names start from Col0: df.add_prefix("Col") ? — anky
– anky, Commented Jun 5, 2020 at 13:19
You probably shouldn't. Column names are meant to be understandable and give information on the content of the column. If that's not the case, I'd argue it's best to leave them to their default value, which is an integer index from 0 to N-1. — Gianluca Micchi
– Gianluca Micchi, Commented Jun 5, 2020 at 13:23

Andriy Ivaneyko · Accepted Answer · 2020-06-05 15:19:56Z

2

I would do it like this:

names = [('Col' + str(i)) for i in range(1, 26)]
df1 = pd.read_csv('/home/j/HiveOP_06June_1.csv', names=names, header=None)

Of course, you can name your columns manually with name for each of them.

edited Jun 5, 2020 at 15:19

answered Jun 5, 2020 at 13:21

Andriy Ivaneyko

22.4k7 gold badges70 silver badges89 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Rohit Over a year ago

Thanks for the solution, Is there a way i can make it as Col1, Col2 instead 1,2...?

Roim Over a year ago

@AndriyIvaneyko I suggest to generalize your solution with using df1.shape[1] for range call, and then set columns name seperatly

Rohit Over a year ago

Thanks much. I am novice and missed the trick. :) appreciate it.

Andriy Ivaneyko Over a year ago

@Rohit, sure no problems, can you please mark answer as accepted if it solves your problem, so it will reflect the current state of your question :) ?

Collectives™ on Stack Overflow

how to add column name in a dataframe created from a csv file?

1 Answer 1

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related