Shift a pandas DataFrame from a certain column

Question

I am trying to manipulate a Pandas DataFrame. See the Pandas DataFrame below:

I am trying to shift from column 6 by a period of 1 if column 6 is missing.

Here is the idea:

tarrif_6_missing = df2[6].isnull()
df2[tarrif_6_missing] = df2[tarrif_6_missing].shift(1,axis=1)

The above is incorrect because it shifts the whole cells from the start of the columns. Instead if column 6 is missing. I would like to shift the columns by a period of 1 from the column 6 not from the start of the column.

EDIT: Thanks for the edits, but I am getting through, getting an error:

tarrif_6_missing = df2.loc[:,6].isnull()
df2.loc[:,tarrif_6_missing:] = df.loc[:,tarrif_6_missing:].shift(1, axis=1)

I get an error: TypeError: '0 False

And it does not go through

I'd be useful to also have an example of what you would like the result to look like. Does "shift by a period of 1" mean downwards or upwards, i.e., are you filling the holes or making them one longer? — Matthew Drury
– Matthew Drury, Commented Mar 5, 2020 at 16:07
Index goes first, then the columns, i.e. loc[tarrif_6_missing, column_6_name:] = ... — Oleg O
– Oleg O, Commented Mar 5, 2020 at 16:30

ThomaS · Accepted Answer · 2020-03-05 16:10:28Z

3

You can use .loc[] to act select a subpart of dataframe to shift like this:

 df.loc[:,column_index:]=df.loc[:,column_index:].shift(1, axis=1)

answered Mar 5, 2020 at 16:10

ThomaS

9057 silver badges15 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

JA-pythonista Over a year ago

I am getting an error: df2[tarrif_6_missing] tarrif_6_missing = df2.loc[:,6].isnull() df2.loc[:,tarrif_6_missing:] = df.loc[:,tarrif_6_missing:].shift(1, axis=1)

ThomaS Over a year ago

df.loc[tarrif6missing,6]=df.loc[tarrif6missing,6].shift(1, axis=1) i think

Oleg O Over a year ago

Probably, irrelevant here, but once I got a weird error trying to shift horizontally, while df.T.shift(1).T worked perfectly. Just for your information.

Collectives™ on Stack Overflow

Shift a pandas DataFrame from a certain column

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related