How to apply a custom function across multiple columns

Question

How to extend this

df = df.select(
  pl.col("x1").map_batches(custom_function).alias("new_x1")
)

to something like

df = df.select(
  pl.col("x1","x2").map_batches(custom_function).alias("new_x1", "new_x2")
)

Or the way to go is doing it one by one

df = df.select(
  pl.col("x1").map_batches(custom_function).alias("new_x1")
  pl.col("x2").map_batches(custom_function).alias("new_x2")
)

Hericks · Accepted Answer · 2025-02-19 22:38:04Z

2

The syntax

df.select(
    pl.col("x1", "x2").some_method_chain()
)

is equivalent to

df.select(
    pl.col("x1").some_method_chain(),
    pl.col("x2").some_method_chain(),
)

Especially, your example is almost correct, but fails on the last call to pl.Expr.alias in the method chain [...].alias("new_x1", "new_x2"). You basically try to set the name of each expression to "new_x1", "new_x2". This issue can be fixed using pl.Expr.name.prefix.

df.select(
    pl.col("x1", "x2").map_batches(custom_function).name.prefix("new_")
)

edited Feb 19 at 22:38

answered Feb 19 at 22:31

Hericks

12.9k3 gold badges35 silver badges44 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to apply a custom function across multiple columns

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related