how to extract format of number from a string using pyspark

Question

I have a column in my table which have this value :

  |col_A|
  -------
  |00140|
  -------
  |00120|
  -------
  |00058|
  -------
  |00009|
  -------
  |00052|

I want to delete all 0 in the left. I use pyspark to build the dataframe. You find as below an exemple :

while tab.col_A.like('0%'):
        tab = tab.withColumn('tab_B', tab['col_A'][2:5])

When I try to execute this code I have this error :

Cannot convert column into bool

Please help.

mehdi · Accepted Answer · 2018-11-26 10:32:49Z

3

I tried this code :

tab = tab.withColumn("col_B", F.regexp_extract(tab['col_A'], '[1-9][0-9]*',0))

The problem is resolved.

Thanks,

answered Nov 26, 2018 at 10:32

mehdi

616 bronze badges

Sign up to request clarification or add additional context in comments.

1 Answer 1