0

I have the following dataframe that contains all the data I need. The thing is, each child can be found in the parent column with their own children

  • 1000584 is Top level
  • 4003773 is Level 1
  • 1252665 is Level 2
    *1321212 is Level 3

enter image description here

What I want to achieve is this:

enter image description here

Improve this question
4
  • Check this answer for a similar question stackoverflow.com/a/62521978/11713502 Commented Jan 6, 2023 at 11:05
  • Can you give any sample code that you have tried so far? Commented Jan 6, 2023 at 11:49
  • Yes, I tried to use the self join but seems it's much complex than that. hierarchy = combinedDF.alias('Parrent').join(combinedDF.alias('Child'), col("Parrent.MATNR") == col("Child.IDNRK"), 'left') Commented Jan 6, 2023 at 12:34
  • @TusharPatil That solution was not what I needed. I managed to solve it. I had to create some custom methods in Spark to do the trick. But thanks! Commented Jan 12, 2023 at 9:33
Related questions
20
Encrypting values using Amazon KMS, storing / retrieving using DynamoDB with Lambda (NodeJS)
1
AWS DynamoDB Encryption - Ruby
4
AWS Encryption SDK Encrypt/Decrypt with Data Key
Load 7 more related questions Show fewer related questions

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.