Pandas Dataframe from a text file (table) python [duplicate]

Question

Considering my text file would have the following pattern:

    CONTAINER ID   IMAGE                                                                        COMMAND                  CREATED             STATUS                       PORTS                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       NAMES
    xxxxxxxxxxxx   yyyyyyyyyyyyyyyyyyyyyyyyyyy                                                  zzzzzzzzzzzzzzzzzzzzzz   aaaaaaaaaaaaaaaa    bbbbbbbbbbb                  ports                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       random name

Basically the output of docker ps command, written to a text file. What is the most effective way to convert this into a data frame or a readable format into python, to query the values. (i.e.) Given a name, get the matching container ID etc.

I tried

    df = pd.read_csv("docker.txt",sep="  ")

but there are lapses, as the delimiter is not consistent.

use regular expressions to handle the inconsistent delimiters — PRStark
– PRStark, Commented Oct 17, 2023 at 2:26
@PandaKim does the job yes, but misses out any empty values for the columns. the next value is taken — Lakshmi Narayanan
– Lakshmi Narayanan, Commented Oct 17, 2023 at 2:38

PRStark · Accepted Answer · 2023-10-17 02:38:14Z

1

import pandas as pd
import re

column_names = ["CONTAINER ID", "IMAGE", "COMMAND", "CREATED", "STATUS", "PORTS", "NAMES"]


data = []
with open("docker.txt", "r") as file:
    lines = file.readlines()
    lines = [line.strip() for line in lines[1:]]

    for line in lines:
        values = re.split(r'\s{2,}', line)
        data.append(values)

df = pd.DataFrame(data, columns=column_names)

print(df)

Hope this helps with using regex and getting dataframe from text file

edited Oct 17, 2023 at 2:38

answered Oct 17, 2023 at 2:31

PRStark

1,2668 silver badges20 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Lakshmi Narayanan Over a year ago

thank you for the answer. there are actually 7 columns, from the output of docker ps, if you can use the scroll bar

PRStark Over a year ago

Its just add the column names, I just updated the script and output

Collectives™ on Stack Overflow

Pandas Dataframe from a text file (table) python [duplicate]

1 Answer 1

2 Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Linked

Related