Is printf in C extension module faster than writelines in python?

Question

Here's my code in python:

for post in posts:
    ss = get_vector_local(word_list, status)
    # ss is a string
    if ss is not None:
        output_file.writelines(ss + '\n')

But I need to write about 1GB file.

Do I need to rewrite the output part with python-C extension module to make the output faster?

Just a brief comment... you should check for None with the is operator instead of equality. For the main problem, I don't know but I stay around coz it's interesting. — bgusach
– bgusach, Commented Aug 7, 2014 at 7:12
I guess the answer depends a lot on the system and other external factors. I suggest you try both and profile (time) the code to see which is faster. — Rudy Velthuis
– Rudy Velthuis, Commented Aug 7, 2014 at 7:20

Don Question · Accepted Answer · 2014-08-07 07:29:53Z

1

Paraphrasing Linus T., C is basically the most portable assembler and therefore beats python in pure computations hands down.

Your example on the other side deals with I/O and as long as python is able to feed the I/O buffers fast enough, there should only be a neglectable overhead compared to pure C.

answered Aug 7, 2014 at 7:29

Don Question

11.7k5 gold badges39 silver badges56 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Is printf in C extension module faster than writelines in python?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related