Make ipython notebook print in real time

Question

Ipython Notebook doesn't seem to print results in real time, but seems to buffer in a certain way and then bulk output the prints. How can I make ipython print my results as soon as the print command is processed?

Example code:

import time


def printer():
    for i in range(100):
        time.sleep(5)
        print i

Supposing that the above code is in a file that is imported. How could I make it that when I call the printer function it prints a number every 5 seconds and not all the numbers at the very end?

Please note that I cannot edit the function printer() because I get it from some external module. I want the to change the configs of ipython notebook somehow so that it doesn't use a buffer. Therefore, I also do not wish to use sys.stdout.flush(), I want to do it in real-time according to the question, I don't want any buffer to start with.

I also tried loading ipython notebook with the command:

ipython notebook --cache-size=0

but that also doesn't seem to work.

Thanks. My question is slighly different. I don't want to change the function printer() because I get it though importing a module which I don't want to change. I simply want to change the behaviour of ipython. So the solutions proposed in the above question don't work for me because I can't add sys.stdout.flush() to the function. What I want is that there be no buffer in ipython notebook. That it outputs everything automatically. — patapouf_ai
– patapouf_ai, Commented Apr 21, 2015 at 13:48
Possibly, but there should be a way to unbuffer ipython notebook stdout no? — patapouf_ai
– patapouf_ai, Commented Apr 21, 2015 at 14:01

Community · Accepted Answer · 2017-05-23 12:09:24Z

16

+50

This is merely one of the answers to the question suggested by Carsten incorporating the __getattr__ delegation suggested by diedthreetimes in a comment:

import sys
oldsysstdout = sys.stdout
class flushfile():
    def __init__(self, f):
        self.f = f
    def __getattr__(self,name): 
        return object.__getattribute__(self.f, name)
    def write(self, x):
        self.f.write(x)
        self.f.flush()
    def flush(self):
        self.f.flush()
sys.stdout = flushfile(sys.stdout)

In the original answer, the __getattr__ method is not implemented. Without that, it fails. Other variants in answers to that question also fail in a notebook.

In a notebook, sys.stdout is an instance of IPython.kernel.zmq.iostream.OutStream and has a number of methods and attributes not present in the usual sys.stdout. Delegating __getattr__ allows a flushfile to masquerade as a ...zmq.iostream.OutStream duck.

This works in a python 2.7 notebook run with ipython 3.1.0

edited May 23, 2017 at 12:09

CommunityBot

11 silver badge

answered Jul 1, 2015 at 5:17

drevicko

15.3k15 gold badges80 silver badges104 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

patapouf_ai Over a year ago

It's quite a work around, but thank you! I will try it.

patapouf_ai Over a year ago

It works!! :) Thank you! I'll attribute the bounty in 2 days.

kmandov · Accepted Answer · 2016-03-18 15:20:02Z

12

Since Python 3.3, print() has an additional flush argument that can be used to force flushing:

for i in range(10):
    print(i, flush=True)
    time.sleep(1)

edited Mar 18, 2016 at 15:20

answered Mar 18, 2016 at 10:03

kmandov

3,20919 silver badges16 bronze badges

Comments

topace · Accepted Answer · 2018-09-14 06:51:42Z

2

Try this:

from IPython.display import display, clear_output

display("Hello World") # print string
display(df) # print object such as dataframe

clear_output(wait=True) # use this if need to clear the output before display, good for dynamic updates

answered Sep 14, 2018 at 6:51

topace

1,7913 gold badges17 silver badges23 bronze badges

Comments

ahmelq · Accepted Answer · 2021-12-07 19:25:58Z

0

Additionally, you can use the carriage return character:

from time import sleep
for i in range(10):
    print(i, end='\r')
    sleep(1)

Or if you're using Jupyter Notebooks:

from IPython.display import clear_output
from time import sleep
for i in range(10):
    print(i)
    sleep(1)
    clear_output(wait=True)

edited Dec 7, 2021 at 19:25

answered Dec 7, 2021 at 18:11

ahmelq

93610 silver badges19 bronze badges

Collectives™ on Stack Overflow

Make ipython notebook print in real time

4 Answers 4

2 Comments

Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

2 Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related