The context is that I'm streaming LLM tokens from a model, and they're in Markdown, so I want to repeatedly append to the rendered Markdown.
This is roughly the code I'm using with bare text:
async for chunk in response.receive():
print(chunk.text, end='')
Which outputs:
# Document heading
Intro text
* A bullet point
* Another bullet point
But I want to render the markdown:
from IPython import display, Markdown
async for chunk in response.receive():
display(Markdown(chunk.text))
Since this outputs a markdown block with each call, there are breaks between each chunk (but with occasional formatting):
Document
heading
Intro
text
*
A
bullet point
*
Another
bullet point
Is there a way to do this naturally with the IPython or other library? Or do I need to manually buffer and re-render the response?
