How to set up streaming?

[Morrowj4]

I saw the announcement about now supporting streaming, but can anyone give me some pointers about the steps?

The LLM modules don't seem to have any settings for it. Is there something else I need to add?

[majumba]

did you manage to find a solution in the end?

[evolu8]

I've flagged streaming to on but nothing. Seems to be rendering at a good speed. But not streaming in the chat.

[carlosrcoelho]

Hey!

Thanks for sharing your question here. I'm sorry for not getting back to you sooner.
Langflow has gone through some major changes since then. I recommend trying out the new version for the best experience. If you have any issues, please open a new one; we'll be here to help.

[Yalab7]

After trying the latest version of LangFlow, I still couldn't find the option to enable streaming and I couldn't find it in the docs either. Can you point me to the steps to enable it?

[carlosrcoelho]

As an example, you can take the OpenAI LLM, go to the Advanced option of the component, and select Stream.

[wuhy198607]

but when I deployed locally, selected the option, but still no stream response.