Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: [Orchestration] Improve Streaming Sample Code #243

Merged
merged 4 commits into from
Dec 20, 2024

Conversation

MatKuhr
Copy link
Member

@MatKuhr MatKuhr commented Dec 18, 2024

Context

Gemini consistently refuses to generate enough numbers, and with the default chunk size of 100 barely any streaming occurs. The new prompt is more reliable

@MatKuhr MatKuhr added the please-review Request to review a pull-request label Dec 18, 2024
@MatKuhr MatKuhr requested a review from Jonas-Isr December 19, 2024 12:11
"Can you give me the first "
+ numberOfFibonacci
+ " numbers of the Fibonacci sequence?");
"Please create a small story about developing a software project with around 700 words.");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(Minor/Comment)

For sake of sample code quality and "real world" application, I would probably still prefer a service method parameter.

Suggested change
"Please create a small story about developing a software project with around 700 words.");
"Please create a small story about "+topic+" with around 700 words.");

Jonas-Isr
Jonas-Isr previously approved these changes Dec 19, 2024
Copy link
Member

@Jonas-Isr Jonas-Isr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Besides @newtork 's point this looks good to me!

@Jonas-Isr Jonas-Isr merged commit a764bff into main Dec 20, 2024
5 checks passed
@Jonas-Isr Jonas-Isr deleted the fix/streaming-e2e-test branch December 20, 2024 10:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
please-review Request to review a pull-request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants