Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DRAFT for Feedback - Support for token streaming for more dynamic UX #4443

Closed
wants to merge 35 commits into from
Closed
Changes from 1 commit
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
963e409
AssistantAgent support for streaming tokens
jspv Nov 22, 2024
8b9295e
Merge branch 'main' into stream_token_0.4
jspv Dec 1, 2024
c20298d
Merge branch 'microsoft:main' into stream_token_0.4
jspv Dec 4, 2024
cf9a1eb
Merge branch 'microsoft:main' into stream_token_0.4
jspv Dec 9, 2024
b854dae
Updates for token handling
jspv Dec 9, 2024
6054cd9
Merge branch 'stream_token_0.4' of https://github.com/jspv/autogen in…
jspv Dec 9, 2024
f43f831
Fixed formatting
jspv Dec 9, 2024
9a763f4
Set default to fix Azure clients
jspv Dec 9, 2024
9d4d58c
refresh from upstream
jspv Dec 18, 2024
4be98d0
Adding ToolCallResultSummaryMessage
jspv Dec 18, 2024
c36c4f2
Merge remote-tracking branch 'origin/main' into stream_token_0.4
jspv Dec 18, 2024
9ff27cf
revert typo
jspv Dec 18, 2024
36fd8a5
Fix merge error
jspv Dec 18, 2024
16b6f5a
Merge branch 'ToolCallResultSummaryMessage' into stream_token_0.4
jspv Dec 18, 2024
c740229
ToolCallResultSummaryMessage support
jspv Dec 18, 2024
bd3ee60
Support for ToolCallResultSummaryMessage
jspv Dec 18, 2024
d17dff4
Merge branch 'main' into ToolCallResultSummaryMessage
jspv Dec 19, 2024
b26bcb0
Added ToolCallSummaryMessage
jspv Dec 19, 2024
d9c1d32
Merge branch 'ToolCallResultSummaryMessage' into stream_token_0.4
jspv Dec 19, 2024
f0e9be2
Merge branch 'main' into ToolCallResultSummaryMessage
jspv Dec 19, 2024
aef903e
ruff format
jspv Dec 19, 2024
b4eb3ab
Add ToolCallSummaryMessage to ChatMessage
jspv Dec 19, 2024
8a9561c
Merge branch 'ToolCallResultSummaryMessage' into stream_token_0.4
jspv Dec 19, 2024
4b72194
Merge branch 'main' into ToolCallResultSummaryMessage
ekzhu Dec 19, 2024
285228a
typing and tests for ToolCallSummaryMessage
jspv Dec 19, 2024
22ff506
Merge branch 'ToolCallResultSummaryMessage' of https://github.com/jsp…
jspv Dec 19, 2024
98a2feb
Merge branch 'ToolCallResultSummaryMessage' into stream_token_0.4
jspv Dec 19, 2024
386db37
Merge branch 'main' into ToolCallResultSummaryMessage
jspv Dec 19, 2024
a6cab09
PR Feedback
jspv Dec 19, 2024
2622fdc
Merge branch 'ToolCallResultSummaryMessage' into stream_token_0.4
jspv Dec 19, 2024
26ec534
Merge branch 'main' into stream_token_0.4
jspv Dec 21, 2024
58a322a
Merge branch 'main' into stream_token_0.4
jspv Dec 25, 2024
f5a14c6
Merge branch 'main' into stream_token_0.4
jspv Dec 29, 2024
ae84087
Merge branch 'main' into stream_token_0.4
jspv Jan 16, 2025
8275745
Merge branch 'main' into stream_token_0.4
jspv Jan 28, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Set default to fix Azure clients
jspv committed Dec 9, 2024
commit 9a763f477b55f6fcdf3623039a97c4c3f56d5945
Original file line number Diff line number Diff line change
@@ -575,7 +575,7 @@ async def create_stream(
extra_create_args: Mapping[str, Any] = {},
cancellation_token: Optional[CancellationToken] = None,
*,
max_consecutive_empty_chunk_tolerance: int = 0,
max_consecutive_empty_chunk_tolerance: int = 10,
) -> AsyncGenerator[Union[str, CreateResult], None]:
"""
Creates an AsyncGenerator that will yield a stream of chat completions based on the provided messages and tools.