Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Complete refactor of assistant #30

Open
wants to merge 37 commits into
base: main
Choose a base branch
from
Open

Complete refactor of assistant #30

wants to merge 37 commits into from

Conversation

trzy
Copy link
Contributor

@trzy trzy commented Jun 17, 2024

  • Removed Claude and Groq
  • Removed DataForSEO and SerpAPI (Perplexity handles all web search now)
  • Removed modular web search and vision tools
  • Support for user-supplied OpenAI and Perplexity tokens
  • Speculative web search w/ Perplexity
  • Direct output of tool responses if they are the only tool invoked, bypassing the second LLM call

trzy added 19 commits June 7, 2024 10:36
@trzy
Streaming response endpoint /mm_stream (only GPTAssistant for now)
6ecf3ce
@trzy
Remove generate_image param from MultimodalRequest as assistant now h…
03ae0b8 
…andles this on demand
@trzy
Fix broken images in /mm_stream
4e57222
@trzy
run_benchmark.py: don't compute non-existant statistics when not gene…
abc65f7 
…rating markdown
@trzy
GPT4Vision: stream results internally to measure time-to-first-token …
20808d6 
…latency
@trzy
NewAssistant: initial rewrite of assistant
f9643ae
@trzy
Vision tool
600b82d
@trzy
Stream out tool response directly if only a single tool invoked
bda190a
@trzy
Doc comment for NewAssistant.send_to_assistant(), removed unused files
493c0d9
@trzy
Token usage
c6e491d
@trzy
Timings and removed unused fields from MM request and response objects
c445abe
@trzy
Mark dummy knowledge tool as unsafe for direct output
19d4341
@trzy
Web search tool
86bb32f
@trzy
Removed old code
09ea310
@trzy
Comment
449f804
@trzy
Initial LLM timing
6263416
@trzy
Remove streaming, added speculative web search tool
d09c106
@trzy
Vision tool can now perform web search again, accounting for speculat…
d1aa72d 
…ive token usage and capabilities only when the tool is used
@trzy
NewAssistant -> Assistant, add support for user-supplied API keys
39fa1c0
@trzy trzy requested a review from uma-shankar-TE June 17, 2024 23:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@uma-shankar-TE uma-shankar-TE uma-shankar-TE approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@trzy @uma-shankar-TE