Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable tool calling for Anthropic LLMs (and OpenRouter) #420

Open
krschacht opened this issue Jun 18, 2024 · 1 comment
Open

Enable tool calling for Anthropic LLMs (and OpenRouter) #420

krschacht opened this issue Jun 18, 2024 · 1 comment
Labels
LLM foundation
Milestone
0.8

Comments

@krschacht
Copy link
Contributor

No description provided.

@krschacht krschacht added this to the 0.8 milestone Jun 18, 2024
@krschacht krschacht changed the title Enable tool calling for Anthropic LLMs Enable tool calling for Anthropic LLMs (and OpenRouter) Jun 25, 2024
@mattlindsey
Copy link
Contributor

mattlindsey commented Nov 28, 2024 •
edited
Loading

Tool calling should work for Ollama now with openai api driver, so we should test and document that it works.
(P.S. I tested against Ollama Llama3.1 model locally, and it didn't seem to want to call the memory tool. LLam3.1 does support tools. I'll keep checking... Also note that setting of the conversation title is not working with Ollama.)

And a PR can be done to enable for Google Gemini.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
LLM foundation
Projects
None yet
Milestone
0.8
Development

No branches or pull requests
2 participants
@krschacht @mattlindsey