-
Notifications
You must be signed in to change notification settings - Fork 732
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add tutorial for evaluating LangGraph agents #1636
Add tutorial for evaluating LangGraph agents #1636
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Overall I think the tutorial is really good but I don't think this should be a getstarted blog - it's too specific to langgraph.
What I'm thinking is add a couple of these integration blogs to
- langgraph
- crewAI
- OpenAI's swarm
ideally for the same usecase and then we'll have enough experience to build a lighter getting started tutorial that is framework agnostic
For now I think you should add this into integration/langgraph
what do you guys think?
Yeah, that makes sense! Adding it to the integration/langgraph section for now sounds like a good to me. |
…e to static folder
also could you add the integration to reference section: https://github.com/explodinggradients/ragas/blob/main/docs/references/integrations.md and provide a link to that in the docs and add the integrations md file to Lines 90 to 92 in 895f9c0
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great!
I know this took a lot of back and forth but you did a great job with your fast responses 🙂 - looking forward to working with you more!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice work, @sahusiddharth! Thanks for patiently addressing the reviews and iterating swiftly ❤️
This PR adds a detailed tutorial to guide users through building a ReAct agent using LangGraph. The tutorial also walks users through setting up an evaluation pipeline using Ragas to assess the agent's performance.