v0.2.0-beta

What's Changed

• feat: topic adherence metric by @shahules786 in #1327
• feat: tool call accuracy by @shahules786 in #1311
• feat: sql sementic equivalence by @shahules786 in #1323
• feat: Factual correctnes metric by @shahules786 in #1334
• docs: migrating over to mkdocs by @jjmachan in #1301
• feat: Adding transforms for testset generation by @jjmachan in #1344
• docs: traditional metrics by @shahules786 in #1346
• feat: transforms for Knowledge Graphs by @jjmachan in #1345
• docs: core concepts in metrics by @shahules786 in #1347
• chores: cleanup metrics by @shahules786 in #1348
• docs: refactor core concepts by @shahules786 in #1351
• wrap as_complete with async by @liupgd in #1350
• chores: add datasets to init by @shahules786 in #1356
• docs: new getting started by @shahules786 in #1355
• docs: metrics concepts by @shahules786 in #1361
• docs: add mindmap by @shahules786 in #1362
• Fixed Nav, search, and some styling issues for the docs by @joelk9895 in #1363
• feat: transform engine to execute transforms by @jjmachan in #1352
• chores: remove fuzzywuzzy by @shahules786 in #1369
• docs: component guides by @shahules786 in #1365
• chores: fix typo by @shahules786 in #1370
• fix:ensure correct sequence in tool calls by @shahules786 in #1371
• [howtos] update Langfuse cookbook by @jannikmaierhoefer in #1368
• feat: adding an implementation of abstractQA by @jjmachan in #1359
• feat: implement TestsetGenerator by @jjmachan in #1375
• docs: testset generation by @shahules786 in #1373
• feat: added more simulators by @jjmachan in #1376
• Update models in Ragas documentation: change gpt-3.5-turbo-16k to gpt-4o-mini and gpt-4 to gpt-4o by @suekou in #1380
• fix: aspect_critique documentation by @jjmachan in #1382
• docs: added google analytics to mkdocs by @jjmachan in #1384
• docs: fix index for metric/index.md by @jjmachan in #1388
• fix: fixed verdict comparison in evolutions.py by @MarkHmnv in #1366
• feat: output new Testset object for generation by @jjmachan in #1386
• Update answer_relevance.md: Minor spell correct by @soumendrak in #1390
• feat: support for callbacks and traces in testset generation by @jjmachan in #1392
• non-asii characters support in faithfulness by @gargewp in #1396
• feat: get and set prompts mixin by @shahules786 in #1391
• fixes: rename naming in testset generation by @shahules786 in #1393
• chore!: moving to pydantic2 by @jjmachan in #1394
• docs: improve getting started by @shahules786 in #1398
• Fix typo in metric error message by @suekou in #1404
• feat!: moving experimental.testset to replace old testset by @jjmachan in #1401
• feat: renamed sample operations and cleaned up test warnings by @jjmachan in #1407
• added better styling to reder jupyter notebooks nicely. by @zodwick in #1389
• docs: add core concepts for test generation by @shahules786 in #1402
• docs:Auto Gen of Reference Page by @zodwick in #1408
• fix key error for FaithfulnesswithHHEM by @linzzzzzz in #1410
• fix: remove usage of contexts in response relevancy by @shahules786 in #1409
• fix: score for jupyter by @shahules786 in #1411
• feat: NER extractor and Jaccard by @shahules786 in #1406
• feat(styles): refactor CSS to use custom variables by @zodwick in #1413
• docs : add customisation by @shahules786 in #1412
• feat(docs): add support for reusable snippets by @zodwick in #1414
• Feature/css variables by @zodwick in #1415
• docs: fix nav bar by @shahules786 in #1416
• feat: more features to prompt object by @jjmachan in #1418
• chore: add tracking for new testset generation by @jjmachan in #1419

New Contributors

• @liupgd made their first contribution in #1350
• @joelk9895 made their first contribution in #1363
• @jannikmaierhoefer made their first contribution in #1368
• @suekou made their first contribution in #1380
• @MarkHmnv made their first contribution in #1366
• @soumendrak made their first contribution in #1390
• @gargewp made their first contribution in #1396
• @zodwick made their first contribution in #1389
• @linzzzzzz made their first contribution in #1410

Full Changelog: v0.1.20...v0.2.0-beta