JAF is python framework for easy building LLM based agents, pipelines, executables and chatbots in Python.
This framework provides you with the most important subsystems already integrated to build on top of LLMs, such as vector db, document parser, LLM integration, Sematic Routing and other
This framework represents LLM pipeline components as basic building blocks, so you don't have to worry about how to use it.
You can use JAF as an application with interative UI or just consume it's python api in your application. Follow below steps to setup JAF.
To use JAF's python apis you can run following command to install JAF as python package
$ pip3 install git+https://github.com/juspay/JAF.git
clone repo to the local.
- Create virtual env for python
$ python3 -m venv .env
- Activates virtual env
$ source .env/bin/activate
- Install poetry for dependency management
$ pip3 install poetry
For M1 mac with Rosseta is enabled
$ arch -arm64 python -m pip install poetry --no-cache
Restart terminal and venv and run command again if you're facing arm46 <> x86 issue.
- Install all dependencies
$ poetry install
Tutorials coming soon