ai-base is a React Electron UI for the llmware API project. Right now you can run generative local llms with context and queries. Here is a link to the llmware project. The goal of the project is to be able to run different llms and prompts then save the results in a database for later review. I think this would help developers to be able to quickly try different scenarios and fine tune the needs of their project without having to change code.
I created this project to test different scenarios for the llmware API. I plan on adding a database to save scenarios and prompt information.
Main screen with response, context and query inputs.
Model view - choose a model from the list. Only generative local models are shown
Prompt view choose a prompt type from the list.
Main screen with model chosen, prompt chosen, context text, query text and final response
Currently, there is no installation package because project is under active development.
This is developed using:
- Node version v21.7.1
- Python version 3.11.0
The main Electron project is in the root folder, the llmware-wrapper folder is the Python bridge to the llmware API, it has Type Script files and Python files.
If you want to try it in dev, clone the repo and then run npm install in the root directory, this will install the Electron project node libraries.
Run npm install in the llmware-wrapper directory, this will install the node libraries use by the bridge.
Set up a Python virtual environment in the llmware-wrapper directory. There is a requirements text file to help with that.
There is a properties file in the llmware-wrapper directory to set your Python path for python-shell to use.
There is a 20-minute timeout on queries that is set in the code, if you need a longer time out you can change it. I plan on adding this to the UI later. :)
Add database support to be able to save model, prompt, context, query and response. Installation package.
Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.
If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement". Don't forget to give the project a star! Thanks again!
- Fork the Project
- Create your Feature Branch (
git checkout -b feature/AmazingFeature) - Commit your Changes (
git commit -m 'Add some AmazingFeature') - Push to the Branch (
git push origin feature/AmazingFeature) - Open a Pull Request
Distributed under the MIT License. See LICENSE.txt for more information.
Kevin Brisson - LinkedIn - [email protected]
Project Link: https://github.com/kbrisso/ai-base