-
-
Notifications
You must be signed in to change notification settings - Fork 288
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BUG] I can't open chroma db #1089
Comments
@Sung-Jae-Seong Hello! Since |
Thank you for your response. I checked my chroma.sqlite3, there was empty. and I found warning message during evaluating /home/rokey4090/.local/lib/python3.10/site-packages/autorag/nodes/retrieval/hybrid_cc.py:16: RuntimeWarning: invalid value encountered in divide
norm_score = (arr - min_value) / (max_value - min_value)
/home/rokey4090/.local/lib/python3.10/site-packages/autorag/nodes/retrieval/hybrid_cc.py:16: RuntimeWarning: invalid value encountered in divide
norm_score = (arr - min_value) / (max_value - min_value)
/home/rokey4090/.local/lib/python3.10/site-packages/autorag/nodes/retrieval/hybrid_cc.py:16: RuntimeWarning: invalid value encountered in divide
norm_score = (arr - min_value) / (max_value - min_value)
... and this is my whole log except above warning.
I might suspect that there is a problem with my dataset.
|
@Sung-Jae-Seong Plus, check your corpus_df that you use unique |
Bug Description
After running the evaluation, I attempted to retrieve the stored results from the vector database using Python, but no data was loaded.
To Reproduce
export OPENAI_API_KEY=".."
export PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True
trial(1) : autorag evaluate --config config.yaml --qa_data_path drl_qa.parquet --corpus_data_path drl_corpus.parquet --project_dir ./project
trial(2) : autorag evaluate --config config.yaml --qa_data_path drl_qa.parquet --corpus_data_path drl_corpus.parquet --project_dir ./project --skip_validation true
{'ids': [], 'embeddings': None, 'documents': [], 'uris': None, 'data': None, 'metadatas': [], 'included': [<IncludeEnum.documents: 'documents'>, <IncludeEnum.metadatas: 'metadatas'>]}
0
검색된 문서가 없습니다.
Code that bug is happened
config.yaml
Desktop (please complete the following information):
Additional context
my project tree
📦project
┣ 📂0
┃ ┣ 📂post_retrieve_node_line
┃ ┃ ┣ 📂generator
┃ ┃ ┃ ┣ 📜0.parquet
┃ ┃ ┃ ┣ 📜1.parquet
┃ ┃ ┃ ┣ 📜best_0.parquet
┃ ┃ ┃ ┗ 📜summary.csv
┃ ┃ ┣ 📂prompt_maker
┃ ┃ ┃ ┣ 📜0.parquet
┃ ┃ ┃ ┣ 📜1.parquet
┃ ┃ ┃ ┣ 📜2.parquet
┃ ┃ ┃ ┣ 📜3.parquet
┃ ┃ ┃ ┣ 📜4.parquet
┃ ┃ ┃ ┣ 📜5.parquet
┃ ┃ ┃ ┣ 📜best_0.parquet
┃ ┃ ┃ ┗ 📜summary.csv
┃ ┃ ┗ 📜summary.csv
┃ ┣ 📂retrieve_node_line
┃ ┃ ┣ 📂passage_augmenter
┃ ┃ ┃ ┣ 📜0.parquet
┃ ┃ ┃ ┣ 📜1.parquet
┃ ┃ ┃ ┣ 📜best_0.parquet
┃ ┃ ┃ ┗ 📜summary.csv
┃ ┃ ┣ 📂passage_filter
┃ ┃ ┃ ┣ 📜0.parquet
┃ ┃ ┃ ┣ 📜1.parquet
┃ ┃ ┃ ┣ 📜2.parquet
┃ ┃ ┃ ┣ 📜3.parquet
┃ ┃ ┃ ┣ 📜4.parquet
┃ ┃ ┃ ┣ 📜best_3.parquet
┃ ┃ ┃ ┗ 📜summary.csv
┃ ┃ ┣ 📂passage_reranker
┃ ┃ ┃ ┣ 📜0.parquet
┃ ┃ ┃ ┣ 📜1.parquet
┃ ┃ ┃ ┣ 📜2.parquet
┃ ┃ ┃ ┣ 📜3.parquet
┃ ┃ ┃ ┣ 📜4.parquet
┃ ┃ ┃ ┣ 📜5.parquet
┃ ┃ ┃ ┣ 📜6.parquet
┃ ┃ ┃ ┣ 📜best_0.parquet
┃ ┃ ┃ ┗ 📜summary.csv
┃ ┃ ┣ 📂retrieval
┃ ┃ ┃ ┣ 📜0.parquet
┃ ┃ ┃ ┣ 📜1.parquet
┃ ┃ ┃ ┣ 📜2.parquet
┃ ┃ ┃ ┣ 📜3.parquet
┃ ┃ ┃ ┣ 📜4.parquet
┃ ┃ ┃ ┣ 📜5.parquet
┃ ┃ ┃ ┣ 📜6.parquet
┃ ┃ ┃ ┣ 📜7.parquet
┃ ┃ ┃ ┣ 📜8.parquet
┃ ┃ ┃ ┣ 📜best_5.parquet
┃ ┃ ┃ ┗ 📜summary.csv
┃ ┃ ┗ 📜summary.csv
┃ ┣ 📜config.yaml
┃ ┗ 📜summary.csv
┣ 📂data
┃ ┣ 📜corpus.parquet
┃ ┗ 📜qa.parquet
┣ 📂resources
┃ ┣ 📂chroma
┃ ┃ ┣ 📂0ec9cd05-0d96-4fc7-9a7a-a1abea6c5ce8
┃ ┃ ┣ 📂50f4b08f-74bf-4fdc-9097-edbe9649cda4
┃ ┃ ┃ ┣ 📜data_level0.bin
┃ ┃ ┃ ┣ 📜header.bin
┃ ┃ ┃ ┣ 📜length.bin
┃ ┃ ┃ ┗ 📜link_lists.bin
┃ ┃ ┗ 📜chroma.sqlite3
┃ ┣ 📜bm25_gpt2.pkl
┃ ┣ 📜bm25_porter_stemmer.pkl
┃ ┣ 📜bm25_space.pkl
┃ ┗ 📜vectordb.yaml
┗ 📜trial.json
I don't know it is because of evaluate error, or config.yaml error, or python code error. can you find the cause of error?
cf. I made dataset myself (by hand), is it possible to occur error?
thank you for reading
The text was updated successfully, but these errors were encountered: