You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello ,
I am using this code, and get the following error:
python3 benchmark_serving.py --backend openai --model /home/ubuntu/falcon-7b/ --dataset ../data/ShareGPT_V3_unfiltered_cleaned_split.json.1 --num-prompts 200 --request-rate 20 --base-url http://127.0.0.1:8000 --trust-remote-code
IndexError: index -1 is out of bounds for axis 0 with size 0
when loading I can see this issue.any Idea how to deal with it:
Token indices sequence length is longer than the specified maximum sequence length for this model (3128 > 2048). Running this sequence through the model will result in indexing errors
Traffic request rate: 20.0
100%|██████████████
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hello ,
I am using this code, and get the following error:
python3 benchmark_serving.py --backend openai --model /home/ubuntu/falcon-7b/ --dataset ../data/ShareGPT_V3_unfiltered_cleaned_split.json.1 --num-prompts 200 --request-rate 20 --base-url http://127.0.0.1:8000 --trust-remote-code
IndexError: index -1 is out of bounds for axis 0 with size 0
when loading I can see this issue.any Idea how to deal with it:
Token indices sequence length is longer than the specified maximum sequence length for this model (3128 > 2048). Running this sequence through the model will result in indexing errors
Traffic request rate: 20.0
100%|██████████████
Beta Was this translation helpful? Give feedback.
All reactions