You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am wondering if there is support for running models that take task/prompt as input in addition to the strings (more recent example of such model is jina-embeddings-v3).
While prompting (template) methods can be accommodated on client side, task method involves passing in an argument to the model. Here is an example from jina-embeddings-v3 on HF:
fromsentence_transformersimportSentenceTransformermodel=SentenceTransformer("jinaai/jina-embeddings-v3", trust_remote_code=True)
task="retrieval.query"embeddings=model.encode(
["What is the weather like in Berlin today?"],
task=task, ### ??? how do I pass this to infinity?prompt_name=task,
)
I could not find anything on the topic in the docs.
I checked the issues/discussions, and the closest thing I found was #34 which concludes with
and the issue is closed; but I am not sure how that solution works.
I'm using infinity via docker deployment. Does docker version support passing in arguments to the SentenceTransformer model? I tried passing "task" argument in the json, it has no impact. Does non-docker version support it?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi team.
I am wondering if there is support for running models that take task/prompt as input in addition to the strings (more recent example of such model is jina-embeddings-v3).
While prompting (template) methods can be accommodated on client side, task method involves passing in an argument to the model. Here is an example from jina-embeddings-v3 on HF:
I could not find anything on the topic in the docs.
I checked the issues/discussions, and the closest thing I found was #34 which concludes with
and the issue is closed; but I am not sure how that solution works.
I'm using infinity via docker deployment. Does docker version support passing in arguments to the SentenceTransformer model? I tried passing "task" argument in the json, it has no impact. Does non-docker version support it?
What are my options? Thank you.
Beta Was this translation helpful? Give feedback.
All reactions