Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DuckDB] Expose vector search capability via duckdb extension #640

Open
eddyxu opened this issue Feb 25, 2023 · 1 comment
Open

[DuckDB] Expose vector search capability via duckdb extension #640

eddyxu opened this issue Feb 25, 2023 · 1 comment
Labels
duckdb good first issue Good for newcomers help wanted Extra attention is needed rust Rust related tasks vector Vector Search

Comments

@eddyxu
Copy link
Contributor

eddyxu commented Feb 25, 2023

Problem Statement

Lance rust dataset has the capability of querying over vector space, via Scannner::nearest(..), we should expose this to DuckDB via its extension mechanism.
For example, a potential implementation could be a duckdb table function lance_nearest

SELECT id, col 
FROM lance_nearest("table", "vector_column", "query", top_k)
WHERE city = 'SF' and day = "02-03-2023"
@eddyxu eddyxu added good first issue Good for newcomers duckdb rust Rust related tasks vector Vector Search labels Feb 25, 2023
@changhiskhan
Copy link
Contributor

Ideally duckdb extension would let us modify the query plan so if we see ORDER BY nearest(...) LIMIT 10 then this is pushed down as ANN search

@changhiskhan changhiskhan added the help wanted Extra attention is needed label Jul 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
duckdb good first issue Good for newcomers help wanted Extra attention is needed rust Rust related tasks vector Vector Search
Projects
None yet
Development

No branches or pull requests

2 participants