Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

datasets dynamic update(add, delete, update) #6

Open
Jowekk opened this issue Aug 17, 2021 · 1 comment
Open

datasets dynamic update(add, delete, update) #6

Jowekk opened this issue Aug 17, 2021 · 1 comment

Comments

@Jowekk
Copy link

Jowekk commented Aug 17, 2021

Ggnn does not support dynamic updating of datasets?

@Jowekk Jowekk changed the title datasets dynamic update datasets dynamic update(add, delete, update) Aug 17, 2021
@LukasRuppert
Copy link
Collaborator

Hi, sorry for the late reply,

do you mean updating the values of existing points in the dataset?
In that case, running one or two refinement iterations (depending on how much the values change) should already do the trick.

If you want to add more datapoints to the dataset after the construction of the kNN search-graph, there is currently no option for this and one would need to change the code.
One could think of searching for the nearest neighbors of the new points in the existing graph as a starting point and then simply add the new points on the bottom layer and run a few refinement iterations.

If you want to progressively build the search graph for regularly sized blocks, you could instead go for sharding and build independent graphs for each block of data which are then all queried and the results are merged.
But that code path also does not yet support adding shards after the initial construction.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants