Suggestion: Wrapper function to run Annotator on larger datasets

[iainmwallace]

Hi,

It would be useful to have a wrapper function for Annotator for when the list of ids is >500. Ideally it would run the queries in parallel.

Cheers,

Iain

[iainmwallace]

This is the best that I could come up with ---

x<-split(my_ids, ceiling(seq_along(my_ids)/500))

annotate_data<-function(my_id_subset,full_data,my_fields){
mini_dataset<-full_data%>%filter(id%in%my_id_subset)
annotated_dataset<-Annotator.annotate(mini_dataset,my_fields)%>%as_tibble() # annotation should return lists
return(annotated_dataset)
}

y<-pblapply(x,annotate_data,a,fields)%>%bind_rows()

[davecap]

Not bad! We actually do something similar in the Python client: https://github.com/solvebio/solvebio-python/blob/master/solvebio/annotate.py#L33

Shouldn't be too hard to get it integrated in the R client.