Deta Base Delete using filter query. #236
-
|
Acc. to docs delete(key: str)But what if I need to delete all the records having the same
deta_task_db.delete( {"user_id": "Harshit" } )Can I do that? |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 9 replies
-
|
Deta currently doesn't offer a What you can do for your example is fetch all records with the same records = db.fetch({ "user_id": "Harshit" })
for record in records:
db.delete(record.key)Hope this helps! |
Beta Was this translation helpful? Give feedback.
-
|
hmm... I was thinking the same thing. But I think we should have a If I fetch records, that's 1 quey, if I have multiple such records, then that's a couple of queries to fetch all records using fetch(last=key), on top of that there will be multiple delete requests (we're not doing batch request, each request is individual). That sounds like a lot of work behind the scenes. It's slow too (at least in theory). |
Beta Was this translation helpful? Give feedback.
-
|
we will think about this in our next release. thanks for the feedback! |
Beta Was this translation helpful? Give feedback.
-
|
However if you have the list of keys to be deleted then you can do delete request asynchronously to the api which will be faster. example: import aiohttp
import asyncio
async def del_key(session, url):
async with session.delete(url) as resp:
return resp.status
async def main():
async with aiohttp.ClientSession() as session:
tasks = []
for key in target_keys:
url = f'https://database.deta.sh/v1/{project_id}/{base_name}/items/{key}'
tasks.append(asyncio.create_task(del_key(session, url)))
done = await asyncio.gather(*tasks)
for status_code in done:
print(status_code)
asyncio.run(main())** |
Beta Was this translation helpful? Give feedback.
-
|
wieldy, this is still very slow. As slow as sequentially making I ran a for loop to create 200 entries in the database, then used aiohttp and asyncio to create multiple delete requests. It took longer than I expected to delete all the entries. |
Beta Was this translation helpful? Give feedback.
-
|
Also, I'm getting this after a while
|
Beta Was this translation helpful? Give feedback.
-
# This is how I delete many entries asynchronously using HTTP API.
async def _delete(self, base_name: str, key: str):
ep = self.__base_root + base_name + '/items/' + key
await self.__session.delete(ep, headers=self.__base_headers)
return key
async def _delete_many(self, base_name: str, keys: list):
task = [asyncio.create_task(self._delete(base_name, key)) for key in keys]
return await asyncio.gather(*task)# my driver code
async def main():
deta = Deta(os.getenv("DETA_TOKEN"))
await deta.connect()
base = deta.base(name='123BASE')
keys = [f'TARGET{i}' for i in range(1000)]
s = time.perf_counter()
print(await base.delete_many(keys))
e = time.perf_counter()
await deta.close()
print(f'Time taken {e - s:.2f} seconds to delete {len(keys)} items')
loop = asyncio.new_event_loop()
loop.run_until_complete(main())
Process finished with exit code 0 |
Beta Was this translation helpful? Give feedback.
-
|
hmm.. not sure why I'm facing so much time with the same code and less number of entries. Anyway, thanks for the help. For me, it still takes lots of time. can you clarify how your I'm doing something like async def delete_task_http(session, key):
url = (
f"https://database.deta.sh/v1/{PROJECT_ID}/{DETA_TASK_BASENAME}/items/{key}"
)
await session.delete(url, headers=headers)
print("Done", url)
return url
async def delete_all_tasks(cls, user_key: str):
"""Get all the tasks and then make multiple delete request concurrently using asyncio."""
# at the time of writing, deta doesn't support deleteMany.
all_tasks = cls.get_tasks(user_key)
all_tasks = [task["key"] for task in all_tasks]
async with aiohttp.ClientSession() as session:
task = [
asyncio.create_task(cls.delete_task_http(session, key))
for key in all_tasks
]
await asyncio.gather(*task)
print("All task deleted")
|
Beta Was this translation helpful? Give feedback.
-
|
I think |
Beta Was this translation helpful? Give feedback.
Hi @harshitsinghai77,
Deta currently doesn't offer a
deleteManymethod, so you need to manually delete each item.What you can do for your example is fetch all records with the same
user_idand then loop through the returned records and delete each one individually by their key:Hope this helps!