-
Notifications
You must be signed in to change notification settings - Fork 79
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
cli: add retries if search results are not expected length in upload-bin
#3650
Conversation
@AnnaShaleva am I correct that we still need that flag for skipping? |
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## master #3650 +/- ##
=========================================
Coverage ? 83.06%
=========================================
Files ? 334
Lines ? 46563
Branches ? 0
=========================================
Hits ? 38678
Misses ? 6311
Partials ? 1574 ☔ View full report in Codecov by Sentry. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Waiting for the results of mainnet data consistency check, because the following error is caused by some other bug in the code:
failed to update index files after upload: empty oid found in index file 0 at position 91 (block index 91)
OK, the solution with resulting OID batch size check is not working, we need to allow duplicating entries since containers may have an arbitrary number of blocks with the same height. But let's keep |
1be96c3
to
c76b8ce
Compare
c76b8ce
to
a7ce9c0
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
OK, I need some more time to review the second commit.
a7ce9c0
to
9541bd8
Compare
@AliceInHunterland, review the updated code. Make sure you understand routines-related code. Leave comments if something is not clear or invalid, we'll discuss it then. Move unrelated style changes to separate commits. Check if this version works properly on mainnet. |
Signed-off-by: Ekaterina Pavlova <[email protected]>
e160597
to
f27ea34
Compare
861df72
to
52781e2
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Some style changes are still leaking from the second commit to the third.
Signed-off-by: Ekaterina Pavlova <[email protected]>
52781e2
to
97e0ff3
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Otherwise LGTM. Try it on mainnet and see if at least a single index file may be uploaded.
In case of incomplete search result it will try to find each missed oid and process it. In case of duplicates the first found will be in index file. Close #3647 Signed-off-by: Ekaterina Pavlova <[email protected]>
83a192e
to
35d1277
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, waiting for the fix of nspcc-dev/neofs-node#2988 to test it on NeoFS mainnet.
@AnnaShaleva as we can get oid when putting we can do something like this a0a0358? |
And for the current PR in a separate commit replace HEAD with GET to retrieve block index by OID. We'll revert it once nspcc-dev/neofs-node#2988 is fixed. |
Will be reverted when nspcc-dev/neofs-node#2988 is fixed. Currently HEAD request can return incorrect attributes, which can lead to incorrect index files. Signed-off-by: Ekaterina Pavlova <[email protected]>
Close #3647
check empty oids in progress