[9.0] add ElasticPilotParametersDB #7164
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
fstagni
force-pushed
the
81_elasticPilotParameters
branch
2 times, most recently
from
a48f466
to
7e13f8e
Compare
chrisburr
reviewed
Sep 15, 2023
| indexSplit = int(pilotID) // 1e6 | ||
| return f"{self.indexName_base}_{indexSplit}m" | ||
|
|
||
| def _createIndex(self, indexName: str) -> None: |
There was a problem hiding this comment.
Can we use index templates instead of creating the index manually?
There was a problem hiding this comment.
I can add the index templates, but anyway the index will need to be created by hand, because the logic for the name depends from the JobID.
| # The _id in ES can't exceed 512 bytes, this is a ES hard-coded limitation. | ||
|
|
||
| # If a record with this pilotID update and add parameter, otherwise create a new record | ||
| if self.existsDoc(self._indexName(pilotID), docID=str(pilotID)): |
|
|
||
| self.log.debug("Inserting data in {self.indexName}:{data}") | ||
|
|
||
| # The _id in ES can't exceed 512 bytes, this is a ES hard-coded limitation. |
There was a problem hiding this comment.
Does anything need to be done about this?
fstagni
changed the title
fstagni
force-pushed
the
81_elasticPilotParameters
branch
3 times, most recently
from
e88e94d
to
0d8b501
Compare
fstagni
force-pushed
the
81_elasticPilotParameters
branch
from
0d8b501
to
efa723a
Compare
|
Moved to diracx |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
For DIRACGrid/diracx#277
ToDo:
How to populate this DB? Probably directly from the Pilot, but not only.
BEGINRELEASENOTES
*WMS
NEW: add ElasticPilotParametersDB
ENDRELEASENOTES