Releases: demisto/demisto-sdk
Releases · demisto/demisto-sdk
v1.18.1
- Fixed an issue where the coloring directives where showing in log messages.
- Fixed an issue where create-content-graph was not executed upon changes in the parser infra files.
- Added a parameter
skip-packs-known-words
to the doc-review command, making sure that pack known words will not be added.
v1.18.0
- Fixed an issue where the DEMISTO_SDK_SKIP_VERSION_CHECK was ignored when running on non CI environments.
- Added the ability to ignore any validation in the validate command when running in an external (non-demisto/content) repo, by placing a
.private-repo-settings
file at its root. - Fixed an issue where validate falsely detected backwards-compatibility issues, and prevented adding the
marketplaces
key to content items. - Calling format with the
-d
flag now removes test playbooks testing the deprecated content from conf.json. - Fixed an issue where the SDK would fail pulling docker images.
- Fixed an issue where prepare-content command would add the string
candidate
to scripts and integrations for the nativeimage key. - Fixed an issue where in some cases the split command did not remove pack version note from the script.
- Improved the content graph performance when calculating content relationships.
- Fixed an issue where validate would not properly detect dependencies of core packs.
- Removed usages of Random in unit tests to ensure the tests are deterministic.
- validate will now run on all the pack content items when the pack supported marketplaces are modified.
- Fixed an issue where validate failed on single-select types incident and indicator fields when given empty value as a select value option.
- pre-commit no longer runs when there are no modified files (unless provided with input files).
- Fixed an issue where errors in validate were logged as
info
. - Fixed an issue where validate error messages were not logged when an integration param, or the default argument in reputation commands is not valid.
- Added new validation that XSIAM integrations must have
marketplacev2
as the value of the marketplaces field. - Fixed an issue where the format command would change the value of the
unsearchable
key in fields. - Added an ability to provide list of marketplace names as a credentials-type (type 9) param attribute.
- doc-review will run with the
--use-packs-known-words
default to true. - Fixed an issue where lint command failed to pull docker image in Gitlab environment.
- Added the deprecated field to the pack object for the content-graph metadata.
- Fixed an issue in doc-review command where escape characters within Markdown files were detected as invalid words.
- Calling modeling-rules init-test-data will now return the XDM fields output in alphabetical order.
- Fixed an issue where validate failed on infrastructure test files.
- Added a new validation (
BA125
) to validate that assures internal function names aren't in use in customer-facing docs. - Removed the Pipfile and Pipfile.lock from the templates in demisto-sdk init command.
- Disabled the option to create an integration with Pipfile and Pipfile.lock files.
- Fixed an issue in update-content-graph where the neo4j service was unaccessible for non-root users.
- Added a Sourcery hook to pre-commit.
- Added a working directory to the
contribution_converter
in order to support working on a temporary directory. - Added a waiting period when checking whether the dataset exists in the modeling-rule test command.
v1.17.2
- Fixed an issue where lint and validate commands failed on integrations and scripts that use docker images that are not available in the Docker Hub but exist locally.
- Added documentation for the flag override-existing used in upload.
- Fixed an issue where validate failed on Incident Field items with a
template
value. - Improved memory efficiency in update-content-graph and create-content-graph commands.
- Removed support for the
cve_id
name for the default-argument for cve reputation commands in validate. Now, onlycve
may be used for such commands. - Fixed an issue where zip_packs failed uploading content.
- Added
tenant_timezone
handling to the modeling-rules init command, allowing usage with tenants in various timezones. - Shortened the timeout when checking whether the dataset exists in test-modeling-rule.
- Cleaned up project dependencies.
- Added support for the List content item in Xpanse marketplace.
- Fixed an issue in run-unit-tests command when running Powershell tests.
- Fixed an issue where lint failed running when a docker container would not init properly.
- Fixed an issue where the upload command would upload a pack metadata with wrong display names.
- Performance enhancements when reading yaml files.
- Removed redundant errors and fields from
errors.py
. - Updated update-release-notes to use graph instead of id_set.
v1.17.1
- Added the
aliasTo
key to the Incident Field schema. - Modified validate to not require fields whose value is always
False
. - Modified validate to use the graph instead of id_set on changed APIModules.
- Fixed an issue where
register_module_line()
was not removed from python scripts when the script had no trailing newline. - Fixed an issue where an integration containing a command without a description would fail to upload while using the upload command.
- Fixed an issue where attempting to individually upload
Preprocess Rule
files raised an unclear error message. Note: preprocess rules can not be individually uploaded, but only as part of a pack. - Fixed an issue where the upload command would fail on Indicator Types.
- Fixed an issue where the upload command would return the wrong error message when connection credentials are invalid.
- Fixed an issue where the upload command would fail parsing input paths.
- added support for the
isfetcheventsandassets
flag in content graph.
v1.17.0
- validate will only fail on docker related errors if the pack is supported by xsoar.
- Added a validation that assures filename, id, and name have a correct suffix for modeling/parsing rules files.
- Added new validate checks, preventing unwanted changes of the marketplaces (BC108,BC109), toversion (BC107) and fromversion (BC106) fields.
- Removed the
timezone_offset
argument in the modeling-rules test command. - Fixed an issue where lint failed when importing functions from CommonServerUserPython.
- The format command now will sync hidden parameters with master branch.
- Fixed an issue where lock integration failed on FileNotFound.(PANW-internal only).
- Fixed an issue where lint falsely warned of using
demisto.results
. - Fixed an issue where validate always returned XSIAM Dashboards and Correlation Rules files as valid.
- Added
GR107
validation to validate using the graph validations to check that no deprecated items are used by non-deprecated content. - Fixed an issue where the modeling-rules test command failed to get the existence of dataset in cases where the dataset takes more than 1 minute to get indexed.
- Fixed an issue in lint where the container used for linting had dependency conflicts with the image used by content, and caused inconsistent results.
- Fixed an issue where the download command failed when the playbook has different
name
andid
. - Moved the pre-commmit command template to the
demisto/content
repository, where it's easier to maintain. - Fixed an issue where an internal method caused warning messages when reading md files.
- Added support for Pre Process Rules in the upload command.
- Fixed an issue where upload would not upload items whose
maketplaces
value was an empty list. - Added a prettyName key to the incident field schema.
- Fixed an issue where upload command could not parse content items that are not unicode-encoded.
v1.16.0
- Added a check to is_docker_image_latest_tag to only fail the validation on non-latest image tag when the current tag is older than 3 days.
- Fixed an issue where upload would not properly show the installed version in the UI.
- Fixed an issue where the
contribution_converter
failed replacing generated release notes with the contribution form release notes. - Fixed an issue where an extra levelname was added to a logging message.
- Modified the
mypy
pre-commit hook to run in a virtual environment, rather than the local mypy version. - Added support to run validate with
--git
flag on detached HEAD. - Added a validation that the validate command will fail if the pack name is not prefixed on XSIAM dashboard images.
- Fixed the generate-test-playbook which failed on an unexpected keyword argument - 'console_log_threshold'.
- Fixed an issue where prepare-content would not properly parse the
fromVersion
andtoVersion
attributes of XSIAM-Dashbaord and XSIAM-Report content items. - Fixed an issue where validate command did not fail on non-existent dependency ids of non-mandatory dependant content.
- Fixed pytest async io deprecation warning.
- Added the
--incident-id
argument (optional) to the run command. - Fixed an issue in run-unit-tests and update-content-graph where running commands in a docker container was done with insufficient permissions.
- Added the
_time
field to the output compare table of the modeling-rules test command. - Changed the endpoint download uses to get system content items.
- Fixed an issue where graph-related tasks failed when files were deleted from the repo.
- Added a validate check, and a format auto fix for the
fromversion
field in Correlation Rules and XSIAM Dashboards. - Update the format used for dev-dependencies in pyproject.toml to match modern versions of Poetry.
- Added timestamps to logging messages when running in a CI build.
v1.15.5
- Breaking Change: The default of the upload command
--zip
argument istrue
. To upload packs as custom content items use the--no-zip
argument. - Removed the
no-implicit-optional
hook from pre-commit. - Removed the
markdownlint
hook from pre-commit. - Fixed an issue in run-unit-tests to pass with warnings when no tests are collected.
- Fixed an issue in run-unit-tests with the coverage calculation.
- Fixed a notification about log file location appeared more than once.
- Updated the error message when code coverage is below the threshold in coverage-analyze to be printed in a more noticeable red color.
- Fixed an issue in upload that failed when a comma-separated list of paths is passed to the
--input
argument. - Running validate with the
--graph
flag will now run the graph validations after all other validations. - improved the generated release note for newly added XSIAM entities when running update-release-notes command.
- Fixed an issue where in some cases validation failed when mapping null values.
- Fixed an issue in upload command where the
--keep-zip
argument did not clean the working directory. - Fixed an issue where an extra levelname was added to a logging message.
- Fixed an issue in upload where uploading packs to XSIAM failed due to version mismatch.
v1.15.4
- Fixed an issue where update-release-notes and doc-review did not handle new content notes as expected.
- Fixed an issue in PEP484 (no-implicit-optional) hook to pre-commit.
- Fixed an issue in upload with
--input-config-file
where the content items weren't uploaded in the correct pack. - Added support to disable the default logging colors with the DEMISTO_SDK_LOG_NO_COLORS environment variable.
v1.15.3
- Added the
--init
flag to download. - Added the
--keep-empty-folders
flag to download. - Added
markdown-lint
to pre-commit - Added the PEP484 (no-implicit-optional) hook to pre-commit.
- Fixed an issue where the content-graph parsing failed on mappers with undefined mapping.
- Fixed an issue in validate where
pack_metadata.json
files were not collected proplely in--graph
option. - Fixed an issue where validate reputation commands outputs were not checked for new content.
- Added IN107 and DB100 error codes to ALLOWED_IGNORE_ERRORS list.
- Added a validation that assures feed integrations implement the
integration_reliability
configuration parameter. - Fixed an issue where the format command did not work as expected on pre-process rules files.
- Fixed an issue where upload command failed to upload when the XSOAR version is beta.
- Fixed an issue where upload command summary was inaccurate when uploading a
Pack
without the-z
flag. - Added pack name and pack version to upload command summary.
- Added support for modeling rules with multi datasets in modeling-rules test command.
- Fixed an issue where validate didn't recognize layouts with incident fields missing from
id_set.json
even when--post-commit
was indicated.
v1.15.2
- Fixed an issue where format added default arguments to reputation commands, which already have one.
- Fixed an issue where validate fails when adding the advance field to the integration required fields.
- Updated the integration Traffic Light Protocol (TLP) color list schema in the validate command.
- Fixed an issue where upload would not read a repo configuration file properly.
- Fixed an issue where upload would not handle the
-x
/--xsiam
flag properly.