Skip to content

Releases: demisto/demisto-sdk

v1.18.1

02 Aug 12:44
Compare
Choose a tag to compare
  • Fixed an issue where the coloring directives where showing in log messages.
  • Fixed an issue where create-content-graph was not executed upon changes in the parser infra files.
  • Added a parameter skip-packs-known-words to the doc-review command, making sure that pack known words will not be added.

v1.18.0

30 Jul 13:09
1a07264
Compare
Choose a tag to compare
  • Fixed an issue where the DEMISTO_SDK_SKIP_VERSION_CHECK was ignored when running on non CI environments.
  • Added the ability to ignore any validation in the validate command when running in an external (non-demisto/content) repo, by placing a .private-repo-settings file at its root.
  • Fixed an issue where validate falsely detected backwards-compatibility issues, and prevented adding the marketplaces key to content items.
  • Calling format with the -d flag now removes test playbooks testing the deprecated content from conf.json.
  • Fixed an issue where the SDK would fail pulling docker images.
  • Fixed an issue where prepare-content command would add the string candidate to scripts and integrations for the nativeimage key.
  • Fixed an issue where in some cases the split command did not remove pack version note from the script.
  • Improved the content graph performance when calculating content relationships.
  • Fixed an issue where validate would not properly detect dependencies of core packs.
  • Removed usages of Random in unit tests to ensure the tests are deterministic.
  • validate will now run on all the pack content items when the pack supported marketplaces are modified.
  • Fixed an issue where validate failed on single-select types incident and indicator fields when given empty value as a select value option.
  • pre-commit no longer runs when there are no modified files (unless provided with input files).
  • Fixed an issue where errors in validate were logged as info.
  • Fixed an issue where validate error messages were not logged when an integration param, or the default argument in reputation commands is not valid.
  • Added new validation that XSIAM integrations must have marketplacev2 as the value of the marketplaces field.
  • Fixed an issue where the format command would change the value of the unsearchable key in fields.
  • Added an ability to provide list of marketplace names as a credentials-type (type 9) param attribute.
  • doc-review will run with the --use-packs-known-words default to true.
  • Fixed an issue where lint command failed to pull docker image in Gitlab environment.
  • Added the deprecated field to the pack object for the content-graph metadata.
  • Fixed an issue in doc-review command where escape characters within Markdown files were detected as invalid words.
  • Calling modeling-rules init-test-data will now return the XDM fields output in alphabetical order.
  • Fixed an issue where validate failed on infrastructure test files.
  • Added a new validation (BA125) to validate that assures internal function names aren't in use in customer-facing docs.
  • Removed the Pipfile and Pipfile.lock from the templates in demisto-sdk init command.
  • Disabled the option to create an integration with Pipfile and Pipfile.lock files.
  • Fixed an issue in update-content-graph where the neo4j service was unaccessible for non-root users.
  • Added a Sourcery hook to pre-commit.
  • Added a working directory to the contribution_converter in order to support working on a temporary directory.
  • Added a waiting period when checking whether the dataset exists in the modeling-rule test command.

v1.17.2

17 Jul 12:52
0de622d
Compare
Choose a tag to compare
  • Fixed an issue where lint and validate commands failed on integrations and scripts that use docker images that are not available in the Docker Hub but exist locally.
  • Added documentation for the flag override-existing used in upload.
  • Fixed an issue where validate failed on Incident Field items with a template value.
  • Improved memory efficiency in update-content-graph and create-content-graph commands.
  • Removed support for the cve_id name for the default-argument for cve reputation commands in validate. Now, only cve may be used for such commands.
  • Fixed an issue where zip_packs failed uploading content.
  • Added tenant_timezone handling to the modeling-rules init command, allowing usage with tenants in various timezones.
  • Shortened the timeout when checking whether the dataset exists in test-modeling-rule.
  • Cleaned up project dependencies.
  • Added support for the List content item in Xpanse marketplace.
  • Fixed an issue in run-unit-tests command when running Powershell tests.
  • Fixed an issue where lint failed running when a docker container would not init properly.
  • Fixed an issue where the upload command would upload a pack metadata with wrong display names.
  • Performance enhancements when reading yaml files.
  • Removed redundant errors and fields from errors.py.
  • Updated update-release-notes to use graph instead of id_set.

v1.17.1

03 Jul 09:19
Compare
Choose a tag to compare
  • Added the aliasTo key to the Incident Field schema.
  • Modified validate to not require fields whose value is always False.
  • Modified validate to use the graph instead of id_set on changed APIModules.
  • Fixed an issue where register_module_line() was not removed from python scripts when the script had no trailing newline.
  • Fixed an issue where an integration containing a command without a description would fail to upload while using the upload command.
  • Fixed an issue where attempting to individually upload Preprocess Rule files raised an unclear error message. Note: preprocess rules can not be individually uploaded, but only as part of a pack.
  • Fixed an issue where the upload command would fail on Indicator Types.
  • Fixed an issue where the upload command would return the wrong error message when connection credentials are invalid.
  • Fixed an issue where the upload command would fail parsing input paths.
  • added support for the isfetcheventsandassets flag in content graph.

v1.17.0

21 Jun 12:01
f4e8fbe
Compare
Choose a tag to compare
  • validate will only fail on docker related errors if the pack is supported by xsoar.
  • Added a validation that assures filename, id, and name have a correct suffix for modeling/parsing rules files.
  • Added new validate checks, preventing unwanted changes of the marketplaces (BC108,BC109), toversion (BC107) and fromversion (BC106) fields.
  • Removed the timezone_offset argument in the modeling-rules test command.
  • Fixed an issue where lint failed when importing functions from CommonServerUserPython.
  • The format command now will sync hidden parameters with master branch.
  • Fixed an issue where lock integration failed on FileNotFound.(PANW-internal only).
  • Fixed an issue where lint falsely warned of using demisto.results.
  • Fixed an issue where validate always returned XSIAM Dashboards and Correlation Rules files as valid.
  • Added GR107 validation to validate using the graph validations to check that no deprecated items are used by non-deprecated content.
  • Fixed an issue where the modeling-rules test command failed to get the existence of dataset in cases where the dataset takes more than 1 minute to get indexed.
  • Fixed an issue in lint where the container used for linting had dependency conflicts with the image used by content, and caused inconsistent results.
  • Fixed an issue where the download command failed when the playbook has different name and id.
  • Moved the pre-commmit command template to the demisto/content repository, where it's easier to maintain.
  • Fixed an issue where an internal method caused warning messages when reading md files.
  • Added support for Pre Process Rules in the upload command.
  • Fixed an issue where upload would not upload items whose maketplaces value was an empty list.
  • Added a prettyName key to the incident field schema.
  • Fixed an issue where upload command could not parse content items that are not unicode-encoded.

v1.16.0

14 Jun 08:22
Compare
Choose a tag to compare
  • Added a check to is_docker_image_latest_tag to only fail the validation on non-latest image tag when the current tag is older than 3 days.
  • Fixed an issue where upload would not properly show the installed version in the UI.
  • Fixed an issue where the contribution_converter failed replacing generated release notes with the contribution form release notes.
  • Fixed an issue where an extra levelname was added to a logging message.
  • Modified the mypy pre-commit hook to run in a virtual environment, rather than the local mypy version.
  • Added support to run validate with --git flag on detached HEAD.
  • Added a validation that the validate command will fail if the pack name is not prefixed on XSIAM dashboard images.
  • Fixed the generate-test-playbook which failed on an unexpected keyword argument - 'console_log_threshold'.
  • Fixed an issue where prepare-content would not properly parse the fromVersion and toVersion attributes of XSIAM-Dashbaord and XSIAM-Report content items.
  • Fixed an issue where validate command did not fail on non-existent dependency ids of non-mandatory dependant content.
  • Fixed pytest async io deprecation warning.
  • Added the --incident-id argument (optional) to the run command.
  • Fixed an issue in run-unit-tests and update-content-graph where running commands in a docker container was done with insufficient permissions.
  • Added the _time field to the output compare table of the modeling-rules test command.
  • Changed the endpoint download uses to get system content items.
  • Fixed an issue where graph-related tasks failed when files were deleted from the repo.
  • Added a validate check, and a format auto fix for the fromversion field in Correlation Rules and XSIAM Dashboards.
  • Update the format used for dev-dependencies in pyproject.toml to match modern versions of Poetry.
  • Added timestamps to logging messages when running in a CI build.

v1.15.5

05 Jun 06:56
7fc1117
Compare
Choose a tag to compare
  • Breaking Change: The default of the upload command --zip argument is true. To upload packs as custom content items use the --no-zip argument.
  • Removed the no-implicit-optional hook from pre-commit.
  • Removed the markdownlint hook from pre-commit.
  • Fixed an issue in run-unit-tests to pass with warnings when no tests are collected.
  • Fixed an issue in run-unit-tests with the coverage calculation.
  • Fixed a notification about log file location appeared more than once.
  • Updated the error message when code coverage is below the threshold in coverage-analyze to be printed in a more noticeable red color.
  • Fixed an issue in upload that failed when a comma-separated list of paths is passed to the --input argument.
  • Running validate with the --graph flag will now run the graph validations after all other validations.
  • improved the generated release note for newly added XSIAM entities when running update-release-notes command.
  • Fixed an issue where in some cases validation failed when mapping null values.
  • Fixed an issue in upload command where the --keep-zip argument did not clean the working directory.
  • Fixed an issue where an extra levelname was added to a logging message.
  • Fixed an issue in upload where uploading packs to XSIAM failed due to version mismatch.

v1.15.4

30 May 15:14
Compare
Choose a tag to compare
  • Fixed an issue where update-release-notes and doc-review did not handle new content notes as expected.
  • Fixed an issue in PEP484 (no-implicit-optional) hook to pre-commit.
  • Fixed an issue in upload with --input-config-file where the content items weren't uploaded in the correct pack.
  • Added support to disable the default logging colors with the DEMISTO_SDK_LOG_NO_COLORS environment variable.

v1.15.3

30 May 07:53
Compare
Choose a tag to compare
  • Added the --init flag to download.
  • Added the --keep-empty-folders flag to download.
  • Added markdown-lint to pre-commit
  • Added the PEP484 (no-implicit-optional) hook to pre-commit.
  • Fixed an issue where the content-graph parsing failed on mappers with undefined mapping.
  • Fixed an issue in validate where pack_metadata.json files were not collected proplely in --graph option.
  • Fixed an issue where validate reputation commands outputs were not checked for new content.
  • Added IN107 and DB100 error codes to ALLOWED_IGNORE_ERRORS list.
  • Added a validation that assures feed integrations implement the integration_reliability configuration parameter.
  • Fixed an issue where the format command did not work as expected on pre-process rules files.
  • Fixed an issue where upload command failed to upload when the XSOAR version is beta.
  • Fixed an issue where upload command summary was inaccurate when uploading a Pack without the -z flag.
  • Added pack name and pack version to upload command summary.
  • Added support for modeling rules with multi datasets in modeling-rules test command.
  • Fixed an issue where validate didn't recognize layouts with incident fields missing from id_set.json even when --post-commit was indicated.

v1.15.2

23 May 11:56
Compare
Choose a tag to compare
  • Fixed an issue where format added default arguments to reputation commands, which already have one.
  • Fixed an issue where validate fails when adding the advance field to the integration required fields.
  • Updated the integration Traffic Light Protocol (TLP) color list schema in the validate command.
  • Fixed an issue where upload would not read a repo configuration file properly.
  • Fixed an issue where upload would not handle the -x/--xsiam flag properly.