Skip to content

Releases: demisto/demisto-sdk

v1.31.4

22 Jul 07:34
0ef3323
Compare
Choose a tag to compare
  • Removed DO106 - docker_not_on_the_latest_tag validation for the old validate. #4429
  • Added documentation improvements to the pre-commit command. #4421
  • Added support to replace incident to alert for deprecated content. #4440
  • Fixed an issue in the test-modeling-rule command, where the table wasn't left aligned. #4419
  • Added Improvements to validate-file-permission-changes pre-commit hook. #4434
  • Fixed an issue where old validate failed without listing the invalid content items. #4432
  • Added DS104 to the new validation format. The validation verifies that a Description file is present for an integration. #4393
  • Added MR107 to the new validation format. Validate that the dataset name of a modeling rule shows in the xif and schema files match. #4429
  • Moved MP107 and MP108 validations to the new validate format as BC113. The validation ensures no incident types and incident fields were removed from the mapper. #4433
  • Added PR101 and MR108 to the new validate format. The validations check if the rule id and the rule name end with the correct suffixes. #4415
  • Removed the following arguments from the (internal) test-content command: circleci, xsiam-machine, xsiam-servers-path, xsiam-servers-api-keys-path. #4422
  • Added the verbose=False parameter to the fetch method call to minimize unnecessary output messages. #4427
  • Removed the validate-file-permissions-changes pre-commit hook. #4436

v1.31.3

14 Jul 14:39
e180408
Compare
Choose a tag to compare
  • Removed IN150 due to invalid_siem_integration_name from both old and new validate flows. #4420
  • Removed RM108 and RM112 from the old validate format. #4408
  • Added the -tpb option to the upload command. When provided, all the test playbooks for the given pack will be uploaded. #4402
  • Modified GR100, that checks whether a content item attempts to use other content items which are not supported in all of the marketplaces of the content item. #4282
  • Added the ability to use git.Repo object to initialize GitUtil. #4387
  • Added timestamp print in console. #4412
  • Add a pre-commit hook to validate file permission/mode changes in Packs directory. #4389
  • Fixed an issue where the relative path regex wasn't written correctly. This fix affect RM108 and RM114 in the new validate. #4413
  • Fixed an issue where new validate failed when attempting to parse renamed files. #4411
  • Fixed an issue where playbook saved due to a failed attempt to dump task object. #4416
  • Added support for the (internal) test-content command to work properly with multiple cloud servers. #4321
  • Moved CR102 to the new validate format. The validation checks 'search_window' existence and non-emptiness when 'execution_mode' == 'SCHEDULED'. #4409
  • Fixed an issue where wrong untracked files were collected during running of pre-commit and validate in contribution PR use-case. #4410

v1.31.2

04 Jul 15:42
26efcb0
Compare
Choose a tag to compare
  • Added the marketplaces field to the widget schema. #4396
  • Moved IF119 to the new validation format. Check whether a selectValue key in an incidentField of type singleSelect do not contain multiple or only empty options. #4277
  • Fixed an issue where IN121 in the new validate flow and IN148 in the old validate flow failed when running on content items with XSOAR on prem and XSOAR SAAS Marketplaces. #4398
  • Fixed an issue where upload command failed locally due to missing lock file. #4397
  • Fixed an issue where pre-commit and validate commands collected invalid untracked files when running on contribution PR. #4394

v1.31.1

30 Jun 18:33
Compare
Choose a tag to compare
  • Added an option to specify a marketplace for certain playbook fields: All input fields: key, value, description, required, playbookInputKey. The following task fields: scriptId, scriptarguments, loop.scriptArguments, message, form. The task id mappings (for example the first task can be converted by "0" -> "0:xsoar"). The left and right options of condition/builtincondition task fields (and their nested fields). #4375
  • Added the -h option as a short option for the --help flag in typer-based commands. #4350
  • Modified the error-code command to show information using the new BaseValidator standard. When such isn't available, defaults to legacy-style inforamtion. #4374
  • Added support to run-specific-validations flag to the new validate format. #4380
  • Modified PA107 to fail when the key marketplaces is missing from the pack_metadata.json file. #4379
  • Added a --fix option to DA100 and fixed the incorrect check in DA101. #4381
  • Fixed an issue where pre-commit and validate commands ignored changed files when running on an external contribution PR. #4351
  • Fixed an issue where RN103 failed on newly added packs due to missing release notes. #4383
  • Fixed an issue where the auto_update_docker_image field was not updated correctly in the the content-graph. #4287
  • Moved PB125 to the new validation format. The validation checks that a playbook condition task doesn't has only a default nexttask. #4365
  • Moved PB114, PB119 to the new validation format. #4348
  • Added support for different validation modes (-i, -a, -g) was added to the new validate command. #4301
  • Moved PB115 to the new validation format. The validation checks if the 'quietmode' field of all tasks in playbook are not in default value. #4366
  • Moved PB116 to the new format. The validation checks that indicator playbooks stop on error. #4364
  • Moved PB109 to the new validate format. The validation checks that taskid field and id field under task field contains equal values. #4358
  • Moved DS108 to the new validation format. The validation ensures that there's a dot at the end of each description line. #4339
  • Moved PB122 to the new validation format. Validate whether branches of built-in conditional tasks are handled properly. #4363
  • Modified MR103 to a path validation. Validates that the file names are the same as its folder. #4376
  • Moved MR101 to the new validation format and combined it with MR102. Validates that the modeling rule yml file contains the schema and rules keys and that they are empty. #4368
  • Moved RM107 to the new validation format. The validation checks that all placeholders are removed and all sections are filled in the readme files. #4373
  • Modified IMAGES_BATCH variable to be configurable per environment. #4382
  • Moved PB106 to new validation format. The validation checks if the playbook uses a specific instance. #4360
  • Moved the RP102 to the new validation format. The validation checks wether the id field equals the details field in an indicator type #4355
  • Moved MR106 to the new validation format. The validation verifies the types in schema files of modeling rules. #4372
  • Moved RP103 to the new validation format. The validation make sure the indicator type id is valid. (can include letters, numbers whitespaces, ampersands and underscores.) #4361

v1.31.0

19 Jun 04:30
56455b0
Compare
Choose a tag to compare
  • Fixed an issue where the logic for retrieving the latest Docker image was based on the entire tag (x.y.z.abcde) instead of just the last part of the image tag (.._.abcde). Only the last part will now be used, per demisto/dockerfiles convention. #4294
  • demist-sdk lint command is deprecated and should be fully removed from the SDK on September 1st. Please use the pre-commit command instead. #4336
  • Removed support for IN124 - 'is param valid is hidden' validation from old-validate flow and prevent the validation from being ignored. The validation and the related information can be found in the new-validate flow. #4317
  • Added support for new XSIAM content items - Case Fields, Case layouts and Case Layout Rules. #4240
  • Added DS101 to the new validation format. Check if the beta disclaimer exists in the detailed description. #4289
  • Added the --force flag to the generate-docs command to force the README.md generation instead of use version control to update the doc. #4303
  • Added DS105 to the new validation format. "check if DESCRIPTION file contains contribution details" #4347
  • Added DS106 to the new validation format. "Check if the description file exist and the name is valid" #4357
  • updated the tenacity version to fix an installation error #4352
  • Fixed an issue where the pre-commit command would fail on simple repository due to a missing docker_native_image_config.json file. #4314
  • Fixed an issue in the download command where downloading with force and run-format flags did not merge YML fields. #4328
  • Fixed an issue in generate-docs where integration commands arguments had missing descriptions. #4320
  • Fixed an issue where validations searching for demisto in strings would find it in URLs (/demisto/content). #4341
  • Fixed an issue where generate-docs command couldn't find the sections within the integration README.md when updating documentation for modified commands. #4303
  • Fixed an issue where modified command names were treated as a new command. #4303
  • Fixed the update-release-notes command to support the right template for incident fields, incident types, layouts, generic objects, indicator types, and indicator fields. #4304
  • Fixed an issue in the pre-commit command where if the DEMISTO_DEFAULT_BRANCH environment variable was set to something other than "master", the command would fail. #4325
  • Fixed an issue where validate-content-path checked suffixes of test- or doc-files #4337
  • Fixed an issue where format did not work with private github repositories. #4313
  • Fixed an issue in the format command where using the --deprecate flag would not properly work on beta integrations. #4332
  • Modified the RM108 validation to follow the new validation format. #4275
  • Modeled base_playbook tasks into objects to ease on the use in various flows. #4343
  • Added a new flow that uploads a playbook execution report JSON to the artifacts bucket. #4284
  • Started adaption for relative paths enforcement in the upload flow - The flow will now attempt to create a json file including a dict objects of all the image paths appears in the markdown files in relative path formats. #4338
  • Updated the artifacts_bucket argument of the test-content command to be optional. #4334
  • Modified the test-pre-commit-command validate hook to run only BA100 validation. #4336
  • Converted the PB105 validation to the new format. The validation verifies the playbook doesn't contain deleteContext with all=Yes. #4356
  • Moved PB108 to the new validate format. The validate checks that the 'taskid' and the 'id' under the 'task' field are from UUID format. #4359
  • Modified the MR100 validation to follow the new validation format. #4331
  • Added PB126 to the new validation format. Ensure that conditional tasks have more than path which is not the default one #4349
  • Added the removed_integration_parameter validation to the new validate as NoRemovedIntegrationParametersValidator. #4354
  • Modified validations RN103 and RN104 to follow the new validations format. #4275
  • Added the PB103 to the new validation format. Validate whether there is an unconnected task. #4340

v1.30.0

28 May 16:51
Compare
Choose a tag to compare
  • Started adaption for demisto-sdk lint command. The command will be fully removed soon Use demisto-sdk pre-commit instead. #4286
  • Added validation for image files in doc_files folder. #4249
  • Refactored PB101 and PB123 valildations. #4273
  • Refactored validation IF116, Check whether a selectValue key in an incidentField of type multiSelect contains empty options. #4278
  • Added support for IT valildations in the new validation command. #4264
  • ֹ"Converted the RM106 validation to the new format. The validation verifies that README doesn't contain the word 'demisto'". #4295
  • Added XSIAM prefix for the defaultDataSource integration README. #4305
  • When updating an existing graph, the list of updated packs is now sorted. #4261
  • Refactored all DA valildations. #4264
  • Updated validation BC106, Verify that the fromVersion key in an incident field has not been changed. #4276
  • ֹConverted the DS107 validation to the new format. The validation verifies the integration description doesn't contain the word 'demisto'. #4296
  • Refactored validation DS100, check whether a description file exists for a beta integration. #4274
  • Removed support for the defaultDataSource field in the pack metadata for hybrid packs. #4302
  • Added support for Python 3.11 #2801
  • Refactored validation IM111, Verify the integration image is within the allowed dimensions. #4255
  • Added the defaultDataSource field to the pack metadata. #4139
  • Change the default fromversion of XSIAM content items to 8.0.0 #4243
  • Fixed an issue where .demisto-sdk-conf did not take into consideration command arguments setting to false. #4253
  • Fixed an issue where format did not take .demisto-sdk-conf into consideration. #4253
  • More detailed error message with action items for validation RM108. #4269
  • Removed lint step from all sdk build steps. #4286

v1.29.3

07 May 13:06
Compare
Choose a tag to compare
  • Fixed an issue where validate ran from-version validation on trigger content items which do not have from_version field. #4235
  • Fixed an issue where requests to dockerhub failed on rate-limits when authenticating with username and password. #4227
  • Fixed an issue where reading pre-commit config templates would not handle cases with key=false and key:mode=true. #4238
  • Improved printing of file paths in the internal gitutil. #4251

v1.29.2

16 Apr 06:58
Compare
Choose a tag to compare
  • Added the --docker_image and --image_ref flags to *pre-commit to override values from configuration files. #4223
  • Removed the update-additional-dependencies script and pre-commit hook. #4225

v1.29.1

14 Apr 12:48
Compare
Choose a tag to compare
  • Fix metadata (i.e. description) for XSOAR6 marketplace. #4208
  • Fixed an issue where xsoar_on_prem tag, was not removed as part of the parsing process. #4218
  • Added support to delete packs in graph update #4205
  • Added a default .pre-commit-config_template.yaml file that will be used by pre-commit command in case such does not exist in the target repository. #4194
  • Fixed an issue where the graph was not fully cleaned before import in graph update #4215
  • Fixed an issue where tests were not collected in VSCode after setup-env #4219
  • Fixed an issue where validate spammed logs when running. #4203
  • Added the dump-api command to dump the demisto-sdk API to a JSON file. #4214

v1.29.0

01 Apr 13:39
Compare
Choose a tag to compare
  • The new validate flow is enabled by default while the old one is disabled. If you want to change this behavior, use the --run-old-validate and --skip-new-validate flags or the RUN_OLD_VALIDATE and SKIP_NEW_VALIDATE environment variables. #4114
  • A new version of validate is available. For more information, refer to the readme. (a docs web page with further information about each validation will be added soon). Note that the old validate flow is beginning to go under a deprecation process and will eventually be removed. #4114
  • Added the --template-path argument to the pre-commit command. #4184
  • Added support for a new argument *parallel for each hook to determine whether a hook run in parallel or not. #4130
  • Added handling for API Modules in pre-commit. #4175
  • Fixed an issue in pre-commit when using --all-files it crashed with memory error. #4196
  • Fixed an issue in graph update where all content packs were being parsed. #4186
  • Fixed an issue in graph update to create the graph from scratch if changed packs can not be determined. #4186
  • Fixed an issue in graph update where the graph failed to update in external repositories. #4190
  • Fixed an issue where pre-commit command showed wrong hooks failing. #4130
  • Fixes an issue where Fetch Events and Fetch Assets checkboxes appeared in Xsoar Machines. #4160
  • Added an implicit validation for the graph's relationship object by converting it to utilize Pydantic. #4142