Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add extra CWEs found detector #6

Open
davewichers opened this issue Dec 22, 2020 · 0 comments
Open

Add extra CWEs found detector #6

davewichers opened this issue Dec 22, 2020 · 0 comments
Labels
enhancement New feature or request
Milestone

Comments

@davewichers
Copy link
Contributor

To help identify and eliminate unintentional vulnerabilities in generated test suites, we can add a debug feature that detects vulnerabilities found in the test suite by tools outside of the intentional vulnerabilities. I can envision two modes during scorecard generation:

  1. Normal Debug: Generate a list of CWEs in the current expected results file, and then for each tool, each time a CWE in that list is identified outside of an expected test case for that CWE, dump out the CWE, and location found.

This is the most useful as it eliminates extraneous vulns of the type we actually count so tools don't 'strangely' find more vulns of a given type than expected.

  1. Go Hard Debug: Report ANY CWEs outside of expected locations. Some tools find all kinds of extraneous stuff, so eliminate any findings mapped to 0 or -1. We might have to tune other parsers to map more extraneous findings to 0/-1, or add a filter her to eliminate CWEs we just don't care about.

This would all be done in BenchmarkScore, so would work across ALL the tools.

@davewichers davewichers transferred this issue from another repository Aug 12, 2021
@davewichers davewichers added this to the Backlog milestone Aug 17, 2021
@davewichers davewichers added the enhancement New feature or request label May 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant