Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 2.7.0 #16

Merged
merged 38 commits into from
Jul 30, 2024
Merged

Release 2.7.0 #16

merged 38 commits into from
Jul 30, 2024

Conversation

aarthy-dk
Copy link
Contributor

Features

  • test types: new multi-table test types, log viewer, and assorted tweaks and fixes (9d62573)
  • cli/ui: scan for personally identifying information (pii) (5b9931c)

Bug Fixes

  • mssql: fixes to distribution shift test (1ef612d)
  • ui: unset bg color of detail values on dark mode (555194e)
  • dbupgrade: add missing index (ed6babe)
  • dbupgrade: renumbered upgrade script (6af9d35)

Miscellaneous

  • ui: change wording from profiling anomalies to hygiene issues in ui (0de8355)
  • fix ci/cd (5d3e22c)

alex-datakitchen and others added 30 commits June 7, 2024 12:53
feat(ui): create a cancel button to kill processes

See merge request dkinternal/testgen/dataops-testgen!15
…d tweaks and fixes

New test types: Aggregate Balance, Aggregate Minimum, Combo Match,
Timeframe Match, Timeframe Keep, Distribution Shift.  Log viewer for
troubleshooting from UI. Assorted tweaks and fixes.
feat(test types): new multi-table test types, log viewer, and assorted tweaks and fixes

See merge request dkinternal/testgen/dataops-testgen!16
feat(test types): new multi-table test types, log viewer, and assorted tweaks and fixes

See merge request dkinternal/testgen/dataops-testgen!17
Sync changes from open source repo

See merge request dkinternal/testgen/dataops-testgen!18
# Conflicts:
#   pyproject.toml
feat(cli): refactor log system

See merge request dkinternal/testgen/dataops-testgen!19
Background color of values in the items details list was strictly set to
 which does not contrast with the white font of dark mode.
This commit uses a CSS variable dependent on the theme to decide that
background color.

Refs: #14
fix(ui): unset bg color of detail values on dark mode

See merge request dkinternal/testgen/dataops-testgen!20
fix(ui): fixed label and help in test definitions

See merge request dkinternal/testgen/dataops-testgen!21
fix(test): re-enable incremental script testing

See merge request dkinternal/testgen/dataops-testgen!22
fix(cli): wildcard % doubled after quick-start

See merge request dkinternal/testgen/dataops-testgen!24
fix(ui): [ui] [open] create qc title is showing up twice

See merge request dkinternal/testgen/dataops-testgen!25
alex-datakitchen and others added 8 commits July 17, 2024 13:28
feat(cli/ui): profiling and test definition improvements

See merge request dkinternal/testgen/dataops-testgen!26
Sync SSL certificate changes to enterprise

See merge request dkinternal/testgen/dataops-testgen!27
feat: support keypair authentication for snowflake

See merge request dkinternal/testgen/dataops-testgen!28
Scan, display and source data lookup for PII as Hygiene Issue
feat(cli/ui): scan for personally identifying information (pii)

See merge request dkinternal/testgen/dataops-testgen!29
Sync readme changes from open source to enterprise

See merge request dkinternal/testgen/dataops-testgen!30
Copy link

Coverage

Coverage Report •
FileStmtsMissCoverMissing
testgen
   __main__.py3453450%1–770
testgen/commands
   run_execute_cat_tests.py867511%18–24, 30–32, 37–40, 45–54, 59–60, 64–65, 72–162
   run_execute_tests.py917614%27–116, 120–135, 140–168
   run_generate_tests.py54497%10–107
   run_get_entities.py755722%10–14, 18–19, 23–24, 28–29, 33–40, 44–46, 50–52, 56–61, 65–72, 76–83, 87–92, 96–101, 105–110, 114–122
   run_launch_db_config.py22220%1–78
   run_observability_exporter.py1529240%31–62, 66–70, 74–103, 107–145, 149–193, 206–253, 286–303, 307–317, 321–323, 327–330
   run_profiling_bridge.py2852665%29, 33–42, 47–107, 131–219, 223–232, 236–484, 488–495
   run_quick_start.py84840%1–163
   run_setup_profiling_tools.py312322%11, 19–47, 61–96
   run_test_parameter_validation.py74695%12–135
   run_upgrade_db_config.py80800%1–156
testgen/commands/queries
   execute_tests_query.py926819%22–26, 30–40, 43–92, 96, 100–104, 107–109, 113–115, 119–126, 132–144, 148–160
   generate_tests_query.py694527%23–26, 30, 33–47, 50–54, 57–61, 66–82, 85–88, 91–94
   profiling_query.py23811047%106–107, 111–112, 116–117, 121–122, 126–127, 131–132, 136–137, 141–142, 146–147, 151–152, 156–176, 180–183, 187–190, 194–197, 210, 232–238, 242–331, 335–340, 344–347, 351–352, 356–359, 363–366
testgen/common
   clean_sql.py292411%8–16, 21–39, 44–53
   display_service.py604519%13–19, 23–30, 35–40, 44–45, 49–60, 64, 68–78, 82–85
   docker_service.py46460%1–76
   get_pipeline_parms.py292413%6–28, 32–41, 45–57
   logs.py473129%22–53, 57, 62–68, 71–73, 76, 79
   process_service.py494014%12, 16–18, 22–24, 28–62
   read_file.py492245%20–>22, 22–>24, 27, 36–37, 40, 46–50, 55–69
testgen/common/database
   database_service.py36730612%56–70, 75, 97–111, 115–129, 135–148, 153–156, 162–200, 204–208, 213–221, 228–288, 293–350, 354–381, 385–405, 409–432, 437–439, 442–465, 469–511, 515–525, 529–540, 544–551, 555–565, 569–607, 611–613, 617–629
testgen/common/database/flavor
   flavor_service.py59590%1–75
   mssql_flavor_service.py18180%1–34
   redshift_flavor_service.py13130%1–22
   snowflake_flavor_service.py36360%1–66
   trino_flavor_service.py12120%1–21
testgen/ui
   app.py59590%1–98
   bootstrap.py54540%1–108
testgen/ui/components/utils
   callbacks.py251439%18–31, 37–>42, 44–51
testgen/ui/components/widgets
   breadcrumbs.py9189%22
   location.py362035%26–41, 45–49, 53–59
   sidebar.py23670%35–37, 55–59
testgen/ui/navigation
   router.py422825%27–35, 38–63
testgen/ui/queries
   connection_queries.py504113%8–17, 21–32, 36–38, 42–68, 73–111, 115–121
   profiling_queries.py392241%9–10, 15–30, 35–44, 49–56, 61–62, 67–78, 83–148
   table_group_queries.py503621%7, 23–27, 31–37, 41–59, 63–67, 72–77, 81–106, 110–155, 159–165, 169–186
   test_definition_queries.py524214%7–15, 20–84, 88–143, 147–242, 246–250, 254–260, 264–270
   test_run_queries.py171222%8–18, 22–32
testgen/ui/services
   authentication_service.py734633%25–33, 37–44, 48–55, 59–61, 65–66, 70–72, 76–91, 99, 103, 107, 111, 115, 119
   connection_service.py13911713%18–21, 25–27, 31–42, 46–49, 53–57, 61–65, 69–84, 88–90, 94–104, 108–110, 114–118, 123–159, 163–189, 193–195, 199–220
   database_service.py14912412%23, 28–36, 40–41, 45, 49–53, 57–59, 63–66, 70–74, 78–80, 85–90, 98–126, 135–159, 166–178, 191–219, 223–244, 248–266, 270–275, 279–282
   form_service.py45136712%88–99, 102–107, 111–176, 183–256, 263, 276–279, 283–284, 288–289, 293–294, 298–299, 305–354, 359–373, 377–390, 396–423, 427–438, 445–456, 460–468, 474–491, 495–496, 502–556, 562–581, 587–613, 617–631, 646–663, 676–749, 762–796, 808–938, 942, 953–972, 979–1008
   javascript_service.py16160%1–38
   query_service.py12010410%10–21, 25–39, 44–74, 78–84, 88–115, 119–126, 130–138, 142–157, 161–175, 179–185, 189–200, 204–228, 232–263, 267–316
   test_definition_service.py665019%11–13, 19–20, 26–31, 35–37, 41–43, 47–49, 54–68, 72–74, 78–83, 87–104
   test_run_service.py8450%7–8, 12–13
testgen/ui/views
   app_log_modal.py57570%1–92
   connections.py39390%1–72
   connections_base.py1801800%1–367
   overview.py16160%1–29
   profiling_anomalies.py1891890%1–501
   profiling_details.py15212713%12–26, 31–54, 58–64, 68–78, 82–85, 89–91, 95–97, 101–103, 107–119, 123–125, 129–131, 135–139, 143–145, 149–173, 177–213, 218–241, 246–291, 295–330
   profiling_modal.py261526%19–39
   profiling_results.py72720%1–206
   profiling_summary.py80800%1–177
   project_settings.py42420%1–74
   table_groups.py2072070%1–530
   test_definitions.py4794229%26–>exit, 37–171, 187–225, 229–246, 261–637, 641–650, 654–668, 673–692, 696–700, 707–849, 853–877, 882–883, 889–890, 896–897, 902–903, 908–909, 914–915, 920–921, 925–940, 944–966, 970–987, 991–1006, 1010–1014, 1018–1020
   test_results.py33628412%26–>exit, 32–133, 143–144, 149–150, 155–163, 168–169, 174–246, 251–263, 268–283, 289–316, 321–322, 326–343, 348–349, 354–451, 456–500, 504–567, 577–696, 700–763, 767–841, 845–856, 860–898, 902–908
   test_runs.py805525%19–>exit, 26–83, 88–97, 102–103, 108–109, 114–152, 156–195
   test_suites.py2862587%22–>exit, 28–150, 170–232, 236–301, 305–346, 350–448, 452–480, 486–491, 495–501, 505–511, 515–545
TOTAL7218591014% 

Tests Skipped Failures Errors Time
19 0 💤 0 ❌ 0 🔥 3.234s ⏱️

@datakitchen-devops datakitchen-devops merged commit c3cc4bf into main Jul 30, 2024
3 of 5 checks passed
@datakitchen-devops datakitchen-devops deleted the release/2.7.0 branch July 30, 2024 16:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants