Skip to content

tests: add a feature diff test view and select by regex in feature tagging dashboard#16779

Open
maykathm wants to merge 2 commits intocanonical:masterfrom
maykathm:add-new-view-in-features
Open

tests: add a feature diff test view and select by regex in feature tagging dashboard#16779
maykathm wants to merge 2 commits intocanonical:masterfrom
maykathm:add-new-view-in-features

Conversation

@maykathm
Copy link
Copy Markdown
Contributor

@maykathm maykathm commented Mar 18, 2026

This adds:

  • the ability to calculate the difference in feature coverage between a set of systems and a single system
  • a test-based overview in the difference between test coverage

New regex

When calculating the difference between test coverage, one can now specify a regex to select a set of systems. The regex permits users to examine the missing coverage of a single system against a set of systems.

For example, now if I wish to see what features are tested in all uc versions but not uc26, I can make the following query:
Screenshot from 2026-03-18 08-47-58

New test view in feature coverage difference

This adds a new test table when looking at feature coverage difference. It shows, of the feature coverage gap, what tests contain those missing features. Each entry in the table reports only missing features that test contains (not features in general that test may have). It allows a user to quickly see where to get the biggest gains in closing the feature coverage gap.
Screenshot from 2026-03-18 09-15-16

Additionally, a user may click on an individual entry in the new test table and see what features they can gain through that test.
Screenshot from 2026-03-18 09-15-45

@maykathm maykathm added the Skip spread Indicate that spread job should not run label Mar 18, 2026
@maykathm maykathm force-pushed the add-new-view-in-features branch from fbeac42 to a4a4a23 Compare March 18, 2026 08:13
@github-actions
Copy link
Copy Markdown

github-actions bot commented Mar 18, 2026

Wed Mar 18 08:33:47 UTC 2026

Spread tests skipped

@codecov
Copy link
Copy Markdown

codecov bot commented Mar 18, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
⚠️ Please upload report for BASE (master@bfa385c). Learn more about missing BASE report.
⚠️ Report is 264 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff            @@
##             master   #16779   +/-   ##
=========================================
  Coverage          ?   77.63%           
=========================================
  Files             ?     1351           
  Lines             ?   188169           
  Branches          ?     2446           
=========================================
  Hits              ?   146078           
  Misses            ?    33268           
  Partials          ?     8823           
Flag Coverage Δ
unittests 77.63% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Copy link
Copy Markdown
Contributor

@sergiocazzolato sergiocazzolato left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice, lets see how it works

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Skip spread Indicate that spread job should not run

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants