Invalid Test Case ee0827d4c9bf80982241e8c3559dceb8b39063e4

[anddann]

Thanks for the great work curating and maintaining the benchmark.

The update in test case ee0827d4c9bf80982241e8c3559dceb8b39063e4 from PR codehaus-plexus/plexus-archiver#259 does not look like a "breaking update".
The bot -- in this case snyk -- proposes a downgrade to a 17-year-old version of a given dependency.
commons-io 2.11.0 --> 20030203.000550

It looks like the version comparison in the bot was buggy, but not an actual dependency update PR.
Thus, I consider this test case insufficient for the benchmark.

Nevertheless, if the criteria for the benchmark are that a PR has been generated by a bot, the test case would be valid.

[frankreyesgarcia]

Hi @anddann , Thank you for your contribution.

Correct: This is not an update, it is a downgrade: “20030203.000550” is older than “2.11.0”. It was classified as a breaking dependency update due to an incorrect numerical comparison of the version.

We are working on this case and will document it explicitly in the metadata.