Generative (Statistical) Testing

[farlee2121]

Are there tools and would it be meaningful to run generated tests against all possible input like in clojure.

The big issue here is understanding what the expected outcome for a set of inputs would be.

[farlee2121]

Clojure: https://lispcast.com/unit-testing-in-functional-languages/

f#: https://fscheck.github.io/FsCheck/

c#: Intellitest (evolution of Pex)

• https://docs.microsoft.com/en-us/visualstudio/test/intellitest-manual/introduction?view=vs-2019
• https://www.microsoft.com/en-us/research/project/pex-and-moles-isolation-and-white-box-unit-testing-for-net/?from=http%3A%2F%2Fresearch.microsoft.com%2Fpex%2F

ErrorUnit: auto-create tests from logged errors http://errorunit.com/

[farlee2121]

Idea: I could at the least prove that my component returns (doesn't crash or return junk) for every input. With this goal, I could use standard data generators for Theories (in xUnit) or TestCaseData (nUnit).
this would allow me to create a super simple test that handles a wide range of values, including dangerous values simply based on type reflection.

The core library could just be a type case generator. Then I could choose to expose that via theories, data prep, or other.

It would also be nice to write a test harness that automatically discovers components and runs these correctness tests.