I have found a peculiar issue: JUnit5 == JUnit Jupiter JUnit4 == JUnit Vintage
Local Testing -> with JUnit Vintage & JUnit Jupiter tests are failing if broken
Bitrise -> only JUnit Vintage test are failing if broken
As it appears JUnit Jupiter test if broken will not fail with either the Android Unit Test or Gradle Unit Test workflow steps on Bitrise. Has anyone else come across this issue before?
We are running tests directly via Bitrise so not locally via the Bitrise CLI.
Our testing step looks uses the latest available ‘android-unit-test’ step from the Bitrise Workflow editor. In this step I have defined my app module ‘mobile’ and the exact variant such as ‘productionBeta’.
I have tried to reverse back to running the gradle task for testing directly but also have not had success with catching faulty tests either.