Within my automation framework I use .describe blocks for tests which are almost identical except for small deviations, such as the data entered into a form field being slightly different. This results in having several tests which share a test key.
Within AIO we have been representing this using Datasets, but as I am integrating the link between our automation framework and AIO I have been noticing some strange behaviour. It might be intended, but everytime I upload my results the Datasets are overwritten with the test titles into Param 1, and all other data within the Dataset is deleted.
I thought this would be fine, and we could have the test titles in each Dataset for the linking to work, and then alongside the test title we could have the usual data for any manual runs of the tests. But this doesn't work, these other parameters will also be deleted with a subsequent upload of a results file.
I am wondering if it is possible to use Datasets / Describe blocks in this way, or if every single test has to have its own test and its own automation key?
Hello @cameron.fairburn, can you please elaborate on your integration - are you using AIO's REST APIs or a generated report to upload results.
Regards, -N