Reproducibility report for the article accepted to PADS 2024
For the article on Disolv simulator that is submitted to PADS, I opted for an optional artefact evaluation. This involves an additional review of the code and methodologies to assess how reproducible the results in the paper are. A docker image was designed to assist the reviewer in conducting this evaluation. Thanks to Fabrizio Fornari for reviewing the artefact.
After some back and forth, the reviewer was successfully able to reproduce the results and concluded that the article deserves the following badges - Functional, Artifacts Available, and Results Reproduced. These badges are allocated based on the conditions defined by ACM. The only badge that was not awarded is the Reusable badge, which requires an extensive documentation supporting the reusability of the simulator for other experiments. While the docker image has instructions to regenerate the paper results, the documentation for the simulator itself is a work in progress. It should get better with more users experimenting with Disolv.
Report is available along with the proceedings. The badges are also visible on the top-right of the article.