Dear all,
to keep track of our efforts, this new thread might help us.
I'll start by summarising and comment on our milestones from the WG charter so far.
1. The first goal to submit a perspective manuscript is done, the review is already back in. Reacting might or might not demand some work on the next milestones in advance. For more, see the conversation on the manuscript. Next would be the preparation for qcML submission into the PSI process.
2-5. We already did some re-evaluation of the current version of qcML while and after Ghent. Major point is, that due to the close intertwining of how metrics are represented and how they are defined, we are likely best off using an iterative looping approach of tackling this milestone and the next. Which is, to re-evaluate our QC controlled vocabulary with the metrics definitions and consolidate with other existing definitions. After this, we would have to see for software implementations. It would be of course nice to have this already available to support the iterations of previous two steps and in response to the reviewer comments. This is a moving target and tedious for developers to keep up, but I made some efforts as I saw some of the reviewer comments coming. Basically the first iteration of goals 2,3,4,5. To have a consolidated list of older metrics, our efforts from Ghent, the NIST metrics in a cv update AND to have them calculated and processed by OpenMS with some tangible output. Therefore, see github (https://github.com/mwalzer/qcML-development/blob/feature/QC-CV-Metric_overview/cv/README.md, https://github.com/mwalzer/qcML-development/blob/feature/QC-CV-Metric_overview/cv/qc-metric-collection.md).
6. Our final goal will be to chaperone qcML through the PSI standardisation process after we deem the metrics definition, the CV, and the format sufficiently aligned and implemented.
But least not to forget after the PSI process to extend our collection of metrics and support for new techniques. This is, of course, a very tempting task to skip ahead to, but let's not forget to cover our bases with the milestones before.
best,
Mathias |