“Similar performances but markedly different triaging thresholds in three CAD4TB versions risk systematic errors in TB screening programs”

🔗2022

🔗Journal/Publication: medRxiv

🔗Read it in full version: https://doi.org/10.1101/2022.04.29.22274472

Abstract 

Tuberculosis (TB) screening programs may apply computer-aided diagnostic (CAD) tools on chest radiographs to select people for microbiological sputum examination using a pre-selected triaging threshold. CAD software-updates are frequently introduced and it is unknown whether their use requires adjustment of triaging thresholds. In a community-based screening program in South Africa, we compared the scores between the three recent CAD4TB versions (v5, v6, and v7) and assessed their performance to identify microbiologically-confirmed TB. The performance of all versions was similar (v5: AUC 0.78, v6: AUC 0.79, v7: AUC 0.80; p-values>0.05), but along a 0-100 point scale, each had markedly different score distributions and optimal triaging thresholds (v5: 40, v6: 47, v7: 20). This has the potential to cause confusion within TB screening programs as these tools are increasingly adopted and new versions released. Independent guidance for adapting CAD triaging thresholds for frequently released software updates is needed.