Aortic & peripheral vascular disease
Inter-Rater Reliability for the Amputation Endpoint in the National Vascular Quality Initiative
Authors' conclusion
Almost two-thirds of the amputations in the VQI registry and one-third of amputations in VQI-VISION were missing at 1 year compared against adjudicated EHR review.
Study context
- Population
- Surgical or endovascular revascularization procedures for peripheral artery disease (PAD), January 1, 2010–December 31, 2017
- Participants
- 1,936 revascularizations
- Comparison
- Vascular Quality Initiative (VQI) registry and VQI-VISION vs adjudicated electronic health record (EHR) review
- Outcome
- Interrater reliability for major amputation vs EHR review
- Follow-up
- 1 year
Methodological details2 academic health systems
- 2 academic health systems
Performance
As reported in the abstract
Major amputation
| Test or model | Sensitivity | Specificity | Spearman's ρ | Cohen's κ |
|---|---|---|---|---|
| VQI | 35.9% | 99.4% | 0.53 | 0.48 |
| VQI-VISION | 67.7% | 98.9% | 0.75 | 0.74 |
Sensitivity
VQI35.9%
VQI-VISION67.7%
Specificity
VQI99.4%
VQI-VISION98.9%
Spearman's ρ
VQI0.53
VQI-VISION0.75
Cohen's κ
VQI0.48
VQI-VISION0.74
Further findings
| Outcome | VQI | VQI-VISION | EHR review | |
|---|---|---|---|---|
| Any amputation | ||||
| Sensitivity | 35.3% | 71.6% | Not reported in the abstract | EHR review: not reported in the abstract |
| Specificity | 99.3% | 97.7% | Not reported in the abstract | EHR review: not reported in the abstract |
| Spearman's ρ | 0.53 | 0.75 | Not reported in the abstract | EHR review: not reported in the abstract |
| Cohen's κ | 0.46 | 0.74 | Not reported in the abstract | EHR review: not reported in the abstract |
Original publication
Inter-Rater Reliability for the Amputation Endpoint in the National Vascular Quality Initiative. JACC Cardiovasc Interv. Published 11 March 2024. doi:10.
Summarised from the published abstract; every number is checked against it