Inter-rater reliability in the testing sample
| Criterion/question on abstraction tool | Agreement between two raters (n=250) | |
| % agreement | Kappa | |
| 1. Is language describing ‘what is the procedure’ (beyond the medical name) provided for the patient? | 92.0 | 0.81 |
| 1a. If provided, is it typed? | 96.4 | 0.89 |
| 2. Is a description of how the procedure will be performed provided for the patient? | 96.8 | 0.89 |
| 2a. If provided, is it typed? | 98.0 | 0.92 |
| 3. Is the clinical rationale (condition-specific justification) for why the procedure will be performed provided? | 92.6 | 0.75 |
| 4. Is any patient-oriented benefit provided (intended impact on the patient’s health, longevity and/or quality of life)? | 96.8 | 0.76 |
| 5. Is a quantitative probability provided for any procedure-specific risk? | 97.6 | 0.61 |
| 6. Is a qualitative probability provided for any procedure-specific risk? | 94.8 | 0.53 |
| 7. Is any alternative provided for the patient? | 98.8 | 0.95 |
| 8a,b. Was the informed consent document shared with the patient at least 1 day before date of procedure, if the patient did not opt out of signing at least 1 day in advance? | 95.2 | 0.88 |
| 8c. Did the patient opt out of signing at least 1 day in advance? | 100.0 | NA |
| Document score agreement | ||
| Spearman correlation | 0.9164 | |
NA, not applicable.