Oxygen Therapy IRR – Colorado

Processed Ratings Table (only last entry for each reviewer)

1 - Unsatisfactory 2 - Below Average 3 - Competent 4 - Above Average 5 - Exemplary
1. Washes hands or applies disinfecting gel/foam. 0 0 2 0 4
2. Introduces self to the patient stating name and department. 0 0 1 0 5
3. Checks patient identity using two patient identifiers. 0 0 2 0 4
4. Clearly defines procedure to patient and checks for patient understanding. 0 0 2 0 4
5. Performs thorough pre-procedure patient assessment (Breath sounds, HR, RR, SPO2, general appearance, patient subjective symptoms, sputum, cough, and peak flow when patients have restrictive airway disease). 0 0 3 0 3
6. Assesses if oxygen therapy is indicated based on patient clinical presentation and current FiO2 settings. 0 0 3 0 3
7. Obtains necessary equipment for procedure, properly assembles, and confirms functionality. 0 1 2 0 3
8. Applies the oxygen device to the patient and sets flow to achieve the desired FiO2. 0 0 3 0 3
9. Performs thorough post-procedure patient assessment (Breath sounds, HR, RR, SPO2, general appearance, patient subjective symptoms, sputum, cough, and peak flow when patients have restrictive airway disease). 0 0 3 0 3
10. Ensures that oxygen delivery method is adequate and does not result in either hypoxia OR hyperoxia. 0 0 4 0 2
11. Ensures the patient's comfort and safety. 1 0 3 0 2
12. Washes hands or applies disinfecting gel/foam. 0 1 2 0 3

Randolph's free marginal multirater kappa value is: 0.264


Reference (as suggested by Landis and Koch (1977)):

K Interpretation
< 0 Less Than Chance Agreement
0.01 - 0.20 Slight Agreement
0.21 - 0.40 Fair Agreement
0.41 - 0.60 Moderate Agreement
0.61 - 0.80 Substantial Agreement
0.81 - 1.00 Almost Perfect Agreement

What should be taken into account:

  1. Coefficient accuracy improves with increase of responders and questions.
  2. Coefficient value needs to be reviewed jointly with the "Processed Results" table to see what do responders agree on.