AE 07: Evaluate models

Note

This application exercise is completed in class and submitted via a worksheet.

Discussion questions

1. Do any metrics differ substantially between groups? What does this mean?

2. You’re evaluating a diagnostic model for COVID-19 detection based on symptoms (fever, cough, loss of taste/smell, fatigue, etc.) and rapid saliva testing.

For each of the stakeholders below, identify their least acceptable type of error and the most important metric to them.

Stakeholders

• Patient

• Hospital administrator

• Public health official

• Workplace/school