[Performance Evaluation] 2. Performance metrics for classification(2)

Outline

• Bias-variance tradeoff & Cross-validation
• Performance metrics for classification

PRECISION AND RECALL

2.16 Precision & Recall

 

2.17 Performance metrics

 

2.18 F1 score

 

2.19 Classification Performances

 

2.20 Advantages of F1 score

 

2.21 Example: F1-score

 

2.22 Hyperparameter tuning based on F1 score

 

ROC CURVE

2.23 Making prediction from probabilities

 

2.24 Changing thresholds

 

2.25 ROC (Receiver Operating Characteristic) curve

 

2.26 ROC curve

 

2.27 How to construct an ROC curve

 

2.28 Example

 

2.29 ROC curves

 

2.30 Precision-recall curve

 

2.31 Class imbalance problem

 

2.32 Dealing with class imbalances