Skip to main content

Table 4 Performance of binary classification

From: Deep learning-based automatic-bone-destruction-evaluation system using contextual information from other joints

 

SISO

MIMO local

MIMO one-hand

MIMO both-hands

Orthopedic surgeon 1

Orthopedic surgeon 2

Orthopedic surgeon 3

Average of surgeons

PIP-IP+MCP+ CMC-M (erosion)

 Sensitivity

0.65

0.54

0.51

0.31

0.64

0.94

0.93

0.84

 Specificity

0.88

0.93

0.93

0.96

0.92

0.57

0.78

0.76

 F-measure

0.50

0.52

0.50

0.38

0.57

0.36

0.51

0.48

 PR-AUC

0.55

0.54

0.53

0.44

0.59

0.58

0.65

0.61

Wrist (erosion)

 Sensitivity

0.78

0.85

0.84

0.77

0.46

0.98

0.88

0.77

 Specificity

0.86

0.85

0.83

0.88

0.95

0.30

0.65

0.64

 F-measure

0.81

0.84

0.83

0.81

0.61

0.70

0.77

0.70

 PR-AUC

0.86

0.88

0.87

0.87

0.81

0.77

0.81

0.80

All joints (erosion)

 Sensitivity

0.73

0.72

0.70

0.58

0.57

0.96

0.87

0.80

 Specificity

0.88

0.92

0.92

0.95

0.93

0.53

0.77

0.74

 F-measure

0.66

0.70

0.69

0.65

0.61

0.51

0.63

0.58

 PR-AUC

0.69

0.73

0.72

0.70

0.66

0.66

0.70

0.67

PIP+MCP+CMC (JSN)

 Sensitivity

0.75

0.74

0.73

0.67

0.55

0.90

0.84

0.76

 Specificity

0.84

0.90

0.89

0.88

0.93

0.83

0.87

0.88

 F-measure

0.72

0.76

0.74

0.70

0.65

0.80

0.79

0.74

 PR-AUC

0.76

0.81

0.79

0.75

0.74

0.82

0.82

0.79

Wrist (JSN)

 Sensitivity

0.81

0.87

0.83

0.84

0.80

0.98

0.91

0.90

 Specificity

0.79

0.78

0.80

0.81

0.84

0.67

0.84

0.78

 F-measure

0.85

0.88

0.86

0.87

0.85

0.91

0.91

0.89

 PR-AUC

0.91

0.93

0.92

0.93

0.91

0.92

0.94

0.92

All joints (JSN)

 Sensitivity

0.77

0.79

0.77

0.74

0.62

0.93

0.86

0.80

 Specificity

0.83

0.89

0.88

0.87

0.92

0.81

0.86

0.87

 F-measure

0.76

0.81

0.79

0.76

0.71

0.84

0.83

0.80

 PR-AUC

0.81

0.85

0.83

0.82

0.81

0.86

0.86

0.84

  1. The performance of each classification model and orthopedic surgeons for erosion and JSN are shown. For erosion, “Wrist” represents the navicular, the lunate, the radius, and the ulna. For JSN, “Wrist” represents the multangular-navicular, the capitate-navicular-lunate, and the radiocarpal joint
  2. SISO single-input single-output model, MIMO multiple-input multiple-output, JSN joint space narrowing, PR-AUC precision-recall area under the curve, PIP proximal interphalangeal, IP interphalangeal, MCP metacarpophalangeal, CMC-M carpometacarpal joint of thumb and multangular, CMC carpometacarpal