Acceptance Criteria — FOLR1_v0
Source: /home/kalras4/avp/FOLR1_v0/cldn20251218/FOLR1_v0_v0v4_cldn20251218/acceptance_study/results/results.csv
Acceptance margin: 0.05 (subtracted from pathologist average mean)
· Upper caps: art_sensitivity=1.0, art_precision=1.0, sstc_sensitivity=1.0, sstc_precision=1.0
Region-Level (ART) — Sensitivity & Precision
| Pathologist | Sensitivity (Mean) | Sensitivity (CI Lower) | Sensitivity (CI Upper) | Precision (Mean) | Precision (CI Lower) | Precision (CI Upper) |
|---|
| p1 | 0.957 | 0.945 | 0.965 | 0.955 | 0.946 | 0.961 |
| p2 | 0.939 | 0.931 | 0.947 | 0.968 | 0.961 | 0.973 |
| p3 | 0.948 | 0.938 | 0.955 | 0.965 | 0.958 | 0.971 |
| p4 | 0.964 | 0.955 | 0.971 | 0.952 | 0.943 | 0.958 |
| Average | 0.952 | 0.942 | 0.960 | 0.960 | 0.952 | 0.966 |
| Acceptance Criteria | 0.902 | — | — | 0.910 | — | — |
Cell-Level (SSTC) — Sensitivity & Precision
| Pathologist | Sensitivity (Mean) | Sensitivity (CI Lower) | Sensitivity (CI Upper) | Precision (Mean) | Precision (CI Lower) | Precision (CI Upper) |
|---|
| p1 | 0.882 | 0.865 | 0.899 | 0.852 | 0.829 | 0.873 |
| p2 | 0.863 | 0.849 | 0.876 | 0.892 | 0.881 | 0.901 |
| p3 | 0.880 | 0.865 | 0.894 | 0.863 | 0.849 | 0.877 |
| p4 | 0.887 | 0.869 | 0.903 | 0.811 | 0.787 | 0.836 |
| Average | 0.878 | 0.862 | 0.893 | 0.854 | 0.836 | 0.872 |
| Acceptance Criteria | 0.828 | — | — | 0.804 | — | — |
Raw Results
Raw Data
| Metric | Mean | CI Lower | CI Upper |
|---|
| dice_p1_consensus | 0.955 | 0.948 | 0.961 |
| dice_p2_consensus | 0.953 | 0.947 | 0.958 |
| dice_p3_consensus | 0.956 | 0.950 | 0.961 |
| dice_p4_consensus | 0.957 | 0.951 | 0.962 |
| sensitivity_p1_consensus | 0.957 | 0.945 | 0.965 |
| sensitivity_p2_consensus | 0.939 | 0.931 | 0.947 |
| sensitivity_p3_consensus | 0.948 | 0.938 | 0.955 |
| sensitivity_p4_consensus | 0.964 | 0.955 | 0.971 |
| precision_p1_consensus | 0.955 | 0.946 | 0.961 |
| precision_p2_consensus | 0.968 | 0.961 | 0.973 |
| precision_p3_consensus | 0.965 | 0.958 | 0.971 |
| precision_p4_consensus | 0.952 | 0.943 | 0.958 |
| sensitivity_p1_consensus | 0.882 | 0.865 | 0.899 |
| sensitivity_p2_consensus | 0.863 | 0.849 | 0.876 |
| sensitivity_p3_consensus | 0.880 | 0.865 | 0.894 |
| sensitivity_p4_consensus | 0.887 | 0.869 | 0.903 |
| precision_p1_consensus | 0.852 | 0.829 | 0.873 |
| precision_p2_consensus | 0.892 | 0.881 | 0.901 |
| precision_p3_consensus | 0.863 | 0.849 | 0.877 |
| precision_p4_consensus | 0.811 | 0.787 | 0.836 |
| f1_score_p1_consensus | 0.859 | 0.847 | 0.868 |
| f1_score_p2_consensus | 0.875 | 0.867 | 0.882 |
| f1_score_p3_consensus | 0.868 | 0.861 | 0.875 |
| f1_score_p4_consensus | 0.838 | 0.828 | 0.849 |
| avg_sd_p1_consensus | 1.493 | 1.403 | 1.594 |
| avg_sd_p2_consensus | 1.428 | 1.343 | 1.518 |
| avg_sd_p3_consensus | 1.383 | 1.304 | 1.468 |
| avg_sd_p4_consensus | 1.558 | 1.463 | 1.660 |
| dice_cytoplasm_p1_consensus | 0.662 | 0.640 | 0.683 |
| dice_cytoplasm_p2_consensus | 0.665 | 0.642 | 0.685 |
| dice_cytoplasm_p3_consensus | 0.666 | 0.646 | 0.688 |
| dice_cytoplasm_p4_consensus | 0.632 | 0.609 | 0.655 |
| ccc_membrane_per_fov_p1 | 0.998 | 0.998 | 0.999 |
| ccc_cytoplasm_per_fov_p1 | 0.995 | 0.990 | 0.998 |
| ccc_membrane_per_fov_p2 | 0.995 | 0.988 | 0.998 |
| ccc_cytoplasm_per_fov_p2 | 0.995 | 0.992 | 0.997 |
| ccc_membrane_per_fov_p3 | 0.998 | 0.997 | 0.999 |
| ccc_cytoplasm_per_fov_p3 | 0.996 | 0.993 | 0.998 |
| ccc_membrane_per_fov_p4 | 0.997 | 0.995 | 0.998 |
| ccc_cytoplasm_per_fov_p4 | 0.992 | 0.988 | 0.996 |