
angular_leaf_spot_test.0.jpgacceptedtarget: Angular leaf spotEvaluation
Everything on this page is rendered from the report JSON shipped in the LeafSentry repository (sha256 ca67b15d…af19312, generated 2026-10-03). If a number disagrees with the repo, the repo wins.
Top-1 accuracy
96.88%
128 pinned test images
Selective accuracy
97.64%
at 99.2% coverage (abstentions excluded)
Macro F1
0.969
unweighted mean over classes
Expected calibration error
0.055
confidence vs. realized accuracy
Multiclass Brier
0.051
lower is better; full probability vector
Latency (CPU)
mean 581 ms
p95 642 ms, model load through policy
Rows are the true label, columns are the prediction. Across 128 test images the model is right 124 times and wrong 4 times. Every misclassification is visible in the matrix below. On top of that matrix the decision policy withholds 1 prediction at the production thresholds (confidence ≥ 0.75, margin ≥ 0.2), so the accepted set is 127 images rather than 128. An abstention is a decision about an existing prediction, not an extra error: the matrix already contains it.
| true \ predicted | angular_leaf_spot | bean_rust | healthy | support |
|---|---|---|---|---|
| angular_leaf_spot | 40 | 3 | 0 | 43 |
| bean_rust | 0 | 43 | 0 | 43 |
| healthy | 0 | 1 | 41 | 42 |
| class | precision | recall | F1 | support |
|---|---|---|---|---|
| angular_leaf_spot | 100.00% | 93.02% | 0.964 | 43 |
| bean_rust | 91.49% | 100.00% | 0.956 | 43 |
| healthy | 100.00% | 97.62% | 0.988 | 42 |
The service answers only when confidence ≥ 0.75 and the top-two margin ≥ 0.2 (temperature 1). The sweep below is the measured tradeoff if those thresholds move: 32 threshold combinations were evaluated against the same 128 images.
| min confidence | min margin | coverage | selective accuracy | selective risk | |
|---|---|---|---|---|---|
| 0 | 0 | 100.00% | 96.88% | 3.13% | |
| 0 | 0.1 | 100.00% | 96.88% | 3.13% | |
| 0 | 0.2 | 100.00% | 96.88% | 3.13% | |
| 0 | 0.3 | 100.00% | 96.88% | 3.13% | |
| 0.5 | 0 | 100.00% | 96.88% | 3.13% | |
| 0.5 | 0.1 | 100.00% | 96.88% | 3.13% | |
| 0.5 | 0.2 | 100.00% | 96.88% | 3.13% | |
| 0.5 | 0.3 | 100.00% | 96.88% | 3.13% | |
| 0.6 | 0 | 100.00% | 96.88% | 3.13% | |
| 0.6 | 0.1 | 100.00% | 96.88% | 3.13% | |
| 0.6 | 0.2 | 100.00% | 96.88% | 3.13% | |
| 0.6 | 0.3 | 100.00% | 96.88% | 3.13% | |
| 0.7 | 0 | 99.22% | 97.64% | 2.36% | |
| 0.7 | 0.1 | 99.22% | 97.64% | 2.36% | |
| 0.7 | 0.2 | 99.22% | 97.64% | 2.36% | |
| 0.7 | 0.3 | 99.22% | 97.64% | 2.36% | |
| 0.75 | 0 | 99.22% | 97.64% | 2.36% | |
| 0.75 | 0.1 | 99.22% | 97.64% | 2.36% | |
| 0.75 | 0.2 | 99.22% | 97.64% | 2.36% | ← production policy |
| 0.75 | 0.3 | 99.22% | 97.64% | 2.36% | |
| 0.8 | 0 | 98.44% | 98.41% | 1.59% | |
| 0.8 | 0.1 | 98.44% | 98.41% | 1.59% | |
| 0.8 | 0.2 | 98.44% | 98.41% | 1.59% | |
| 0.8 | 0.3 | 98.44% | 98.41% | 1.59% | |
| 0.9 | 0 | 92.19% | 98.31% | 1.69% | |
| 0.9 | 0.1 | 92.19% | 98.31% | 1.69% | |
| 0.9 | 0.2 | 92.19% | 98.31% | 1.69% | |
| 0.9 | 0.3 | 92.19% | 98.31% | 1.69% | |
| 0.95 | 0 | 28.91% | 100.00% | 0.00% | |
| 0.95 | 0.1 | 28.91% | 100.00% | 0.00% | |
| 0.95 | 0.2 | 28.91% | 100.00% | 0.00% | |
| 0.95 | 0.3 | 28.91% | 100.00% | 0.00% |
41f85ace09a4 (pinned 40-hex revision, so inference cannot silently drift).ca67b15d960d1e2f….Try the policy live on the demo page . The same thresholds decide whether an upload gets an answer or an abstention.
Adjust thresholds, filter the confusion matrix, and inspect individual samples with per-class probabilities and confidence margins, all recomputed live from the same128 pinned predictions.
Selective accuracy
97.64%
At current thresholds
Coverage
99.22%
127 of 128 images
Selective risk
2.36%
3 errors in accepted
32 threshold combinations evaluated against the same 128 images. Adjust sliders above to highlight the production policy row.
| min confidence | min margin | coverage | selective accuracy | selective risk |
|---|---|---|---|---|
| 0.00 | 0.00 | 100.00% | 96.88% | 3.13% |
| 0.00 | 0.10 | 100.00% | 96.88% | 3.13% |
| 0.00 | 0.20 | 100.00% | 96.88% | 3.13% |
| 0.00 | 0.30 | 100.00% | 96.88% | 3.13% |
| 0.50 | 0.00 | 100.00% | 96.88% | 3.13% |
| 0.50 | 0.10 | 100.00% | 96.88% | 3.13% |
| 0.50 | 0.20 | 100.00% | 96.88% | 3.13% |
| 0.50 | 0.30 | 100.00% | 96.88% | 3.13% |
| 0.60 | 0.00 | 100.00% | 96.88% | 3.13% |
| 0.60 | 0.10 | 100.00% | 96.88% | 3.13% |
| 0.60 | 0.20 | 100.00% | 96.88% | 3.13% |
| 0.60 | 0.30 | 100.00% | 96.88% | 3.13% |
| 0.70 | 0.00 | 99.22% | 97.64% | 2.36% |
| 0.70 | 0.10 | 99.22% | 97.64% | 2.36% |
| 0.70 | 0.20 | 99.22% | 97.64% | 2.36% |
| 0.70 | 0.30 | 99.22% | 97.64% | 2.36% |
| 0.75 | 0.00 | 99.22% | 97.64% | 2.36% |
| 0.75 | 0.10 | 99.22% | 97.64% | 2.36% |
| 0.75 | 0.20 | 99.22% | 97.64% | 2.36% |
| 0.75 | 0.30 | 99.22% | 97.64% | 2.36% |
| 0.80 | 0.00 | 98.44% | 98.41% | 1.59% |
| 0.80 | 0.10 | 98.44% | 98.41% | 1.59% |
| 0.80 | 0.20 | 98.44% | 98.41% | 1.59% |
| 0.80 | 0.30 | 98.44% | 98.41% | 1.59% |
| 0.90 | 0.00 | 92.19% | 98.31% | 1.69% |
| 0.90 | 0.10 | 92.19% | 98.31% | 1.69% |
| 0.90 | 0.20 | 92.19% | 98.31% | 1.69% |
| 0.90 | 0.30 | 92.19% | 98.31% | 1.69% |
| 0.95 | 0.00 | 28.91% | 100.00% | 0.00% |
| 0.95 | 0.10 | 28.91% | 100.00% | 0.00% |
| 0.95 | 0.20 | 28.91% | 100.00% | 0.00% |
| 0.95 | 0.30 | 28.91% | 100.00% | 0.00% |
Raw: all 128 samples. Accepted: 127 (124 correct, 3 errors). Abstained: 1.
Raw correct
124
Raw errors
4
Accepted correct
124
Accepted errors
3
Abstained
1
Total accepted
127
Total samples
128
| true \ predicted | angular_leaf_spot | bean_rust | healthy | support |
|---|---|---|---|---|
| angular_leaf_spot | 40 | 3 | 0 | 43 |
| bean_rust | 0 | 43 | 0 | 43 |
| healthy | 0 | 1 | 41 | 42 |
Click a cell with samples to filter the gallery below. Diagonal = correct predictions, off-diagonal = errors.

angular_leaf_spot_test.0.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.1.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.10.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.11.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.12.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.13.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.14.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.15.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.16.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.17.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.18.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.19.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.2.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.20.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.21.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.22.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.23.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.24.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.25.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.26.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.27.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.28.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.29.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.3.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.30.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.31.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.32.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.33.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.34.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.35.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.36.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.37.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.38.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.39.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.4.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.40.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.41.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.42.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.5.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.6.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.7.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.8.jpgacceptedtarget: Angular leaf spot
angular_leaf_spot_test.9.jpgacceptedtarget: Angular leaf spot
bean_rust_test.0.jpgacceptedtarget: Bean rust
bean_rust_test.1.jpgacceptedtarget: Bean rust
bean_rust_test.10.jpgacceptedtarget: Bean rust
bean_rust_test.11.jpgacceptedtarget: Bean rust
bean_rust_test.12.jpgacceptedtarget: Bean rust
bean_rust_test.13.jpgacceptedtarget: Bean rust
bean_rust_test.14.jpgacceptedtarget: Bean rust
bean_rust_test.15.jpgacceptedtarget: Bean rust
bean_rust_test.16.jpgacceptedtarget: Bean rust
bean_rust_test.17.jpgacceptedtarget: Bean rust
bean_rust_test.18.jpgacceptedtarget: Bean rust
bean_rust_test.19.jpgacceptedtarget: Bean rust
bean_rust_test.2.jpgacceptedtarget: Bean rust
bean_rust_test.20.jpgacceptedtarget: Bean rust
bean_rust_test.21.jpgacceptedtarget: Bean rust
bean_rust_test.22.jpgacceptedtarget: Bean rust
bean_rust_test.23.jpgacceptedtarget: Bean rust
bean_rust_test.24.jpgacceptedtarget: Bean rust
bean_rust_test.25.jpgacceptedtarget: Bean rust
bean_rust_test.26.jpgacceptedtarget: Bean rust
bean_rust_test.27.jpgacceptedtarget: Bean rust
bean_rust_test.28.jpgacceptedtarget: Bean rust
bean_rust_test.29.jpgacceptedtarget: Bean rust
bean_rust_test.3.jpgacceptedtarget: Bean rust
bean_rust_test.30.jpgacceptedtarget: Bean rust
bean_rust_test.31.jpgacceptedtarget: Bean rust
bean_rust_test.32.jpgacceptedtarget: Bean rust
bean_rust_test.33.jpgacceptedtarget: Bean rust
bean_rust_test.34.jpgacceptedtarget: Bean rust
bean_rust_test.35.jpgacceptedtarget: Bean rust
bean_rust_test.36.jpgacceptedtarget: Bean rust
bean_rust_test.37.jpgacceptedtarget: Bean rust
bean_rust_test.38.jpgacceptedtarget: Bean rust
bean_rust_test.39.jpgacceptedtarget: Bean rust
bean_rust_test.4.jpgacceptedtarget: Bean rust
bean_rust_test.40.jpgacceptedtarget: Bean rust
bean_rust_test.41.jpgacceptedtarget: Bean rust
bean_rust_test.42.jpgacceptedtarget: Bean rust
bean_rust_test.5.jpgacceptedtarget: Bean rust
bean_rust_test.6.jpgacceptedtarget: Bean rust
bean_rust_test.7.jpgacceptedtarget: Bean rust
bean_rust_test.8.jpgacceptedtarget: Bean rust
bean_rust_test.9.jpgacceptedtarget: Bean rust
healthy_test.0.jpgacceptedtarget: Healthy
healthy_test.1.jpgacceptedtarget: Healthy
healthy_test.10.jpgacceptedtarget: Healthy
healthy_test.11.jpgacceptedtarget: Healthy
healthy_test.12.jpgacceptedtarget: Healthy
healthy_test.13.jpgacceptedtarget: Healthy
healthy_test.14.jpgacceptedtarget: Healthy
healthy_test.15.jpgacceptedtarget: Healthy
healthy_test.16.jpgacceptedtarget: Healthy
healthy_test.17.jpgacceptedtarget: Healthy
healthy_test.18.jpgacceptedtarget: Healthy
healthy_test.19.jpgacceptedtarget: Healthy
healthy_test.2.jpgacceptedtarget: Healthy
healthy_test.20.jpgacceptedtarget: Healthy
healthy_test.21.jpgacceptedtarget: Healthy
healthy_test.22.jpgacceptedtarget: Healthy
healthy_test.23.jpgacceptedtarget: Healthy
healthy_test.24.jpgacceptedtarget: Healthy
healthy_test.25.jpgacceptedtarget: Healthy
healthy_test.26.jpgacceptedtarget: Healthy
healthy_test.27.jpgacceptedtarget: Healthy
healthy_test.28.jpgacceptedtarget: Healthy
healthy_test.29.jpgacceptedtarget: Healthy
healthy_test.3.jpgacceptedtarget: Healthy
healthy_test.30.jpgacceptedtarget: Healthy
healthy_test.31.jpgacceptedtarget: Healthy
healthy_test.32.jpgacceptedtarget: Healthy
healthy_test.33.jpgacceptedtarget: Healthy
healthy_test.34.jpgacceptedtarget: Healthy
healthy_test.35.jpgabstainedtarget: Healthy
healthy_test.36.jpgacceptedtarget: Healthy
healthy_test.37.jpgacceptedtarget: Healthy
healthy_test.38.jpgacceptedtarget: Healthy
healthy_test.39.jpgacceptedtarget: Healthy
healthy_test.4.jpgacceptedtarget: Healthy
healthy_test.40.jpgacceptedtarget: Healthy
healthy_test.41.jpgacceptedtarget: Healthy
healthy_test.5.jpgacceptedtarget: Healthy
healthy_test.6.jpgacceptedtarget: Healthy
healthy_test.7.jpgacceptedtarget: Healthy
healthy_test.8.jpgacceptedtarget: Healthy
healthy_test.9.jpgacceptedtarget: HealthyThis report measures the serving stack as it is deployed, which is PyTorch. The runtime benchmark runs the identical weights through PyTorch and ONNXRuntime in separate processes and checks per-sample probability parity, so the export path is measured rather than assumed.