Evaluation

The benchmark behind the claims

Everything on this page is rendered from the report JSON shipped in the LeafSentry repository (sha256 ca67b15d…af19312, generated 2026-10-03). If a number disagrees with the repo, the repo wins.

Top-1 accuracy

96.88%

128 pinned test images

Selective accuracy

97.64%

at 99.2% coverage (abstentions excluded)

Macro F1

0.969

unweighted mean over classes

Expected calibration error

0.055

confidence vs. realized accuracy

Multiclass Brier

0.051

lower is better; full probability vector

Latency (CPU)

mean 581 ms

p95 642 ms, model load through policy

Confusion matrix

Rows are the true label, columns are the prediction. Across 128 test images the model is right 124 times and wrong 4 times. Every misclassification is visible in the matrix below. On top of that matrix the decision policy withholds 1 prediction at the production thresholds (confidence ≥ 0.75, margin ≥ 0.2), so the accepted set is 127 images rather than 128. An abstention is a decision about an existing prediction, not an extra error: the matrix already contains it.

true \ predictedangular_leaf_spotbean_rusthealthysupport
angular_leaf_spot403043
bean_rust043043
healthy014142
classprecisionrecallF1support
angular_leaf_spot100.00%93.02%0.96443
bean_rust91.49%100.00%0.95643
healthy100.00%97.62%0.98842

Decision policy and the accuracy–coverage tradeoff

The service answers only when confidence ≥ 0.75 and the top-two margin ≥ 0.2 (temperature 1). The sweep below is the measured tradeoff if those thresholds move: 32 threshold combinations were evaluated against the same 128 images.

min confidencemin margincoverageselective accuracyselective risk
00100.00%96.88%3.13%
00.1100.00%96.88%3.13%
00.2100.00%96.88%3.13%
00.3100.00%96.88%3.13%
0.50100.00%96.88%3.13%
0.50.1100.00%96.88%3.13%
0.50.2100.00%96.88%3.13%
0.50.3100.00%96.88%3.13%
0.60100.00%96.88%3.13%
0.60.1100.00%96.88%3.13%
0.60.2100.00%96.88%3.13%
0.60.3100.00%96.88%3.13%
0.7099.22%97.64%2.36%
0.70.199.22%97.64%2.36%
0.70.299.22%97.64%2.36%
0.70.399.22%97.64%2.36%
0.75099.22%97.64%2.36%
0.750.199.22%97.64%2.36%
0.750.299.22%97.64%2.36%← production policy
0.750.399.22%97.64%2.36%
0.8098.44%98.41%1.59%
0.80.198.44%98.41%1.59%
0.80.298.44%98.41%1.59%
0.80.398.44%98.41%1.59%
0.9092.19%98.31%1.69%
0.90.192.19%98.31%1.69%
0.90.292.19%98.31%1.69%
0.90.392.19%98.31%1.69%
0.95028.91%100.00%0.00%
0.950.128.91%100.00%0.00%
0.950.228.91%100.00%0.00%
0.950.328.91%100.00%0.00%

Provenance

Model:
nateraw/vit-base-beans @ 41f85ace09a4 (pinned 40-hex revision, so inference cannot silently drift).
Dataset:
AI-Lab-Makerere/beans test split, 128 images, archive sha256 ca67b15d960d1e2f….
Runtime:
Python 3.12.3, torch 2.13.0+cpu, transformers 5.10.1, device cpu.
Scope, stated plainly:
model loading (first sample), preprocessing, forward pass, and score policy on local CPU; not an HTTP/load benchmark. These numbers are model-level evidence on a pinned test split; they are not a field-performance claim, and this post explains why that distinction matters.

Try the policy live on the demo page . The same thresholds decide whether an upload gets an answer or an abstention.

Interactive exploration

Adjust thresholds, filter the confusion matrix, and inspect individual samples with per-class probabilities and confidence margins, all recomputed live from the same128 pinned predictions.

Interactive threshold explorer

Production: confidence ≥ 0.75, margin ≥ 0.2

Selective accuracy

97.64%

At current thresholds

Coverage

99.22%

127 of 128 images

Selective risk

2.36%

3 errors in accepted

Threshold sweep (recomputed live)

32 threshold combinations evaluated against the same 128 images. Adjust sliders above to highlight the production policy row.

min confidencemin margincoverageselective accuracyselective risk
0.000.00100.00%96.88%3.13%
0.000.10100.00%96.88%3.13%
0.000.20100.00%96.88%3.13%
0.000.30100.00%96.88%3.13%
0.500.00100.00%96.88%3.13%
0.500.10100.00%96.88%3.13%
0.500.20100.00%96.88%3.13%
0.500.30100.00%96.88%3.13%
0.600.00100.00%96.88%3.13%
0.600.10100.00%96.88%3.13%
0.600.20100.00%96.88%3.13%
0.600.30100.00%96.88%3.13%
0.700.0099.22%97.64%2.36%
0.700.1099.22%97.64%2.36%
0.700.2099.22%97.64%2.36%
0.700.3099.22%97.64%2.36%
0.750.0099.22%97.64%2.36%
0.750.1099.22%97.64%2.36%
0.750.2099.22%97.64%2.36%
0.750.3099.22%97.64%2.36%
0.800.0098.44%98.41%1.59%
0.800.1098.44%98.41%1.59%
0.800.2098.44%98.41%1.59%
0.800.3098.44%98.41%1.59%
0.900.0092.19%98.31%1.69%
0.900.1092.19%98.31%1.69%
0.900.2092.19%98.31%1.69%
0.900.3092.19%98.31%1.69%
0.950.0028.91%100.00%0.00%
0.950.1028.91%100.00%0.00%
0.950.2028.91%100.00%0.00%
0.950.3028.91%100.00%0.00%

Partition counts (raw vs accepted/abstained)

Raw: all 128 samples. Accepted: 127 (124 correct, 3 errors). Abstained: 1.

Raw correct

124

Raw errors

4

Accepted correct

124

Accepted errors

3

Abstained

1

Total accepted

127

Total samples

128

Confusion matrix (click cells to filter samples)

true \ predictedangular_leaf_spotbean_rusthealthysupport
angular_leaf_spot403043
bean_rust043043
healthy014142

Click a cell with samples to filter the gallery below. Diagonal = correct predictions, off-diagonal = errors.

Sample gallery (128 samples)

Sample: angular_leaf_spot_test.0.jpg
angular_leaf_spot_test.0.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.943)margin: 0.912
Sample: angular_leaf_spot_test.1.jpg
angular_leaf_spot_test.1.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.945)margin: 0.915
Sample: angular_leaf_spot_test.10.jpg
angular_leaf_spot_test.10.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.940)margin: 0.907
Sample: angular_leaf_spot_test.11.jpg
angular_leaf_spot_test.11.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.945)margin: 0.915
Sample: angular_leaf_spot_test.12.jpg
angular_leaf_spot_test.12.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.942)margin: 0.911
Sample: angular_leaf_spot_test.13.jpg
angular_leaf_spot_test.13.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.947)margin: 0.917
Sample: angular_leaf_spot_test.14.jpg
angular_leaf_spot_test.14.jpgacceptedtarget: Angular leaf spot
pred: Bean rust (0.754)margin: 0.528
Sample: angular_leaf_spot_test.15.jpg
angular_leaf_spot_test.15.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.944)margin: 0.910
Sample: angular_leaf_spot_test.16.jpg
angular_leaf_spot_test.16.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.944)margin: 0.913
Sample: angular_leaf_spot_test.17.jpg
angular_leaf_spot_test.17.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.949)margin: 0.922
Sample: angular_leaf_spot_test.18.jpg
angular_leaf_spot_test.18.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.943)margin: 0.913
Sample: angular_leaf_spot_test.19.jpg
angular_leaf_spot_test.19.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.936)margin: 0.893
Sample: angular_leaf_spot_test.2.jpg
angular_leaf_spot_test.2.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.943)margin: 0.910
Sample: angular_leaf_spot_test.20.jpg
angular_leaf_spot_test.20.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.941)margin: 0.912
Sample: angular_leaf_spot_test.21.jpg
angular_leaf_spot_test.21.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.948)margin: 0.920
Sample: angular_leaf_spot_test.22.jpg
angular_leaf_spot_test.22.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.945)margin: 0.918
Sample: angular_leaf_spot_test.23.jpg
angular_leaf_spot_test.23.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.946)margin: 0.915
Sample: angular_leaf_spot_test.24.jpg
angular_leaf_spot_test.24.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.929)margin: 0.884
Sample: angular_leaf_spot_test.25.jpg
angular_leaf_spot_test.25.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.946)margin: 0.918
Sample: angular_leaf_spot_test.26.jpg
angular_leaf_spot_test.26.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.948)margin: 0.917
Sample: angular_leaf_spot_test.27.jpg
angular_leaf_spot_test.27.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.919)margin: 0.871
Sample: angular_leaf_spot_test.28.jpg
angular_leaf_spot_test.28.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.947)margin: 0.918
Sample: angular_leaf_spot_test.29.jpg
angular_leaf_spot_test.29.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.947)margin: 0.914
Sample: angular_leaf_spot_test.3.jpg
angular_leaf_spot_test.3.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.944)margin: 0.913
Sample: angular_leaf_spot_test.30.jpg
angular_leaf_spot_test.30.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.948)margin: 0.921
Sample: angular_leaf_spot_test.31.jpg
angular_leaf_spot_test.31.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.947)margin: 0.921
Sample: angular_leaf_spot_test.32.jpg
angular_leaf_spot_test.32.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.946)margin: 0.915
Sample: angular_leaf_spot_test.33.jpg
angular_leaf_spot_test.33.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.806)margin: 0.665
Sample: angular_leaf_spot_test.34.jpg
angular_leaf_spot_test.34.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.939)margin: 0.907
Sample: angular_leaf_spot_test.35.jpg
angular_leaf_spot_test.35.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.942)margin: 0.907
Sample: angular_leaf_spot_test.36.jpg
angular_leaf_spot_test.36.jpgacceptedtarget: Angular leaf spot
pred: Bean rust (0.939)margin: 0.901
Sample: angular_leaf_spot_test.37.jpg
angular_leaf_spot_test.37.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.945)margin: 0.916
Sample: angular_leaf_spot_test.38.jpg
angular_leaf_spot_test.38.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.924)margin: 0.876
Sample: angular_leaf_spot_test.39.jpg
angular_leaf_spot_test.39.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.923)margin: 0.871
Sample: angular_leaf_spot_test.4.jpg
angular_leaf_spot_test.4.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.933)margin: 0.889
Sample: angular_leaf_spot_test.40.jpg
angular_leaf_spot_test.40.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.947)margin: 0.915
Sample: angular_leaf_spot_test.41.jpg
angular_leaf_spot_test.41.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.944)margin: 0.914
Sample: angular_leaf_spot_test.42.jpg
angular_leaf_spot_test.42.jpgacceptedtarget: Angular leaf spot
pred: Bean rust (0.937)margin: 0.893
Sample: angular_leaf_spot_test.5.jpg
angular_leaf_spot_test.5.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.935)margin: 0.898
Sample: angular_leaf_spot_test.6.jpg
angular_leaf_spot_test.6.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.938)margin: 0.904
Sample: angular_leaf_spot_test.7.jpg
angular_leaf_spot_test.7.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.939)margin: 0.903
Sample: angular_leaf_spot_test.8.jpg
angular_leaf_spot_test.8.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.943)margin: 0.912
Sample: angular_leaf_spot_test.9.jpg
angular_leaf_spot_test.9.jpgacceptedtarget: Angular leaf spot
pred: Angular leaf spot (0.944)margin: 0.914
Sample: bean_rust_test.0.jpg
bean_rust_test.0.jpgacceptedtarget: Bean rust
pred: Bean rust (0.940)margin: 0.905
Sample: bean_rust_test.1.jpg
bean_rust_test.1.jpgacceptedtarget: Bean rust
pred: Bean rust (0.948)margin: 0.920
Sample: bean_rust_test.10.jpg
bean_rust_test.10.jpgacceptedtarget: Bean rust
pred: Bean rust (0.923)margin: 0.883
Sample: bean_rust_test.11.jpg
bean_rust_test.11.jpgacceptedtarget: Bean rust
pred: Bean rust (0.947)margin: 0.918
Sample: bean_rust_test.12.jpg
bean_rust_test.12.jpgacceptedtarget: Bean rust
pred: Bean rust (0.952)margin: 0.925
Sample: bean_rust_test.13.jpg
bean_rust_test.13.jpgacceptedtarget: Bean rust
pred: Bean rust (0.940)margin: 0.906
Sample: bean_rust_test.14.jpg
bean_rust_test.14.jpgacceptedtarget: Bean rust
pred: Bean rust (0.946)margin: 0.917
Sample: bean_rust_test.15.jpg
bean_rust_test.15.jpgacceptedtarget: Bean rust
pred: Bean rust (0.843)margin: 0.708
Sample: bean_rust_test.16.jpg
bean_rust_test.16.jpgacceptedtarget: Bean rust
pred: Bean rust (0.950)margin: 0.925
Sample: bean_rust_test.17.jpg
bean_rust_test.17.jpgacceptedtarget: Bean rust
pred: Bean rust (0.937)margin: 0.894
Sample: bean_rust_test.18.jpg
bean_rust_test.18.jpgacceptedtarget: Bean rust
pred: Bean rust (0.945)margin: 0.918
Sample: bean_rust_test.19.jpg
bean_rust_test.19.jpgacceptedtarget: Bean rust
pred: Bean rust (0.939)margin: 0.908
Sample: bean_rust_test.2.jpg
bean_rust_test.2.jpgacceptedtarget: Bean rust
pred: Bean rust (0.942)margin: 0.908
Sample: bean_rust_test.20.jpg
bean_rust_test.20.jpgacceptedtarget: Bean rust
pred: Bean rust (0.941)margin: 0.911
Sample: bean_rust_test.21.jpg
bean_rust_test.21.jpgacceptedtarget: Bean rust
pred: Bean rust (0.937)margin: 0.898
Sample: bean_rust_test.22.jpg
bean_rust_test.22.jpgacceptedtarget: Bean rust
pred: Bean rust (0.897)margin: 0.826
Sample: bean_rust_test.23.jpg
bean_rust_test.23.jpgacceptedtarget: Bean rust
pred: Bean rust (0.946)margin: 0.913
Sample: bean_rust_test.24.jpg
bean_rust_test.24.jpgacceptedtarget: Bean rust
pred: Bean rust (0.923)margin: 0.869
Sample: bean_rust_test.25.jpg
bean_rust_test.25.jpgacceptedtarget: Bean rust
pred: Bean rust (0.944)margin: 0.914
Sample: bean_rust_test.26.jpg
bean_rust_test.26.jpgacceptedtarget: Bean rust
pred: Bean rust (0.949)margin: 0.919
Sample: bean_rust_test.27.jpg
bean_rust_test.27.jpgacceptedtarget: Bean rust
pred: Bean rust (0.931)margin: 0.893
Sample: bean_rust_test.28.jpg
bean_rust_test.28.jpgacceptedtarget: Bean rust
pred: Bean rust (0.947)margin: 0.920
Sample: bean_rust_test.29.jpg
bean_rust_test.29.jpgacceptedtarget: Bean rust
pred: Bean rust (0.950)margin: 0.923
Sample: bean_rust_test.3.jpg
bean_rust_test.3.jpgacceptedtarget: Bean rust
pred: Bean rust (0.933)margin: 0.897
Sample: bean_rust_test.30.jpg
bean_rust_test.30.jpgacceptedtarget: Bean rust
pred: Bean rust (0.866)margin: 0.761
Sample: bean_rust_test.31.jpg
bean_rust_test.31.jpgacceptedtarget: Bean rust
pred: Bean rust (0.945)margin: 0.910
Sample: bean_rust_test.32.jpg
bean_rust_test.32.jpgacceptedtarget: Bean rust
pred: Bean rust (0.948)margin: 0.915
Sample: bean_rust_test.33.jpg
bean_rust_test.33.jpgacceptedtarget: Bean rust
pred: Bean rust (0.923)margin: 0.880
Sample: bean_rust_test.34.jpg
bean_rust_test.34.jpgacceptedtarget: Bean rust
pred: Bean rust (0.950)margin: 0.922
Sample: bean_rust_test.35.jpg
bean_rust_test.35.jpgacceptedtarget: Bean rust
pred: Bean rust (0.944)margin: 0.912
Sample: bean_rust_test.36.jpg
bean_rust_test.36.jpgacceptedtarget: Bean rust
pred: Bean rust (0.868)margin: 0.754
Sample: bean_rust_test.37.jpg
bean_rust_test.37.jpgacceptedtarget: Bean rust
pred: Bean rust (0.927)margin: 0.880
Sample: bean_rust_test.38.jpg
bean_rust_test.38.jpgacceptedtarget: Bean rust
pred: Bean rust (0.949)margin: 0.921
Sample: bean_rust_test.39.jpg
bean_rust_test.39.jpgacceptedtarget: Bean rust
pred: Bean rust (0.927)margin: 0.886
Sample: bean_rust_test.4.jpg
bean_rust_test.4.jpgacceptedtarget: Bean rust
pred: Bean rust (0.945)margin: 0.916
Sample: bean_rust_test.40.jpg
bean_rust_test.40.jpgacceptedtarget: Bean rust
pred: Bean rust (0.947)margin: 0.918
Sample: bean_rust_test.41.jpg
bean_rust_test.41.jpgacceptedtarget: Bean rust
pred: Bean rust (0.948)margin: 0.918
Sample: bean_rust_test.42.jpg
bean_rust_test.42.jpgacceptedtarget: Bean rust
pred: Bean rust (0.899)margin: 0.839
Sample: bean_rust_test.5.jpg
bean_rust_test.5.jpgacceptedtarget: Bean rust
pred: Bean rust (0.930)margin: 0.893
Sample: bean_rust_test.6.jpg
bean_rust_test.6.jpgacceptedtarget: Bean rust
pred: Bean rust (0.901)margin: 0.848
Sample: bean_rust_test.7.jpg
bean_rust_test.7.jpgacceptedtarget: Bean rust
pred: Bean rust (0.925)margin: 0.879
Sample: bean_rust_test.8.jpg
bean_rust_test.8.jpgacceptedtarget: Bean rust
pred: Bean rust (0.943)margin: 0.908
Sample: bean_rust_test.9.jpg
bean_rust_test.9.jpgacceptedtarget: Bean rust
pred: Bean rust (0.945)margin: 0.908
Sample: healthy_test.0.jpg
healthy_test.0.jpgacceptedtarget: Healthy
pred: Healthy (0.959)margin: 0.936
Sample: healthy_test.1.jpg
healthy_test.1.jpgacceptedtarget: Healthy
pred: Healthy (0.957)margin: 0.934
Sample: healthy_test.10.jpg
healthy_test.10.jpgacceptedtarget: Healthy
pred: Healthy (0.809)margin: 0.647
Sample: healthy_test.11.jpg
healthy_test.11.jpgacceptedtarget: Healthy
pred: Healthy (0.956)margin: 0.928
Sample: healthy_test.12.jpg
healthy_test.12.jpgacceptedtarget: Healthy
pred: Healthy (0.958)margin: 0.936
Sample: healthy_test.13.jpg
healthy_test.13.jpgacceptedtarget: Healthy
pred: Healthy (0.940)margin: 0.909
Sample: healthy_test.14.jpg
healthy_test.14.jpgacceptedtarget: Healthy
pred: Healthy (0.958)margin: 0.937
Sample: healthy_test.15.jpg
healthy_test.15.jpgacceptedtarget: Healthy
pred: Healthy (0.960)margin: 0.939
Sample: healthy_test.16.jpg
healthy_test.16.jpgacceptedtarget: Healthy
pred: Healthy (0.952)margin: 0.925
Sample: healthy_test.17.jpg
healthy_test.17.jpgacceptedtarget: Healthy
pred: Healthy (0.954)margin: 0.930
Sample: healthy_test.18.jpg
healthy_test.18.jpgacceptedtarget: Healthy
pred: Healthy (0.958)margin: 0.936
Sample: healthy_test.19.jpg
healthy_test.19.jpgacceptedtarget: Healthy
pred: Healthy (0.958)margin: 0.936
Sample: healthy_test.2.jpg
healthy_test.2.jpgacceptedtarget: Healthy
pred: Healthy (0.959)margin: 0.939
Sample: healthy_test.20.jpg
healthy_test.20.jpgacceptedtarget: Healthy
pred: Healthy (0.957)margin: 0.933
Sample: healthy_test.21.jpg
healthy_test.21.jpgacceptedtarget: Healthy
pred: Healthy (0.960)margin: 0.939
Sample: healthy_test.22.jpg
healthy_test.22.jpgacceptedtarget: Healthy
pred: Healthy (0.957)margin: 0.936
Sample: healthy_test.23.jpg
healthy_test.23.jpgacceptedtarget: Healthy
pred: Healthy (0.959)margin: 0.937
Sample: healthy_test.24.jpg
healthy_test.24.jpgacceptedtarget: Healthy
pred: Healthy (0.837)margin: 0.698
Sample: healthy_test.25.jpg
healthy_test.25.jpgacceptedtarget: Healthy
pred: Healthy (0.955)margin: 0.931
Sample: healthy_test.26.jpg
healthy_test.26.jpgacceptedtarget: Healthy
pred: Healthy (0.960)margin: 0.939
Sample: healthy_test.27.jpg
healthy_test.27.jpgacceptedtarget: Healthy
pred: Healthy (0.940)margin: 0.906
Sample: healthy_test.28.jpg
healthy_test.28.jpgacceptedtarget: Healthy
pred: Healthy (0.951)margin: 0.924
Sample: healthy_test.29.jpg
healthy_test.29.jpgacceptedtarget: Healthy
pred: Healthy (0.959)margin: 0.939
Sample: healthy_test.3.jpg
healthy_test.3.jpgacceptedtarget: Healthy
pred: Healthy (0.959)margin: 0.938
Sample: healthy_test.30.jpg
healthy_test.30.jpgacceptedtarget: Healthy
pred: Healthy (0.946)margin: 0.911
Sample: healthy_test.31.jpg
healthy_test.31.jpgacceptedtarget: Healthy
pred: Healthy (0.959)margin: 0.938
Sample: healthy_test.32.jpg
healthy_test.32.jpgacceptedtarget: Healthy
pred: Healthy (0.958)margin: 0.935
Sample: healthy_test.33.jpg
healthy_test.33.jpgacceptedtarget: Healthy
pred: Healthy (0.959)margin: 0.939
Sample: healthy_test.34.jpg
healthy_test.34.jpgacceptedtarget: Healthy
pred: Healthy (0.957)margin: 0.932
Sample: healthy_test.35.jpg
healthy_test.35.jpgabstainedtarget: Healthy
pred: Bean rust (0.627)margin: 0.303
Sample: healthy_test.36.jpg
healthy_test.36.jpgacceptedtarget: Healthy
pred: Healthy (0.935)margin: 0.902
Sample: healthy_test.37.jpg
healthy_test.37.jpgacceptedtarget: Healthy
pred: Healthy (0.960)margin: 0.939
Sample: healthy_test.38.jpg
healthy_test.38.jpgacceptedtarget: Healthy
pred: Healthy (0.960)margin: 0.940
Sample: healthy_test.39.jpg
healthy_test.39.jpgacceptedtarget: Healthy
pred: Healthy (0.960)margin: 0.939
Sample: healthy_test.4.jpg
healthy_test.4.jpgacceptedtarget: Healthy
pred: Healthy (0.957)margin: 0.934
Sample: healthy_test.40.jpg
healthy_test.40.jpgacceptedtarget: Healthy
pred: Healthy (0.926)margin: 0.889
Sample: healthy_test.41.jpg
healthy_test.41.jpgacceptedtarget: Healthy
pred: Healthy (0.953)margin: 0.927
Sample: healthy_test.5.jpg
healthy_test.5.jpgacceptedtarget: Healthy
pred: Healthy (0.958)margin: 0.936
Sample: healthy_test.6.jpg
healthy_test.6.jpgacceptedtarget: Healthy
pred: Healthy (0.952)margin: 0.925
Sample: healthy_test.7.jpg
healthy_test.7.jpgacceptedtarget: Healthy
pred: Healthy (0.953)margin: 0.929
Sample: healthy_test.8.jpg
healthy_test.8.jpgacceptedtarget: Healthy
pred: Healthy (0.957)margin: 0.935
Sample: healthy_test.9.jpg
healthy_test.9.jpgacceptedtarget: Healthy
pred: Healthy (0.951)margin: 0.920

Same model, different runtime

This report measures the serving stack as it is deployed, which is PyTorch. The runtime benchmark runs the identical weights through PyTorch and ONNXRuntime in separate processes and checks per-sample probability parity, so the export path is measured rather than assumed.