Skip to content

Investigate missed inference on some nodes (root causes + mitigation) #820

Open @tcharchian opened 2026-02-27 21:13 UTC 3 comments Updated 2026-10-17 16:42 UTC
bug help wanted up-for-grabs Priority: High

Discussed in https://github.com/gonka-ai/gonka/discussions/817

Originally posted by **tcharchian** February 27, 2026 Task: Some nodes experience missed inference events. Likely multi-cause, needs community participation.

💬 Comments (3)

@AlexeySamosadov commented 2026-03-03 10:27 UTC

PR: https://github.com/gonka-ai/gonka/pull/843

@Mayveskii commented 2026-03-06 14:25 UTC

Measured data from live network may help narrow root causes here.

Epochs 161–191, 2,503,595 inferences: Miss rate: 3.25% (81,360 misses) Completion rate: mean 90.4%, σ=7.4%, range 72–99%

The σ=7.4% variance is the signal — not the mean. Some nodes miss 28% of assigned inferences while others miss 1%. GetRandomExecutor routes to both equally regardless.

Phase 4 of GiP #860 proposes GetQualityWeightedExecutor — routes traffic proportional to L9 completion rate. Projection: σ ↓40% as high-miss nodes receive less traffic and face economic incentive to improve.

Design + data: docs/specs/inference-quality-protocol.md (PR #859 branch) Discussion: #860

@gafrustam commented 2026-10-17 16:42 UTC

Is this issue still relevant after PR #943 and PR #859 were merged, or are there remaining edge cases to investigate?

🔄 Auto-synced from Issue #820 every hour.