Skip to content

Define changes in the API container for smooth migration #731

Closed @tcharchian opened 2026-02-11 01:28 UTC 3 comments Updated 2026-03-11 19:54 UTC

(empty)

💬 Comments (3)

@tamazgadaev commented 2026-03-02 01:18 UTC
  • Fix the 400/422 issue in API container
  • Adjust thresholds a little bit (onchain, not API)
  • Do one of the two: a) ignore -9999 logprobs in validation b) enforce top_p and top_k in requests (a) preferred)
@tamazgadaev commented 2026-03-03 03:06 UTC

Actually, we don't strictly need any of these 3 for smooth migration. 1 is desirable, 2 nice to have (and we'll get the threshold values), 3 is not needed

@gmorgachev commented 2026-03-11 19:54 UTC

i think we need to close this one. fix 400/422 is independent bug to fix

🔄 Auto-synced from Issue #731 every hour.