[P2] URLs with `/chat/completions` and `/completions` for Open Router #558
Provide a minimal but verifiable example that demonstrates Gonka’s inference capability via standard OpenAI-compatible endpoints, suitable for validation and review by openrouter.ai. We need to run a simple inference and provide publicly accessible URLs for the following endpoints:
- /completions
- /chat/completions
These endpoints are required for listing Gonka as an inference vendor on openrouter.ai.
Requirements - The inference should be very simple (e.g. a basic prompt like asking about the weather). - The URLs must return real inference results, not mock data.
Inference logs for the provided URLs must: - Be readable - Remain accessible for a reasonably long period of time - Just a minimal, clear demonstration of how to query the API
Must be openAI-compliant and return usage for both stream and non-stream
- include pricing models endpoint
Before implementation, please review OpenRouter documentation and any relevant provider integration requirements. This will help ensure full compatibility and avoid iteration during validation.
💬 Comments (3)
Should it work with no "request signing" needed? With "api key" requests? Do we have requirements from them? @kotelnikova @tcharchian
After review https://github.com/gonka-ai/gonka/pull/614, the merge is temporarily paused. A community broker must be identified to serve as an intermediary between OpenRouter and Gonka. Once that structure is defined, the required adjustments on the integration side will become clearer.
In particular, this will determine whether separate endpoints (for example, with /openrouter in the address) are necessary, or whether a different architectural approach would be more appropriate.
Further feedback and next steps will be shared once the broker setup is clarified.
cc: @libermans @kotelnikova @x0152
🔄 Auto-synced from Issue #558 every hour.
@x0152 feel free to ask @kotelnikova any questions here as well