Does koog support local LLMs on Android or iOS?
I'm using koog on Android and iOS. In the model configuration I can pick from various models, but none of them are local/on-device. Is support for local LLMs planned for these platforms, and when might it arrive?
Originally asked on GitHub: https://github.com/JetBrains/koog/issues/137
1 answer
Open: as of the last update in this thread (June 11, 2025), koog does not support local LLMs on Android or iOS. The issue is a feature request: the model configuration currently offers various models, but none are local. A JetBrains collaborator confirmed that work has started on this, tracked as koog issue #262. They said Android local model support is expected in the release planned for July 1, 2025, and iOS support is expected to follow afterward.
The thread does not contain a workaround or configuration change that enables local models. There is no error message involved and no setup steps to adjust. If you need a local model before the planned release, you would have to wait or use another tool; that is general advice, not something verified in this thread.
Did this work for you?
Related questions
- Does koog support iOS targets in Kotlin Multiplatform projects?
- Koog: can I use tool calls with executeStreaming?
- Does Koog support the A2A Protocol for multi-agent systems?
- koog executeStreaming() missing tools arg: tool calls dropped in streaming responses
- Koog crashes with NoSuchMethodError after kotlinx-datetime 0.7.1