This is exactly what I’m building at https://www.get-vox.com - it automatically detects your local models installed via Ollama.

It is fast, native and cross-platform (built with Qt using C++ and QML).