Looks really nice. I wanted to do exactly this with my project Kavita, but have been distracted with other things. I've heard Whisper has great potential and a few of my users have been doing something similar with it.

Look forward to see how this project matures. We need more options in the book reading scene that are self-hosted and not Calibre.