genuinely what's the point of this comment? are you allergic to cool stuff? honestly curious as to what you were trying to achieve by this comment.

nowhere in this post does the author say that it's ready with the current state of models, or he'd use a foundation model for this. why the hate?

what's the cost difference between groq/cerebras vs using something else for inferencing open source models? I'm guessing the speed comes at a cost?

0.6/1$ per M tokens in groq/cerebras vs 0.3$ per M tokens in deepinfra (for llama 3.3 70b)

But note the free tiers for groq and cerebras are very generous.

I don't know off the top of my head, only played with it a little not seriously.

fair enough

i think lots of apps are going to go in the adaptive/generate ui direction - even if it starts a lot simpler than generating the code

Perhaps an UI passed on a Salvador Dali painting - perhaps we should also be questioning our UI concepts of slider, button, window and co.

would you be willing to pay for something that essentially is google inbox - but a separate web view client with more personalization/better search?

are you using whisper at the backend

Would people be willing to pay for a gmail plugin that takes a stab at combatting ai email spam? something like Mailman [1] but with an LLM layer for detecting AI slop?

[1]: https://mailmanhq.com/

Would you be willing to pay for a gmail plugin that takes a stab at this? something like Mailman [1] but with an LLM layer for detecting AI slop?

[1]: https://mailmanhq.com/

Could you name some?

I agree on the most part, but I still think some pretty cool games can come up with local LLMs. Suck up for example, though not local afaik, is a pretty cool one.

Was playing around with this model - why does it return 2 or 3 responses when I ask it for one? I asked it for a json response and it generates 2 or 3 at a time. What's with this.