if the ai is the product, and the product isnt trustable, isnt that a product issue??

It’s a core technology issue.

The AI isn’t the product, e.g. the ChatGPT interface is the main product that is layered above the core AI tech.

The issue is trustworthiness isn’t solvable by applying standard product management techniques on a predictable schedule. It requires scientific research.

Does a TPU have XLA-graph for GPUs Cuda-graphs? Not sure on TPU theory

TPUs lower XLA into their own instruction set. https://pytorch.org/xla/release/2.3/index.html

Ive noticed the same on extremely small models aswell, magnitude is a positional encoding or a couple tokens, so its easy to grok?

well world model in the context of the tulip fields, so models could be finetuned+sheared to drop size and remain effective

claude.ai

Theres a startup doing that named galileo_ai

Part of an FRC team building a Vision system from scratch, quite fun and nearly complete, just need to recalibrate some angle formulas

I just saw a markdown mode show up today, but only partially, like bold and italics in markdown

not sure if this is just chatgpt, but analogous evolution is interesting to see

Wow, it really does have that sound. I'm trying to figure out exactly what about the phrasing feels that way, while at the same time it doesn't seem like it's as uniformly broken up as most GPT answers are. Of course it could be an edited combo as well.

yes the size is different, but training a diffusion model and a language model are really different, like how RL models can be small but take a long time to train aswell