I guess it's the classic case of one not being able to outrun a bad diet.
If fueling during the activity stops you from overeating afterwards and possibly allows you to exercise a bit longer it is worth it, even though it seems counter productive.
Also it's not just about running an obviously worse quant.
Running different GPU kernels / inference engines also matters. It's easy to write an implementation that is faster and thus cheaper but numerically much noisier / less accurate.
I mean yes it depends on your definition of humid but if your definition of humid is under 20% RH then that's not in agreement with any other humans on the planet and if it's over 50% RH then no, millions of people are not doing this because they would die. Our bedroom is at 50% RH because under that our baby's skin dries out. There's no way anyone is sitting in a 90 C 50% RH sauna for any appreciable amount of time. They would die.
Haha no, I been in 90c saunas many times. Can I stay there for a long time? Heck no. But some people can and it doesn’t kill you (maybe if you have some preexisting condition)
Aren't mac minis flying for "local models" because people have no clue what they are doing?
All those people who bought them for openclaw just bought them because it was the trendy thing to do. No one of those people is running local models on there.
CUDA was built during the time AMD was focusing every resource on becoming competitive in the CPU market again. Today they dominate the CPU industry - but CUDA was first to market and therefore there's a ton of inertia behind it. Even if ROCm gets very good, it'll still struggle to overcome the vast amount of support (read "moat") CUDA enjoys.
True. After all Nvidia hasn't built tensorflow or PyTorch. That stuff was bound to be built on the first somewhat viable platform. Rocm is probably far ahead of where cuda was back then, but the goal moved.
If fueling during the activity stops you from overeating afterwards and possibly allows you to exercise a bit longer it is worth it, even though it seems counter productive.
reply