It’s probably something like deepseek’s native sparse attention with content based granularity. They might not be publishing anything because it’s not such a strong value proposition and doing so would lead to commentary that would tank their investment opportunities.
There's ways and means. Pushing something out in the sub-30B range would gain them mindshare and they could keep bigger models to themselves. I can't see any indication of what size their model is though.
> why would SGD put the right things in the right bucket?
Think of it as a best fit curve and exceptions to that curve. The noise is essentially this set of exceptions that move points away from where they would otherwise fall on the curve.
Gradient descent wants to be able to make the smallest change that moves the most data points towards the curve. To do this it learns an arrangement where it can change, say, one parameter and have a bunch of points move at once. What does this correspond to? The big common patterns shared by many data points.
Most of the capacity gets soaked up modelling these sorts of common patterns, and after they have been learned the model starts adding exceptions that allow individual points to deviate from the curve.
Because they’re exceptions, they must not impact neighbouring points, or at least only ones within a very short distance from them. Otherwise they’re now driving the error higher by impacting more points than they should. So you end up with very narrow ranges of features that are able to trigger different sorts of noise.
How narrow they are is shaped by the training data, they’re exactly as narrow as needed not to raise the error, so assuming the total population has the same distribution, they don’t get hit. Much.
Well that would be silly. I would hope the diabetic would go to a nutritionist for their physical and medical problem. But a social problem is something that should probably be fixed with a social solution
There’s a lot of energy in this thread mixing up introversion and autism for an inability to relate to others. That’s not true you just have a different perspective and will relate in a different way. Autism might be a proximal cause for anxiety but anxiety is not a feature of autism and it can be overcome.
> HL's engine GoldDrc was originally a mod for Quake.
GoldSrc is based on Quake 1 code with valves own modifications and a little Quake 2 added in, if I remember correctly. I wouldn’t call that a “mod”, they bought a commercial license for the engine and made a game with it.
You’re trying to use this to say that valve are unoriginal? I really don’t think that’s a criticism you can lob at the half life series.
I do not work in robotics, but I would also like to thank you for listening to your conscience and resigning. The world needs more people like you. I hope your venture goes well!
This saddens me as well, because that's the type of thing that happens every day where I live, but...
> I don’t understand why it is allowed to continue.
The answer is even sadder. It's even worse. And it is as follows: because there's not enough people who are taking action, and from those taking action there's not enough people in power to change something significantly. At least that's how I see it. And... I can't even blame those who don't take action - because many people feel completely powerless, they feel like "what you can do to stop this war/other thing if you're just a regular human?"
There's also a huge cost for taking action about this especially in the US. You can easily get thrown out of school, have your career destroyed or be deported.
This. There are entire groups dedicated to rooting out any sign of deviation from per-authorized storyline and verbiage. It is particularly striking given that US considers itself 'free speech' bastion.
This is mostly a US thing. Netanyahu and Putin are two war criminals according to International Court of Justice. Although Trump threatened the ICJ, this doesn't change that basic fact.
Already in 2002 US passed the "American Service-Members' Protection Act" that allows USA to deploy military to prevent U.S. or allied officials and military personnel from being prosecuted or detained by the ICC.
It passed via bypartisan vote well in time before US launched the illegal invasion of Iraq in which it committed various war crimes.
This goes beyond direct action by individuals, it’s completely obvious what’s happening and it happens because the US political system has been captured.
I haven’t paid any attention to the mission, and there’s something about the framing of this article that I don’t like, as if it’s talking about a soap opera or reality TV or something. It just rubs me up the wrong way.
I agree. Even though I thought this mission was interesting, to me the article massively overstates everything. NASA and the crew is SO amazingly competent, the world in recent years is SO totally devoid of competency, everyone has been thirsting for the sense of AWE that we are ALL feeling (or should be feeling now, let me list the reasons!), etc.
To me, this was irritating. True competency and things that inspire real awe encapsulate “res ipsa loquitur” — they speak for themselves. Having some internet influencer try to hype me into getting awed, and implying that “we all” are feeling a certain way as she channels our collective zeitgeist is tiresome.
And personally, IMO although the mission was nice, it wasn’t groundbreaking technically or particularly awe-inspiring.
Ironically, I left feeling a tiny bit disappointed: if everyone is truly thinking this mission is the height of awesomeness or competency, we have a low-ish bar.
I bet that when the old-timers with their starched white shirts, pocket protectors, and horn-rimmed glasses that did the 60s missions got together to watch 2026 Artemis they privately had a good laugh about how little state-of-the-art has progressed.
For what it’s worth Dan, you’re probably the best moderator I’ve ever encountered, and without you HN likely wouldn’t be worth visiting. As it is it’s one of the best places for online discourse. That’s directly because of you and your efforts.
It’s not easy to be a cop, and that’s basically what you are around here, but thank you for doing it.
Just take a second to consider this: if HN, probably one of the less reactionary places on the internet, and one of the most capitalist-friendly, is this angry at this point, before the mass job losses even start, what in the name of God do you think the general public is going to be like when they’ve been going on for years?
If nothing else there’s a serious self-preservation incentive for AI CEOs to sort something out that doesn’t get them lynched, because it’s not looking good.
Maybe HN is particularly upset because they feel targeted, given that overpaid tech executives have been giddily making the claim that programming jobs will disappear any minute now. What makes it even worse is that it's very obvious that said tech executives haven't programmed in over 10 years, if ever, and don't know anything about the technology they are selling. They are putting jobs at risk purely for the sake of personal enrichment.
This is probably combined with a general sense of AI fatigue. The population as a whole is getting tired of "AI slop" and companies trying to shoehorn "AI" into everything. Personally I'm also tired of every startup needing to be an AI startup. As if there was nothing else worth building or investing in. It's sucking the air out of the room.
reply