Hacker Newsnew | past | comments | ask | show | jobs | submit | jononor's commentslogin

Dynamic routing is the usual name for the piece that orchestrates which LLM will be used, based on query complexity. There in an open source implementation as part of the vLLM project (and probably others), it is a field of active research in several universities and labs. It is also suspected that the frontier LLM providers might already be doing something like it behind the covers.

Having local AI as a credible threat will keep them on their toes. Which will benefit consumers a lot.

Hardware sales would be an excellent business model for open weights. Nvidia is already on it with their Nemotron models. Any new LLM/NPU hardware companies would want to so the same, if noone else does it for them (Chinese labs currently do).

Selling managed self-hosting solutions would be another. That is the business of that recent American company.

Selling fine-tuning services or similar adaptations is another. That is what Unsloth is going for, I believe.

Most likely any sound business strategy is going to be of "commoditize your compliments" type. There are many complementary products to open-weight - some probably not invented/discovered yet.


Where/how did you buy your DDR4 from SZ? Interested in doing the same, but want reputable source/supplier.

The seller was Focus Memory on Newegg, DIMMs are Rimlance. It arrived quickly via DHL. I'd be a little sketched out to do this if it wasn't registered ECC. The dies appear to be Micron, register IDT, but there is some possibility of soft fraud where they die printed over something. The registers look a little scratched so I wonder if they found some way of recycling DIMMs or even dies. The SPD is their own.

# dmidecode 3.7 # SMBIOS entry point at 0xba970000 Found SMBIOS entry point in EFI, reading table from /dev/mem. SMBIOS 3.3.0 present.

Handle 0x0023, DMI type 16, 23 bytes Physical Memory Array Location: System Board Or Motherboard Use: System Memory Error Correction Type: Multi-bit ECC Maximum Capacity: 1 TiB Error Information Handle: 0x0022 Number Of Devices: 8

Handle 0x0027, DMI type 17, 92 bytes Memory Device Array Handle: 0x0023 Error Information Handle: 0x0026 Total Width: 72 bits Data Width: 64 bits Size: 32 GiB Form Factor: DIMM Set: None Locator: DIMM5 Bank Locator: BANK4 Type: DDR4 Type Detail: Synchronous Registered (Buffered) Speed: 3200 MT/s Manufacturer: Unknown Serial Number: 05A23401 Asset Tag: Not Specified Part Number: RRD25600D4C8K256 Rank: 2 Configured Memory Speed: 3200 MT/s Minimum Voltage: 1.2 V Maximum Voltage: 1.2 V Configured Voltage: 1.2 V Memory Technology: DRAM Memory Operating Mode Capability: Volatile memory Firmware Version: Unknown Module Manufacturer ID: Bank 1, Hex 0x80 Module Product ID: Unknown Memory Subsystem Controller Manufacturer ID: Unknown Memory Subsystem Controller Product ID: Unknown Non-Volatile Size: None Volatile Size: 32 GiB Cache Size: None Logical Size: None ...


Super info, thanks!

That is not at all the intention of the ARC team. By ARC teams definition, passing any single ARC-AGI benchmark does not mean that AGI has been achieved. Instead, AGI would be considered achieved when we are no longer able to come up with new benchmarks that the AI systems do not immediately do well on.

Partitioning is not all that expensive. It is definitely worth testing for your specific workload. We use TimescaleDB, which relies heavily on postgres partitions, have a bit under 100 million rows in our active set (last 90 days), across 120 partitions (device*time), and it works nicely. Over 100 partitions is probably a bit many for this workload, but since it works OK we have not changed it.

YouTubes biggest moat the last 10 years is probably more that all the viewers and creators are already there. Any competitor has a huge disadvantage - creators are not interested in a place without viewers, and viewers not in a place without creators/content.

yeah, network effect is real, and you cannot get viewers without competitive video delivery, so perhaps the moat is more like having an ocean on both sides

Network effect means it will be a huge and risky undertaking, and one needs to solve the bootstrap problem. But the costs of video delivery means that one would have to burn serious cash in the meantime. So it works in tandem.

TikTok kinda did manage to make a dent though - I suspect it substitutes for YouTube in some cases (though not all).


With enough tokens, all bugs are shallow? :D


Yep that is annoying. There are USB-C magnetic charge adapters. It will prevent shit from getting into the slot, and easy to charge magsafe style. And of course you can easily take it out temporarily to use a standard USBC charging cable.


Time to migrate off Atlassian, and ban it for any use in the company. You cannot just help yourself to customer data like that. The data is not yours, never was, and never will be. Pay for a service that blatantly rips of our company IP? Nope.

Thanks for showing your colors so clearly Atlassian. Good riddance.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: