| | First Looking into Jax (gilesthomas.com) |
| 3 points by gpjt 1 day ago | past | discuss |
|
| | 10Gb/s Ethernet: using mini-heatsinks with a 10GBASE-T SFP+ module (gilesthomas.com) |
| 1 point by ibobev 12 days ago | past | discuss |
|
| | 10Gb/s Ethernet: using mini-heatsinks with a 10GBASE-T SFP+ module (gilesthomas.com) |
| 3 points by gpjt 13 days ago | past | discuss |
|
| | 10Gb/s Ethernet: what I did to get it working in my home (gilesthomas.com) |
| 232 points by gpjt 32 days ago | past | 177 comments |
|
| | 10Gb Ethernet: what I had to (re)learn (gilesthomas.com) |
| 2 points by ibobev 32 days ago | past |
|
| | 10Gb Ethernet: what I had to (re)learn (gilesthomas.com) |
| 1 point by gpjt 33 days ago | past | 1 comment |
|
| | LLM from scratch, part 33 – what I learned from the appendices (gilesthomas.com) |
| 5 points by gpjt 39 days ago | past |
|
| | LLM from scratch (32l) – Interventions: updated instruction fine-tuning results (gilesthomas.com) |
| 1 point by gpjt 41 days ago | past |
|
| | An LLM becomes more coherent as we train it (gilesthomas.com) |
| 1 point by ibobev 43 days ago | past |
|
| | How an LLM becomes more coherent as we train it (gilesthomas.com) |
| 3 points by gpjt 44 days ago | past |
|
| | LLM from scratch, part 32k – Interventions: gradient accumulation (gilesthomas.com) |
| 2 points by gpjt 46 days ago | past |
|
| | Interventions: Trying to train a better model in the cloud (gilesthomas.com) |
| 1 point by ibobev 51 days ago | past |
|
| | LLM from scratch, part 32j – trying to train a better model in the cloud (gilesthomas.com) |
| 2 points by gpjt 52 days ago | past |
|
| | Writing an LLM from scratch, part 32i – Interventions: what is in the noise? (gilesthomas.com) |
| 2 points by ibobev 53 days ago | past |
|
| | Writing an LLM from scratch, part 32i – Interventions: what is in the noise? (gilesthomas.com) |
| 1 point by gpjt 54 days ago | past |
|
| | Writing an LLM from scratch, part 32h – Interventions: full fat float32 (gilesthomas.com) |
| 2 points by ibobev 55 days ago | past |
|
| | Writing an LLM from scratch, part 32h – Interventions: full fat float32 (gilesthomas.com) |
| 7 points by gpjt 58 days ago | past |
|
| | Automating starting Lambda Labs instances (gilesthomas.com) |
| 2 points by ibobev 58 days ago | past |
|
| | Writing an LLM from scratch, part 32g – Interventions: weight tying (gilesthomas.com) |
| 2 points by ibobev 67 days ago | past |
|
| | Writing an LLM from scratch, part 32g – Interventions: weight tying (gilesthomas.com) |
| 2 points by gpjt 68 days ago | past |
|
| | Writing an LLM from scratch, part 32f – Interventions: weight decay (gilesthomas.com) |
| 6 points by gpjt 69 days ago | past |
|
| | Writing an LLM from scratch, part 32e – Interventions: the learning rate (gilesthomas.com) |
| 3 points by ibobev 76 days ago | past |
|
| | Writing an LLM from scratch, part 32e – Interventions: the learning rate (gilesthomas.com) |
| 3 points by gpjt 82 days ago | past |
|
| | Writing an LLM from scratch, part 32a – Interventions: training a baseline model (gilesthomas.com) |
| 3 points by ibobev 3 months ago | past |
|
| | Writing an LLM from scratch, part 32B – Interventions: gradient clipping (gilesthomas.com) |
| 1 point by ibobev 3 months ago | past |
|
| | Writing an LLM from scratch, part 32c – Interventions: removing dropout (gilesthomas.com) |
| 1 point by ibobev 3 months ago | past |
|
| | Writing an LLM from scratch, part 32d – Interventions: adding attention bias (gilesthomas.com) |
| 1 point by ibobev 3 months ago | past |
|
| | Writing an LLM from scratch, part 32d – Interventions: adding attention bias (gilesthomas.com) |
| 6 points by gpjt 3 months ago | past |
|
| | Writing an LLM from scratch, part 32c – Interventions: removing dropout (gilesthomas.com) |
| 1 point by gpjt 3 months ago | past |
|
| | Writing an LLM from scratch, part 32B – Interventions: gradient clipping (gilesthomas.com) |
| 2 points by gpjt 3 months ago | past |
|
|
| More |
