Nice article related to the last point (nearly orthogonal vectors): https://tran...

		rahimnathwani 7 months ago \| parent \| context \| favorite \| on: Embeddings are underrated (2024) Nice article related to the last point (nearly orthogonal vectors): https://transformer-circuits.pub/2022/toy_model/index.html