Karpathy recently did an interview where he says that the future of AI is 1b models and I honestly believe him. The small models are getting better and better, and it’s going to end up decentralizing power moreso than anything else