The economics for AI chips has to work for Chip builders System builders Data center operators Application builders Paying customer (end users). The bigger large language models are at 400 Gigabytes or more and mixture of experts is at 1.8 terabytes. TechTechPotato interviews AyarLabs and makes the case that optical connections between chiplets is needed …
