A deep dive into on-device vs. data center inference for robots, including a primer on robot models, deployments, supply chains, the “network wall”, and more
Robot Models, Silicon & DRAM Efficiency, Jetson Thor vs. B300 TCO, Deployments, The Network Wall — Ivan Chiam, Gianluca, Zane Fong, and 3 others
A detailed look at Jalapeño, OpenAI's ASIC developed with Broadcom in 16 months, which beat Nvidia, AMD, and Google chips on multiple top open-weight models
OpenAI's self-designed ASIC compared with Rubin, Jalapeño's TCO, throughput per MW, and spicy deets
How luxury brands' stiffest competition is coming from secondhand online resellers like The RealReal and Fashionphile, driven by Gen Z and millennial consumers
Carol Ryan / Wall Street Journal : X: @contrariancurse , @michaelmiraflor , and @buccocapital X: @contrariancurse : A cool thing about high luxury goods is that TCO decreases at the very highest end ...
A deep dive into Amazon's Trainium2, which shows the company is on a path to eventually providing competitive custom AI chips, especially for LLM inference
- Trn2, Trn2-Ultra, Performance, Software, NeuronLinkv3, EFAv3, TCO, 3D Torus, Networking Costs, Supply Chain — AWS Trainium1 / Inferentia2 GenAI Weakness
Meta details Llama 3: 8B- and 70B-parameter models, a focus on reducing false refusals, and an upcoming model trained on 15T+ tokens that has 400B+ parameters
What To Know About ‘Llama 3’ Model Marcus Gopolang Moloko / Memeburn : Meta AI with built in Llama 3 is on WhatsApp in South Africa Hamsat Abdurasheed / News.ng : Meta releases Llama 3, new AI assista...