A look at MatX, which was founded by ex-Google engineers, has raised $25M, and hopes to design chips that are 10x faster than Nvidia's GPUs at training LLMs
Introducing MatX: we design hardware tailored for LLMs, to deliver an order of magnitude more computing power so AI labs can make their models an order of magnitude smarter. Our hardware would make it possible to train GPT-4 and run ChatGPT, but on the budget of a small startup..…
We're going to need much more innovation in silicon to power the global compute rollout that AI will require, and the MatX team is among the very best in the world at this.
“The MatX founders are symbolic of a trend in our AI world...because they're “taking some of the best ideas developed at some of the largest companies, which are a little bit too slow-moving and too bureaucratic, and commercializing them on their own.” https://www.bloomberg.com/.…