2023-01-17
An under appreciated fact (slightly exaggerated in article below): With current move to @openai Triton, PyTorch 2.0 makes Nvidia software moat a bit weaker. AMD & Intel are working to support Triton, easier than reinventing whole CUDA / Bias stack. https://www.semianalysis.com/ ...
SemiAnalysis
An overview of the ML software development industry over the past decade: a decline of Nvidia's CUDA monopoly, PyTorch overtaking Google's TensorFlow, and more
the CUDA monopoly is nowhere close to being broken and CUDA will continue to be the key dependency for PyTorch. As a data point, Triton isn't the first rally — multiple vendors use...
This is the very reason why we bet on Triton instead of writing custom CUDA code for Kernl library, plus at the end when things do not work you review PTX instructions anyway... The main current advantage of CUDA is certainly maturity, but for how much time... https://twitter.com/...
SemiAnalysis
An overview of the ML software development industry over the past decade: a decline of Nvidia's CUDA monopoly, PyTorch overtaking Google's TensorFlow, and more
the CUDA monopoly is nowhere close to being broken and CUDA will continue to be the key dependency for PyTorch. As a data point, Triton isn't the first rally — multiple vendors use...