Google AI claims PaLM, its 540B parameter, dense decoder-only Transformer model, shows breakthrough capabilities in tasks like language, reasoning, and coding
In recent years, large neural networks trained for language understanding and generation have achieved impressive results across a wide range of tasks.
Google AI Blog
Related Coverage
- Do The Google AI Claims Grow Like a Pinocchio Body Part? Beyond Search · Stephen E. Arnold
- Google talks up its 540-billion-parameter text-generating AI system The Register · Katyanna Quach
- Google introduces Pathways Language Model with 540 Bn parameters Analytics India Magazine · Kartik Wali
- Google AI's Latest 540-Billion Parameter Model (Pathways Language Model Called PaLM) Unlocks New Tasks Proportional To Scale MarkTechPost · Annu Kumari
- Google PaLM Algorithm: Path To Next Generation Search Search Engine Journal · Roger Montti
- Google made an annoying AI that explains why jokes are supposed to be funny ZME Science · Tibi Puiu
Discussion
-
@googleai
@googleai
on x
Introducing the 540 billion parameter Pathways Language Model. Trained on two Cloud #TPU v4 pods, it achieves state-of-the-art performance on benchmarks and shows exciting capabilities like mathematical reasoning, code writing, and even explaining jokes. https://ai.googleblog.com…
-
@ericjang11
Eric Jang
on x
kudos to the animator! imagine if every paper had more artists-in-residence who could explore and create science communication concepts like these. https://twitter.com/...
-
@blader
Siqi Chen
on x
The singularity is approaching. Another huge step function improvement in performance and capability over GPT3. https://ai.googleblog.com/... https://twitter.com/...
-
@backlon
Dieter Bohn
on x
An AI model called PaLM that explains jokes to people sounds like me at parties. (Actually it's smarter because it can decode those emoji riddles that stump me every time) https://ai.googleblog.com/... https://twitter.com/...
-
@zseward
Zach Seward
on x
A neural network explains a pun. https://ai.googleblog.com/... https://twitter.com/...
-
@timsneath
Tim Sneath
on x
When I read this and see what the latest AI models are capable of, I'm as dumbfounded as my great-grandmother would have been by the computers of the last decade. That a computer can discern meaning and respond in this way is unfathomable by me: https://ai.googleblog.com/...
-
@narphorium
Shawn Simister
on x
PaLM-Coder is 540B parameter language model fine-tuned on GitHub data which can automatically fix bugs in code. https://ai.googleblog.com/... https://twitter.com/...
-
@skiminok
@skiminok
on x
Our team at @Theteamatx has collaborated with @GoogleAI on 🌴 PaLM - a single 540B-parameter dense language model for multiple domains & tasks, trained over two TPUv4 Pods. PaLM-Coder is an adaptation of PaLM fine-tuned on code and evaluated on software engineering tasks. 1/ https…
-
@mattshumer_
Matt Shumer
on x
3x bigger than GPT-3! Google's newest model achieves breakthrough performance on many tasks, through a combination of size + architecture improvements. Most importantly: “performance improvements from scale have not yet plateaued”. https://ai.googleblog.com/...
-
@robinhanson
Robin Hanson
on x
A key PaLM limit: in some of its tasks it LOOKS like it is drawing conclusions, but none result in it changing its representation. It learns from data, then does tasks, but doesn't learn FROM doing tasks. Is there a way to make THAT the task? “Read stuff and learn from it.” https…
-
@robinhanson
Robin Hanson
on x
Reading this is giving me an especially strong sense of “I'm living in the future”. When young, I wondered what future would be like. Now that I'm old, I ponder strange wonders like this, & ask what it says re further futures. https://twitter.com/...
-
@elipariser
Eli Pariser
on x
Everyone loves a good joke explanation. https://twitter.com/...
-
@amasad
Amjad Masad
on x
AGI already emerged and its utility function is to maximize parameters. It will turn the entire known universe into TPUs to train ever bigger language models. https://twitter.com/...
-
@jeffdean
Jeff Dean
on x
Excited about this @GoogleAI work on “PaLM: Scaling Language Modeling with Pathways” with many authors. Be sure to check out the accompanying 83 page PDF! https://goo.gle/... https://twitter.com/... https://twitter.com/...