Google's video demo of Gemini's multimodal AI capabilities wasn't carried out in real time or in voice; the model was shown still images and given text prompts
Attached: 1 image Just tried the new google Gemini model … Reethu Aaby / The Week : ChatGPT's challenger is here! Everything you need to know about Google's Gemini AI James Laird / Tech.co : Did Google Really Fake Its Hands-on Gemini AI Video? Anusuya Lahiri / Benzinga : What's Going On With Google Parent Alphabet Stock Friday? Tim Sweezy / HotHardware : Google Confirms Its Awesome Gemini AI Demo Was Staged And Explains Why Maxwell Zeff / Gizmodo : Google Definitely Had Its ‘Hands-On’ That Gemini AI Demo Ben Schoon / 9to5Google : Google shows how it made that too-good-to-be-true Gemini AI demo [Gallery] Sean Endicott / Windows Central : Fake Gemini hands-on video shows Google's sleight of hand, not the future of AI Alex Kantrowitz / Big Technology : Google's Gemini Marketing Trick Victor Tangermann / Futurism : Google Admits Gemini AI Demo Was at Least Partially Faked Amanda Breen / Entrepreneur : Google Just Launched Its Own Version of GPT-4 Called Gemini — But Execs Are Refusing to Answer One Very Important Question Jonathan Lamont / MobileSyrup : Google staged a Gemini demo depicting a real-time conversation Stephen E. Arnold / Beyond Search : Google Smart Software Titbits: Post Gemini Edition Devesh Beri / MSPoweruser : We tested how bad GPT-4 is compared to Gemini: it's not Arthur Brown / Android Headlines : How to access Google Gemini Rael Hornby / Laptop Mag : Google's Gemini AI demo is too good to be true (literally) Kai Xiang Teo / Business Insider : Turns out Google's Gemini demo wasn't nearly as amazing as it seemed Ryan Morrison / Tom's Guide : Google called out for making Gemini Ultra AI seem more impressive than it actually is Keval Vachharajani / MySmartPrice : Google Admits That Gemini AI Demo Video Was Staged: Everything To Know Mayar Alkhatieb / Al Bawaba : Google begins battle against OpenAI with the “Gemini” Rishabh Raj / NewsBytes : Google Gemini AI's staged demo raises questions about its capabilities Kyle Wiggers / TechCrunch : Users say Google's Gemini Pro is loath to comment on potentially controversial news topics, fails to get basic facts right, and struggles with some coding tasks Threads: Mark Vickers / @mark_r_vickers : Anyone who couldn't recognize this as a slick marketing video from the get-go should be ashamed of themselves. That doesn't mean that the software can't do some or all of these things, but nothing ever goes that smoothly, simply and quickly. Ian Betteridge / @ianbetteridge : If you're a journalist, it's always best to assume that any demo is rigged. And if you're not allowed hands-on with the product, the demo almost certainly *is* rigged. Youness El Andaloussi / @younelan : Most demos in tech companies are faked... Not necessarily because the product is worthless... Primarily because they don't want a repeat of the Bill Gates BSOD demo. To be fair they have progressed and have been catching up a lot since their initial release Dare Obasanjo / @carnage4life : At least one of Google's Gemini AI videos seems to have been faked but Google says that criticism is too harsh. “All the user prompts and outputs in the video are real, shortened for brevity,” a Google DeepMind VP said. “The video illustrates what the multimode user experiences built with Gemini could look like. … Mastodon: @Jigsaw_You@mastodon.nl : Don't believe everything you saw in the #Gemini presentation: it was partially fake. Can this #AI hype please end? — #generativeAI #LLM #tech #technology — https://www.theverge.com/... @emilymbender@dair-community.social : In the tech report, there is half a page describing (most the preprocessing of) the data. What a farce: — https://twitter.com/... And Google can't even be bothered to cite Drs. @meg and @timnitGebru 's work: — https://twitter.com/... /2 @emilymbender@dair-community.social : And then there's evaluation, or lack thereof: — Google is advertizing Gemini as an everything machine—a general purpose model that can be used in many different ways. In other words: sthg that cannot be evaluated, since it doesn't have a specific purpose. … @emilymbender@dair-community.social : I can't even with the anthropomorphizing language in the PR: “collaborative tool” as if software can enter into collaboration, “recognize and understand”, “sophisticated reasoning capabilities”... And they even declare their intention to lean into misleading UI, rather that building the kind of transparency that helps people use tools effectively... … Richard Matthias / @rhm@mastodon.gamedev.place : Google's share price rose over %5 yesterday based, one assumes, on the hype from this demo. I hope no one involved sold Google shares based on that movement.. https://arstechnica.com/... Vladimir Campos / @vladcampos@mastodon.social : 🤯 The video below about #Gemini is mind blowing, but here's my tip. Before sharing your opinion about it, please read the its description and visit the suggested site to understand how #AI was actually used to create it. — It's not exactly what the video makes you believe, but it is still pretty amazing. … @ai6yr@m.ai6yr.org : How not to run a high profile product demo, if you are a major company. #AI #demo #fakery https://techcrunch.com/... Martin Dufort / @martind@mastodon.online : Well the Google Gemini ‘Blue Duck’ video was not totally faked but a montage. That would have very good to set expectations to the right level at the beginning. — Now people were under the impressions that all this was being analyzed from the live video feed. It was not and it's all downhill from there. … Dave Mark / @davemark@mastodon.social : “Google's best Gemini demo was faked” — This just makes me sad. I had the sense that the demo was speeded up, but this is a whole other level. — I feel cheated. Boooooo. 👎🏻 — [H/T @jneno ] — https://techcrunch.com/... #Google #Gemini #AI Nate Gaylinn / @ngaylinn@tech.lgbt : I watched the promo video for Google's Gemeni multimodal LLM this morning: https://www.youtube.com/... It's very impressive, but I find it misleading and very hard to take seriously because of what it doesn't show. This performance is meaningless without context. How was the AI trained? … Irwin / @irwin@saturation.social : The Google Gemini hype video “fake” just reinforces @emilymbender 's point that AI is mostly hype and hot air and promise. We're astounded by certain capabilities, which misleads us from the reality that it's just not *there* yet completely. — BTW there's a whole genre of this concept hype video. … Chris Heilmann / @codepo8@toot.cafe : Oh no! A faked AI product keynote? Who could have ever predicted something like that? Can we stop fighting for market share and pool resources to make AI a helper in the background whilst keeping privacy and security? I know, silly — #GeminiAI #dontbeevil — https://techcrunch.com/... @k2052@mastodon.social : I got real vibes from the Gemini video that they faked UX for Gemini that doesn't exist. They did even more than I thought, they used still frames from the video to prompt Gemini and the audio was edited in. That crosses the line from deceptive marketing to outright fakery. — https://www.bloomberg.com/... @jasonpettus@mastodon.cloud : For the first time in the company's history, Google finds itself behind the curve when it comes to an important new tech development (namely, the rise of AI-LLMs); so for the first time in the company's history, Google tried a Facebook-style fake demo video to make their new Gemini look better than it is, then got flat-out busted for it a day later. https://techcrunch.com/... Jorge Arango / @jarango@mastodon.social : The reports of the misleading Gemini demo reminded me of Carl Sagan's famous phrase: “Extraordinary claims require extraordinary evidence.” I should've been more skeptical when that demo blew my mind. Harry McCracken / @harrymccracken@mastodon.social : Google seems to have made Gemini look extra-astounding by creating a video demo that bears little resemblance to the actual experience. https://www.bloomberg.com/... Mark Pesce / @mpesce@arvr.social : Google admitted when asked for comment that the video demo didn't happen in real time with spoken prompts but instead used still image frames from raw footage and then wrote out text prompts to which Gemini to responded. — http://windowscopilot.news/... @emilymbender@dair-community.social : More lacking transparency: they state “Gemini has the most comprehensive safety evaluations of any Google AI model to date, including for bias and toxicity.” but provide no link to where anyone can inspect the methodology and results of those evaluations. — /3 — [image] @emilymbender@dair-community.social : A quick thread on #AIhype and other issues in yesterday's Gemini release: — #1 — What an utter lack of transparency. Researchers form multiple groups, including @meg and @timnitGebru when they were at Google, have been calling for clear and thorough documentation of training data & trained models since 2017. … Andrew Schmidt / @schmidt@xoxo.zone : Turns out Google's #Gemini video was pretty fake: the AI wasn't responding to video, and its responses were edited for brevity and speed. — Color me much, much less impressed. — https://www.theverge.com/... X: Oriol Vinyals / @oriolvinyalsml : Really happy to see the interest around our “Hands-on with Gemini” video. In our developer blog yesterday, we broke down how Gemini was used to create it. https://developers.googleblog.com/ ... We gave Gemini sequences of different modalities — image and text in this case — and had it respond... [video] Parmy Olson / @parmy : 🚨PSA about Google's jaw-dropping video demo of Gemini - the one with the duck: It was not carried out in real time or in voice. The model was shown still images from video footage and human prompts narrated afterwards, per a spokesperson. More here: https://www.bloomberg.com/... [image] Richard Johnson / @richinseattle : Pressure got to them. They initially announced plans to wait until next quarter but suddenly dropped Gemini in 3 forms: small model for mobile, a GPT-3.5 level consumer model to power Bard, and an unobtanium model that claimed to beat GPT4 that they advertised with faked videos.. Rakesh Agrawal / @rakeshlobster : why? why? why? the actual technology is really impressive. why fake it? https://www.bbc.com/... yes, PR has puffery. but this goes beyond that line. Chris Bakke / @chrisjbakke : Great to see that the Theranos engineers found new roles at Google: [image] Harry McCracken / @harrymccracken : Google seems to have made Gemini look extra-astounding by creating a video demo that bears little resemblance to the actual experience. https://www.bloomberg.com/... Parmy Olson / @parmy : In its YouTube description Google also admits the video is edited for latency - which makes it look like the model is responding more quickly than it is. Very slick marketing on Google's part and another reason to be cautious amid hype. My column: https://www.bloomberg.com/... Jesse Felder / @jessefelder : 'A demo video released by Google has wowed social media but it's a feat in spin. Google's showboating is almost certainly timed to capitalize on all the recent turmoil at OpenAI but Google has demonstrated uncanny new tech before that didn't go anywhere.' https://www.bloomberg.com/... Neel Das / @nilzkool : @parmy Oh damn, this is so clickbaity by Google @_alialkhatib : i vaguely remember when apple was like “btw the whole presentation you just watched was shot on an iPhone” and everyone got mad as hell that apple didn't like... shoot it in natural light or something so it'll be interesting to find out what people make of this Parmy Olson / @parmy : ✨More from Google on THAT Gemini “duck” video: “We created the demo by capturing footage in order to test Gemini's capabilities on a wide range of challenges,” a spokesperson says. “Then we prompted Gemini using still image frames from the footage, & prompting via text.” (1/5) [image] Tae Kim / @firstadopter : The super fast real-time from voice prompts Gemini video was terrific, except for the fact it wasn't real-time or video or super fast or voice prompts 🤦♂️ [image] @svpino : Google, this is embarrassing.You published an impressive video showing Gemini answering your questions. It looked awesome. It looked real-time.But it was a lie. None of that happened as recorded and presented to the public... [image] Andrew Jones / @ajones55555 : Fun fact: that viral-ish Gemini demo video is basically entirely fake [image] LinkedIn: Bob Duffy : Two thoughts here — 1. For a tech crowd, these edits were not needed to communicate the achievement of Gemini. … Branden McIntyre : Like most people, I watched Google's demo of their new multi-modal LLM (Gemini) yesterday with some amazement. … Manash Bhattacharjee : Although there are multiple POVs on how sophisticated (or not) the #Google Gemini model is vs #OpenAI, one crucial thing to consider is the scope … Tatyana Mamut, PhD : Important reality check - the Google #Gemini demo was a highly-edited video, not a live demo. #GPT-4 from OpenAI is still better on most tests. … Reuven Cohen : Desperate times call for desperate measures. Google staged their recent Ai demos. — https://lnkd.in/... Abhishek Ratna : Is Gemini impressive? Yes. But if you're nodding along with Bloombergs assertions, it might be a case of too little too late. … Tina Chu : The tech world has been keenly observing the debut of Google's latest LLM, Gemini. Interesting to see hot debates whether it is superior to GPT-4 … Forums: r/technews : Google's best Gemini demo was faked | TechCrunch Ars OpenForum : ChatGPT vs. Google Bard, round 2: How does the new Gemini model fare?