Google says it removed its AI model Gemma from AI Studio; in a letter to Google, Senator Blackburn said it fabricated sexual misconduct accusations against her
where models simply make things up about all types of things— and sycophancy — where models tell users what they want to hear — are challenges across the AI industry, particularly smaller open models like Gemma. We remain committed to minimizing hallucinations and continually improving all our models. @blueblimpms : @AndrewCurran_ It's a bit hard for me to imagine how someone would have ended up in Ai Studio asking Gemma such questions. Presumably it was a fishing expedition. @pr337h4m : @AndrewCurran_ this is a blatant violation of the first amendment Andrew / @_dr5w : @AndrewCurran_ WOW, that is next level stupid. No small model can ever be published. @tbkaskeladd : @AndrewCurran_ nah wtf... this is pure ignorance. everyone knows llms especially as small as gemma can struggle with hallucinations. this feels like a testprep to see if they can get away with doing this so that they can do it again and again in the future.(such as when gemini 3 comes out) @paytondev : @AndrewCurran_ this is like buying an iPhone 4 and then complaining to Apple that it can't make phone calls. you chose to use the small, open model and then got upset when it didn't answer right. I bet if you ask the same questions to the consumer-facing Gemini, it'll get the answer perfectly Hadrian Veidt / @hadrianveidt0 : @AndrewCurran_ Fascinating how neither party values free speech. Very, very cool. Matthew Davis / @matthewtradcath : @AndrewCurran_ isn't the issue that they use this tiny model to generate the answers above google searches, which is why they're so often wrong Louis Amira / @louisamira : @AndrewCurran_ Calling for shutdowns during a govt shutdown? Ashish Shroti / @xshroti : @AndrewCurran_ Quite a blow for OSS models. No wonder why China is ahead in terms of OSS LLMs. They only need to worry about not offending Xi. While U.S. Tech giants have many more stakeholders to take care of. Girish Koushik / @girkosh : @NewsFromGoogle This is so annoying. People use the wrong models for their tasks and then complain when they don't get desired results. Gemma was a great model available free of cost to developers to perform quick experiments and now we have to rely on APIs for that. smh Johnny Silverhand / @wyrmstar : @NewsFromGoogle This is because @robbystarbuck is suing Google because Gemma keeps inventing false facts about him that are defamatory. AFAIK, neither he nor his lawyers are devs, so this cuts their access. @boxyinadream : @NewsFromGoogle This is unfortunate. Gemma is a very good model and availability through AI Studio opens the door for non-developers to become new developers. I hope that confusion around use case and capabilities clears up quickly. When used correctly, 270m will function exactly as instructed. A. Theerthala / @thesilvervein : @NewsFromGoogle Oh man that sucks. The Gemma series with 10k queries were my go-to for testing orchestration strategies and prompt refining. Sad to see it go away. @sinnformer : @NewsFromGoogle Hi, I'm a developer that doesn't want to use the API because I'm burned the fuck out due to stupid shit happening both in the world and in the workplace. Could you give me back what I was using? I don't give a flying fuck if someone is using it wrong, it's not a fucking gun. Evan / @ubuto23 : @NewsFromGoogle “We've now seen reports of non-developers trying to use Gemma in AI Studio and ask it factual questions. We never intended this to be a consumer tool .” Sorry this is a bad thing how? Andrew Curran / @andrewcurran_ : This is the letter that caused Gemma to be pulled from AI Studio. [image] @memecoin_track : @TechCrunch AI defamation? NGMI if you trust centralized models. WAGMI with decentralization. Bluesky: Carre / @carre.neocities.org : That senator apparently understands the problem shouldn't be treated with ai-themed corpspeak or kid gloves, but as an influential anti-roe-v-wade far-rightist she helped erode her country to this point, and it's telling that Google listens to her and not others. @aaronbiello : It is an exciting time we live in and innovation is leapfrogging itself at record pace. But we must hold companies accountable for their technology and promote responsible Ai or we run the risk of harming individuals, ways of life and further divide. Forums: r/technology : Google pulls Gemma from AI Studio after Senator Blackburn accuses model of defamation
TechCrunchAnthony Ha
Context & Ripple Effects
Google had already paused a Gemini feature amid quality failures, while reporting also flagged absurd Gemini text responses. Gemma’s removal from AI Studio extends that reliability problem from product output to a named individual’s reputational claim.
The episode matters because the complaint comes from a senator and concerns an allegation of sexual misconduct, making model hallucinations a governance and access issue rather than only a user-experience defect.
First-order effects
AI Studio users can no longer access Gemma through that service, while Google must address a high-profile accusation that the model produced false defamatory content.
Senator Blackburn’s letter puts Google’s stated hallucination-reduction efforts under direct public and political scrutiny.
Second-order effects
Google’s model teams and AI Studio operators face pressure to strengthen evaluations and safeguards for prompts that can generate allegations about identifiable people.
Other AI providers offering broadly accessible models may face closer attention to how their systems handle reputationally harmful fabricated claims, especially when public officials are involved.
Third-order effects
If similar incidents persist, model distribution channels may increasingly differentiate access and add targeted guardrails for high-risk claims about people, trading some openness or utility for reputational-risk control.
Political complaints about hallucinated allegations could make reliability governance a more concrete policy issue, centered on provider accountability and the boundaries of model access.
The trend: Generative-AI deployment is shifting from broad capability releases toward tighter governance of harmful failure modes in publicly accessible model interfaces.
Gemma is available via an API and was also available via AI Studio, which is a developer tool (in fact to use it you need to attest you're a developer). We've now seen reports of non-developers trying to use Gemma in AI Studio and ask it factual questions. We never intended thi…
“Shut it down until you can control it.” This is a terrible precedent. Some of the “frontier labs” are also inadvertently pushing this with their unmeasured hype. The average person needs to take LLMs a lot *less* seriously.
@eliebakouch It's poetic:) The same people who mocked us Europeans this week for being a ‘museum’ because of Uber just watched Google pull Gemma because someone from the US Senate misused it in AI Studio. Superb.
. @Google's at it again. This looked so wild I thought it must've been a lie. But it's true. Google's Gemma 3 27B model will claim you're a criminal, predator, child molester, racist, etc... Seems hosed beyond saving. See prompts (and link) in thread; try it with your name. [imag…
Fun fact: Gemma is the base model for the pi0.5 VLA If vaguely threatening letters from the senate trickle down into messing with robotics research I will be very sad
Senator Blackburn (R-TN) says we should shut down AI until we control it. IMO this goes too far. We need opportunities to improve AI. But Blackburn's right - we don't know how to control AI. This is a huge problem. We can't yet have AI in critical systems. [image]
This is why Open-Source Models LLMs out of China dominate as opposed to the US or God Forbid, the EU. The US only cares about their closed source babies, and if anything is a threat to them, it just gets shutdown entirely
> you need to attest you're a developer 🤮 Wasn't computer programming supposed to be universally accessible without arbitrary restrictions? Or that's a boomer thing?
@robbystarbuck ... I've seen enough - they need to shut off Gemma. I just posed the same query to Gemini 2.5 fast and got the following sans imaginary allegations of criminal misconduct and imaginary articles falsely attributed to @yashar. Robby Starbuck (born Robert Starbuck New…
@Mirrormn @quixoticrambler Well if Google is responsible they will simply stop releasing small models and we'll run everything on chinese one (gemma is literally the only common US alternative right now). I guess that's an option.
Google's “Gemma” made up a sexual assault allegation against me, along with a series of links to fake news articles to support the false claim. This is outrageous. If @Google can't prevent these so-called “hallucinations,” they need to shut Gemma down. https://www.foxnews.com/...
Now @Google AI is accusing me of running a pump and dumb crypto scheme. Insane. None of this happened. Like not even one detail of this happened. None of these companies or people have EVER been associated with me. I've never paid anyone a settlement. End this @sundarpichai!
Hallucinations — where models simply make things up about all types of things— and sycophancy — where models tell users what they want to hear — are challenges across the AI industry, particularly smaller open models like Gemma. We remain committed to minimizing hallucinations a…
@AndrewCurran_ It's a bit hard for me to imagine how someone would have ended up in Ai Studio asking Gemma such questions. Presumably it was a fishing expedition.
@AndrewCurran_ nah wtf... this is pure ignorance. everyone knows llms especially as small as gemma can struggle with hallucinations. this feels like a testprep to see if they can get away with doing this so that they can do it again and again in the future.(such as when gemini 3 …
@AndrewCurran_ this is like buying an iPhone 4 and then complaining to Apple that it can't make phone calls. you chose to use the small, open model and then got upset when it didn't answer right. I bet if you ask the same questions to the consumer-facing Gemini, it'll get the ans…
@AndrewCurran_ Quite a blow for OSS models. No wonder why China is ahead in terms of OSS LLMs. They only need to worry about not offending Xi. While U.S. Tech giants have many more stakeholders to take care of.
@NewsFromGoogle This is so annoying. People use the wrong models for their tasks and then complain when they don't get desired results. Gemma was a great model available free of cost to developers to perform quick experiments and now we have to rely on APIs for that. smh
@NewsFromGoogle This is because @robbystarbuck is suing Google because Gemma keeps inventing false facts about him that are defamatory. AFAIK, neither he nor his lawyers are devs, so this cuts their access.
@NewsFromGoogle This is unfortunate. Gemma is a very good model and availability through AI Studio opens the door for non-developers to become new developers. I hope that confusion around use case and capabilities clears up quickly. When used correctly, 270m will function exactly…
@NewsFromGoogle Oh man that sucks. The Gemma series with 10k queries were my go-to for testing orchestration strategies and prompt refining. Sad to see it go away.
@NewsFromGoogle Hi, I'm a developer that doesn't want to use the API because I'm burned the fuck out due to stupid shit happening both in the world and in the workplace. Could you give me back what I was using? I don't give a flying fuck if someone is using it wrong, it's not a f…
@NewsFromGoogle “We've now seen reports of non-developers trying to use Gemma in AI Studio and ask it factual questions. We never intended this to be a consumer tool .” Sorry this is a bad thing how?
That senator apparently understands the problem shouldn't be treated with ai-themed corpspeak or kid gloves, but as an influential anti-roe-v-wade far-rightist she helped erode her country to this point, and it's telling that Google listens to her and not others.
It is an exciting time we live in and innovation is leapfrogging itself at record pace. But we must hold companies accountable for their technology and promote responsible Ai or we run the risk of harming individuals, ways of life and further divide.