In internal memo, Andrew Bosworth says he wants the metaverse to have “almost Disney levels of safety” but that moderation at scale “is practically impossible”
Internal memo from Andrew Bosworth lays out the scale of the challenge Tweets: @mshannahmurphy , @matthewfederman , @peterwsinger , @somebadideas , @minimaxir , @alexweprin , @karlbode , @counternotions , @markdistef , @malcolmmoore , and @oliviasolon Tweets: Hannah Murphy / @mshannahmurphy : SCOOP: Boz, the exec leading Facebook's push into the metaverse, has told employees he wants its virtual worlds to have “almost Disney levels of safety” But also acknowledged that moderation “at any meaningful scale is practically impossible” https://www.ft.com/... Matthew Federman / @matthewfederman : Unfortunately, it will be SONG OF THE SOUTH era Disney. https://twitter.com/... Peter W. Singer / @peterwsinger : And thus he perfectly encapsulates the problem... https://twitter.com/... Aaron Stewart-Ahn / @somebadideas : This is what Facebook Metaverse is gonna end up like tho https://twitter.com/... https://twitter.com/... Max Woolf / @minimaxir : literally the first thing VR developers should accept about VR is that people are going to have extremely kinky sex in it and there's nothing they can do about it https://twitter.com/... Alex Weprin / @alexweprin : Disney maintains an iron grip on its owned platforms and theme parks to ensure that brand safety. That does not appear to be in the cards for the metaverse. https://twitter.com/... Karl Bode / @karlbode : we can't properly manage the things we build at the massive scale we build them, but we're going to build them anyway because, money https://twitter.com/... Kontra / @counternotions : “Facebook can't moderate their existing platform. How can they moderate one [Metaverse] that is enormously more complex and dynamic?” (We'll get used to it.) https://twitter.com/... Mark Di Stefano / @markdistef : Internal docs show Facebook's VR universe has a racism and abuse problem https://www.theinformation.com/ ... @malcolmmoore : An internal Facebook memo outlines its early thoughts on tackling toxic behaviour on its metaverse. Scoop from @MsHannahMurphy https://twitter.com/... Olivia Solon / @oliviasolon : “Facebook can't moderate their existing platform. How can they moderate one that is enormously more complex and dynamic?” said John Egan, chief executive of forecasting group L'Atelier BNP Paribas https://twitter.com/... Expand More For Next Unexpand More For Next
Context & Ripple Effects
Bosworth had recently outlined how Meta would rank and display metaverse content while balancing private conversations against moderation in a discussion of content ranking and private interactions. His memo makes the operational constraint explicit: the safety standard he wants is far harder to deliver at meaningful scale.
The admission also sits against Facebook's earlier experience running a large, multilingual content-moderation apparatus, extending a familiar platform-governance problem into immersive virtual spaces.
First-order effects
- Meta's metaverse team must set safety policies and product expectations around a gap Bosworth says cannot be closed through moderation alone at scale.
- The content-ranking approach Bosworth had described becomes more consequential, because decisions about what is displayed will carry part of the safety burden.
Second-order effects
- Meta's safety claims face a sharper credibility test as virtual-world design choices determine how much harmful conduct is surfaced, restricted, or left to private spaces.
- The company's moderation operations must adapt existing platform controls to environments where immersive interaction creates additional abuse and racism concerns identified in internal documents.
Third-order effects
- If Meta treats moderation capacity as a hard limit rather than a staffing problem, safety will become a core product-architecture constraint for large virtual-world platforms.
- The episode points to trust and safety becoming platform infrastructure: growth in immersive social products will be bounded by what their governance systems can reliably enforce.
The trend: Immersive social platforms are confronting the same scale-versus-safety trade-off that shaped earlier social networks, but with governance embedded more deeply in product design.