Discussion

• @anthropicai @anthropicai on x

  Participants in the AI group finished faster by about two minutes (although this wasn't statistically significant). But on average, the AI group also scored significantly worse on the quiz—17% lower, or roughly two letter grades. [image]

• @anthropicai @anthropicai on x

  AI can make work faster, but a fear is that relying on it may make it harder to learn new skills on the job. We ran an experiment with software engineers to learn more. Coding with AI led to a decrease in mastery—but this depended on how people used it. https://www.anthropic.com/…

• @anthropicai @anthropicai on x

  In a randomized-controlled trial, we assigned one group of junior engineers to an AI-assistance group and another to a no-AI group. Both groups completed a coding task using a Python library they'd never seen before. Then they took a quiz covering concepts they'd just used. [imag…

• @sasurobert Robert Sasu on x

  Yep. AI makes code worst especially if it is not reviewed. Like AI create tremendous good work, but sometimes it fails stupidly and if not checked the bad cod accumulates and you have a non production ready code. It is good for MVPs, for POCs, but not for production. The young

• @rokomijic Roko on x

  Moltbook is basically proof that AIs can have independent agency long before they become anything other than bland midwits that spout reddit/hustle culture takes. It's sort of the opposite of the yudkowskian or bostromian scenario where the infinitely smart and deceiving

• @anthropicai @anthropicai on x

  These results have broader implications—on how to design AI products that facilitate learning, and how workplaces should approach AI policies. As we also continue to release more capable AI tools, we're continuing to study their impact on work—at Anthropic, and more broadly.

• @theprimeagen @theprimeagen on x

  very cool study very happy to see anthropic measuring the negatives as well. Honestly good for them

• @judyhshen Judy Shen on x

  📣Our study on how AI impacts coding skill formation is now out! (w. @AlexTamkin) AI Assistance is NOT a shortcut to skill formation. Using AI to help you learn to code only reduces mastery if you're delegating everything.

• @anthropicai @anthropicai on x

  We were particularly interested in coding because as software engineering grows more automated, humans will still need the skills to catch AI errors, guide its output, and ultimately provide oversight for AI deployed in high-stakes environments.

• @_philschmid Philipp Schmid on x

  AI is going to be the same for everyone, but our mindset determines the outcome. The most valuable skill to learn is to care about how things work, to be curious and to be okay with failing and getting stuck. Great work and research from Anthropic in reminding us! [image]

• @elfsternberg Elf M. Sternberg on bluesky

  I found this myself recently, when I tried to use Claude to better understand a code base I'd written myself six months in an atrocious, pretentious style because I thought I was the only one who would use it.  It took much longer than I'd thought necessary to build the mental mo…

• r/BetterOffline r on reddit

  Anthropic: AI assisted coding doesn't show efficiency gains and impairs developers abilities.

• r/DevelEire r on reddit

  Anthropic: AI assisted coding doesn't show efficiency gains and impairs developers abilities.

• r/theprimeagen r on reddit

  Anthropic: AI assisted coding doesn't show efficiency gains and impairs developers abilities.