Discussion

• @officiallogank Logan Kilpatrick on x

  Say hello to Gemini 1.5 Flash-8B ⚡️, now available for production usage with: - 50% lower price (vs 1.5 Flash) - 2x higher rate limits (vs 1.5 Flash) - lower latency on small prompts (vs 1.5 Flash) https://developers.googleblog.com/ ...

• @natolambert Nathan Lambert on x

  Probably good for data filtering/classification pipelines that you need to scale up, or at least try.

• @altryne Alex Volkov on x

  Basically “free” intelligence is already here. “When using Caching, Gemini 1.5 Flash-8B costs $0.01 / million tokens 🤯” New Gemini 1.5 flash 8B is... you can literally use it all day long and not even notice in your bank account [image]

• @maxwinebach Max Weinbach on x

  Genini 1.5 Flash 8B is insane for a few reasons. 1 million token context window full multimodal 8B parameter Fast af CHEAP And quality isn't amazing vs other models but it's good enough with proper prompting and so so cheap

• @_arohan_ Rohan Anil on x

  Flash8B General Availability: We originally trained Flash 8B giving it all our algorithmic efficiency improvements to pack as much as possible in a small form factor which then was scaled up to Flash On benchmarks, it is closely matching Flash announced during May at I/O [image]

• @officiallogank Logan Kilpatrick on x

  When using Caching, Gemini 1.5 Flash-8B costs $0.01 / million tokens 🤯 [image]

• r/Bard r on reddit

  Gemini 8b out of preview available for production use through api