2024-04-10
@_akhaliq This is awesome, but if you're Apple and pretty much own all layers of the application, OS, and hardware, why would you go with an image/screenshot-first approach here?
AppleInsider
Apple researchers publish a paper on Ferret-UI, a multimodal LLM tailored for enhanced understanding of mobile UI screens
this AI can read your iPhone screen Mini Games / The Indian Express : Apple's ‘Ferret-UI’ AI model could understand what's on your screen in a new way Oliver Haslam / iMore : Apple...