Microsoft Research video shows off sensing tech that reacts to fingers before they touch the screen
Tom Warren / The Verge :
Context & Ripple Effects
This lands two weeks before Google demos watch and speaker prototypes running Project Soli radar sensors for hand gestures — the same moment, two different bets on detecting hands without contact. Microsoft Research's video pushes the idea from radar to the screen itself: sensing a finger's approach so the interface can react before the tap.
It also fits a longer Microsoft thread of rethinking input surfaces — months later the company was testing an on-screen trackpad aimed at tablet users in Windows 10 builds — and it foreshadows the accessibility direction the research arm later took with Seeing AI's haptic edge-tracing.
First-order effects
- Touchscreen UI designers get a new input dimension: interfaces can anticipate a finger's approach and adjust before contact, changing how taps, menus, and hover states are built.
Second-order effects
- Component and sensor vendors face pressure to move past capacitive-only screens — the lane Synaptics entered weeks later with optical fingerprint sensors that work under glass — while Google's Soli effort becomes the rival approach to contactless hand sensing.
Third-order effects
- If pre-contact sensing matures alongside later tactile work like Facebook AI's open-source ReSkin and DIGIT fingertip sensors, computing's input layer shifts from touch-only screens to multi-modal sensing spanning devices and robots alike.
The trend: Input sensing is expanding from contact-based touchscreens toward anticipatory, multi-modal detection of hands and objects — a shift Microsoft Research, Google, and eventually robotics labs are all staking out.