Sony's New AI Patent Predicts Button Presses via Finger-Camera Tech

A newly published patent from Sony reveals potential plans to reduce input latency in future hardware using an AI-driven approach enhanced by additional sensors. This innovation could significantly improve gameplay responsiveness, especially as newer rendering technologies like frame generation become more widespread.

Sony introduced its proprietary upscaling solution, PlayStation Spectral Super Resolution (PSSR), with the PlayStation 5 Pro. While PSSR effectively upscales lower resolutions to 4K, advanced graphical features such as frame generation can introduce unwanted input lag. This means that although players may experience smoother framerates, the overall responsiveness of the game may suffer.

Similar challenges have been addressed by GPU manufacturers AMD and Nvidia through Radeon Anti-Lag and Nvidia Reflex, respectively. Now, it appears Sony is exploring its own dedicated solution to maintain competitive performance while preserving low-latency gameplay.

First discovered by Tech4gamers, the patent—WO2025010132, titled “Timed Input/Action Release”—focuses on optimizing the timing of user inputs by predicting which button a player is about to press. According to the filing, there is often a delay between when a player gives a command and when the system processes and executes it, potentially leading to unintended outcomes during fast-paced gameplay.

The proposed solution involves a combination of components working together: a machine learning model trained to anticipate player input and external sensors that track physical interactions. One example outlined in the patent includes using a camera aimed at the controller to detect which button a player is preparing to press. The patent states: “In one particular example, the method may include providing camera input as an input to a machine learning (ML) model. The camera input may indicate the first user command.”

Additionally, the patent suggests that sensor-equipped buttons within the controller itself could be used to predict inputs. Considering Sony’s history of refining analog control schemes, this could hint at enhancements in a future iteration of the DualSense controller or beyond.

While the exact implementation described in the patent may not appear directly in the PlayStation 6—since many patented ideas evolve before reaching consumer hardware—it clearly signals Sony’s intent to innovate in the realm of latency reduction. As technologies like FSR 3 and DLSS 3 gain traction across gaming platforms, minimizing frame-induced latency becomes increasingly important for maintaining smooth, responsive gameplay.

If implemented, this technology could be particularly beneficial in genres where precision and timing are critical, such as competitive shooters and fighting games. Whether or not this concept translates into actual hardware remains uncertain, but it's clear that Sony is actively exploring cutting-edge solutions to keep its platform ahead of the curve.