New Delhi: Microsoft has updated its Copilot Vision AI, a scanning tool that can scan all of the screen and not just two or three applications. The new capability that can be obtained by Windows Insiders substantially increases the scope of the tool. Rather than only being able to manage two open programmes, Copilot Vision has the ability to now see either your entire desktop or the programme or browser window of choice.
The new feature is more manual as compared to Microsoft Recall, which records automatic snapshots of your screen. Copilot Vision is more of a screen-sharing app; the user has to click a glasses icon in the Copilot app and select what they want to share. According to Microsoft, the AI is capable of scrutinising what it sees, providing useful information, and even coaching the user verbally.
Analyse and interact with anything on desktop
Copilot Vision is useful in a variety of tasks, such as editing creative works, perfecting resumes, or providing gameplay advice. It can offer you real-time suggestions or answers to the questions you have regarding the content you see on your screen by recognising what it sees on your screen.
Copilot Vision was originally tested with Microsoft Edge in 2023, but it has expanded beyond browser use. It is also compatible with mobile phone cameras so that the user can query about real-life objects or text which is captured by the mobile phone camera. The new release advances the Microsoft dream of highly embedded, useful AI.