Jump to content
  • "Click To Do" is Windows 11's answer to Android's "Circle To Search" — an AI overlay that understands what's on screen and helps complete actions


    Karlston

    • 221 views
    • 3 minutes
     Share


    • 221 views
    • 3 minutes

    Windows 11 is getting its very own AI screen analyzer which lets you do tasks with just a few clicks.

    What you need to know

    • Microsoft is launching a new AI screen analyzer on Windows 11 later this year called Click To Do.
    • Click To Do works similarly to Android's Circle To Search, allowing users to quickly search the web based on an element selected on screen.
    • Click To Do goes a step further with contextual actions based on what's currently on screen. 
    • Click To Do is exclusive to Copilot+ PCs.

     


     

    Microsoft has announced a big new AI feature coming exclusively to Copilot+ PCs later this year that adds an intelligent overlay to the OS which can understand what's on-screen and provide contextual actions at any time. The overlay is invoked by holding down the Windows key and clicking with your mouse.

     

    The feature is called Click To Do and is a clear competitor to Android's Circle To Search function, only more capable. In addition to providing a quick way to visually search the web, Click To Do also provides contextual suggestions based on what it can see on screen. 

     

    For example, if you've selected some text, Click To Do will offer actions such as summarizing what's been highlighted or rewriting it. If you've selected an image, Click To Do will provide quick actions like blurring the background or erasing an object within the image that has been selected.

     

    When in the Click To Do overlay, you will be able to search for anything on screen with a dedicated search bar that floats at the top of the screen. This interface also offers quick access to Windows Recall, as both Recall and Click To Do use similar technology to identify what's on-screen. 

     

    Because of this, Click To Do is exclusive to Copilot+ PCs with an NPU of 40+ TOPS. That means if you're not using a Copilot+ PC, you won't get access to this feature later this year. Copilot+ PCs will be able to begin testing Click To Do in October, and is expected to begin rolling out in waves from November onwards.

     

    Click To Do is an example of AI being useful from a productivity standpoint. It's a feature designed to help streamline tasks and experiences, offering contextual actions that it thinks you are most likely to want to complete based on what's currently on-screen. AI as a productivity tool is the best kind of AI.

     

    Microsoft has also announced a number of other AI features coming to Copilot+ PCs this fall, including adding AI to Windows Search. It's also launching a brand-new Copilot experience today that's more human and interactive, which can browse the web alongside you and help with tasks with Copilot Vision.

     

    Source


    RIP Matrix | Farewell my friend  :sadbye:

     

    Hope you enjoyed this news post.

    Thank you for appreciating my time and effort posting news every day for many years.

    2023: Over 5,800 news posts | 2024 (till end of September): 4,292 news posts


    User Feedback

    Recommended Comments

    There are no comments to display.



    Join the conversation

    You can post now and register later. If you have an account, sign in now to post with your account.
    Note: Your post will require moderator approval before it will be visible.

    Guest
    Add a comment...

    ×   Pasted as rich text.   Paste as plain text instead

      Only 75 emoji are allowed.

    ×   Your link has been automatically embedded.   Display as a link instead

    ×   Your previous content has been restored.   Clear editor

    ×   You cannot paste images directly. Upload or insert images from URL.


  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...