Jump to content
  • A daring developer reincarnates Clippy from the Microsoft Graveyard to pop up like an AI genie with insightful details about cryptic screenshots on Windows PCs — like Google's Circle to Search tool


    Karlston

    • 250 views
    • 3 minutes
     Share


    • 250 views
    • 3 minutes

    Clippy wiggles its way back to Windows to provide insightful information about obscure details captured in screenshots.

    What you need to know

    • An avid tech enthusiast and developer recently shared an interesting project featuring Microsoft's discontinued office assistant, Clippy.
    • The project dubbed AI-Snip leverages Clippy's smarts, explaining obscure details captured in screenshots.
    • The developer also claims the project can be used for translation or custom prompts.

     


     

    It's barely been a week since Salesforce CEO Marc Benioff slammed Microsoft for reportedly disserving the AI industry while referring to Copilot as the new Microsoft Clippy. Now, the virtual assistant is seemingly back from the Microsoft Graveyard. In a surprising yet fun turn of events, an avid developer recently shared a project dubbed AI-Snip on Reddit.

     

    According to Developer Yannik Keller:

     

    "I found this to be super useful for everyday use. Anytime I do not understand anything, I just make a screenshot and get it explained. It can do other things as well such as translation or custom prompts."

     

    Demo of GPT-4o as an Image to Text model that makes MS Clippy explain the screenshots you take. from r/OpenAI

    The project has sparked interest on Reddit, with multiple users sharing nostalgic memories of the virtual office assistant. "My old heart jumps from joy... no, wait, that's too much jumping, stop it... stop..damn you again, Clippyyyyy," one user indicated. "It's a great idea," another user added. "I'm surprised Microsoft isn't promoting something fun like this."

     

    The project is reminiscent of Google's Circle to Search feature on Android phones. The feature lets you search for anything on your Android phone without switching apps by simply circling, highlighting, scribbling, or tapping the area that sparked your interest. More details about the highlighted region will be presented in real time.

     

    Perhaps more interestingly, Microsoft Edge also features a similar feature dubbed Circle to Copilot, which serves the same purpose as Google's Circle to Search (although the forthcoming Click-to-Do is even more powerful).

     

    According to the developer, the easiest way to run AI-snip on your Windows device is to download the binary from the releases page. Tech-savvy users with vast Python knowledge could alternatively clone the repository and follow the step-by-step instructions highlighted in AI-Snip's repository in GitHub.

     

    It's also possible to run AI-Snip on Linux. However, the developer indicates, "You will only be able to do one snip each time you run this program" because the operating system doesn't feature a uniform system tray like Windows.

     

    Here are available hotkeys when leveraging AI-Snip on your PC:

     

    • D: Toggles clippy (always starts on)
    • C: Toggles if AI response is copied to clipboard (always starts off). This will also disable streaming, resulting in slower response times.
    • E: Go into translation into english mode. Will also set clipboard on.
    • L: Go into Latex mode. Toggles clippy off and clipboard on.
    • T: Free prompt mode. Write your own prompt for the AI to answer.
    • Q or Esc: Cancel your ongoing snip or close clippy (you may have to re-select the clippy window if you de-selected it).

     

    Keller says AI-Snip is in explanation mode by default. As such, Clippy will pop up with an explanation, providing more insight and context regarding the section you snipped.

     

    Source


    Hope you enjoyed this news post.

    Thank you for appreciating my time and effort posting news every day for many years.

    2023: Over 5,800 news posts | 2024 (till end of September): 4,292 news posts

    RIP Matrix | Farewell my friend  :sadbye:


    User Feedback

    Recommended Comments

    There are no comments to display.



    Join the conversation

    You can post now and register later. If you have an account, sign in now to post with your account.
    Note: Your post will require moderator approval before it will be visible.

    Guest
    Add a comment...

    ×   Pasted as rich text.   Paste as plain text instead

      Only 75 emoji are allowed.

    ×   Your link has been automatically embedded.   Display as a link instead

    ×   Your previous content has been restored.   Clear editor

    ×   You cannot paste images directly. Upload or insert images from URL.


  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...