Microsoft Copilot Evolves: Now Reads, Thinks, and Talks Aloud!

Microsoft has introduced a series of updates to its Copilot assistant, which now includes the ability to read your screen, think more deeply on complex issues, and even speak aloud to users. These new features aim to make the AI assistant more versatile and user-friendly.

One of the standout features of this update is Copilot Vision, which allows the assistant to analyze text and images on web pages via Microsoft Edge, providing answers to queries related to the content displayed. This feature can be accessed by typing “@copilot” into Edge’s address bar. However, it is currently limited to a pre-approved list of popular websites and cannot interpret paywalled or sensitive content.

To ensure user privacy, Microsoft has implemented stringent measures. Data used in Copilot Vision sessions is not stored or used to train AI models, with all processed data being deleted immediately after the conversation. This move helps Microsoft avoid privacy concerns and the potential misuse of AI-trawled data.

The Think Deeper feature is another enhancement designed to boost Copilot's utility. Leveraging advanced reasoning models developed in collaboration with OpenAI, this feature enables the assistant to tackle more complex problems by providing detailed, step-by-step answers. This makes it particularly useful for tasks that require deep thought, such as comparing complicated options or solving difficult math problems.

Microsoft has also rolled out Copilot Voice, a new function allowing users to engage with the assistant through voice interactions. Copilot Voice supports four synthetic voices and can interpret user tone, responding in a conversational manner. Available in English in select countries, it makes the AI more accessible and interactive.

To cater to individual user preferences, Microsoft is introducing personalization settings in Copilot. This feature allows the assistant to tailor its suggestions and interactions based on past usage and other Microsoft services. However, due to stringent data privacy laws, this functionality is not yet available in the European Union and select other regions.

These enhancements to Microsoft Copilot are a part of a broader strategy to create more intuitive and capable AI assistants. By adding functionalities like deep reasoning, voice interaction, and screen analysis, Microsoft aims to set new standards in AI-powered user assistance. However, the gradual rollout and limited geographical availability suggest that Microsoft is being cautious, addressing potential legal and privacy issues before a more global release.