• 3 min read

Introducing Copilot Labs and Copilot Vision

Copilot
Copilot Labs is where we explore what’s next for Copilot—through fast, responsible experimentation. While Copilot delivers polished, production-ready AI experiences, Labs helps us test bold ideas early, learn quickly, and shape future innovation.  It’s a space where we bridge research and product, working closely with users to co-develop features that address emerging needs. Experiments in Labs may be

Copilot Labs is where we explore what’s next for Copilot—through fast, responsible experimentation. While Copilot delivers polished, production-ready AI experiences, Labs helps us test bold ideas early, learn quickly, and shape future innovation. 

It’s a space where we bridge research and product, working closely with users to co-develop features that address emerging needs. Experiments in Labs may be limited in availability, but Copilot Labs itself is open to all Copilot users. 

By learning in the open and iterating fast, we aim to bring the most useful, responsible, and forward-looking AI experiences to life. 

Interested in learning more about Copilot Labs? Join our Discord community to stay up-to-date on the latest experiments.

To give you an idea of what to expect from Copilot Labs, in this blog post you’ll learn more about Think Deeper and Copilot Vision, both radical features that originated in their early incarnations in Copilot Labs.

Think Deeper 

For complex problems that require consideration from every angle, Copilot users can make use of Think Deeper. First introduced through Copilot Labs, the Think Deeper feature allows users to ask complex questions and get comprehensive answers with real-time information, eliminating the need for endless searches and hyperlinks. From step-by-step guidance to solving a particularly challenging equation with digestible insights, Think Deeper is now available free for all Copilot users in the United States, Canada, United Kingdom, Australia, New Zealand, with availability in additional localities coming soon. 

Copilot Vision 

Language is, of course, a powerful means of communication, but there’s so much context to any task or interaction that lies far beyond what you can say. One way of addressing this is by giving you the option to let Copilot see what you see. through Copilot Vision.  

Through Copilot Vision, your companion can look across whatever you have open on your desktop – whether it’s multiple tabs on your browser or even different applications – to offer context and solutions that considers everything you’re working with. Whether you need advice on next steps, have questions about a process, or simply help navigating whatever it is you want to do, Copilot Vision can is also now available for free to all Copilot users. 

What started as an experimental feature exclusive to Copilot Lab participants, our goal was to put the interests of users and creators at the heart of the Copilot experience and make the collaboration all the more fruitful and seamless. Vision is an entirely opt-in feature, only getting invoked when you decide it might be helpful. You decide strictly when, how and if you want to use it. Privacy was also of the upmost importance with this feature, so we made sure to make it so absolutely nothing viewed by Vision – from audio, to images, text, and even your conversation with Copilot – nothing is stored or used for training. In fact, as soon as you close the feature, it gets permanently discarded. 

We are currently blocking the service on paywalls and sensitive content, limiting use to just a pre-approved list of websites in the first instance. These are popular sites used by a broad swathe of the population, and when Vision interacts with them it respects their machine-readable controls on AI. Over time we look to add more, always with safety and responsibility firmly in mind. We are also producing Vision with a view to creating a new driver of traffic to websites. When it comes to a paywalled site, Copilot Vision simply won’t comment. Copilot Vision is also not engaging directly with the web; it’s there to answer questions rather than take actions. Have a look at the in-depth Q&A see more about safeguards that are woven throughout.  

All Copilot users in the United States, Canada, United Kingdom, Australia, and New Zealand can now experience Copilot Vision as well as Think Deeper. If you’re curious, you can explore it all at Copilot Labs. Want to test new experiments for yourself? Explore Copilot Labs today.