Brilliant Labs created Frame glasses with a multimodal AI assistant

Brilliant Labs created Frame glasses with a multimodal AI assistant

Brilliant Labs released Frame – the world’s first glasses with a built-in multimodal AI assistant, reports Venture Beat.

The company’s list of advisors and investors includes Coho VC, Brendan Iribe (co-founder of Oculus), Adam Cheyer (co-founder of Siri), Eric Migikowski (founder of Pebble), Steve Sarowitz (founder of Paylocity and chairman of Wayfarer Studios), Nirav Patel (former member of the Oculus core team and founder of Framework), Francisco Tolmaski (a member of the original iPhone team), Plug and Play Ventures, and Moveon Technologies.

Led by former Apple executive and Brilliant Labs CEO Bobak Tawangar, Frame has introduced what it calls a paradigm shift in everyday life.

Equipped with an always-on AI assistant named Noa, who looks like Jarvis from Iron Man, Frame not only changes the way we perceive the world, but also reimagines how we interact with the physical environment, the company said.

“Noa, a completely new kind of virtual assistant with artificial intelligence, enables users to interact more with the world around them. We hope that Frame will enable people to communicate with each other in completely new ways and open up new experiences in everyday life, in the workplace, in the classroom and more. It is a unique promise to bring generative AI to the human eye.” – the message says.

Thanks to its integrated multimodal generative AI system, Frame is capable of simultaneously running GPT4, Stability AI and Whisper AI.

Noa performs real-time visual processing, new image generation, and real-time speech recognition and translation.

Frame’s multimodality enables multiple AI systems to work together, opening up limitless applications for this technology in everyday life.

There is no augmented reality function as such. Frame is designed as AI-embedded glasses. Typically, people type or upload content to ChatGPT to actually work with it.

Now, with LLM on your glasses, you can tell it through real-world data (like what you’re seeing, what you’re hearing, and where you are at any given time).

Multimodal AI Assistant with personality

Frame can handle AI requests

Frame’s built-in multimodal generative AI allows you to control multiple AI systems for complex tasks such as visual and acoustic measurement of emotional moods and facial expressions.

In addition to personal assistance, the company also noted that Frame is redefining the concept of a search engine in the age of AI-enabled glasses. Noa can instantly check prices by scanning clothing items in retail stores and more.

Designed in such a way that they are indistinguishable from glasses

The frame weighs only 39 grams. It is made of technical nylon plastic for comfort and durability.

Presented in a classic vintage style in a variety of colors, Frame is designed to match the style of any wardrobe.

The device has a bright high-resolution display with 3000 nits brightness, a front-facing spatial camera, a built-in microphone and a 6DoF IMU for advanced functionality.

The Frame will be available for pre-order in March 2024 for a retail price of $300.

Continuation of the open source model for developers

Brilliant Labs said it is open-sourced as the Frame follows in the footsteps of its predecessor, the Monocle.

Developers can explore and modify both Frame hardware and software using all the resources that Brilliant Labs provides, including up-to-date documentation, an open source code base, and hardware schematics. They can also adjust the parameters of supported Noa AI models.

“Brilliant Labs’ innovative progress, starting with Monocle and now with the launch of Frame, has been inspiring. With a design that is both beautiful and practical for everyday use, the Brilliant Labs Frame is the first step in a new era that will change the way society functions. Frame can enhance our human ability to organize, access, and act on information with Noa’s built-in AI assistant. With the help of your Brilliant Labs’ extensible and open artificial intelligence platform can usher in a new wave of hands-free applications reminiscent of the dawn of the iPhone era.” Adam Cheyer, co-founder of Siri and investor at Brilliant Labs, said in a statement.

Frame can record video and take photos. Frame does not store any images/videos like Snapchat or Meta can.

Thus, the purpose of the video or photo is more for AI functionality than for social media use.

Read also on ProIT about smart AR glasses that may soon become a part of your life.

Subscribe to ProIT on Telegram so you don’t miss a post!

Related posts