Snap Specs translate speech in 60 languages and show a 115-inch virtual screen

Snap Specs translate speech in 60 languages and show a 115-inch virtual screen

Snap has set out what its Specs augmented reality glasses will actually do once they ship. The glasses overlay live closed captions in 60 languages, stream video on what Snap describes as a 115-inch virtual cinema screen, put walking directions on the street in front of you, and run partner Lenses built with the NBA, HBO Max, Spotify and Tripadvisor.

Navigation directions overlaid on a street through Snap Specs

Snap's own illustration of walking navigation on Specs, with arrows overlaid on the street. Image: Snap Inc.

Snap says in its September 16 newsroom post that all of the computing sits in the frames, with hardware "built directly into the glasses without a puck or tether". That positioning claim came alongside the launch event where Snap opened pre-orders at $2,195 in the US with a $200 refundable deposit.

Live captions run in 60 languages

Translation is the feature Snap leads with. The glasses overlay closed captions when someone speaks in a different language, and Snap says they support 60 languages, track the speaker and place the subtitles in the wearer's field of view.

Navigation works along the same lines. You can type a destination or say it out loud, and Snap says you get directions overlaid on the world with optional voice guidance, the arrows moving with you as you walk. A Tripadvisor Lens sits next to it for nearby restaurants and landmarks, translated reviews and currency conversion.

Snap pairs all of that with an unusually blunt set of privacy lines. Specs "do not use facial recognition to identify people", the company says, and they "don't continuously record or save audio, video, or photos". A prominent external LED in the centre of the frames lights up or flashes whenever the wearer takes a photo or records video or audio.

Spotify interface shown on Snap Specs

Spotify is one of the launch partners Snap names for Specs. Image: Snap Inc.

The browser opens a 115-inch screen

The Specs browser streams YouTube, HBO Max and other services on a virtual display that Snap says "feels like a 115-inch cinema screen placed about 10 feet away". Travel Mode keeps that screen stable on a moving train or a flight, where the scenery going past would otherwise drag the image with it.

There is a work side to this as well. Specs connect wirelessly to a computer to extend the desktop, support Bluetooth keyboards for editing documents, and carry a Whiteboard experience for brainstorming and diagrams. Bluetooth phone pairing handles calls, notifications and music, and Snapchat itself has been redesigned for the glasses, with a finger snap to take a Snap and hands-free video calls.

Partners supply the first Lenses

Most of what Snap showed is built with somebody else. The launch partners it names include:

  • NBA and WNBA basketball drills that use a real ball and hoop, a Soccer Skills Lens, and a golf Lens Snap says was developed with guidance from PGA Professionals.
  • An HBO Max Lens built around the new HBO series Harry Potter and the Philosopher's Stone, which premieres at Christmas.
  • Apollo 11 and Starmap education Lenses, plus Spotify, Tripadvisor and Shopify Catalog for placing 3D products in a room at full scale.
  • Connected Lenses for two people in the same space, including chess, table tennis and a dominoes Lens made with Jimmy Butler.

The enterprise list is shorter: Salesforce, Amazon Web Services, NVIDIA, Trifork and Hololight, aimed at shop floors, factories and field work. Snap also lists ALO Wellness Club movement experiences as coming next year, which is a reminder that the launch catalogue and the promised catalogue are not the same thing.

You can try a pair from October 1

Anyone who does not fancy putting down a deposit on unseen hardware gets a way out. Beginning October 1, Snap says, the Specs First Look will be available at Westfield Century City in Los Angeles, the first place in the US where the glasses can be worn without buying them.

Shipping itself is vaguer. Snap says only that it is "expected to begin later this fall in the United States, United Kingdom, and France", so the demo store will open weeks before anyone's pre-order arrives.

Leave a Comment

Your email address will not be published. Required fields are marked *