Relatable AR

What is the value of augmented reality in the world of marketing? For Joe Zeff, president of Joe Zeff Design in Pittsburgh, it’s to help his customers tell better stories.

As a former graphic journalist at both Time and The New York Times, Zeff’s responsibility was to distill the week’s news stories into visual representations. Today, he takes the same skill and applies it to the world of marketing.

Clients include AT&T, Nike and American Express Global Business Travel, as well as one company very much a part of the news these days — Astrobotics, Inc., which created the landing module for the Artemis rocket.

Zeff has also been the designer and developer of some of the world's first iPad apps. Zeff’s passion for technology has put him squarely in the middle of a world that would eventually become the heart of much of his business.

Getting the AR Fever

Zeff became interested in AR about five years ago while working with Bigtincan, an AR platform he used to create complex AR scenes. One of Bigtincan’s clients was (and still is) T-Mobile. Zeff was asked to create a proof of concept to show how sales associates could present in-store products to customers, as well as provide a way for customers to learn more about products on their own.

As part of this project, Zeff created an AR experience to promote T-Mobile’s Family Mode connected service.

When the salesperson hovered over the package with their iPad, the box would come to life with interactive buttons and video. As the iPad hovered, the buttons would play like a slide show—“set limits,” “schedule downtime,” “set bedtimes”—and the user could touch each button to bring up more information, including a video.

Since then, Zeff has used Bigtincan to develop AR experiences for other clients.

Seeing Inside the Black Box

Many of these experiences have been used to engage booth visitors at trade shows and conferences, where people’s attention is short and it takes that “something extra” to draw them in. AR provides the opportunity to open what are often “black box” technologies and better tell the story of what is behind the curtain.

Zeff gives an example from HIMSS19, a global health conference and exhibition, where AT&T was showing its connected devices.

“To tell their story, AT&T had brought several IoT devices that were powered by AT&T transmitters, antennae and equipment, but you wouldn't know that simply by looking at the devices sitting on that table,” Zeff said. “I created an AR experience that allowed AT&T employees to point to one of these objects and let people see beneath the surface. They see where the transmitters existed, where the accelerometer was placed, and how those devices connected to things outside of the room.”

AR took the technology from being a “black box” to telling a compelling story.

From Proprietary Apps to QR Code Scans

In these early days of AR, all of the experiences Zeff created used Bigtincan. Today, he also uses two mobile-browser-based platforms, ZappAR and WorldViewAR from RealityBLU, both of which use WebAR, or mobile-browser-based AR, to access AR experiences via QR Code.

“The ability to give AR without an app was game changing,” Zeff said. “Suddenly anyone could access these experiences. If you can scan a QR Code, you can engage with augmented reality. That has opened up an entirely new world of marketing.”

Zeff uses RealityBLU for creating holographic twins (holotwins), 3D objects and virtual portals that transport viewers into different times and places. He uses ZappAR to bring posters and other printed materials to life.

When it comes to living posters, Zeff points to a project he created for Advanced Construction Robotics, which was looking to increase engagement at Automate, a robotics industry conference held by the Association for Advancing Automation. For the conference, Zeff created a life-sized cut-out of Danielle Proctor, CEO of Advanced Construction Robotics, that when scanned, came to life and started talking.

“It sprung alive like a Harry Potter movie,” Zeff said.

Other buttons appeared superimposed over the poster that allowed the viewer to access a slide show and interactive content, including “Meet Danielle,” “Why Robotics?” and “Why Pittsburg?” The experience also brought up a video showing Advanced Construction Robotics’ new TyBot machine in action.

Taking Augmented Reality to the Moon

But one of the most exciting projects Zeff has had the opportunity to work on is for Astrobotics lunar module.

As part of the pre-launch publicity, Zeff had the opportunity to once again work with Time magazine and use RealityBLU’s WorldViewAR platform to help tell the story of Astrobotics’ Peregrine lander (June 2022 issue). The article describes the lander, packed with 24 instruments and other payloads from five different countries, and its journey to the moon. To round out the story, Zeff created an infographic about the lander with a QR Code that, when scanned, lets readers use AR to place a 3D model of the lander in the room with them. Once the AR object is placed, readers can walk around the model, look underneath it, and examine it as if the lander were right there.

“Not only can they read about the lander, but they can interact with the 3D model, helping to deepen their understanding and connection to the technology,” Zeff said.

Bringing Joe Zeff’s Holotwin to Life

Zeff’s passion for holotwins is reflected in his own use of holotwins to promote his business. Want to see for yourself? Go to Zeff’s website and click the gray banner at the top of the page that says, “Want to learn more about augmented reality?” You’ll be greeted with a page with the Advanced Construction Robotics poster, a QR Code with Joe Zeff’s bitmoji in the center, and two other QR Codes — one for an in-process project to retain Pittsburg-based talent, and another of a holotwin of a Tyrannosaurus Rex walking straight at you.

But it’s Zeff’s holotwin you came to see. So scan the QR Code with his bitmoji and you’ll be able to place Jeff in in front of you, snapping his fingers, and speaking to you.

Below the holotwin is a button that, when touched, takes the viewer to Zeff’s website.

Zeff has created holotwins for multiple clients, including a proof of concept for the Pittsburg Zoo. In the project, Zeff created a series of virtual zookeepers (holotwins) in front of each display.

He has also created his own storytelling platform called Augmented Pittsburgh to help residents and visitors more deeply engage with the city.

“The first two deployments roll out this fall,” he said. “A partnership with Acrisure and the Pittsburgh Post-Gazette to deliver weekly sportscasts via augmented reality, and a partnership with the City of Pittsburgh and Bike Share Pittsburgh to place holotwins throughout the city to help people better understand their transportation options.”

Zeff has several other partnerships set to launch in early 2023.

Using His Own Product

Zeff continues to use AR to promote his business. If you live in the Pittsburg area, you’ll see his QR Code on posters in bus shelters, on the sides of buses and on billboards along the highway. On his LinkedIn page, Zeff recently reposted an image of a Pittsburg resident with his bitmoji pinned to her collar.

Truly, he’s everywhere.

“I’ve done a lot of self-promotion to get ideas out there, but in those promotions, I don’t talk about the technology,” Zeff said. “I say, ‘This is how we tell stories now.’ Then, when you scan the QR Code, you see me standing on the sidewalk. Then my holotwin talks about AR.”

While Zeff has been successful selling AR-fueled campaigns, he acknowledges that we are still in the early days.

“Businesses are just starting to see the potential for how AR can be part of their toolkit as it relates to selling, training and engagement,” he said. “It’s incumbent upon creators to put those examples about there to give potential clients a peek at what’s possible.”

Seeing is believing, which is why Zeff’s website is full of examples of AR, both past and present.

“For me, AR is something I use as a sweetener to make any storytelling engagement more rich,” he said. “Like adding a spice to a dish. If I’m creating a microsite for a client, I’m looking for a way to include AR. If I’m doing a print campaign, I’m looking to add AR. I'm looking at AR as an exciting way to extend those experiences—make them accessible to anyone with a smartphone, thereby unlocking many ways to tell stories.”