There’s nothing sexier than measurement.
Well, that’s not true. But it was certainly a hot topic during Advertising Week.
Google made cross-device announcements, Nielsen waxed poetic about the future of measurement, Facebook got reprimanded by the industry for mistakenly exaggerating its average view times for video and Tapad rolled out a new time-based metric.
The need for accurate and trustworthy measurement sits at the heart of every advertising effort, at least for a media agency shepherding its client’s spend.
“You’ve got to prove it out,” Oleg Korenfeld, Mediavest/Spark’s EVP of ad tech and platforms, said Wednesday at a Tapad event. “Was the investment worth it?”
Tapad is tossing its hat in the ring with a new metric called VET, short for viewable exposure time, which uses time and identity, rather than reach and frequency, to optimize spend across ads and channels.
“Instead of thinking of frequency as a cap, think of it as a lever,” said Kate O’Loughlin, Tapad’s SVP of media.
Tapad uses a combination of its graph, its TV metric product and relationships with viewability vendors to determine which ads a particular user has seen across TV and digital and how long that person spent with them.
From there, an advertiser can pull back spend on the people who’ve already been exposed and shift it to the people who are underexposed or need a little more nudging. The likeliest use case would be tapping digital to fill in the gaps on a TV buy for particular audiences.
“It’s the application layer of identity,” O’Loughlin said. “There’s a lot being done already with targeting, attribution and some audience-based analytics. Now is the time to innovate in analytics with cross-screen.”
Cross-device is a space crying out for standardization, so an attempt at creating a currency is constructive, but it could also add to some of the confusion around cross-device jargon, at least in the short term.
“To say that [cross-device] is hard to do is … kind of an understatement,” said Evan Neufeld, a principal analyst at market research firm Storyline Development, speaking at a cross-device workshop hosted by the Direct Marketing Association and the Coalition for Innovative Media Measurement on Monday.
“There’s no standardization even in the way measurement terms are used from vendor to vendor – it’s a confusing vendor landscape,” Neufeld said. “That’s not the fault of the vendors. This is the way technology evolves.”
The DMA released an RFI template on Monday to help advertisers and publishers educate themselves about cross-device and ask vendors the “right questions.”
“The buyers are as responsible here as the vendors,” said Jane Clarke, CEO and managing director of CIMM. “Buyers have to demand transparency. Keep asking questions.”
For example, what is the difference between the accuracy and precision of a graph? The two terms are used interchangeably, but in the cross-device context the nuance is quite significant.
Accuracy is a measure that shows how well a probabilistic graph is performing based on matches and non-matches. In other words, if a graph is comprised entirely of correctly identified non-matches – aka this phone is not connected to this tablet, this laptop is not connected to this phone, etc. – that graph can be considered 100% accurate.
What it’s not is 100% precise. Precision only measures the accuracy of matches, not non-matches.
With that in mind, it sounds like a foregone conclusion that precision is the only metric an advertiser should look at when evaluating cross-device technology. But it’s not as simple as that.
Precision is great, but it generally comes at the cost of scale, unless you’ve got an enormous amount of deterministic data at your disposal (or you’re Facebook, Google or Amazon).
“If you have tons of data, you can afford a higher precision,” said Michael Celona, global CTO at Publicis Media and former CTO of programmatic platform Run, which Publicis acquired in 2014. “These numbers don’t really mean anything unless you look at them in context, though.”
But walled gardens are not the only option for cross-device precision at scale. Facebook et al. have a lot of deterministic data, but there’s a trend now toward combining deterministic and probabilistic methodologies for greater scale without sacrificing precision.
Oracle, which acquired some cross-device technology of its own in April in the form of Crosswise, for example, still uses Tapad and Drawbridge to help power Oracle Data Cloud products.
“If you talk to folks like Facebook, they’ll tell you that everybody else is doing it wrong,” Neufeld said. “The flip side of that, which is important for brands, publishers, agencies and ad tech startups, is to be thinking about what exists beyond these walled gardens and how we can share data. It would make for a better ecosystem.”