Home On TV & Video How The YouTube Scandal Exposes A Double Measurement Failure

How The YouTube Scandal Exposes A Double Measurement Failure

SHARE:
Nico Neumann, assistant professor and fellow, Centre for Business Analytics at Melbourne Business School

By now, most people working in advertising have heard about the recent YouTube scandal

A comprehensive report from measurement company Adalytics provides a long list of cases where TrueView ads didn’t seem to adhere to Google’s quality standards. Ads were served on third-party sites and apps via the YouTube partner network, known as GVP. 

Many advertisers were unaware their TrueView ads were actually running on GVP sites. Of particular concern is that numerous ads placed on GVP were found to be muted and/or auto-playing, sometimes without any accompanying video content.

Google and other traffic verification companies have released several press statements pertaining to the scandal. But discrepancies across the various attempts to quantify the issue and address everyone’s concerns have just raised more questions.

The statistics war

While everyone largely agrees that problematic or inferior GVP ads are not what media buyers expect when paying premium dollars for TrueView placements, opinions diverge on the scale of the uncovered problem. How many campaigns actually include GVP inventory? And how many GVP TrueView placements may end up being outstream, muted, auto-played or hidden?

The Adalytics report found between 50%-90% of the TrueView billable cost of audited campaigns ended up on GVP. But “Pixability found that across all their video campaigns only 11% of their ads ended up on GVP, whereas IAS found that GVP accounted for 21% of campaigns with both YouTube and GVP inventory,” according to Google’s official statement.

This range of numbers has made people wonder who to believe. However, such a debate completely misses the point. 

The various reported percentages represent samples from diverse campaigns and varying time periods. They appear to focus on different units of measure (billable views vs. impressions). And this matters a lot for a product like TrueView, where only a fraction of impressions results in a completed, billable view.

Therefore, it’s impossible to draw any absolutes from these summary statistics. It’s like measuring the temperature in Celsius and Fahrenheit at different months of the year in different countries at different times of the day – and then asking which value best describes what the weather’s like on Earth. 

Interestingly, Google – the only company that should know the exact numbers – just mentioned in their press release that “the overwhelming majority of video ad campaigns serve on YouTube, not GVP.”

Subscribe

AdExchanger Daily

Get our editors’ roundup delivered to your inbox every weekday.

Exposing a double measurement failure

The most important lesson we can draw is that, too often, there is a double measurement failure.

The first failure relates to the walled garden mentality. Currently, no verification vendor is allowed to measure campaigns on YouTube. Instead, advertisers must rely on the information that Google provides through Ads Data Hub for their assessment of campaign quality. This basically means it’s impossible to determine how many GVP campaigns suffer from the reported problems.

Let’s be clear about this concern. Imagine you are a food safety and health inspector, but are never allowed to enter the kitchen of an establishment you are supposed to examine. Instead, the restaurant only sends you some sample photos. How many restaurants would send a picture showing a dirty kitchen or health code violation?

Yet, any ad-placement-level analysis only represents the first measurement layer in the media procurement chain. And this step will always depend on the goodwill of the publisher or platform to allow any external JavaScript tags or tracking pixels. Even in a world with privacy regulations increasing, there must be a way to allow external parties to properly run audits while protecting sensitive information.

A second layer of measurement

Even without access to ad placement data, there should always be a second layer of measurement. A working ad effectiveness method should be in place to help identify any campaign inefficiency, be that viewability, fake traffic, or poor ad placements. This should serve as a safety net in case the first layer fails.

Let’s not forget – unseen ads should not have an impact on any meaningful marketing outcome, be it brand awareness or sales.

So the question is: How many marketers have a method in place that would flag the performance of a problematic GVP campaign? Too often, marketers still prefer volume-related vanity metrics or benchmark-inflating attribution models that don’t reveal campaigns without incremental advertising effects.

What actions can marketers take today?

There are four questions that any brand should ask their agency or media buyer now:

  1. How much are our campaigns affected? Conduct an independent review of your video placements using log-level data and digital forensics. Don’t rely on summary reports.
  2. How much of YouTube’s inventory is on GVP? How much is outstream versus instream? There should be no excuse to hide such basic measurable information.
  3. How can we minimize exposure to the problematic GVP inventory? Untick the box when running campaigns and avoid performance choices that do not allow removing GVP inventory if you want your money to be spent on actual YouTube ads.
  4. Would your measurement methods pick up any problematic GVP or other video campaigns? It’s never too late to review your media analysis choices and opt for more robust scientific methods, such as ongoing experimentation.

Let’s not waste time arguing about industry statistics. They are all averages. What matters is how your brand is affected.

On TV & Video” is a column exploring opportunities and challenges in advanced TV and video. 

Follow Nico Neumann and AdExchanger on LinkedIn.

For more articles featuring Nico Neumann, click here.

Must Read

Viant Acquires Data Biz IRIS.TV To Expand Its Programmatic CTV Reach

IRIS.TV will remain an independent company, and Viant will push for CTV platforms to adopt its IRIS ID to provide contextual signals beyond what streamers typically share about their ad inventory.

Integral Ad Science Goes Big On Social Media As Retail Ad Spend Softens In Q3

Integral Ad Science shares dropped more than 10% on Wednesday, after the company reported lackluster revenue growth and softened its guidance for the Q4 season.

Comic: Gen AI Pumpkin Carving Contest

Meet Evertune, A Gen-AI Analytics Startup Founded By Trade Desk Vets

Meet Evertune AI, a startup that helps advertisers understand how their brands and products appear in generative AI search responses.

Privacy! Commerce! Connected TV! Read all about it. Subscribe to AdExchanger Newsletters

Private Equity Firm Buys Alliant As The Centerpiece To Its Platform Dreams

The deal is a “platform investment,” in which Inverness Graham sees Alliant as a foundation to build on, potentially through further acquisitions.

Even Sony Needed Guidance For Its First In-Game Ad Campaign

In-game advertising is uncharted territory even for brands like Sony Electronics that consumers associate with gaming.

Comic: Always Be Paddling

The Trade Desk Maintains Its High Growth Rate And Touts New Channels

“It’s hard not to be bullish about CTV when it’s both our largest channel and our fastest growing,” said The Trade Desk Founder and CEO Green during the company’s earnings report on Thursday.