November 21, 2009
Login | Register Now

Advertising Age: Your Online Source for Marketing and Media News


More from Ad Age:
Creativity
Ad Age China
Bookstore
Jobs
Ad Age On Campus
Sign up for E-mail Newsletters

Stay on top of the news, sign up for our free newsletters


What's the ROI of Putting Your Pants on in the Morning?

The Dilemma of Measurement and Accountability

Share on Twitter Share on Facebook Submit to Digg Add to Google Share on StumbleUpon Submit to LinkedIn Add to Newsvine Bookmark on Del.icio.us Submit to Reddit

Phil Johnson
Phil Johnson
A couple of months ago I had lunch with Scott Monty, a friend and former PJA manager, who is now director of social media at Ford. He was telling me a story about a speech he had recently given where someone in the audience kept challenging the ROI of social media. Scott is an analytical guy, but I guess he got exasperated and finally said, "What's the ROI of putting your pants on in the morning?" Some things just seem like a good idea, including program measurement and accountability. The dilemma I see is that while agencies have gotten religion about the discipline of measurement, these efforts have not necessarily increased the value of agency services.

Listen to the agency buzz, and we're all masters of measurement and analytics. Every agency worth its salt claims to not only solve its client's business problems but has the data and case studies to back it up. By the same token, CMOs cite producing measurable results as their No. 1 priority.

That's all great. CMOs want results and agencies deliver. Shouldn't everybody be happy? Not so fast. The other buzz out there is that agencies are getting killed on price and are frequently viewed as a commodity service. That's no way to treat someone who helps drive your business success. Maybe agencies are not measuring enough, or measuring the right variables? Maybe the measurement is fine, but the results just aren't good enough? In any case, there's a gap between what agencies are saying about the ROI of their programs and how they're valued in the market.

Direct agencies can argue that they have solved this problem, and digital agencies get high marks for raising the bar on analytics. But right now everybody suffers from the same price erosion and competitive pressure. While we debate the merits of one approach over another, billions of dollars are gushing straight to Google and contextual advertising. According to Ken Auletta in his recent article in the New Yorker about Google, they "provide an answer to the adman's legendary line: I know half of my advertising works, I just don't know which half."

The cold reality is that lots of money that used to go to agencies of every persuasion, now goes somewhere else. This shift has also led to the market devaluation of many of the attributes that agencies use to differentiate themselves, such as creativity, planning, service -- and, yes, even measurement. In a buyer's market, even the most specialized qualities become a commodity.

The only way out of this dilemma is for agencies to take the next step and conclusively prove beyond any doubt that they contribute to a client's business results. There's no faking it. You'll know you have succeeded because clients will happily pay premium pricing for an agency that's indispensable.

There is no secret formula. But after staring out the window for a good while, I'm convinced that agencies need to attack this problem from three specific directions: the client relationship, the resource allocation and the agency methodology.

To get credit for influencing business results, the agency's work has to be tied to a specific visible goal that the client management team really cares about and plans to measure. Then the agency can align its own measurement strategy around initiatives in which the client is fully vested. To enforce this alignment, the most senior people on the agency side need to stay fully engaged in the day-to-day strategy and management of the business. For the record, I think this is incredibly hard to achieve and depends on a near-perfect client-agency relationship.

Agencies also have to flip the financial equation. Too often the story goes, "Here's how much money I have; tell me what you can do." You wouldn't want a carpenter to take your money, but only fix half the roof. Agencies need better data to understand what it costs to achieve specific business results so that they have the resources to succeed.

The most important shift may be the need for agencies to reorient their culture and processes. We've read a lot about empowering everyone in an agency to be part of the creative process. Now we have to train and empower everyone to measure their contributions against the business results that we want to produce. The discussion can't stop with one sentence in the creative brief but has to track through every step in the agency methodology.

Just like putting on your pants in the morning, agencies deliver a lot of intangible value. That's why they will always have a place at the table. Business results, however, will guarantee their rightful place at the top of the business food chain.

~ ~ ~
You can follow Phil Johnson on Twitter: @philjohnson

17 Comments
Subscribe to comments on: What's the ROI of Putting Your Pants on in the Morning?
  By chrisabraham | Washington, DC October 20, 2009 05:00:32 pm:
I am the president of a virtual, distributed agency of over 35 employees who have no reason to put their pants on at all. Putting pants on as an assumed mandatory culture is dead. Putting pants on is the perfect dead analogy -- putting pants on is not mandatory and in many cases can be considered non-essential and, in many cases, a tip-of-the-hat to the 19th century, the height of pants-putting-on. More and more workers are rolling over in the morning and being productive without pants or cars or commutes or elevators or desks or conference rooms or spit-polishes or any of that Elizabethan hogwash. While I must admit that I am wearing pants now, at this moment, is it only because I guest lectured at a University today on the digital Agency. Universities are so stuck in the enlightenment era, when the fancier the pants the better -- also, tweet and elbow patches! Next thing you know, Phil, you're going to tell me that the pair of pants I need to don in the morning are from the House of Armani.
  By keithboss | riverhead, NY October 20, 2009 05:02:00 pm:
Phil - I think the key sentence here is "For the record, I think this is incredibly hard to achieve and depends on a near-perfect client-agency relationship." I think too often, agencies don't know what the "big metric" is and their internal client may not know it either. In this case, we get stuck hitching wagons to lots of "little metrics" that don't impact the business. This is why we get the constant question of; what's the ROI of that? Because if we have lots of measurements, they may make up for the fact that we don't have the important measurement. I see the potential for lots of projects getting bogged down in measuring everything for this reason. There are some things that can't be measured. There are other things that aren't worth measuring.
  By PHILIP | CAMBRIDGE, MA October 20, 2009 07:10:37 pm:
Keith, you actually said it better than I did. Thanks for the clarity.

Chris, I love your business model. And I would never tell you what kind of pants to wear.

- Phil Johnson agencypja.com
  By nashway | Englewood Cliffs, NJ October 21, 2009 09:00:34 am:
Phil-
Excellent post as always. You seem to have your focus on some of the most important issues affecting agency/client relations. I just wanted to point out one area of your post where you said "agencies need to flip the financial equation." This is an extremely difficult and delicate task, and I'm not sure agencies really get it - your carpenter analogy is perfect.

You wrote: 'Too often the story goes, "Here's how much money I have; tell me what you can do." ' Generally speaking, this is how agencies are selected, reviewed and even dropped - by their ability to answer that question.

But I do think there should be more of a dialogue between agencies and marketers, (read: marketers need to do more of the talking,) and here are maybe some of the questions agencies should be asking when they send back RFPs:

What do you WANT us to do? (Make you look cool? Move the sales needle? Build a brand? All of the above?)

How, then, will WE really be measured?

What's the most important business problem that needs to get solved? (Sometimes, it's operational and has nothing to do with the agency - but it's good to get that out in the open.)

Phil, can you think of any others?

Nader Ashway
Blog: www.markethingthingy.wordpress.com
Twitter: @nashway



Getting back to the carpenter

One more
  By jimmygilmore | Atlanta, GA October 21, 2009 09:21:48 am:
Phil, I love the title/Scott's comment. At Kilgannon, We spend a lot of time focused on ROI around here as well. To make sure we use metrics that are relevant to both us and our client, we create a scorecard in collaboration with our client. Our CFO talks about our scorecard in relationship to high-involvement brands here http://bit.ly/2cTzN4 .

Jimmy Gilmore
jimmy-gilmore.com
@jimmygilmore
  By Brian | Naperville, IL October 21, 2009 09:57:58 am:
I think a lot of the ROI obsession is just obfuscation. "Just tell me the ROI on this" is often a smokescreen for weak or non-existent thinking. Talking ROI makes us all think we're smart without need of judgment, wisdom, insight, risk...

"There is an occasion for everything, and time for every activity under heaven" - and there is a time for using ROI metrics, of course. But too many of us are being lulled into incrementalism and monkey-see, monkey-do by the siren song of ROI.
  By howie@skypulsemedia | Los Angeles, CA October 21, 2009 10:30:33 am:
Great write up. I think Brands overestimate their product/service and market potential. Agencies fail to stand up and say 'sorry but I am promoting a dog of a product what can I do with a dog?'. I love Miller/Bud/Coors commercials. I think they are funny most of the time. I will even purposefully watch them even when DVR'd because they make me laugh. I never buy the product! EVER! I like strong crafted beers. Think of the whole chain there. Agency made a great commercial. It gets Nielsen ratings! I don't buy the beer. Its the beer makers fault not the agency. How can the agency measure if their work has ROI for the beer makers? At Point of Sale with Club Card Bud is $3 a case cheaper so you buy Bud. At the Pub Coors Lite Pitchers are on sale Wed Nights. Each case saw an increase in sales that had nothing to do with Agency work or the product. And thus we have an ecosystem of wastage, voodoo, and fuzzy math.
  By ajpress | DALLAS, TX October 21, 2009 10:34:07 am:
I have a similar question: "What is the ROI of measuring ROI?"

We spend a lot of time and effort agonizing about the methods of measuring countless metrics with precision and granularity. Every activity has a code, every action has a number, and all the data is dutifully collected. But these numbers are subject to human interactions, influence, and associated imperfections.

While measurement is certainly valuable, many companies and agencies push well beyond diminishing returns in the persuit of unerring accuracy, and begin justifying measurement for it's own sake.
  By boxingclever1 | St. Louis, MO October 21, 2009 11:51:13 am:
I say we all wait and see what Rodney Mason has to say before we get any farther into this conversation!

Jim
  By William | East Rockaway, NY October 21, 2009 07:15:29 pm:
Talking about putting our pants on in the morning ... all of this new hoopla about ROI, digital or otherwise, is simply the "Emperor's new clothes" revisited. We've had copy testing via the likes of Millward Brown and Starch; simulated marketing models via Nielsen's BASES; shopper marketing analytics via NPD; etc., for years. All very useful research tools to help guide our creative and investment decisions before rolling out the big media bucks. Quantitative measures like these are the metrics of agency performance! High brand identity, recall and persuasion scores, quality diagnostics and verbatims, hits and clicks, and converted consumer transactions, for example. But ROI, in a classic financial sense, is what it is and that's on the client - because they control most of what affects a brand's ultimate sales, market share and P&L, e.g., R&D, product innovation and quality control, pricing and distribution strategies, trade allowances, and so on. All things beyond any agency's control unless invited to participate (which rarely, if ever, happens these days). And for perspective, academic marketing icons such as Britt, Levy, Kotler, et al, have never been able to prove the ROI of a brand "advertising" investment. Cost-effectiveness and cost-benefit analyses, yes! But ROI, no! Indeed, John Wanamaker summed it up best many years ago for all of us today, "Half the money I spend on advertising is wasted; the trouble is I don't know which half". And so, the question remains. Bill Crandall at bcrandallnyc@aol.com
  By Nevin_S | Lansing, MI October 22, 2009 08:36:52 am:
Phil,
As a corporate marketing guy for decades many agencies lose track of one thing when they work with metrics and measurements. The companies I've been at are there to make money that's the bottom line. The agencies I've employed bring all kinds of numbers and measurements to meetings but every time the missing part is "how are we buying pants after paying for the socks".

Not that I don't like the metrics of a good campaign. I love crunching the numbers of how good that program did among 20 somethings and other groups. But when it come down to corporate its all about how much did the socks cost and how many pants can I buy with the left over.

When I have been asked to track and trend ROI it comes down to one simple measurement, did the plan positively effect the income of the company. The presidents and board of directors I have worked with do not care how they get there or what I have worn just that the income is more then the cost of the socks.
  By Todd_Sebastian | Cincinnati October 22, 2009 10:20:47 am:
SUCCESS STORIES are critical -- and not enough agencies take the time to create and leverage them back with their clients to prove the value they delivered.

One issue: Many agencies think that if they demonstrate a financial payout beyond a shadow of a doubt, then there is no use creating a case study. Not true. There are lots of creative ways to prove to a client that delivered value (e.g., testimonials, social media exposure, shelf presence, etc.).

http://www.TellYourClientsWhereToGo.com
  By griffinof74 | Denver, CO October 22, 2009 12:25:27 pm:
While I work for an agency that is all about relationship marketing and tracking of results. I have seen a lot of turn over of CMOs and marketing directors. All of them were focused on the numbers - tracking ROI, trakcing leads, tracking conversions, etc.

While that is well and good, and something agencies should bring to the table. And yes, agencies need to know what the big metric is and have agreement with the client on its measurement and what would be deemed success.

But, the number one job of CMOs has always been brand management. How are they different than the competion and what is marketing doing to ensure that brand grows. I saw a poll recently of CMOs top concerns. They are were all things like ROI, tracking this, tracking that. But, of their list of concerns, there was no mention of supporting their brand and ensuring that they maintain what is different about them. That could be a reason why their turnover is so high, they have the numbers and results, but they have lost track of job number one.

No wonder fewer and fewer consumers perceive that there are really a handful of different and unique brands on the market. And no wonder everyone is getting pushed into a commodity state. Agencies, even with stressing the numbers and analytics still need to maintain the brand as job number one.
  By Formula13 | Atlanta, GA October 22, 2009 01:05:09 pm:
Agencies and marketers need to keep their eyes on the big picture. While a Twitter profile for the brand may not produce measurable ROI, it can play an important role in connecting with customers and keeping the brand top of mind. Measuring the brand's awareness, preference, and equity are where the focus should be (that and the bottom line). Compensation models are shifting to reflect some of the changes we are seeing in the market.

I believe that agencies need to build stronger relationships with their clients so they have a seat at the table and a more vested interest in the brand's success. ROI concerns will not go away anytime soon, but the end result of a successful strategy should be evident on its own.

www.formula-13.com
  By GregBanks | Dallas, TX October 23, 2009 10:50:08 am:
I have a counter-point to Mr. Johnson's article 'What's the ROI of Putting Your Pants on in the Morning?

Clearly marketers should put their pants on before they catch the train to work each day. Otherwise they'll wind up in jail. But a lot of marketers invest their company's money in a way that, with any other discipline, would also wind them up in jail -- right next to the over-exposed commuter.

With the marketing discipline, it's not unusual, to invest $100MM+ dollars a year for a company -- and not know - year after year - 'was the marketing return positive, i.e. more than the $100MM invested?' 'less?' 'how much less?' Too often, the tired answer from marketers: 'We don't even know if we're close to break-even -- but we showed excellent judgment and risk-taking, so the company should keep giving us the $100MM/year.'

That type of answer has gotten leniency from corporate judges in the past, but it's going to be convicted in the future.

Look at any other discipline for a contrast. For example, imagine that your company hired an investment manager, and entrusted to him or her $100MM/year. And imagine if this investment manager said after a few years: 'We don't know if we're close to break-even -- but we showed excellent judgment and risk-taking, so the company should keep giving us the $100MM/year.'

What would happen?

You got it, Club Fed.

Marketers need to stop holding on to the past, when the 'supply side' ruled, and the marketing discipline was managed as a luxury, a cost. Marketing is now on the front-edge of the demand-side economy, and it's an investment, with a calculable return. Marketing needs to pay out, i.e. return more than it invests -- just like any other investment.

And what bothers me the most - this is a time when marketers don't need to hold on to outdated notions. Marketers have increasing advantages and importance in generating profit and growth for their companies.

OK, in summary, to show that I still have plenty of empathy with my marketing colleagues, I will officially here join their chorus and say -- the marketing discipline excels in qualities like 'judgment and risk-taking.' Agreed.

But where I disagree, strongly, is that marketers can keep leaning on qualities like judgment and risk-taking -- as an excuse -- for not even knowing if they're near break-even with their investments! That's a crime.

Greg Banks
President
Javelin Marketing Group
  By RedShift | Richmond, VA November 4, 2009 10:00:33 am:
I have to say, I thought this article was going to de-bunk the myth of needing pants in general. With so much business taking place in the digital space, actually putting pants on in the morning might not have such a great ROI. (Especially with a video conference call. You could totally get away your bottom half still clad in PJs and no one would know.) But I do agree- the increasing the effectiveness of measuring ROI is paramount in moving forward in the Ad World.

http://www.redshiftagency.com/
  By JamieJoVittetoe | Lafayette, CO November 15, 2009 12:00:01 pm:
Great article. It seems like companies are loosing trust in their agencies. Even longstanding clients are starting to doubt the suggestions made by the professionals marketing their product. Do they doubt their attorneys, accountants, etc. advice also?
:

Note: Comments submitted to AdAge.com are posted automatically and will include the user name with which you registered. Ad Age reserves the right to delete comments that are insulting or personal in nature. Comments may be used in the print edition at editorial discretion. Comments are restricted to 500 words or less.




Stay on top of the news and stay ahead of the game—sign up for e-mail newsletters now!



Advertising Age: Your Online Source for Marketing and Media News