tag:blogger.com,1999:blog-5249997465016074955.post8826387894076864600..comments2023-12-23T21:59:20.634-08:00Comments on The Ad Contrarian: Twitter, ROI, And BullshitBOB HOFFMANhttp://www.blogger.com/profile/05158827977385952634noreply@blogger.comBlogger19125tag:blogger.com,1999:blog-5249997465016074955.post-82400148692817081552014-11-15T10:40:37.620-08:002014-11-15T10:40:37.620-08:00First, do people really take ROI claims such as th...First, do people really take ROI claims such as this entirely at face value, any more than they believe fuel consumption figures from a car manufacturer? We reckon you'd be pretty stupid if you did but equally stupid not to look in more detail at what lies behind the claim in case it does have relevance and is appropriate to you. After all, a car's official fuel consumption figures will be bullshit but that doesn't mean they're completely useless in the decision-making process.<br /><br /><br />Second, it's obvious why you shouldn't invest every dollar in Twitter in this example regardless of the ROI, even if this were 170 to 1 let alone 17. Why? Because of the reasons stated in point 2. <br /><br /><br />No, the REAL problem with ROI isn't doing the math (or maths as we'd say in the UK). It's that ROI calculations, typically, are not simple. The problem then isn't that ROI calculations are bullshit but, rather, that people who need to understand them can't; and it's nearly always in the resulting simplification process that the bullshit appears.<br /><br /><br />None of this makes an ROI claim invalid. What it does do is demand that somebody looking at it asks the right questions to test its validity. Unfortunately, virtually no advertising professionals have a clue what those questions should be and that is just as much an indictment of the advertising profession as it is of the people making the ROI claim in the first place.SpectrumInsightnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-75234494521531612532014-11-14T03:37:23.438-08:002014-11-14T03:37:23.438-08:00Yes, but the profits will be impacted by the dimin...Yes, but the profits will be impacted by the diminishing returns at some point.LeShannnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-56583411046384129612014-11-13T05:47:48.939-08:002014-11-13T05:47:48.939-08:00That's not so important, because if it's s...That's not so important, because if it's still positive - that means it generates net profit. Otherwise you are just saying: "I dont want any more profit, because my ROI will drop". the higher ROI the farther away from saturation you are - and farther away from potential, bigger net profit.Swopardnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-84140968470043282252014-11-13T05:09:28.875-08:002014-11-13T05:09:28.875-08:00Yes, I think bad weather puts people off attending...Yes, I think bad weather puts people off attending funerals- causation not correllation.<br /> <br />You can be sure said salesperson doesn't attribute the sale to Twitter and 19,800 of those data points will have led that person to be in that showroom at that time, having that conversation.Tomnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-61880278184058273262014-11-13T03:35:58.127-08:002014-11-13T03:35:58.127-08:00What can definitely be confirmed is that Twitter d...What can definitely be confirmed is that Twitter drove an incremental purchase by me of your book after I saw the retweet of this article from Dr. Byron. 10 more people like me and you have a positive ROI on the time it took you to post the article!Kurt Jettanoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-6582396537254830872014-11-13T03:29:18.349-08:002014-11-13T03:29:18.349-08:00Terrific article, as usual. Disagree with your Po...Terrific article, as usual. Disagree with your Point #2. In fact short-term promotional ROI is about the only ROI that CAN be accurately measured. All of the "zillions of dollars spent building the brand" are already absorbed into the baseline estimate.Kurt Jettanoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-6328830394314733582014-11-12T13:24:13.786-08:002014-11-12T13:24:13.786-08:00Ha! Love it. I saw this crap the day it came out, ...Ha! Love it. I saw this crap the day it came out, and posted this comment:<br /><br />Put it in perspective please, AdAge. <br /><br />U.S. auto sales in 2013 were 564 billion dollars. Take 34% of that total (34% of auto sales was the number covered in this "study") and that gives you sales of 191 billion - upon which was studied Twitter's effect. <br /><br />Twitter's 716 million dollar impact on 191 billion in sales amounted to .4 percent: less than half of one percent. Free doughnuts at the dealership probably have a bigger effect. <br /><br />And the article advises: "for best results, mix with other marketing messages and media." Really? Ya think?<br /><br />When will the social media hype and bullshit stop?Jonathan Rodgersnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-45582784148925143682014-11-12T11:45:45.165-08:002014-11-12T11:45:45.165-08:00How can you say that this tweet alone didn't s...How can you say that this tweet alone didn't sell at least $17k in Acuras: "Here's something you haven't seen before. Configure your dream 2015 Acura TLX below without ever leaving Twitter. http://acura.us/1Av9LHU"DuBOISTEROUSnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-55744011747450838992014-11-12T08:12:18.288-08:002014-11-12T08:12:18.288-08:00"Any fool can know. The point is to understan..."Any fool can know. The point is to understand." ~ Albert EinsteinJeff Spicolinoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-72118800008524076742014-11-12T06:34:36.021-08:002014-11-12T06:34:36.021-08:00"We do live in a world where the weather is m..."We do live in a world where the weather is more likely to affect how many people show up at your funeral than any other metric"<br /><br /><br /><br />It it really? Or are you using a vague sense of correlation to reach that conclusion?<br /><br /><br />Tens of thousands of people turned up to Nelson Mandela's funeral and it was horrible weather. The rain certainly stopped those numbers being even higher, but most important factor in how many people turn up? No way.<br /><br /><br />Measurement is useful. Just don't try to push it beyond what it can actually do.<br /><br /><br />I can't prove it (intuition is useful too!) but bet a car salesman would disagree with your 20,000 data points and say it's almost always the same very few things that decide a sale.Neil Charlesnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-22656281526939463982014-11-12T06:22:23.648-08:002014-11-12T06:22:23.648-08:00I agree that by isolating some variables, using ba...I agree that by isolating some variables, using banks of empirical data we can get to a point where we know A works better than B or that when we did C, D tended to go up, but I don't think for one second it's as advanced as people assume. We do live in a world where the weather is more likely to affect how many people show up at your funeral than any other metric, where film reviews matter more than advertising films, where sometimes stuff just happens. <br /><br /> We'd be better to assume we know nothing and that we can get a vague sense of correlation to some activities that we do and the be pleasantly surprised by what we establish, that what we do now, which is to peddle the myth we can somehow measure ROI. <br /><br /><br />To buy a car probably includes 20,000 data points, of which 90% we don't even realize we're making, it's smell, how greasy the salespersons hands were, how nice the coffee was, to attribute a sale to ANY one thing is madness.Tomnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-74880819607373934632014-11-12T06:21:18.701-08:002014-11-12T06:21:18.701-08:00ROI diminishes bur profit rises. If the campiagn i...ROI diminishes bur profit rises. If the campiagn is really effective you should still invest in it much moreSwopardnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-32598367639093572282014-11-12T05:13:25.452-08:002014-11-12T05:13:25.452-08:00From the referenced AdAged article:
"With ov...From the referenced AdAged article:<br /><br />"With over 65,000 daily tweets about purchasing or researching a new <br />car, Twitter gives auto brands the unique opportunity to connect with an<br /> audience of in-market shoppers <b>who have expressed intent to buy a car</b>,"<br /> said Rob Pietsch, head of Twitter's auto vertical, in a statement. (Emphasis mine.)<br /><br />...in other words, they were already in the market for a car, so Twitter didn't "drive" sales, only (perhaps) redistributed them.Graham Strongnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-398803473315148972014-11-12T02:31:34.696-08:002014-11-12T02:31:34.696-08:00"For one, any new product can't possibly ..."For one, any new product can't possibly ever have an ROI attached to it, to do so we'd need to somehow know what would have happened without that ROI"<br /><br />Spot on. Calculating ROI in the first 6-12 months of a product's life is pretty well impossible. Everything's going upwards and you can pin those increases on anything you like.<br /><br />"Secondly even existing products in markets where little changes still have far too many variables"<br /><br /><br /><br />That's not correct though. There's a very well established statistical technique called multiple regression, which can pick apart which factors are having what impact on sales. There are textbooks full of caveats about where it doesn't work and it needs huge care, but a decent analyst with high quality data can separate advertising's immediate sales impact from the weather, distribution changes and other factors, fairly easily.<br /><br /><br />The list of things that make a significant difference to what a brand sells in a week isn't actually that long - only 7 to 8 factors. As long as they've been varying over time you can work out which bits are having an effect.Neil Charlesnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-6324862751091494472014-11-12T02:21:30.082-08:002014-11-12T02:21:30.082-08:00The really uncomfortable thing about calculating R...The really uncomfortable thing about calculating ROI on advertising is that anyone not from Advertising can see how totally impossible it is, there are simply far far far too many variables.<br /><br />For one, any new product can't possibly ever have an ROI attached to it, to do so we'd need to somehow know what would have happened without that ROI. It seems that Tesla were able to sell every car they ever made with no advertising. If Tesla had done one promoted Tweet to support their car, the ROI would seem to be infinite. Yet common sense makes us know this to be bull.<br /><br />Secondly even existing products in markets where little changes still have far too many variables, it could be the weather, it could be competitor activity, regulation, new distribution. Anyone know knows anything about Marketing can see that it's impossible.<br /><br />We need to rely on gut more. The worst thing in advertising was the illusion that we could measure it. You may like this. http://www.mediapost.com/publications/article/230654/advertisers-get-comfortable-with-ambiguity.htmlTomnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-15742449092341887302014-11-12T02:15:46.531-08:002014-11-12T02:15:46.531-08:00I make a living measuring the ROI of marketing cam...I make a living measuring the ROI of marketing campaigns, so this and the linked 'Return On Ignorance' post make for somewhat uncomfortable reading.<br /><br /><br />They're not wrong, which is why they make for uncomfortable reading.<br /><br /><br />We need to be honest about what ROI measurement, as it exists today, does. Putting any awareness increases etc. to one side for a minute, all ROI metrics do the same thing: They measure the spike in sales that occurs during and in the few months following a marketing campaign.<br /><br /><br />1. This isn't the whole ROI from marketing.<br /><br /><br />2. It is still incredibly useful information, because you can find out which campaigns create bigger spikes.<br /><br /><br />You can also use this ROI for budget setting. In simple terms, when a CMO says "I want to make sales double this year by spending more on the same adverts", it allows an analyst to say "that won't work. Let's talk alternative strategies". ROI measurement as it exists today lets you build realistic, accurate, short to medium-term sales forecasts.<br /><br /><br />That said, a 17x ROI from social media is clearly nonsense for the reasons outlined in the post.<br /><br /><br />The marketing industry has a habit of responding to a common-sense analysis that it doesn't like, by making it more complicated. It doesn't invalidate the common-sense answer but everyone gets confused and then bored and then the problem goes away. Bringing diminishing returns into this one - as a couple of comments have - feels a lot like that to me.Neil Charlesnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-3294109142761983472014-11-12T01:55:36.547-08:002014-11-12T01:55:36.547-08:00"Knowing the names of things is not the same ..."Knowing the names of things is not the same as knowing things"<br /><br />That is my new favourite quote - currently scrawled on a post-it note on my monitor.Dan Plantnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-16085422739108665662014-11-12T01:53:04.637-08:002014-11-12T01:53:04.637-08:00My thoughts exactly, Chris. Diminishing returns. Y...My thoughts exactly, Chris. Diminishing returns. You might see good results when people see your TV ad 5 times. Making them see it 25 times is 5 times more expensive but the results most definitely won't be 5 times better.<br />This is not to defend the "study" in question. Working in direct response makes calculations much more straight forward. And the job much more difficult.Adamnoreply@blogger.comtag:blogger.com,1999:blog-5249997465016074955.post-89325383921073375632014-11-12T01:28:59.898-08:002014-11-12T01:28:59.898-08:00Agree with what you're saying here Bob, but on...Agree with what you're saying here Bob, but one thing strikes me - wouldn't we expect ROI to diminish as marketing investment increased? Surely there are only a finite number of people to reach?Chrisnoreply@blogger.com