Amber Naslund's (@Ambercadabra's) brilliant post about getting started in Social Media Measurement got me thinking. Her premise is dead on, that measurement of social media isn't the issue, and it's measurement in general. I can't tell you how many companies either don't measure any of their marketing programs or don't KNOW how they measure their marketing programs. And her advice is terrific – if you are in the business of selling stuff, in other words, if you are either a B to B or B to C Company. But for the other 50% of PR people out there that work for non-profits, educational institutions, government entities, associations etc. most of this good advice is irrelevant.
This brings us to another reality of social media measurement. How and what you measure, and how you define ROI is very much dependent on what vertical market you play in. If you're in higher ed, you're "selling" ideas – the brilliance of your faculty as industry experts, and/or you are in the business of recruiting – be it faculty or students or parents of students. You have lots of different audiences to deal with and the measurement playing field looks very different.
If you're a non-profit, you may be selling the cause, but your metrics are, again, different. You want to measure not just donations, but engagement in the cause, and the enthusiasm of your fans, followers and donors.
If you're a government entity, your mission may be to educate, to lower cost, to "sell" a concept – and thus you are measuring not "leads" or "conversions" but rather the degree to which people buy into whatever it is you are trying to convince them of.
Last summer, I gave two workshops back to back. The first had the full spectrum of industries represented. Government, media, agency, consumer packaged goods, services, education etc. The other just happened to be entirely populated with people in charge of communications at educational institutions. The content of both workshops was the same, but the satisfaction levels were dramatically different. After the second one, every attendee went away happy, with tools they could use, and full of ideas of how to better measure his/her success. The feedback on the first one was all over the map, with some people very disappointed, and others thrilled. What I learned was that whether you're teaching measurement or implementing it, you have to tailor your thinking to the industry you're dealing with.
This may seem to be an obvious conclusion, but one only needs to read a few posts to hear a dozen people express the need for "One good social media metric we can all use." There is no such thing.
All people deserve very good life and loan or collateral loan can make it better. Because freedom is grounded on money.
Posted by: JulietRasmussen | May 26, 2010 at 07:36 AM
Not measuring your marketing efforts' results is indeed stupid.
I'm interested to see location-specific data. Do you know of any source to this type of social media metrics?
Posted by: Patrick Long | May 01, 2010 at 09:22 AM
Great post KD,
And I agree with a lot of what Debra is saying as well. I do think that the organization is benchmarking against themselves and their goals, but knowing where your competition fits in that equation is critical.
A good amount of my clients ask the ROI question: "What will my ROI be from doing social media?" Personally, I think people have lost site of what ROI actually means.
ROI requires an investment, and in using social media, that investment means people, time and resources. People don't work for free, and I seen ROI as a more long term measurement after a program has been up and running.
How do you tackle the ROI question with your clients?
Posted by: Nateriggs | February 08, 2010 at 09:04 AM
Hi Katie, As usual you are bang on the money with this post. We whole heartedly agree with this philosophy at Metrica. The sooner that folks understand that metrics need to be tailored to an organisation's specific goals and objectives the better! There was never a magic bullet that worked in main stream media measurement and there definitely isn't one that works measuring online conversations and social social media.
Posted by: Richard Bagnall | February 05, 2010 at 11:58 AM
two thumbs up for this great blog. keep it up!
i find myself also lost in measuring the output of my marketing campaign. all i know is that my website which was set-up by Prova is doing wonders for me. i think i better know these stuff as well.
Posted by: Barbara | February 05, 2010 at 01:53 AM
Of course, you should monitor what your competition is doing, but I stand by my position that focusing on your competition is an ineffective method for benchmarking. There is a difference between benchmarking and strategizing. Either one without the other ultimately leads to corporate suicide.
My comment didn't suggest wearing blinders to block out the competition. It does say that the competition's benchmarks don't matter. Access to real numbers from other companies is virtually impossible to obtain. If you do acquire them, any comparison is apples to oranges. They may have a 12% overall response rate compared to your 9%. But, if that rate is achieved by offering significant discounts, they are trading profit for response. Benchmarking your business by your competitor's standards is a dangerous game to play.
Posted by: Debra Ellis | February 03, 2010 at 01:51 PM
They were doing really really well, but ultimately lost market share. By not comparing themselves to the competition, they never realized that their message and products were out of date and the competition was getting all the visibility.
Posted by: refurbished computers | February 02, 2010 at 02:32 PM
Great post. I do see clients falling into the trap of trying to find that elusive golden social media metric which, as you said, would not be applicable across the board.
I completely agree with you, Queen of Measurement. Both metrics are equally important: how do we compare to what we were doing last year, and how do we compare to our competition?
Posted by: John S | January 29, 2010 at 11:10 AM
Actually, I have to jump into this and tell you why ONLY looking at your own progress over time is a really dangerous practice. I had a client who instituted a very good measurement program that tracked its own progress in messaging and visibility month over month. They were doing really really well, but ultimately lost market share. By not comparing themselves to the competition, they never realized that their message and products were out of date and the competition was getting all the visibility.
Short version. You need both self benchmarking and competitive benchmarking.
Posted by: Queen of Measurement | January 22, 2010 at 07:15 AM
@Debra,
your comment is great, I think the same thing. It really is important how last month and last year went. So long as things keep moving up, times are good. I will say that there are many factors that can be measured that give a good indication of how things are going and where things are heading
Posted by: Promotional Products | January 21, 2010 at 09:25 PM
Hi Katie,
Yep, I'm with you. I wouldn't go so far as to say discussions about measurement for business are irrelevant to other verticals, as I think there are parallels you can draw.
I spent many years as a non-profit fundraiser, and there are definitive impact points we needed to measure: cost per dollar raised, value of volunteers, engagement and connection to our cause, etc.
But again, while WHAT you measure is often different, the discipline of measurement still needs to be part of your practice. I refuse to settle for the notion that slushier things like engagement or relationships can't at least be demonstrated to have an impact or influence on harder business metrics (and if you're a nonprofit or an educational institution, you're still a business). It takes work and some creativity for how you quantify or qualify those things, and there's undoubtedly a margin for error, but it's still workable.
Your main point is well heard, though, and something I've stumped about for a long time. There is no "standard" that crosses verticals. I do think we'll see some consistent measurements emerge in specific and like markets, but they'll always be dependent on goals and objectives and the individual makeup of each business itself.
Amber
Posted by: Amber Naslund | January 21, 2010 at 10:57 AM
Katie,
This is the problem with benchmarking whether you are measuring social media, direct marketing, or productivity. As a consultant specializing in marketing and operations integration and a proponent for measuring everything, I'm often asked, "how do we compare to other businesses?" (And by often, I mean hundreds of times in a year.) The answer is always the same.
It doesn't matter.
What matters is how your numbers compare to last month or last year. The best businesses compete with themselves, striving for continuous improvement. Even within the same industry, there are different corporate cultures and customer expectations that make comparison with competitors dangerous.
Thank you for this post. Hopefully it will help move people towards defining their own metric system.
Posted by: Debra Ellis | January 21, 2010 at 09:38 AM