You Become What You Measure

As we kick off 2014, we’re awash in PR trends and predictions. Here are six trends to watch in 2014. Here are 20 more. And another 10 more. But let’s look a little further ahead. And let’s start by looking at the implementation of standardized testing in our nation’s schools, the performance reviews of police officers, and the recent financial crisis.

These three seemingly incongruous industries are actually suffering from a situation that will soon face the PR industry as well. They’re all suffering from quant overshoot. It’s one of the four stages of the rise of the quants as described by Felix Salmon in his excellent “Numbed by Numbers: Why Quants Don’t Know Everything” article in January’s WIRED. In the overshoot stage, people stop thinking like people and start thinking like machines.

“On a managerial level, once the quants come into an industry and disrupt it, they often don’t know when to stop. They tend not to have decades of institutional knowledge about the field in which they have found themselves. And once they’re empowered, quants tend to create systems that favor something pretty close to cheating. As soon as managers pick a numerical metric as a way to measure whether they’re achieving their desired outcome, everybody starts maximizing that metrics rather than doing the rest of their job – just as Campbell’s law predicts.”

Salmon points to police departments that judge effectiveness on arrests and schools that focus their efforts on increasing standardized test scores as examples of the unintended consequences of yielding decision-making to quantitative data. What scared me as I read this article is that I see marketing and PR taking the exact same road. Quantitative analysis of big data is thoroughly disrupting our industry – everything we do now can be measured, analyzed and optimized. We use tools like Sysomos and Radian6 to track millions of social media posts. We use sophisticated algorithms to measure the specific level of influence people have among their friends. We use social network analysis to determine how messages flow from one person to another. We can even use cookies and web analytics to optimize the actual content that you see when you visit a site. And we’re only at the beginning. PR is going to get more and more data-driven, allowing us to become more efficient than we’ve ever been.

And that’s what scares me.

PR has always been more art than science and for good reason

Just because we can measure and optimize something doesn’t always mean we should. We’re abdicating our relationships and conversations in favor of statistical models and algorithms. Data has undoubtedly made PR more efficient and effective, but I worry that we don’t know when to stop. We’ve already stopped using Twitter to actually talk with people. Instead, we analyze the length, content, and timing of them to optimize their reach and shares. I’ve already seen instances where relationship-building Tweets like “Great article @reporterX – will be sharing that one around the office!” are shunned because they won’t impact engagement numbers. We’ve resorted to sharing “inspirational quotes” not because they do anything for our brand, but because they’ll get us more likes. We ignore reporters and bloggers who don’t measure up to some arbitrary influencer score. Where does it stop? Will it stop? Can we stop?

PR can and should serve a critical role in the integrated marketing mix. PR should be the ones who help mitigate the impact of the overshoot stage and quickly move organizations into stage four – the synthesis stage, the stage where quantitative data is married with old school subjective experience. PR professionals should be the ones who help bridge this gap, not fall victim to the same over-reliance on data that doomed our financial systems or our schools.

In 2014, let’s make a concerted effort to not be a slave to data. To not let machines and spreadsheets dictate our conversations and relationships. To remember that public relations is still more art than science. To use data to enhance our decision-making, not make decisions for us. Let’s recognize that no matter how advanced the data gets, computers and algorithms will never be able to replace actual human interaction. Hopefully, PR professionals will still be able to do that in between analyzing their graphs and spreadsheets.

*Image courtesy of Flickr user themadlolscientist

Original post

Leave a Comment

2 Comments

Leave a Reply

Mark Hammer

It’s not so much the tyranny of “the quants”, or even numbers. Rather, it is the urge towards at-a-glance “dashboards” and away from more fullsome measurement. It is also the frequent limited knowledge about measurement by those who make the decisions. I do not question the motives of those making thse decisions (at least most of the time). Their motivation is good, but their capacity to anticipate both the weaknesses in the measurement, and pernicious effects of poor measures that become the-whip-that-cracks, is generally low. That’s where the weak link is.

Steve Radick

Thanks for the comment Mark. I echo your frustration with dashboards as well. It’s something I’m seeing in the private sector more and more – if all you’re seeing is a line graph, of course you assume that having it go up from left to right is a good thing. Nothing else seems to matter.