Category Archives: Research

MEASURING EMPLOYEE ENGAGEMENT — WHAT TO MEASURE & WHY

“Engagement” is, as we like to say, the “flavor of the month” amongst organization leadership, employee communication and human resource professionals.

Getting an engagement score helps an organization know how they compare with other organizations like theirs as well as win headlines for “best places to work” in magazines and newspapers. What it doesn’t do is tell leadership anything about what might be wrong and what to do about it. Does the score reflect a problem with trust? transparency? empowerment? teamwork? satisfaction? something else?

A team of public relations academics and professionals set out a few years ago to dissect employee engagement in order to understand what are the driving factors of employee relations, and what truly contributes toward building a workforce that is committed to and fully productive for the organization. Lead by Sean Williams of TruDigital Communications, Ohio, Julie O’Neil, Ph.D. of Texas Christian University, Michele Ewing, Ph.D. of Kent State and myself, along with 13 other international professionals and scholars, we sought to fully define Measurement Standards for the profession around employee relations.

A glimpse into the soon to be published paper, shows 22 Standards, broken down into three key categories:

 Outtakes — Whether employees received, paid attention to, comprehended or retained particular messages
 Outcomes — evidence of changes to or reinforcement of opinions, attitudes or behaviors
 Organizational Impact — Whether and how internal communication has influence organizational performance

What is NOT a category is outputs, what is generated as a result of a program or campaign, and now typically measured by the number of releases, brochure, posters, meetings held, etc. or the number of column inches generated. Outputs were discarded by our group because they show no impact, only production. Using these data points for measurement would be like rating your dentist’s effectiveness on the number of x-rays he took of your mouth to cure a toothache!

Next steps for the committee is to identify methods for measuring each of the 22 Standards — both by self-reporting (surveys) and observation (behavioral indicators already available in an organization). The committee hopes to work with three different organizations to test these standards and their measurement methods — Southwest Airlines is already on-board!

We expect the paper to be published soon, but if you are interested in a bootlegged copy of the 22 standards and their definitions, contact me at ssmith@jjwpr.com.

The “So What” Factor: Migrating From Outputs to Outcomes in PR Research

For years, PR practitioners measured effectiveness by “counting clips” and calculated the dollar value of press coverage they obtained for their organizations. Some PR people are still doing this — mostly, we hope, only when their bosses are demanding it. We have made progress, but we know we have much more work to do to educate management on what Public Relations and Communications professionals can …and should … be measuring.

The good news is, more and more public relations professionals are thinking about what JJ&W calls the “so what” factor – we measured it, but so what? What are the behavioral results? It’s nice that we know how many people recalled seeing our hospital's advertising …but what really matters is, how many people chose our hospital for their healthcare needs?

I’m happy to report that the subject of how PR professionals measure the impact of what we do is being presented on, discussed and debated a lot more frequently than when I started my career 30 years ago. In 2010, the Institute of PR Research formed the Barcelona Principles. There are 7 principles, which are continually discussed and refined, and they reflect the direction PR research is moving in our field. Principle #2, for example, states unequivocally that “measuring the effect on outcomes is recommended vs. only measuring outputs.”

JJ&W has been talking about the importance of measuring behavior for years; Pat Jackson, JJ&W’s founder, together with leading academic professional Jim Grunig, created the Public Relations Behavioral Model and implored practitioners to define the “ultimate desired behavior(s)” they were seeking — in order to have a clear behavioral goal against which to measure success. It’s nice to see the scales in our field tipping in the behavioral direction.

At the International PR Research Conference in Miami this past March, practitioners from all over the world shared ideas on measuring ROI (return on investment) relative to PR activity. Visit www.instituteforpr.org to download and listen to some of those conversations.

Both keynote and breakout session speakers at the PRSA District Conference held on April 28th in Corning, NY focused their remarks on delivering measurable results.

• Ross Levi from the NYS Division of Tourism talked about the impact of the “I Love NY” campaign and its efforts to broaden tourism beyond NYC to all parts of NY – generating a staggering $102 billion in tourism dollars for the state.

• Katie Paine of KD Paine & Partners urged PR practitioners to “measure behavior, not activities”. Instead of doing research to measure our performance, she said, PR should be conducting research that will produce better results for our organizations

• I added to the District conference research conversations by presenting with my colleague Dane Wiseman on the topic, “Your PR Data Has A Story”. Part of dissecting the behaviors we want to reinforce or change is finding out what motivates our audiences, and what’s blocking the behaviors we want from our audiences. We need to make sure our research is asking the right behavioral questions so we have the information we can use to develop the right PR strategies.

For a copy of my Powerpoint on “PR Storytelling with Behavior-Based Data”, email me at rschell@jjwpr.com. For more information on Jackson Jackson & Wagner, visit our website at www.jjwpr.com.

Robin Schell, APR, Fellow PRSA, Senior Counsel & Partner,       Jackson Jackson & Wagner

 

CLEAN OUT YOUR COMMUNICATIONS JUNK DRAWER WITH A COMMUNICATION AUDIT

It is a time for new beginnings, fresh thinking, purging files and finding different ways of doing things.  If you’ve been managing your communications function for a while — or, if you’ve recently inherited the position and found yourself asking, “why are we doing what we’re doing?” – it is a good time for an audit.

The word “audit” is a bit daunting, but really what we’re talking about is an evaluation of what you’re doing now to see if it is:

  • in line with your organization’s goals… your communication department’s goals should be directly aligned with those of your organization
  • meeting the needs of your stakeholders, because if it isn’t, then why are you doing it?
  • driving knowledge and behaviors so that stakeholders act on what has been communicated

A communications audit examines what you are doing now to assess what’s working and not working for your critical audiences.  It helps focus on communications vehicles and messaging that has the greatest impact.

JJ&W asks the following questions when conducting a communication audit:

  1. What does your organization’s communication system look like?  We look at how communication is flowing from the top down, the bottom up and across the organization (laterally).  Do you have a good balance of one-way and two-way communication tools?
  2. What audiences are you reaching with each communication tool? Have you asked these audiences how they would like to be communicated with, or are you just bombarding them from all directions and hoping something sticks?
  3. Have you accounted for the changing demographics of your target audiences? If you’re a utility who is geared toward communication with the senior generation, have you thought about how you might change things up to reach the millennials who are becoming your customers – and will be with you for a long time to come?  Are you communicating in the right languages (not actual languages but idioms of that generation)?
  4. Are the key messages resonating with your audiences? Are those messages driving understanding and behavior?
  5. How effective are your digital communication tools, including social media? Are your target audiences using and responding? Are they clear on where to get their “need to know” vs. their “nice to know” communication?
  6. Do all your communications look like they come from the same organization? Do they have an easily-recognizable family look & feel that immediately lets audiences know where to find information?
  7. Have you gotten the perspectives of more than the senior management team? Have you talked to the front-liners who may not be sitting at desks with computers to find out how, and if, they’re getting the communication they need to do their job?

And if you want to leverage the real power of communications… how about some questions to probe the culture at your organization?  Do people perceive they can “fail forward” or are they fearful of taking risks that might result in punishment?  Do they feel communication is transparent, or does leadership hold things “close to the vest?”

This is an excellent time to clean out your “communications junk drawer” – get rid of anything that’s not working and fill in the gaps with effective methods and messages that are right for the stakeholders you are trying to reach.

Robin Schell/rschell@jjwpr.com /603/770-3607.