Friday, July 2, 2010

Do your social networks influence your performance appraisals?


Here is a question: when it comes to the performance ratings you receive does it, or should it, matter who you are connected to at work? Intuitively we would expect that certain powerful friendships could influence how you are rated, but surprisingly, there has been very little actual research that tries to uncover the impact of social networks on performance evaluations. Oh, and by social networks I mean your personal connections in the workplace, and not whether you are an avid user of Facebook/Linked-in/Twitter etc!

This is a really important issue - folk theory would suggest that social connections can significantly influence a lot of things managers care about: fair pay and recognition, promotions and terminations, training and career opportunities. It is important to try and understand, are such connections at work always beneficial, or can they also be detrimental? My colleague Gianluca Carnabuci and I thought we would investigate this issue and see how mapping employee social networks might shine some new light on the problem of the accuracy of performance appraisals.

Although it is truly difficult to define job performance in a way which everyone can agree upon, the accuracy of subjective ratings of job performance may be captured by four key measures:

1. leniency - are the ratings given higher than they should be?
2. central tendency/range restriction - does a supervisor tend to give the same ratings to all of their direct reports?
3. halo effects - does a supervisor tend to rate each direct report similarly across objectively different dimensions of performance (e.g., timeliness, quality, quantity of output) regardless of real differences?
4. inter-rater disagreement - when different supervisors are asked to evaluate the same employees, do they agree?

There are several reasons to expect that social ties may influence the accuracy of performance evaluation, both positively and negatively. The most obvious social connection to consider when looking at accuracy of performance ratings would be whether there is a strong friendship between manager and direct-report. These kind of relationships might be expected to reduce the ability or willingness of the supervisor to provide an accurate evaluation, for fear of damaging the relationship. However, strong relationships also imply frequent and open interaction, and this can lead to a supervisor having a lot more accurate information about the true performance of the person they are rating. Which of these effects is stronger is not at all obvious.

In addition to such friendships, we were also curious about another aspect of social networks, which we refer to as 'social embeddedness'. This concept refers to the extent to which any individual is connected to many others through strong and mutual exchanges of trust, friendship, advice and support. The idea here is that being more deeply connected within a work community may exert some additional pressures on the performance rating process.

What happens when a manager or supervisor is 'networked' in the organization? Social embeddedness would increase their ability to access information about performance of a particular direct report, simply by being connected on the 'grapevine'. This should increase the ability of managers to perform accurate ratings.

What about the embeddedness of employees (direct reports) in social networks? Consider the popular employee, connected to many others in strong relationships. It is likely to be much easier to give that person a positive rating than a negative one. After all, if you upset 'popular Pat' with a negative evaluation, then he or she may complain about you to his/her friends. If you already perceive it to be costly to give a negative evaluation, because of the emotional upset and potential loss of cooperation, then the threat could be magnified in the case of a popular employee. Not only might you lose the cooperation of your direct report, but possibly their friends as well. At the extreme, perhaps you would be perceived more negatively even if you are being quite fair. Supervisors are rational human beings, and recognize when the cost of giving an accurate rating outweigh the benefits. The social embeddedness of direct reports could alter the balance of this judgment.

We were interested in seeing whether we could measure these effects, and which of them was strongest with respect to the four measures of accuracy. We studied a network of employees in a large manufacturing firm, by gathering data on their social connections in the workplace, and by separately obtaining performance ratings across five dimensions of performance. In summary, what we have found is that:

1. When there is mutual trust between supervisor and direct report we see greater, and not lower accuracy in ratings (although the average ratings increase, we also see lower levels of halo effect and higher inter-rater agreement).

2. The extent to which supervisors are embedded in workplace social networks does seem to moderately enhance accuracy - they are better at differentiating across performance dimensions (reduced halo effects).

3. The social embeddedness of direct reports has the opposite effect. Consistent with the idea that it is harder to accurately rate popular people, we see greater leniency, more halo effect and some evidence of greater disagreement across raters.

What do we learn from this? Relative to folk theory, the reality is quite complex: social connections definitely matter; but whose social connections we consider is also important. For supervisors, being connected may help improve accuracy, while for direct reports broad social connections can lead to less accurate feedback. Quite surprising, and contrary to popular opinion, strong relationships between supervisor and direct report can improve accuracy rather than diminish it.

So what does this mean for managing? Different organizations have their own patterns of social relationships. Bureaucratic organizations tend to stifle informal social relations while clan-like organizations are built upon them. In bureaucratic organizations the network embeddedness effects may be more limited. However, if you are trying to build an organic, clan-like organization, perhaps because you are interested in being innovative and entrepreneurial, then the effects of social networks on the performance management process are likely to pose a significant challenge. In these conditions, promoting the benefits of embeddedness for managers, while preparing managers for the biasing effects of subordinate networks should help with the effectiveness of performance management.

Monday, June 21, 2010

Managers should be social scientists




Browsing through the McKinsey Quarterly recently I came across this article exhorting businesses to consider the benefits of applying knowledge in the field of behavioral science to areas such as marketing, operations, and customer service. The advice can be simple, even while the research itself is rigorous and complex. For example, in the McK Q article the advice to companies seeking to manage customer interactions in ways that consider this research are the following five bullet points:

1. Get bad experiences over with early (rip-it-off like a band-aid)
2. Break up pleasure and combine pain (mix up the rewards and costs of interacting)
3. Finish the interaction strongly (leave them wanting more)
4. Give customers choice (give them control)
5. Let customers stick to their habits (don't keep changing things up)

Nothing wrong with this at all. What strikes me is that this is exactly the sort of knowledge that b-schools (and e-schools) need to be passing on to their graduates.

The recent popularity of books such as Dan Ariely's "Predictably Irrational" Malcolm Gladwell's Blink/Tipping Point/Outliers, Levitt & Dubner's Freakonomics/Super Freakonomics and numerous others, together indicate an appetite for behavioral research in its various guises. The scientific knowledge that forms the foundation for these books represents real Rosetta-stone material for unlocking how people think, decide, and act. Now those are tools that all managers should have in their tool boxes.

You can learn about teamwork anywhere. You can learn about leadership anywhere (perhaps anywhere BUT the classroom). Where better than the universities, those places that are conducting this kind of basic research, can you learn about behavioral science findings and how to apply them?

Thursday, June 10, 2010

educational entrepreneurship


A very recent story in the Times Higher Educational Supplement reports that David Willetts, the UK's new Universities minister is proposing a form of deregulation of higher education that is extremely interesting. According to the THES article, Willetts is suggesting that the processes of teaching and grading be de-coupled. This would create a system much like that in the UK high-school sector, where exams are graded by exam boards. Only, in the case of Higher Education (HE) the grading services would be provided by degree granting institutions.

This is precisely the kind of external 'disruption' that can be a powerful driver of entrepreneurial opportunity. If a change such as this were to take place, there are a number of obvious sources for enterprising individuals, companies, and universities to contribute to a more dynamic, competitive, and ultimately welfare enhancing HE sector. For example:

  • opportunities for industrious and well regarded universities to build an 'exam board' business
  • opportunities for private sector entrepreneurs to credibly enter the HE market and provide higher quality (or lower cost) services
  • opportunities for greater flexibility for consumers of HE
I would be surprised if this is the only such disruption forthcoming in the HE sector in the next five years. Watch out for enterprising educational institutions going forward. Given the need for flexibility and speed to exploit these opportunities, it would not be surprising to see some different institutional names in the frame, and not necessarily the 'ancient' universities or even the 'civic' universities.