Archive for the ‘assessment’ Category

Everyday stories hold great insight

Wednesday, May 14th, 2008

If you’ve visited this space at all before, you’ll know that I believe the stories we tell of our lives hold vast riches of information–and that information can be used to inform decisions on strategy, management & leadership, among other areas.

Today, the invaluable Harvard Business School Working Knowledge website features an article by Julia Hanna discussing creativity in the workplace and its place in innovation. The whole article is wonderful and worth reading in full. But I was fascinated by this passage regarding the research of Harvard professor Theresa Amabile:

As a way to delve deeper into the link between motivation and creativity, Amabile and her husband, psychologist Steven J. Kramer, conducted a three-year study of 238 professionals from seven companies in the high-tech, consumer products, and chemicals industries. Without revealing the focus of their study, they asked the subjects (all of whom were working on projects requiring creative effort) to fill out a daily electronic diary form that required numerical answers to questions about their work that day, as well as their emotions, motivation, and work environment. They were also asked to describe what they’d done that day and to include a brief description of one event at work that stood out in their minds [emphasis mine]. (Participants were asked to refrain from discussing the diary content with colleagues.) By the end of the study, Amabile and Kramer had collected nearly 12,000 entries, what she describes as a “wonderful treasure trove of data.”

“We have a window into how concrete events affected knowledge workers’ thoughts, perceptions, emotions, and motivations,” Amabile says. “We call this ‘inner work life,’ and we found that it directly influences creativity and other aspects of performance.”

The mundane, quotidian stories (the events the subjects documented) were an integral part of the study data. By leveraging these, Amabile and Kramer were able to evaluate a trait–creativity–far more deeply than could have been done by numerical analysis alone. I’m convinced that capturing and sorting through stories can add incalculable wisdom to the business world. We’ve only begun to scratch the surface of the possibilities.

On a side note, I’ve been thinking about how Twitter and like tools will be involved in this arena. What are all those tweets telling us about ourselves?

But that’s a topic for another post.

(Photo: “Old Diary” by Race_Eend via stock.xchng)

Tags:
, , , , , ,

Complex business problems need diagnosis, not packaged solutions

Monday, January 14th, 2008

Dave Snowden, whose posts are always interesting and instructive, says this in a post today:

What I am finding is that the more accurately you can describe the situation, the less you need formal intervention methods. For example if I can show a statistically valid trend, supported by narrative then most people in leadership or management positions can work out what they need to do.

In other words: if you fully understand the problem, you don’t need complex managerial methodologies to solve it. Over-relying on “five practices” or “seven habits” or “four steps” amounts to short-cutting the real difficulty of understanding complex situations. There are lots of reasons, which Dave describes well in his post, why best practices and case studies are not good guidance for action in most circumstances.

And it is difficult to know what the problem is in a complex environment. Standard assessments & surveys demonstrate this. Asking a thousand employees, “How innovative are we on a scale of one to five?” produces, at best, a pretty-looking chart that signifies nothing. At worst, it can point you in a completely-wrong direction. But everyone wants a short cut.

Exhibit A: the current romance with performance dashboards. In my experience, at best dashboards point you to a situation that you need to understand more deeply (”Is this drop in region 5 sales an anomaly, or is there something substantial behind it?”). In no circumstances is dashboard information enough to act on.

So the need is more for problem-understanding skills, and less for problem-solving skills–meaning managers will need to get more in tune with narrative sense-making. Here are two examples where intelligent executives looked beyond the data, into the narrative mess behind a problem or dilemma, and used the story that emerged to guide their actions:

1) A.G. Lafley of Procter and Gamble, as described in the book “The Opposable Mind“:

While trying to decide to whether to roll out highly-concentrated laundry soap, Lafley faced a dilemma. Merchants loved the idea, but consumers, as measured by P&G’s quantitative research, were neutral to negative. In most cases, this would answer the question: don’t roll out a product that consumers didn’t love. But Lafley didn’t accept the data at face value:


…[He] decided to dive into the voluntary comments that some of the consumers added to their quantitative research forms…. Lafley took many evening and weekend hours to pore over more than four hundred handwritten voluntaries. He came to the conclusion that while consumers weren’t wildly enthusiastic about compact detergents, few were actively hostile….


And, as a result, Lafley decided that the product could be a success. And, of course, it was. (Stay tuned for a review of “The Opposable Mind” later this week.)

2) A Fortune 500 VP of Human Resources, evaluating a new performance appraisal system, as described in this blog:

Last year we had a pilot of a new performance management system for our employees. The trial group was 4000 people. We had spent a lot of time on the pilot and gathered a lot of data. At the end of the trial, the VP of Human Resources printed out all the comments that had been received on the survey forms. He took them home one night and read every single one. Then he came in the next day and said, “We can’t roll this system out.” And that was it. The trial was very expensive. We’d gathered lots of data, lots of numbers, but the final determinant was what he read in those comments.

One observation about the above two incidents is that reading narratives and evaluating qualitative data, if done at all, are relegated to nights and weekends.

This is perhaps a sign of some of the difficulties we face in the corporate world–you can spend all day looking at charts and spreadsheets, but read stories on your own time!

, , , ,

An anecdote on the power of business narrative analysis

Friday, April 13th, 2007

I had lunch with a former colleague yesterday, whom I hadn’t seen in ten years. She related to me this story:

Last year we had a pilot of a new performance management system for our employees. The trial group was 4000 people. We had spent a lot of time on the pilot and gathered a lot of data. At the end of the trial, the VP of Human Resources printed out all the comments that had been received on the survey forms. He took them home one night and read every single one. Then he came in the next day and said, “We can’t roll this system out.” And that was it. The trial was very expensive. We’d gathered lots of data, lots of numbers, but the final determinant was what he read in those comments.

I had been talking to my friend about collecting and analyzing business narrative to assess organizational change using Anecdote’s methods. I told her, “He didn’t use a system, and comments aren’t necessarily stories. But, in essence, your VP was using the narrative technique.”

, , ,