Seven Rules For Observational Research

Seven rules for observational research: how to watch people do stuff
Observational research, ethnography, or, in plain English, watching people do stuff, seems to be hot these days. Newsweek touts it ("Enough Talk," August 18, 1997), which means its getting to be mainstream, but I find that a lot of clients arent very comfortable with it.

Certainly, compared to traditional focus groups, mini-groups, or one-on-one interviews, observational research accounts for a pitiably small portion of most research budgets. Yogi Berras famous line that "You can observe a lot just by watching" is widely acknowledged, but observation remains the most under-utilized qualitative technique in marketing research.
One of the reasons seems to be that many clients (and researchers) just dont know how to get value out of watching. Nothing sours people on a good approach more permanently than a few "interesting but useless" projects.

Learning from watching is, in fact, hard. If you ask a not-very-deep question in a focus group, you still may get a deep and revealing answer. But if you dont know how to think about what youll see when you watch normal people doing stuff, you wont learn much from it. And in observational research, as in all qualitative research, its the "thinking about" thats the key.
Since observation skills dont get sharpened up in real life the way questioning skills do, you need to train yourself to see, learn, and think when you watch people do stuff.

It takes some practice, and some discipline. I dont pretend to have mastered the art, but Ive learned some techniques that will help. So here are my "Seven Rules for Observational Research."
Look for the ordinary, not the extraordinary
Remember the qualitative project when the lady in the third seat on the right side of the table told the story that really made it all come clear to you? You know how you wait behind the mirror for the moderator to show the new concept so you can hear real consumers respond to it for the first time and all the questions that have been running around your mind for weeks will finally be answered? Thats probably not going to happen in an observational study.
Most observational projects Ive worked on have begun with a pretty nervous period while we all get past our first impression that nothings happening! People arent "doing" anything! Theyre just going about their business, and nothing that theyre doing looks surprising! Theyre making lunch for their kids, the same way I would if I were in their shoes.

Theyre waiting for their cars to be serviced, the same way I do. If my clients are along, they begin to get very antsy at this point, because theyre seeing the same thing I am: nothing out of the ordinary.
Rule 1 for observational researchers: "Ordinary" is what youre there to observe. If you dont go looking for something extraordinary, you wont be so anxious when it doesnt appear. What youre really looking for are the insights hidden in "ordinary.

"
Observation gives you the chance to answer those questions such as "What do you do when that happens?" that come up all the time in focus groups. Suddenly youre not restricted by respondents memories, or their reluctance to discuss the issue in a group, or their desire to conceal what they really do in order to present a more admirable face to the rest of the group.
Nothing people do is "natural"
The first time you try observational research, I guarantee that youll find yourself wondering what there is about the things youre seeing that requires an explanation. You may watch people walking into a retail environment. Theyll walk in, look around to get their bearings, walk over to a display or proceed down an aisle, maybe pick up an item or two or compare prices.

"Of course," youll say to yourself, "thats just what Id do in their shoes. Its just common sense."
Rule 2: Whatever you saw could have happened differently. Your shoppers could have taken more time to get their bearings, or less time. They might have gone down a different aisle. They might have picked up more items, or not as many.

They might have sought help from an employee. They might have, but they didnt. What they did needs to be explained.
Start noticing the regularities: do most people need a period of time to get their bearings when they come into the store? Where are they when they do this? Where do they look? What do they see there? Is there something about the store environment that makes them do things they way theyre doing them? Is the way theyre behaving the optimum way you want your customers to behave? Look at the "rule breakers." Who are they? What regularities are they defying?
Once you recognize that everything people do is the result of something, you can begin looking for that something. Maybe its something about them.

Or the people theyre with. Or the environment theyre in. Or something. How do you find it?
"I am the master of the obvious"
When I was first learning to conduct and analyze focus groups, Saul Ben Zeev, who founded C&R Research and is now its chairman, told me that the psychologist, Bruno Bettelheim, his teacher, referred to himself as "the master of the obvious.

" For Bettelheim, it was the secret of his success. Saul trotted that out whenever one of us was stuck for a place to start working on qualitative data (and still trots it out from time to time, now that I mention it).
Think about the last series of focus groups you conducted. What was the most obvious thing about what you saw and heard? Thats where to start: If its really obvious, then it must be really basic. What does it mean? How did people get there? What does it lead to? This was one of the first things I ever learned about qualitative, and remains one of the few really valuable generalizations I know about qualitative analysis.
The same thing is true about observation.

Rule 3: Be the master of the obvious. Take the most obvious thing youve observed. Maybe you were watching people wait to have their cars fixed, and they "didnt do anything." Maybe they actually nodded off in the waiting area! Maybe they spent the whole time looking bored.

Thats about all you saw, and youve been poring over your field notes looking for something to get a handle on ever since.
Ask yourself why they were so bored - and remember that boredom isnt natural. Humans are the most curious creatures on earth. The room had a TV, a bunch of magazines, todays newspaper, some sales material and POP. Why didnt they get interested in any of that?
Were they interested in anything? Not really - theyd get up, check on the progress of their cars, then sit down and nod off again.

But maybe thats it: all they were interested in was their cars - not the TV or the magazines or newspapers, and certainly not the POP. They wanted to see what was happening with their cars! And thats all they wanted to see. Hows that for obvious?
Dont fear the details
The car repair story is real - I once spent a week watching people nod off waiting for their cars to be repaired. I was Jane Goodall and they were the chimps.

And I got more and more panicky as I saw less and less "happening." Then I started thinking about the obvious things I could see.
One seat in the waiting room actually had a pretty good view of the car repair bays, and two or three had decent views. None of the others really let you see your car at all. Luckily, I had detailed notes: I knew where people had sat and how long they sat in each seat.

As I reconstructed scenes, it became more and more clear that people tended to sit in one of the "good" seats unless they were occupied or someone was sitting in the next seat and there were a lot of other empty seats available. When the waiting room was empty, I looked carefully at the carpet and the upholstery of the "good" seats and, sure enough, the wear patterns showed that what I had seen that week had been going on for a long time. There really were good seats and bad seats and you could tell which was which by checking out the sight lines.
Since the project was about developing criteria for understanding waiting-area designs, this was an important piece of information. A good design would put the car center stage and use the fact that customers were riveted to that stage as a way to organize the space and its communication elements. The path for the rest of the analysis was pretty clear.

Rule 4: God is in the details. Take good notes. Make videotapes. Think about where people walk, stand, sit, and look. For how long. Doing what.

With whom.
The whole activity
After "master the obvious," the next most valuable thing Ive learned about observation is, "identify the whole activity."
Heres an example: We were observing people using a newly designed gasoline pump on a summer day some years ago. One of the first "pay at the pump" designs, it allowed drivers to insert a credit or ATM card so they could pay without having to walk to the cashiers station.

We noticed a number of motorists driving up to the pump, getting out and looking at it, then climbing back into their cars, apparently searching for something. Theyd get back out of the car, go back to the pump, and read the directions - which seemed to present some difficulty. At a certain point we began walking up to people who had done this odd little in-and-out-of-the-car dance and asking what they were doing: "Looking for my reading glasses."
There are two points to this little vignette: The first is that a concept isnt reality.

In this case we found that: (a) drivers dont wear reading glasses to drive (although lots wear sunglasses), so pump directions need to be designed for legibility even without glasses (or with the wrong glasses), (b) this particular design failed because the user couldnt make it work without reading the directions, and (c) respondents in several focus groups leading up to this test hadnt noticed the problem, since they had their reading glasses on, nor had the experienced researchers working on the design (us, unfortunately).
The second is that the observational perspective redefines the object of study. We went into this project thinking, as the client did, that we were going to study people pumping gas. But we quickly saw that pumping gas was part of a larger activity - people driving their cars from point A to point B - and that it had to be altered to fit into that activity.

By failing to appreciate the demands of the whole activity, our client had neglected to think about glasses, or driving glasses vs. reading glasses, or sunglasses. All their research had abstracted pumping gas as the activity of interest - setting up experimental situations or taking pump designs into focus groups - and it took observation to put it back into its context.
Rule 5: The "whole activity" is the key to what the consumer is trying to accomplish. Think of activities as rings of context.

Pumping gas takes place inside the "driving somewhere" ring, which takes place inside the "going home from work" ring, and so forth. Most research projects involve single activity units like pumping gas, or kitchen clean-up, or visiting a fast-food drive-thru; but these arent generally whole activities. The whole activity is a set of behaviors that includes these small units plus at least one layer of context. Its "whats going on" from the consumer point of view, and it may be very different from what you (and your client) think is going on.

To get clues about a whole activity, look at how people enter the activity youre trying to observe, and how they exit. Whats going on just before and just afterward? How do they get to the point youre interested in? What and who do they bring with them? What mental state are they in? How do they leave? What do they take with them and what do they leave behind?
The whole activity defines the parameters for the unit activity you want to understand.
Let the arrow find the target
Its a Zen idea. If you strive to place the arrow in the bullseye, youll miss. If you let the arrow find the bullseye, it will fly unerringly. Observation, like all qualitative techniques, takes some Zen.

If your task is too tightly defined, all youll see is what you expected to see.
This doesnt mean that you should leave everything up in the air. The project wont define itself. You need to put together observation forms and some kind of debriefing protocol.

You need to keep your notes up to date, and debrief yourself regularly. (I find that talking into a tape recorder as I drive from observation point to observation point works best for me.) But make sure you leave a lot of room for "other" in your materials.
Every observation form I make has space for what the client and I think the key issues and behaviors are; specific areas we want detailed information on.

But every one also has a big space for comments or something equally open-ended. And as projects go on, those comment areas always seem to get more and more filled up.
This is where youll find the things that suddenly seem obvious, and where all the context issues will land. I guarantee that you wont find either the most obvious aspects of the activity youre observing or the clues to the whole activity in the detailed parts of your note forms. In fact, if you do, I think you should be dubious about your findings because youve probably missed something (unless youre a lot luckier and smarter than I am).

Rule 6: the most obvious things are obvious only in hindsight, and context doesnt appear until it appears in real action.
Marry observation with traditional qualitative
You can learn a lot by watching, to rephrase Mr. Berra, but you can learn even more by watching and talking.
There is absolutely no better way to go into focus groups, one-on-ones, or mini-groups than with your mind full of observational detail and insight.

No better way to look at collages, photo albums or other projective vehicles than with a firm grounding in real behavior. Nor can I think of a better way to follow up on qualitative analysis than going out and observing people doing stuff. Each layer adds dimension and analytic richness, and the richer the stew of data, the more savory it is.
Observation isnt the be-all and end-all of research, and neither are focus groups or any other silver-bullet solutions - which seem to be proliferating at an almost frightening pace. Weve been doing collage research here at C&R for quite a few years now, and we really like it. But its not the One True Technique that youd think it was if you believed its press.

Same thing for giving people disposable cameras, having them wear beepers, or (I swear I heard a serious discussion of this) hypnotizing them to retrieve their deeply repressed memories (about their childhood experiences with a clients breakfast cereal, or whatever). Do you have the feeling that someone could sell focus groups done in a swimming pool because respondents would be more relaxed while floating in warm water?
My own feeling is that the deepest understanding social phenomena comes from combining an analysis of what people do with an analysis of what people have to say - observation plus traditional qualitative. So, as Rule 7, I offer that marriage as the strongest foundation on which to erect a qualitative analysis.
This article written by Walt Dickie is about the understanding and usage of observation research. He suggests that observation research is under utilized because people notice too much of its short-comings rather than its essential benefits. He stipulates that there indeed exist substantial benefits and tries to set about in a seven-step approach on how to get these benefits.

Each of his seven steps is thoroughly explained in a detailed fashion so as to point out and guide the user on what to look for, what part of the observation is vital, how to go about certain situation etc.All in all, he gives the impression just as he explained at the beginning Yogi Berras famous line that "You can observe a lot just by watching" is widely acknowledged, but observation remains the most under-utilized qualitative technique in marketing research. .
I agree with Walt Dicke. Although his seven-steps are not literally found in our marketing book, his point should be well addressed.

Firms are not really pushing the observation research as they should be. Its an excellent tool for the marketing researcher to record behavioural patterns as Walt Dickie was trying to point out in Rules 1,2,3. A wide variety of information can be obtained. Although some major disadvantages to observation research are that attitudes, expectations, intentions are not observable, Walt Dickie suggests following rules 4,5,6 to help alleviate from these problems. He also suggests that when the information is gathered that a qualitative analysis be done. Whether its time-consuming or not or whether it under-utilized by many one thing is certain and that is that observation is the most direct, and at times the only method for collecting certain data.

Words
/ Pages : 2,978 / 24