
I had an experience lately that really made me think about what we do and how we approach our design work… once I got over being angry. My team had engaged a group to conduct some research on our behalf in support of an initiative that I lead. They interviewed us (as they should), asked lots of good questions (as they should), and then went away to do the work and report back with observations and a findings report. The goal here was to make recommendations based on a solid research foundation, supported by strong rationales. They spent three weeks digging in and crafting the report.
At the end of those three weeks we were presented with the results of their efforts… and left unbelievably wanting. What went wrong? When did they forget the goal of the project? Did they even understand what research actually is and entails? Needless to say, my team was disappointed and wondering why we had engaged this group. I detailed thoroughly what the issues were and regrouped with the team to discuss how to move forward. We’re back on track now, and things are coming together both quickly and in a way that is creating the needed value from this effort. But it begs a bigger question.
How did we get there? Where was the misunderstanding? How can research goals and efforts go so wrong?
Ultimately, why do so many research efforts fail and, more importantly, why do design teams so often sleepwalk through the research and discovery process? This project made this clear as it was not yet part of a larger effort. The research WAS the project, and evidence based design should look at this type of work with big eyes and anticipation. It’s what we do, we work to understand and create context for our recommendations and assertions (or as a best practice, are supposed to do).
I think one reason is that research is often done by an individual or team that is largely separate from the rest of the project conceptualization and design phase. They do their work and create a findings report or set of requirements which are presented to the larger project team who may or may not actually read the documents. This becomes the protocol and they begin to devalue their own efforts. It is hard to believe, but there is still a proliferation of designers who do not value the research and findings created at the inception of most projects. What is even more unbelievable is the reality that there are still designers who enter into project work with a design bias from the very beginning, and resist tempering that bias with the reality of the market research or competitive audit. This ends up costing the client, in many cases, as work needs to be re-investigated or brought back on strategy. The reality of my project is the group we hired put the wrong team together, they missed the point and treated this discreet research effort as they would the discovery phase of any other project, which is to say… poorly. My team was pretty explicit about how to proceed, but old habits die hard. I knew that the team we hired had the expertise and the talent to provide us with the value we required, they just missed the opportunity to organize around this requirement and instead went on autopilot. Getting reoriented was painful, but I now honestly feel we will have a better foundation for moving forward with the initiative as the missteps so clearly outlined what opportunities were missed and where the misunderstandings were. I’ll let you know where we net out as I get the new report TOMORROW. I am excited to see what they provide, but will admit to having a bit of anxiety about it.