Sunday, October 17, 2010

Judging the Jay Chiat Awards

Top man and top strategist, Russ Meyer, the CSO of Landor, invited me to be a judge on the 'Innovative Design' category of the AAAA Jay Chiat Awards for strategic excellence.

It was fun, though it would have been more fun if the judges had been able to convene in person rather than on conference calls.

It was interesting comparing this judging experience to the IPA and Effies. Overall, these awards were focused on the creation of good strategy and the resulting creative, whereas the IPA Effectiveness Awards, are, not surprisingly, focused more on effectiveness.

You might have thought, intuitively, that the Jay Chiat awards would have more variance of opinion because the focus was on creative strategy which on the surface is more subjective than judging the hard data of effectiveness, but it wasn't the case. Although there were far fewer papers to judge and far fewer judges to agree there was a lot of agreement on what was a good strategy and why.

In contrast, judging the Effectiveness Awards, provoked more variance in discussion, especially around the subject of effectiveness which one intuitively would think would be more cut and dry. The discussion was often good, but often vague and off point. With so many entries having econometrics in them it put people in an uncomfortable place. Unsurprisingly, a good few judges were not  prepared to say "I don't know how to judge this paper" (which would have been a good thing to do but would have made people appear rather dim in front of their peers - they are prestigious awards) and we found ourselves having to look to the specialist econometricians a little too often.

The day spent judging the IPA awards was, overall, fantastic. The sheer rigour of the IPA award submissions were fantastic. Huge amounts of work had gone into at least 40 of the 60 odd papers. In the end the best papers did go forward; it wasn't as though we were totally incompetent as judges, but it did leave me more sceptical about effectiveness whilst the AAAA judging did leave me feeling better about the power of the creative end of the strategic process.

I think this subject may deserve a little go around another time.

No comments: