Stop measuring success by counting attendees

Stop measuring success by counting attendees

The post-event budget meeting opens with a number. Someone has put it on a slide, large enough to be read from the back of the room, which is ironic given that the back of the room at the actual event was populated by people who had technically attended and were technically also on their phones.

That number is attendance. It's good. Everyone agrees it is good. The meeting then pivots, with the clean efficiency of a well-oiled organization, to one question: how does next year's number get bigger? If this sounds familiar, that's because entire professions have been accidentally doing it for years. Yet the logical consequence of the metric is not even considered: what happened to the people making up the number?

The mechanism has a name

British economist Charles Goodhart observed in the 1970s that statistical relationships can break down once they are used for control purposes. The idea later became widely known as Goodhart's Law and is often summarized as: when a measure becomes a target, it stops being a good measure.

The problem is not theoretical. Research by Gwyn Bevan and Christopher Hood into the English public health system documented how performance targets created opportunities for gaming: organizations learned to optimize what was being measured, sometimes without improving the underlying outcome the measure was supposed to represent.

The same pattern appears elsewhere. In education, high-stakes testing can push schools toward teaching to the test rather than broader learning. In policing, numerical crime targets have been associated with dysfunctional behaviors aimed at improving reported performance. And in academia, publication counts and journal metrics can incentivize quantity over research quality. Different industries, same basic problem: once the number becomes the goal, people get very good at improving the number.

Events are not immune either. Attendance is a perfectly reasonable shorthand for “the event was valuable enough that people showed up.” The problem starts when that shorthand becomes the primary thing being optimized. At that point, the budget, the program and the post-event reporting can all begin reorganizing around producing the number rather than the thing the number was supposed to reflect — which is how perfectly sensible metrics end up wandering off and starting new careers as targets.

What the number actually buys

Attendance is wonderfully easy to defend in a budget conversation. Marketing campaigns, venue capacity, registration targets: they all lead neatly toward a number that fits beautifully into a spreadsheet.

What happens to those people once they are inside is a much less cooperative question.

The investments that shape what happens inside - how the program is structured so energy doesn't quietly drain out by 2pm, whether the networking has any actual mechanism or just hopes for the best, whether sessions have enough interaction to keep three hundred adults from simultaneously deciding to check email - are harder to defend in a budget conversation organized around headcount. They rarely produce one satisfyingly large number. So they are easier to trim.

The result is an event optimized for getting people through the door and then leaving the rest largely to chance.

The timing problem nobody mentions

The irony of using attendance as a success metric is that an event can hit its attendance target and still fail completely at what the target was meant to represent. A room of four hundred people in low-power mode is a very different event from two hundred people genuinely present.

The badge scanner, logging another beep, cannot tell the difference.

What can tell the difference is what participants are actually asked to do. Respond. Choose. Compete lightly. Notice they are in a room with other people who are also doing the thing.

A gamified structure can create those opportunities for participation while also making some of that activity visible: who participated, when engagement dropped, which session sparked follow-on activity and which produced nothing but polite silence.

The quality signal and the engagement mechanism arrive together — but only if someone in the budget meeting thought to ask for them, which requires the meeting to be about something other than slide three.

The question that changes what gets built

The planning meeting that starts with “how do attendance numbers grow?” will produce a well-attended event.

The one that starts with “what should participants be able to do by the end, and how will anyone know?” will produce a better one - and a slightly more uncomfortable meeting, since it requires answering questions a good attendance figure has historically made it possible to skip.

Attendance is just an early number, collected at the door before the event has technically started. Declaring success at that moment is a little like judging a restaurant by how many people walked in, and then leaving before the food arrives.