This time, the AEA conference was held in Portland, where the skies are as gray as our thoughts on evaluation challenges, and the coffee flows as readily as our passion for data! As the American Evaluation Association (AEA) conference wraps up, I wanted to distill the best bits from #Eval24 – albeit some reflection points. Here are my top four takeaways from this year’s discussions – because the evaluations we love don’t just do themselves!
1. The AI Surge: Artificial Intelligence in Evaluations
You’d think evaluators would be a little apprehensive about AI stepping into our domain – but surprise! This year, AI was the star. From improving data accuracy to automating data synthesis, it turns out AI has a few tricks up its silicon sleeve to make our lives easier (and, yes, a little spookier). Fun fact – all tweets quoted in this blog were extracted in 1 second using AI.
As one evaluator tweeted, “AI: making evaluations faster, more thorough, and, for better or worse, self-reflective. #Eval24” – because if your evaluation tool doesn’t make you question reality, is it even worth using?
Participants filled up the ballroom for an AI Session
2. The Rise of Young and Emerging Evaluators
Move over, veterans; there’s a new wave of evaluation enthusiasts coming in hot. A fresh focus was placed on supporting Young and Emerging Evaluators (YEEs), who bring innovation, fresh perspectives, and TikTok fluency to the table. The enthusiasm was palpable, with every room buzzing over how to mentor, support, and celebrate the energy YEEs bring to the field. And yes, some of them even brought their hashtag game.
“The YEEs are coming, and they’re questioning everything! #Eval24” – it’s exciting to see new voices challenge old paradigms, and it reminds us all why we got into this work in the first place.
3. Confronting Power Asymmetries in Evaluation
Ever feel like the room where decisions happen feels a bit… asymmetrical? Power dynamics in evaluation came under scrutiny, and this time, nobody was letting it slide. The sessions echoed with calls to disrupt hierarchical power structures, challenge biases, and ensure that all voices are heard, not just the ones in the proverbial “big chairs.”
As one enthusiastic participant put it, “Power asymmetries in evaluation? If I had a dollar for every time that topic got hushed up… but not here! #Eval24.” Indeed, the path to fairer evaluations begins by leveling the playing field and letting the data – and the people – speak.
Bagela Chilisa argues the need for recognizing indigenous knowledge systems during the closing plenary
4. Respect for Indigenous Knowledge Systems in Evaluation
This conference redefined what it means to consider all voices. Evaluators leaned into the importance of integrating Indigenous knowledge systems, a shift that feels well overdue. The message was loud and clear – especially from the keynote Bagela Chilisa gave. True evaluation means respecting, learning from, and elevating voices that have been here a lot longer than many of us. We were reminded to “evaluate with” rather than “evaluate on” Indigenous communities, a refreshing perspective on ethical, equitable evaluation.
One panelist noted, “Imagine a world where evaluation recognizes that knowing is enough. Indigenous knowledge might not need our methods to validate its worth. #Eval24,” proving once and for all that authenticity is priceless.
Hold on a bit, with more enthusiasm towards artificial intelligence, arguably amongst the younger generations. Isn’t that a divergence from focusing on indigenous knowledge systems? Doesn’t shifting towards AI bring another dimension into the complexity of power asymmetries in evaluation? Obviously, indigenous knowledge systems might have to play catch-up with AI systems or form a convergence – just like it has been since the “globalization” era – or perhaps, like the breakfast package on my table.
Portland’s inseparable coffee and craft – the choice is yours!
The AEA conference proved that evaluation, like Portland’s coffee, only gets better with a little blend of innovation, respect, and fresh energy – more reason I have been a member since 2018. Whether it’s AI, Indigenous knowledge, power dynamics, or a new generation ready to make its mark, the future of evaluation is anything but predictable.
And with that, we say, #Eval24, it’s been real! Keep challenging, keep laughing, and keep doing the good work. Until next year in Kansas!
