Case studiesUsing AI

Using AI to analyse stakeholder feedback: two projects, two very different approaches

Share
Summarising stakeholder feedback for a council report
Share

Doing a good job of analysing stakeholder feedback is important because it’s where we listen to the people who will be affected by decisions. But there’s no denying it can be tedious, overwhelming work, particularly where there are large volumes of comments to make sense of, and/or you are working to a tight deadline. The good new is there are plenty of opportunities to use AI to help you with this type of work. But the best approach will depend on what you’re dealing with.

Here are two project examples which involved summarising and reporting on feedback. AI was a huge help with both of them, but in very different ways.

Example 1: Taking the grind out of summarising feedback

A council had gathered customer feedback on its community facilities, and I needed to make sense of thousands of comments across four facility types. My job was to distil all of it into summaries for the Executive Team to consider.

My method

I asked AI to categorise the different comments in response to each survey question, using category topics I provided. This gave me an easy way to record the number of comments in each category. It also allowed me to review all the comments within each category to identify the representative ones.

I copied over a broad range of the comments into a new list and provided this raw content to AI. I asked it to draft summary paragraphs for me. Then I edited these draft paragraphs to ensure they covered all relevant points, and cut out any unnecessary words and sentences. To finish, I ran a fabulous prompt shared by Lisa Mullis to pick up any remaining ‘AI-isms’ in the writing.

Using human judgment

I chose to read through all the comments and hand-select the representative ones to inform the summaries. This was a big job given the volume, but doing this gave me familiarity with the content, so I could judge whether the AI’s summaries reflected the full range of what people said.

Example 2: Using AI as an analyst

The second project was a regional youth-sector project. The feedback was smaller in volume but more diverse. My role was to analyse the feedback, make recommendations and develop a draft action plan.

This time I didn’t need to use AI to summarise the content (due to the smaller scale of it). Instead, I used it to help me think about the feedback.

I adapted two prompts from Ed Gandia’s AI Advantage Hub, which I subscribe to. The first one is called ‘The Fast Intel Summary’. It helped me crunch the numbers (in support and opposition), spot patterns, and quickly get to grips with the different points of view in the feedback. Rather than grappling with the structure for the deliberations report I could jump straight into getting my draft recommendations onto the page.

The second prompt is called the ‘Adversarial Editor’. I gave it my own role, as a policy analyst, and asked it to review my draft report and rough recommendations. I wanted it to identify what was working, what was strong but underdeveloped, where the gaps were, and the key changes I could make that would most improve my draft report.

Using these two prompts really saved my bacon when I was under huge deadline pressure. I got my report to a ‘good enough’ place to leave, so I could move on to the other project above. When I came back to it a week later (with fresh eyes) it was a relatively simple process to finalise my deliberations report and action plan.

Summing up

Using AI to reduce the grind of summarising large numbers of submissions is a huge time saver. Make sure you maintain human oversight so that the result is a fair and accurate reflection of the feedback.

The second use, getting AI to give you an initial readout to respond to, and then to stress-test your analysis, is also well worth doing where you are making recommendations on what to do in response to feedback. It’s a different job from drafting the consultation document in the first place – what I learned using AI to develop two consultation documents covers that side of the process.

Need someone to do this for you?

Both of these projects were done-for-you work – I distilled thousands of comments into summaries the Executive Team and staff could act on, and I turned a regional youth-sector consultation into a deliberations report with recommendations and a draft action plan.

If you’ve got a pile of submissions and a report due, that’s the kind of work I can do for you. Have a look at my strategic planning service, or just email me and tell me what you’d like help with.

Written by
Debra Bradley

Debra Bradley writes strategies, policies and plans for councils and not-for-profits in New Zealand, and trains teams to use AI without losing ownership of their work

Related Articles
EditingUsing AI

When to use AI for editing, and when to edit by hand

In August and September I taught two workshops for professional editors on...

Graph showing support and oppose results from AI-assisted submission analysis
Using AI

Using AI to speed up submission analysis: what I’d do again and what I’d change

Summary Using AI to speed up submission analysis brought an estimated 60...

A manager discussing a draft council report with a team member.
ReportsUsing AI

Reviewing council reports: three risks, and where AI helps or gets in the way

I’ve known excellent staff who have resigned over ‘report churn’ within an...

Using AI for consultation documents will be different every time.
Case studiesCommunity engagementUsing AI

What I learned using AI to develop two consultation documents

When I first started using AI seriously, I built myself four advanced...