Is AI your junior scrutiny assistant?


Have you been thinking about AI in the context of your scrutiny work at all? Conversations are certainly starting to happen - so here are a couple of things that it might be useful to reflect on.

I see that as councils are beginning to form policies, so some scrutiny committees are starting to receive reports on AI. And I wonder if the first in-depth inquiries are just around the corner - perhaps they are happening already?

And, from a scrutiny perspective, there are so many dimensions of this to look at. You have the ethics, the environmental costs, data ownership, data security, unauthorised use and workforce issues. To name just six.

Looking just at how scrutiny works, however, there are a couple of things that I’ve been thinking about.

First, and this came up during a conversation at the Centre for Governance and Scrutiny conference this year, is the idea of AI as a ‘junior scrutiny assistant’.

The AI assistant can do many things such as produce summaries of reports, transcribe meetings, analyse data or undertake research. No doubt they have other abilities and new ones will emerge.

But it’s a junior assistant because its work needs to be carefully managed and checked.

I spoke to Phil Rumens at West Berkshire Council about this. Phil is involved in a pilot to use AI for meeting transcriptions right across the council. He told me that, just as we are training AI to be more human, we shouldn’t be surprised when it makes mistakes.

And bias will also be an issue. Not least because the information that AI draws on will most likely also contain biases.

“Ask it to show its working”, suggests Phil. “Get it to cite its sources and say which articles of the constitution it is referring to, for example”.

Yes, supervising your junior scrutiny assistant requires skill and the right training.

A second idea comes from something that Catherine Howe said during her keynote at the CfGS conference. She talked about AI ‘saving time for the human work’ and what that human work might involve. This really struck a chord because it raises what is, perhaps, the most interesting question raised by AI:

What exactly is the ‘human work’ of scrutiny? In other words, what is it that only humans can do, that adds value and makes scrutiny meaningful?

I mean, we can talk about the skilled questioning, the trusted relationships and the connections with residents for starters.

Yes, your ‘junior scrutiny assistant’ can suggest some questions but it’s your scrutiny human that decides what to ask, adds details that they have picked up from other conversations, frames things in the right way and carefully follows up.

So, we shouldn’t lose sight of the human skills in our conversations about AI - perhaps that should be the first thing we talk about.

By the way, I've also posted this on LinkedIn. You can read / add any comments here.

Dear scrutineer,

Get reflections like this straight to your inbox. I also share them on LinkedIn.

Read more from Dear scrutineer,

Once upon a time, dear scrutineer, there was a senior officer called Ralph who worked as a director at three different councils. Here is his scrutiny story. I wonder what you’ll make of it? At the first, Strawbridge District Council, Ralph’s relationship to scrutiny was as a witness, appearing before the scrutiny committee to present reports and answer questions. At this council, it was generally the officers who did this, cabinet members, when they did attend, sat with the committee members...

Kostas, a scrutiny officer I know, was telling me about what he thought was a funny moment before a meeting the other week. He said it was ok to share, so, as long as you keep it to yourself, here it is. The chair of the committee that Kostas supports was talking to him about how to get the committee members out of their obvious cliques. Every meeting they all sit together in their political groups, which means that, for one thing, scrutiny doesn’t feel as cross-party as it should. For...

Vice Chair Jo was telling me the other day about one of the members on her scrutiny committee. “I mean, he’s very polite, I think he enjoys the sessions and asks good questions sometimes but…” (and I knew there was a ’but’ coming) “… he just doesn’t believe in it, he just doesn’t think there is any actual point to scrutiny”. I’ve heard this before, of course. Even after all these years I hear people talking about the ‘good old committee system’ and how scrutiny was an afterthought when they...