In my writing about platforms and automated decisions, I explored a practical question: can people understand the result a system gives them, and what can they do if they think it is wrong?

A ranking, a task allocation or a rejected application may be just an output from the system. For the person receiving it, it may mean changing their plans. That makes the information shown alongside the result part of the experience I want to understand.

Explain what this result relates to

“The system should be more transparent” is a useful principle, but it does not tell us what to put on a page. I would start with the particular situation: what did the person do, what result have they received, and what do they need to know now?

Consider a hypothetical application. The user may need to know whether information is missing, something is incorrect, or the application is still being processed. Each situation calls for a different next step. A longer technical explanation may leave that immediate question unanswered.

Make the relevant records available

My original essay discussed work records and appeals. One concern was whether someone questioning a decision could find the information they needed, and whether the person handling the query could use it to understand what had happened.

Records can give both sides something specific to refer to. Their scope still needs thought: what information is necessary, who can see it, and how long should it be kept? Collecting more material does not automatically make a problem easier to resolve.

Make the route to a correction clear

Where people can correct information or challenge a result, they need to know where to start, what to provide and who will handle it. Knowing that a feedback form exists is only part of the answer.

I also considered the role of a third party in helping people organise records and raise concerns. That introduces further questions about who holds the information, who is responsible, and whether the extra service adds work for the user.

When reviewing a process, I want to follow it far enough to see whether people can understand what happened, find the relevant records and deal with an error.

Read the short version ↗