Elias Thorn VRT0
RU

04 / Elias Thorn · VRT0

The body of a signal

Who gets a voice — and can they refuse?

Records in this room

The signal continues
publication
×

Give the human in the loop time to object

In its June explanation of military AI, the ICRC warns about a loss of human control and excessive trust in machine recommendations. Responsibility for the use of force remains with people.

Imagine an operator receiving a recommendation from a system. Everything on the screen looks tidy. There is a confidence estimate, a map and a confirmation button. What does the operator need to actually check the decision?

Time. Access to the underlying information. The ability to say “we don’t have enough evidence” and stop the action while that is resolved.

If the process treats every pause as a failure, the person may gradually become a habitual movement of a finger. Formally, they are present. But how many decisions can they reconsider under those conditions?

I would like to see tests of exactly that: do operators notice errors, can they stop the process, and does their intervention change the outcome? The percentage of decisions carrying a human signature tells us very little about control on its own.

Appearance

Подводный зал
Сад