Article 14: Human Oversight

Official Statutory Text

Article 14 Human oversight 1. High-r isk AI systems shall be designed and developed in suchaway , including withappropriate human-machine interface too ls, that they canbe effectively overseenby natural persons during the periodin which they are in use. 2. Human oversight shall aim to preventor minimise the risks to health, safety or fundamental rights that may emerge when a high-r isk AI system is used in accordance with its intended purpose or under conditions of reasonably foreseeable misuse, in particular where suchrisks persist despite the application of other requirements setout in this Section. 3. The oversight measures shall be commensurate with the risks, level of autonomy and contextof use of the high-r isk AI system, and shall be ensured through either one or both of the following types of measures: (a) measures identified and built, when technically feasible, into the high-r isk AI system by the provider before it is placed on the mark etor put into service; (b) measures identified by the provider before placing the high-r isk AI system on the marke tor putting it into service and that are appropriate to be implemented by the deployer . 4. For the purpose of implementing paragraphs 1, 2 and 3, the high-r isk AI system shall be provided to the deployer in suchaway that natural persons to whom human oversight is assigned are enabled, as appropriate and proportionate : (a) to properly understand the relevant capacities and limitations of the high-r isk AI system and be able to duly monitor its operation, including in view of detecting and addressing anomalies, dysfunctions and unexpected perfo r mance; (b) to remain aware of the possible tendency of automatically relying or over -relying on the output produced by a high-r isk AI system (automationbias), in particular for high-r isk AI systems used to provide information or recommendations for decisions to betakenby natural persons; (c) to correctly interpret the high-r isk AI system’s output, taking into account, for exam ple, the interpretation tools and methods available; (d) to decide, in any particular situation, not to use the high-r isk AI system or to other wise disreg ard, override or reverse the outputof the high-r isk AI system; (e) to intervene in the operation of the high-r isk AI system or interrupt the system througha ‘stop’ button or a similar procedure that allows the system to come to a halt in a safe state. 5. For high-r isk AI systems refer red to in point 1(a) of Annex III, the measures referred to in paragraph 3 of this Article shall be suchas to ensure that, in addition, no action or decision is takenby the deployer on the basis of the identification resulting from the system unless that identification has been separately verified and confirmed byat least two natural persons with the necessary compet ence, training and authority . The requirement for a separate verificationbyat least two natural persons shall not apply to high-r isk AI systems used for the purposes of law enforcement, migration, border control or asylum, where Union or national law considers the application of this requirement to be disproportionate .