Article 10: Data and Data Governance

Official Statutory Text

Article 10 Data and dat a gover nance 1. High-r isk AI systems which make use of techniques involving the training of AI models with data shall be developed on the basis of training, validation and testing data sets that meet the quality criteria referred to in paragraphs 2 to 5 whenever such data sets are used. 2. T raining, validation and testing data sets shall be subject to data governanceand management practices appropriate for the intended purpose of the high-r isk AI system. Those practices shall concern in particular: (a) the relevant design choices ; (b) data collection processes and the origin of data, and in the case of personal data, the original purpose of the data collection; (c) relevant data-preparation processing operations, suchas annotation, labelling, cleaning, updating, enrichment and aggregati on; (d) the formulation of assum ptions, in particular with respect to the information that the data are supposed to measureand represent ; (e) an assessmentof theavailability , quantity and suitability of the data sets that are needed; (f) examination in view of possible biases that are likely to affect the health and safety of persons, havea negative im pacton fundamental rights or lead to discrimination prohibited under Uni on law , especially where data outputs influence inputs for future operations; (g) appropriate measures to detect, prevent and mitigate possible biases identified according to point (f); (h) the identification of relevant data gaps or shortcomings that prevent compliance with this Regulation, and how those gaps and shortcomings can beaddressed. 3. T raining, validation and testing data sets shall be relevant, sufficiently representative, and to the best extent possible, free oferrors and complete in view of the intended purpose. They shall have theappropriate statistical proper ties, including, whereapplicable, as regards the persons or groups of persons in relation to whom the high-r isk AI system is intended to be used. Those characteristics of the data sets maybe met at the level of individual data sets or at the level of a combination thereof. 4. Data sets shall take into account, to the extent required by the intended purpose, the characteristics or elements that are particular to the specific geographical, cont extual, behavioural or functional setting within which the high-r isk AI system is intended to be used. 5. To the extent that it is strictly necessary for the purpose of ensuring bias detection and correction in relation to the high-r isk AI systems in accordance with paragraph (2), points (f) and (g) of this Article, the providers of such systems mayexceptionally process special categories of personal data, subject to appropriate safeguards for the fundamental rights and freedoms of natural persons. In addition to the provisions setout in Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680, all the following conditions must be met in order for such processing to occur: (a) the bias detection and correction cannot be effectively fulfilled by processing other data, including synthetic or anonymised data; (b) the special categories of personal data are subject to technical limitations on the re-use of the personal data, and state-of-t he-ar t security and pr ivacy-preser ving measures, including pseudon ymisation; (c) the special categories of personal data are subject to measures to ensure that the personal data processed are secured, protect ed, subject to suitable safeguards, including str ict controls and documentation of theaccess, to avoid misuseand ensure thatonly authorised persons haveaccess to those personal data with appropriate confidentiality obliga tions; (d) the special categories of personal data are not to be transmitte d, transferredor other wiseaccessed by other par ties; (e) the special categories of personal data are deleted once the bias has been correctedor the personal data has reached the end of its retention per iod, whichever comes first ; (f) the records of processing activities pursuant to Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680 include the reasons why the processing of special categories of personal data was strictly necessary to detect and correct biases, and why thatobjective could not beachieved by processing other data. 6. For the developmentof high-r isk AI systems not using techniques involving the training of AI models, paragraphs 2 to 5 apply only to the testing data sets.