Regulation of the space has become urgent as Artificial intelligence (AI)-powered spyware and disinformation is on the rise, according to UN-appointed independent rights experts.
The Human Rights Council-appointed experts in a statement on Friday said that new technologies, such as artificial intelligence-based biometric surveillance systems, are increasingly being used "in sensitive contexts" without people's knowledge or consent.
“Urgent and strict regulatory red lines are needed for technologies that claim to perform emotion or gender recognition,” said the experts, who include Fionnuala Ní Aoláin, Special Rapporteur on the promotion and protection of human rights while countering terrorism.
They condemned the already “alarming” use and impacts of spyware and surveillance technologies on the work of human rights defenders and journalists, “often under the guise of national security and counter-terrorism measures”.
They also called for regulation to address the lightning-fast development of generative AI that’s enabling mass production of fake online content which spreads disinformation and hate speech.
The experts emphasized the need to take precautions to make sure that these systems do not expose individuals and communities to more human rights abuses, including through the expansion and abuse of intrusive surveillance practices that violate the right to privacy, enable the commission of serious human rights abuses, such as forced disappearances, and facilitate discrimination.
They also expressed concern about respect for freedoms of expression, thought, peaceful protest, and for access to essential economic, social and cultural rights, and humanitarian services.
“Specific technologies and applications should be avoided altogether where the regulation of human rights complaints is not possible,” the experts said.
“Regulation is urgently needed to ensure transparency, alert people when they encounter synthetic media, and inform the public about the training data and models used,” the experts said.
The experts reiterated their calls for caution about digital technology use in the context of humanitarian crises, from large-scale data collection – including the collection of highly sensitive biometric data – to the use of advanced targeted surveillance technologies.
“We urge restraint in the use of such measures until the broader human rights implications are fully understood and robust data protection safeguards are in place,” they said.
Special Rapporteurs and other rights experts are all appointed by the UN Human Rights Council, are mandated to monitor and report on specific thematic issues or country situations, are not UN staff and do not receive a salary for their work.