Out of Alignment: Conflicting Trends in the Governance of Advanced Artificial Intelligence

  • Panel
  • Class Room
  • Wednesday 21.05 — 08:45 - 10:00

Organising Institution

AI Collaborative

International

  • Academic 1
  • Business 1
  • Policy 4
The discussion about AI regulation is often reduced to simple dichotomies, but the reality is far more complex. While there are prominent voices warning that any regulation will kill innovation, there is also huge enthusiasm across the globe to regulate advanced AI systems. Within the pro-regulation side, however, there is an absolute cacophony of perspective and ideologies with very different ideas of what precisely to regulate, and how. With speakers from government, civil society and academia, this panel will explore four prominent concepts within the global debate on AI governance: the role of national ‘AI Safety’ authorities; the need for human rights standards; the role of effective altruism and related ideologies; and the role of infrastructure and industrial policy.

Questions to be answered

  1. What roles do different authorities and international organisations play in the ecosystem of regulators for advanced AI systems?
  2. In this moment of crisis for human rights and the civil society and broader public interest sector what is the role of government/international bodies in public interest (technology)?
  3. What is effective altruism, what role does it play in debates around ‘AI safety’? How does it impact debates on issues like ‘open source AI’?
  4. Have there been any victories for human rights based governance of AI, and in what ways are governments and companies moving away from rights based governance?

Moderator

Fanny Hidvegi

AI Collaborative - International

Fanny Hidvegi joined the AI Collaborative as Policy Director in April 2024. The AI Collaborative is an Initiative of the Omidyar Group. The AI Collaborative was created to help regulate artificial intelligence based on democratic values and principles and to ensure that the public has a critical voice in AI governance and development. For more than seven years Fanny was Access Now’s Europe Policy and Advocacy Director and led the organisation’s work on artificial intelligence and human rights as well. She also served as interim Policy Director of the global team. Fanny was a member of the European Commission's High Level Expert Group on Artificial Intelligence and the Council of Europe's Committee of Experts on Freedom of Expression and Digital Technologies. She was a member of the European Parliament STOA Committee’s International Advisory Board. Fanny is the chair of the board of the Hungarian Civil Liberties Union (HCLU). Fanny is part of the Mozilla Rise25 inaugural cohort (’23), an Obama Foundation Europe Leader (’20) and a Marshall Memorial Fellow (’23). Fanny was selected to be a member of the POLITICO Tech 28 Class of 2022. Previously, Fanny was International Privacy Fellow at the Electronic Privacy Information Center in Washington, D.C. where she focused on E.U.-U.S. data transfers. For three years Fanny led the Freedom of Information and Data Protection Program of the HCLU. There, she gained experience on how to operate as a human rights advocate in a restrictive environment. Fanny also worked as a consumer protection lawyer both in the public and the private sector.

Speaker

Shazeda Ahmed

UCLA - United States

Shazeda Ahmed is a Chancellor’s Postdoctoral (Presidential Postdoctoral Fellowship Program) fellow at UCLA. Shazeda completed her Ph.D. at UC Berkeley’s School of Information in 2022, and was previously a postdoctoral research fellow at Princeton University’s Center for Information Technology Policy. She has been a research fellow at Upturn, the Mercator Institute for China Studies, the University of Toronto's Citizen Lab, Stanford University’s Human-Centered Artificial Intelligence (HAI) Institute, and NYU's AI Now Institute. Shazeda’s research investigates relationships between the state, the firm, and society in the US-China geopolitical rivalry over AI, with implications for information technology policy and human rights. Her work draws from science and technology studies, ranging from her dissertation on the state-firm co-production of China’s social credit system, to her research on the epistemic culture and knowledge production practices in the emerging field of AI safety.

Speaker

Gerald Hopster

Autoriteit Persoonsgegevens (Dutch DPA) - Netherlands

Coordinating Senior – Monitoring & Strategy, Autoriteit Persoonsgegevens, Department for the Coordination of AI oversight Gerald Hopster serves as the coordinating senior for monitoring and strategy at the Autoriteit Persoonsgegevens, specifically within the Department for the Coordination of AI Oversight. He co- founded this department in 2023, aiming to monitor the risks associated with algorithms and AI systems concerning public values and fundamental rights. The DCA actively monitors, analyses, and reports on the risks associated with AI and algorithms in the Netherlands. It publicises the biannual AI & Algorithmic Risks Report Netherlands in both Dutch and English. The department not only enhances collaboration among national supervisors but also offers guidance on both existing and emerging legislation. Situated within the Autoriteit Persoonsgegevens, which also acts as the Dutch Data Protection Authority (DPA), the DCA plays a crucial role in protecting public values and fundamental rights in the development and use of AI and algorithms. A criminologist and researcher with a specialized focus on technology, Gerald previously held the position of team lead for the technology and telecommunications team at the Dutch DPA before assuming his current role at the DCA.

Speaker

Roel Dobbe

TU Delft - Netherlands

Roel Dobbe is an Assistant Professor in Technology, Policy & Management and Director of the Sociotechnical AI Systems Lab at Delft University of Technology. His research addresses the integration and implications of algorithmic technologies in societal infrastructure and democratic institutions, focusing on issues related to safety, sustainability and justice. His projects are situated in various domains, including energy systems, public administration, and healthcare. Roel’s system-theoretic lens enables addressing the sociotechnical and political nature of algorithmic and artificial intelligence systems across analysis, engineering design and governance, always with an aim to empower domain experts and affected communities. His results have informed various policy initiatives, including the European AI Act as well as the development of the algorithm watchdog in The Netherlands. Roel is also on the board of PublicSpaces, a Dutch foundation uniting more than forty public and civil society organizations working towards an internet that is not dependent on commercial extraction. Prior to Delft, Roel was a graduate student in the Berkeley AI Research (BAIR) Lab, receiving a PhD in Control & Intelligent Systems from the Department of Electrical Engineering and Computer Sciences at UC Berkeley (2018), where he received the Demetri Angelakos Memorial Achievement Award. Subsequently, he was an inaugural postdoc at the AI Now Institute in New York City.

Speaker

Iverna McGowan

Office of the United Nations High Commissioner for Human Rights - International

Iverna McGowan is currently serving as Tech & Human Rights Advisor at UN Human Rights (OHCHR). She founded and then Directed the Centre for Democracy & Technology from 2020 to 2024. She has been listed by EU Insider in 2024 as one of the most influential people on digital policy and by POLITICO in 2017 as one of the most influential women on EU policy and law making. Politico said that [she] "makes the voices of human rights victims heard in Brussels’ corridors of power". Iverna was Executive Director of Amnesty International’s Office in Brussels and Advocacy Director for Europe for seven years and covered EU and Council of Europe issues. Prior to that she worked in the Human Rights Unit at the Irish Department of Foreign Affairs, and later as a legal researcher for an expert member of the UN Committee on the Elimination of all Forms of Discrimination against Women (CEDAW). She was awarded the Sinti and Roma European Civil Rights Prize in 2016 for her work on equal access to education for Roma children. She holds an LL.M in EU Law and was a Top 3% scholar of the University of Maastricht, she also holds an honors degree from Trinity College Dublin, where she studied European Studies. She has previously served on the boards of the Natural Resource Governance Institute, Transparency International. She was a member of the Advisory Panel to the EU Fundamental Rights Agency, and member of the Advisory Board of the Vrije Universiteit Brussel’s Privacy Hub. She is a frequent commentator on technology’s impact on society, human rights, EU foreign policy and gender equality and has contributed to pieces by Euronews, CNN, BBC, RTE, and Reuters.