Innovation, Quantum-AI Technology & Law

Blog over Kunstmatige Intelligentie, Quantum, Deep Learning, Blockchain en Big Data Law

Blog over juridische, sociale, ethische en policy aspecten van Kunstmatige Intelligentie, Quantum Computing, Sensing & Communication, Augmented Reality en Robotica, Big Data Wetgeving en Machine Learning Regelgeving. Kennisartikelen inzake de EU AI Act, de Data Governance Act, cloud computing, algoritmes, privacy, virtual reality, blockchain, robotlaw, smart contracts, informatierecht, ICT contracten, online platforms, apps en tools. Europese regels, auteursrecht, chipsrecht, databankrechten en juridische diensten AI recht.

Berichten in Quantum-AI
Quantum Event Horizon: Addressing the Quantum-AI Control Problem through Quantum-Resistant Constitutional AI

What happens when AI becomes not just superintelligent, but quantum-superintelligent? QAI agents with both classical and quantum capabilities? How do we ensure we remain in control?

This is the central question of my new article, where I introduce the concept of the Quantum Event Horizon to frame the urgency of the QAI control problem. As we near this point of no return, the risk of losing control to misaligned systems—machines taking over or seeing them weaponized—becomes acute.

A metaphorical Quantum Event Horizon can be thought of as an inflection point, or quantum governance 'tipping point' beyond which our ability to steward advanced quantum technology and AI towards beneficial outcomes for all of humanity, may vanish.

Simple guardrails are not enough. The solution must be architectural. I propose a new paradigm: Quantum-Resistant Constitutional AI, a method for engineering our core values into the foundation of QAI itself. This is a crucial discussion for policymakers, researchers, builders, and industry leaders.

Navigating the Quantum Event Horizon

This paper addresses the impending control problem posed by the synthesis of quantum computing and artificial intelligence (QAI). It posits that the emergence of potentially superintelligent QAI agents creates a governance challenge that is fundamentally different from and more acute than those posed by classical AI. Traditional solutions focused on technical alignment are necessary but insufficient for the novel risks and capabilities of QAI. The central thesis is that navigating this challenge requires a paradigm shift from reactive oversight to proactive, upfront constitutional design.

The core of the argument is framed by the concept of the ‘Quantum Event Horizon’—a metaphorical boundary beyond which the behavior, development, and societal impact of QAI become computationally opaque and practically impossible to predict or control using conventional methods. Drawing on the Collingridge dilemma and the Copenhagen interpretation, this concept highlights the risk of a "point of no return," where technological lock-in, spurred by a "ChatGPT moment" for quantum, could cement irreversible geopolitical realities, empower techno-authoritarianism, and present an unmanageable control problem (the risk of machines taking over). Confronting this requires a new philosophy for governing non-human intelligence.

Machines Taking Over

The urgency is magnified by a stark geopolitical context, defined by a Tripartite Dilemma between the existential safety concerns articulated by figures like Geoffrey Hinton, the geopolitical security imperative for rapid innovation voiced by Eric Schmidt, and the builder’s need to balance progress with safety, as expressed by Demis Hassabis. This dilemma is enacted through competing global innovation models: the permissionless, market-driven US system; the state-led, top-down Chinese system; and the values-first, deliberative EU model. In this winner-takes-all race, the first actor to achieve a decisive QAI breakthrough could permanently shape global norms and our way of life.

An Atomic Agency for Quantum-AI

Given these stakes, current control paradigms like human-in-the-loop oversight are inadequate. The speed and complexity of QAI render direct human control impossible, a practical manifestation of crossing the Quantum Event Horizon. Therefore, governance must be multi-layered, integrating societal and institutional frameworks. This includes establishing an "Atomic Agency for Quantum-AI" for international oversight and promoting Responsible Quantum Technology (RQT) by Design, guided by principles such as those outlined in our '10 Principles for Responsible Quantum Innovation' article. These frameworks must be led by robust public governance—as corporate self-regulation is insufficient due to misaligned incentives—and must address the distributive justice imperative to prevent a "Quantum Divide."

Towards Quantum-Resistant Constitutional AI

The cornerstone of our proposed solution is Quantum-Resistant Constitutional AI. This approach argues that if we cannot control a QAI agent tactically, we must constrain it architecturally. It builds upon the concept of Constitutional AI by designing a core set of ethical and safety principles (a 'constitution') that are not merely trained into the model but are formally verified and made robust against both classical and quantum-algorithmic exploitation. By hardwiring this quantum-secure constitution into the agent's core, we can create a form of verifiable, built-in control that is more likely to endure as the agent's intelligence scales.

Self-Aware Quantum-AI Agents

Looking toward more speculative futures, the potential for a Human-AI Merger or the emergence of a QAI Hive Mind—a networked, non-human consciousness enabled by quantum entanglement—represents the ultimate challenge and the final crossing of the Quantum Event Horizon. The foundational governance work we do today, including projects like Quantum-ELSPI, is the essential precursor to navigating these profound transformations.

In conclusion, this paper argues that for the European Union, proactively developing and implementing a framework centered on Quantum-Resistant Constitutional AI is not just a defensive measure against existential risk. It is a strategic necessity to ensure that the most powerful technology in human history develops in alignment with democratic principles, securing the EU’s role as a global regulatory leader in the 21st century.

Meer lezen
Stanford Scholar Mauritz Kop Teaches Quantum Computing & Law at Fordham Law School

New York, NY, January 21, 2025 – Stanford University scholar Mauritz Kop, a leading voice in the intricate nexus of quantum technology, AI, and law, today addressed the legal community at the Fordham Law School Library. His presentation, titled "Here Comes Quantum Computing — What the Legal Community Needs to Know," was a featured event in the Maloney Library's esteemed "Tech Lunch 'n' Learn" series, a program designed to keep legal professionals at the forefront of technological innovation.

Stanford Scholar Mauritz Kop the Quantum Future for the Legal Community at Fordham Law

Kop, the Founding Director of the Stanford Center for Responsible Quantum Technology, offered a comprehensive overview of the transformative potential and inherent risks of quantum technologies at Fordham Law. He emphasized that the leitmotif of our time is that "Quantum’s benefits outweigh its risks, if implemented responsibly".

Responsible Quantum Technology (RQT) is a framework designed to ensure that the innovation and implementation of quantum technologies align with societal demands and enhance global welfare. It provides a principled approach to guide quantum technology development.

Responsible Quantum Technology

The core components and objectives of RQT entail:

Compliance and Safety: Developers, vendors, and users of quantum systems must adhere to a range of emerging regional and global requirements. This includes technology-specific rules and industry-specific regulations in sectors like finance and healthcare, supported by standards and certifications to guarantee safe deployment.

Addressing Implications (Quantum-ELSPI): RQT involves engaging with quantum technologies in a way that is consistent with Quantum-ELSPI—the ethical, legal, socio-economic, and policy implications of the technology. This requires a tailored approach that considers the unique and counter-intuitive principles of quantum mechanics, such as superposition and entanglement.

Alignment with RRI: The RQT framework responds to the key dimensions of Responsible Research and Innovation (RRI): anticipation, reflexivity, inclusion, and responsiveness.

Ethical Foundation: RQT must align with quantum ethics, which involves identifying the dilemmas inherent in making these technologies ethical through interdisciplinary, context-specific methods.

Legal Frameworks: The framework requires adherence to legal norms like the rule of law and proportionality. It advocates for future legislation that mitigates risks and maximizes benefits, providing legal certainty to incentivize Responsible Quantum Innovation (RQI).

Socio-Economic Considerations: RQT dictates that quantum technology should prioritize society's most pressing goals, such as cybersecurity, economic stability, and managing climate change. It also mandates that the benefits and burdens of the technology should be equitably distributed.

Policy Guidance: RQT serves as a tool for policymakers, helping them learn from the governance of other disruptive technologies like AI, nuclear energy, and the internet. An important policy goal is to foster values-based quantum ecosystems globally.

Operational Principles: The RQT paradigm is put into practice through "10 Principles for Responsible Quantum Innovation". These principles are structured to safeguard, engage, and advance (SEA) quantum technologies, society, and humankind, with the ultimate goal of protecting society by responsibly advancing the technology.

Practical Tools: The framework can be used by policymakers to design regulations and can be complemented by self-regulatory tools like technology impact assessments to monitor, validate, and audit quantum applications throughout their lifecycle using appropriate RQT benchmarks and metrics.

Hardwiring Values: A core tenet of RQT is embedding shared values and standards into the design, deployment, and infrastructure of quantum systems. This includes current work on how to embed values and standards into the architecture and infrastructure of quantum AI systems, products, and services. The goal is to guide these technologies toward collective social and environmental benefit.

Quantum Computing — What the Legal Community Needs to Know

The ‘Quantum Computing — What the Legal Community Needs to Know’ lecture provided an in-depth exploration of second-generation (2G) quantum technologies, which harness the unique principles of quantum physics, such as superposition and entanglement, to solve problems beyond the grasp of classical computers. Kop highlighted recent breakthroughs, including Google's "Willow" quantum computing chip, which completed a complex calculation in under five minutes—a task that would take the fastest supercomputers an estimated 10 septillion years. This, he explained, demonstrates the potential for quantum computers to revolutionize sectors like healthcare, finance, energy, and defense.

Navigating the Ethical and Legal Maze

A significant portion of the talk was dedicated to the ethical, legal, socio-economic, and policy implications (Quantum ELSPI) of this emerging field. Kop stressed the dual-use nature of quantum technology, which, much like nuclear energy, can be applied to both civilian and military purposes. This duality necessitates a robust governance framework to prevent misuse by adversaries and to avoid a new arms race.

Kop advocated for a "Responsible Quantum Technology (RQT)" framework to ensure that innovation aligns with societal values and legal standards. This approach calls for a recalibration of legal frameworks to mitigate risks while fostering responsible innovation. He pointed to the "Collingridge dilemma," cautioning that regulating quantum too early could stifle innovation, while regulating too late could result in irreversible negative consequences.

A Call for Global Cooperation and Responsible Innovation

The lecture underscored the necessity of global cooperation in developing unified quantum interoperability standards to avoid a "quantum splinternet" fragmented along geopolitical lines. Kop argued for a research and development agenda that is "as open as possible, and as closed as necessary" to address national security concerns while fostering international partnerships.

To operationalize the RQT paradigm, Kop and his research group have proposed "10 Principles for Responsible Quantum Innovation," organized to safeguard, engage, and advance (SEA) quantum technologies for the benefit of humanity.

Fordham's Commitment to Legal Tech Education

The "Tech Lunch 'n' Learn" series at Fordham's Maloney Library provides a crucial platform for such discussions, inviting experts to shed light on the evolving landscape of law and technology. These sessions empower students and practitioners to grapple with complex subjects like AI, data privacy, and now, quantum computing.

Kop's lecture at Fordham served as a vital call to action for the legal community to proactively engage with the development of quantum technologies. As he concluded, "As society shapes technology, technology shapes society". The legal profession has a critical role to play in ensuring that the quantum era unfolds in a manner that is secure, equitable, and beneficial for all.

Meer lezen
Mauritz Kop Consults U.S. Department of State on Quantum Technology and Foreign Policy Strategy

Washington D.C. – On December 12, 2024, Mauritz Kop, Founding Director of the Stanford Center for Responsible Quantum Technology (RQT) and the Stanford Quantum Incubator, was invited to consult with the U.S. Department of State on the pressing challenges and strategic opportunities presented by the quantum era. The analytic outreach event, hosted by the Bureau of Intelligence and Research’s Office of Analytic Outreach (INR/AO), provided a critical forum to discuss the integration of quantum technology considerations into U.S. foreign policy and national security strategy.

This engagement highlights the growing recognition within the U.S. government that understanding quantum technology is no longer the exclusive domain of physicists and engineers, but a crucial imperative for diplomats, intelligence analysts, and foreign policy architects.

Informing Diplomacy with Strategic Insight

The U.S. Department of State is the nation’s lead foreign affairs agency, responsible for advancing the interests and security of the American people. Within the Department, the Bureau of Intelligence and Research (INR) holds a unique mandate to provide independent, all-source intelligence and analysis to the Secretary of State and other senior policymakers. INR’s primary mission is to deliver timely, objective, and insightful assessments that inform decision-making on the full spectrum of diplomatic and foreign policy challenges. It is within this context of providing deep, substantive expertise that the Office of Analytic Outreach convenes leading external experts like Mauritz Kop to engage directly with government analysts and officials.

A Bird's-Eye View of Quantum's Strategic Landscape

While the specific details of the consultation remain confidential, the discussion drew upon Mr. Kop’s extensive research on quantum governance, which offers a strategic framework for policymakers. His analysis emphasizes several key themes crucial for navigating the complexities of the quantum age.

A central theme is the inherently dual-use character of quantum technology. This paradigm holds both immense promise and profound risk. On one hand, quantum advancements are poised to revolutionize sectors vital to human progress; quantum sensors could dramatically improve medical imaging and seismic prediction, while quantum simulation could enhance drug discovery and macroeconomic modeling. On the other hand, this same power presents formidable threats. The advent of a fault-tolerant quantum computer, or "Q-Day," could catastrophically break the classical encryption that underpins global finance, data security, and critical infrastructure, with a potential timeframe of just two to three years.

This governance model is set against a backdrop of intense geopolitical competition. Kop’s research posits the risk of a "Quantum Event Horizon"—a governance tipping point at which one technological bloc could achieve quantum supremacy and with that the keys to the world’s operating system, creating an irreversible, "winner-takes-all" advantage that could destabilize the global order. This makes it a strategic imperative for the United States and its allies to lead in building a "globally leading, values-laden Made in America quantum ecosystem."

Embedding Democratic Values into the Quantum Future

A core pillar of the responsible governance framework presented is the imperative to embed democratic values and human rights principles into the very architecture of quantum systems. Technology is never neutral; it inherently carries the values of its creators. Therefore, the U.S. and its like-minded partners have a generational opportunity to set the "rules of the road" for quantum technology through international standard-setting that prioritizes privacy, fairness, and fundamental freedoms. This involves fostering diverse, interdisciplinary research and development teams to combat inherent biases and ensure outcomes align with the principles of a free society.

Stanford RQT and the Department of State’s Bureau of Intelligence and Research

The engagement with the Department of State’s Bureau of Intelligence and Research represents a vital step in bridging the gap between the academic frontier of quantum research and the pragmatic realities of foreign policy. The work of the Stanford Center for Responsible Quantum Technology remains committed to fostering these essential conversations, ensuring that as humanity prepares to take its next great technological leap, it does so with foresight, responsibility, and a steadfast commitment to democratic values.

Meer lezen
Mauritz Kop and Mark Lemley Host Canadian Quantum Governance Delegation at Stanford RQT to Inform its G7 Presidency

Stanford, CA, May 8, 2024—Today, the Stanford Center for Responsible Quantum Technology (RQT) had the privilege of hosting a distinguished Canadian delegation for a critical dialogue on the future of quantum governance. The meeting, held at Stanford Law School, was a pivotal moment for shaping the international policy landscape for these transformative technologies. Professor Mark Lemley and Executive Director Mauritz Kop were honored to welcome senior officials from Global Affairs Canada, the nation’s foreign ministry, for a conversation designed to inform Canada’s quantum policy development efforts ahead of its G7 Presidency in 2025.

A Convergence of Expertise in Law, Technology, and Diplomacy

The success of such a dialogue hinges on the diverse expertise of its participants. On behalf of the Stanford Center for Responsible Quantum Technology, its Founding Director Mauritz Kop was pleased to co-host the session. Professor Kop’s work, which focuses on the ethical, legal, social, and policy implications (ELSPI) of quantum technologies, AI, and cybersecurity, has included serving as a member of the Expert Panel on the Responsible Adoption of Quantum Technologies for the Council of Canadian Academies (CCA). This role provided a direct link to the foundational research shaping Canada's domestic and international quantum strategy.

Kop was joined by his esteemed colleague, Mark Lemley, the William H. Neukom Professor of Law at Stanford Law School and the Director of the Stanford Program in Law, Science, and Technology. As one of the world's preeminent scholars in intellectual property and technology law, Professor Lemley’s insights into innovation, competition, and the legal structures that govern emerging technologies were indispensable to our discussions on incubating startups and navigating the complex IP landscape of the quantum sector.

A Foundation in Evidence: The Council of Canadian Academies' Quantum Potential Report

Our discussions at Stanford did not occur in a vacuum. They were built upon a solid foundation of evidence-based analysis, most notably the 2023 Quantum Potential report from the Council of Canadian Academies (CCA). As a member of the expert panel that authored this report, chaired by the esteemed Professor Raymond Laflamme of the University of Waterloo, Professor Kop was able to directly infuse its findings into our dialogue.

The CCA’s Quantum Potential report was commissioned by the National Research Council of Canada (NRC) and Innovation, Science and Economic Development Canada (ISED) to assess the opportunities and challenges of quantum adoption in Canada. The report provided a clear-eyed assessment, warning that while the potential is transformative, significant scientific and engineering obstacles remain. It highlighted critical national security risks, particularly the potential for a fault-tolerant quantum computer to "undermine the digital infrastructure that underpins key areas of everyday life" and "jeopardize data privacy and security".

Crucially, the report championed a proactive and responsible approach to governance, framed through the lens of "Quantum ELSPI"—the ethical, legal, social, and policy implications of the technology.

The Culmination: The G7 Kananaskis Common Vision on Quantum

The journey from academic analysis and focused diplomatic engagement to international consensus reached its apex on June 17, 2025. Drawing upon the preparatory work from the CCA, the insights from our meeting at Stanford, and extensive multilateral consultations, the Government of Canada, during its G7 Presidency, unveiled the Kananaskis Common Vision for the Future of Quantum Technologies.

This declaration represents a landmark achievement in global technology governance and directly reflects the principles and priorities discussed at our Center. The document acknowledges both the "transformative benefits" of quantum technologies and their "far-reaching implications for national and international security". Echoing the core themes of our dialogue and scholarship, the G7 leaders committed to a set of shared principles that build directly on the work of the RQT community and the CCA report.

G7 Joint Working Group on Quantum Technologies

The meeting with the Canadian delegation at the Stanford Center for Responsible Quantum Technology was a profound demonstration of how academia can effectively inform and shape public policy on a global scale. It showcased a direct pathway from flagship scholarship like the “Ten principles for Responsible Quantum Innovation” and foundational reports like the CCA's Quantum Potential, through focused expert dialogues, to the codification of international norms in a G7 leaders' declaration. We are proud to have played a role in this vital process and look forward to continued collaboration with our Canadian partners and the new G7 Joint Working Group on Quantum Technologies to build a future where quantum technology unfolds responsibly, securely, and for the benefit of all humanity.

Meer lezen
Princeton University’s Liechtenstein Institute on Self-Determination’s visits Stanford Center for Responsible Quantum Technology

On Wednesday, January 22, 2024, the Stanford Center for Responsible Quantum Technology (RQT) had the distinct pleasure of hosting a delegation from Princeton University’s Liechtenstein Institute on Self-Determination (LISD) for a dynamic discussion on transatlantic technology policy at Stanford Law School. The event was marked by great energy and a profound exchange of ideas, reflecting the shared commitment of both institutions to navigating the complex intersection of emerging technology, global governance, and societal values.

Princeton LISD leadership and their talented International Policy Associates at Stanford RQT

As the host of the meeting, Professor Mauritz Kop had the opportunity to welcome the LISD leadership and their talented International Policy Associates. He provided an overview of the mission of the Stanford RQT, explaining our framework for ensuring that quantum technologies are developed and integrated into society in a manner that is safe, ethical, and equitable. This introduction served as a foundation for a rich and meaningful conversation, where the Princeton fellows posed insightful questions. The discussion traversed a wide spectrum of pressing topics, including the challenges of regulating the suite of quantum technologies, the discovery of quantum use cases in healthcare, the complexities of export controls and quantum materials supply chains, and the crucial interface between AI and quantum computing. Furthermore, we explored the application of universal democratic values and culturally sensitive ethics to these new domains, comparing the innovation systems of the US, EU, and China, and considering the potential for technology to drive both scarcity and abundance on a planetary scale.

Freeman Spogli Institute for International Studies (FSI) and Stanford Graduate School of Business (GSB)

The engagement at the RQT was a cornerstone of the LISD delegation's broader visit to Northern California, which included several high-level meetings across Stanford University. The group’s thank-you message noted their "incredibly enriching visit" and the comprehensive nature of their discussions. Their agenda also included conversations with preeminent scholars Professor Francis Fukuyama and Professor Michael McFaul at the Freeman Spogli Institute for International Studies (FSI), and a meeting with Dean Jon Levin of the Stanford Graduate School of Business (GSB). According to the delegation, these dialogues covered a range of vital geopolitical issues, from the war in Ukraine and a possible attack on Taiwan to Stanford's pivotal role in innovation, highlighting the "multifaceted impact of technology on democracy." The visit also provided an opportunity for the delegation to connect with Princeton alumni in the region.

Collaborating on global challenges and opportunities presented by quantum technologies

The esteemed LISD delegation was led by its senior leadership, including Sophie Meunier, the Acting Director of LISD and a Senior Research Scholar at the Princeton School of Public and International Affairs; Nadia Crisan, the Executive Director of LISD; Jonathan Fredman, a Non-Resident Fellow and former senior leader at the Central Intelligence Agency; and Jana-Alessa Peper, the Institute Assistant who coordinates the IPA program. They were accompanied by the LISD’s International Policy Associates, a cohort of students pursuing careers in foreign policy and international business, who brought a diverse array of academic and professional interests to the discussion.

The dialogue reinforced the critical importance of building bridges between institutions and disciplines. The exchange of perspectives between Stanford’s technology and policy experts and Princeton’s specialists in international affairs and self-determination created a unique and valuable synergy. We extend our sincere thanks to the entire LISD delegation for a stimulating and productive session that has undoubtedly planted the seeds for future collaboration in addressing the global governance challenges and opportunities presented by quantum and other advanced technologies.

Meer lezen
Mauritz Kop Fellow at Inter-CeBIL Harvard Cambridge Copenhagen

Harvard-Cambridge-Copenhagen, Sept 15, 2023 — Mauritz Kop has accepted a position as an Inter-CeBIL Fellow at the prestigious Novo Nordisk Foundation Copenhagen-Cambridge-Harvard Inter-CeBIL Programme for International Collaborative Bioscience Innovation & Law. In this role, Kop will focus his research on Advanced Medical Computing, Artificial Intelligence (AI) and Quantum Technologies within the life sciences ecosystem.

About the Inter-CeBIL Programme

The Inter-CeBIL Programme is a world-leading research hub dedicated to identifying and tackling the most significant legal and regulatory barriers to health and life science innovation. The initiative fosters robust knowledge networks to provide tailored legal and regulatory support to patients, researchers, businesses, and incubators, with the ultimate goal of ensuring that health and life science innovations can safely and effectively reach patients and markets.

This international collaboration brings together top-tier academic institutions to drive progress in healthcare and biotechnology. The program is a joint effort between the Centre for Advanced Studies in Bioscience Innovation Law (CeBIL) at the University of Copenhagen, the Petrie-Flom Center for Health Law Policy, Biotechnology, and Bioethics at Harvard Law School, and the University of Cambridge, among other key partners. The program is led by a distinguished team, including Professor Timo Minssen as the Founding Director of CeBIL at the University of Copenhagen, Professor I. Glenn Cohen who leads Harvard Law School’s contribution, and Professor Mateo Aboy who leads the Cambridge part.

Key Research Areas

The Inter-CeBIL Programme centers its research on three key "grand challenges":

1. Advanced Medical Computing: Focusing on Artificial Intelligence (AI) and Quantum Technologies (QT).

2. Pandemic Preparedness & Anti-Microbial Resistance (AMR).

3. Sustainable Innovation & Biosolutions: Encompassing eco-systems, drug R&D, drug regulation, and data infrastructures.

Focus on Key Area 1: Advanced Medical Computing, AI & Quantum Technology

This key research area addresses the increasingly critical role of advanced computing in the life sciences and medical sectors. Algorithms are becoming fundamental building blocks in a wide range of medical devices, digital health technologies (DHTs), and drug discovery tools (DDTs). The use of advanced computing, including AI/ML and quantum computing (QC), holds immense potential benefits for the life sciences, drug discovery, and medical sectors. These advancements also raise significant legal, ethical, governance, and regulatory issues that the program aims to address.

In his capacity as an Inter-CeBIL Fellow, Mauritz Kop will contribute his deep expertise in quantum-AI, its governance, and its legal-ethical implications to this key research area, helping to navigate the complex challenges and opportunities presented by these cutting-edge technologies.

Meer lezen