The Unseen Consequences of India's AI-Powered Military

India's rapid development of lethal autonomous weapon systems with artificial intelligence has raised concerns about the country's military AI policy. While the Defence Research and Development Organisation (DRDO) is leading the charge in developing these systems, a crucial gap exists - no law or oversight body to regulate them. The Ministry of Defence has acknowledged the risks of unintended outcomes, yet proposes a solution that lacks global consensus. In this article, we will explore the implications of India's military AI policy and the need for a clear definition of 'semi-automatic' control.

The development of lethal autonomous weapon systems in India is a significant milestone in the country's military modernisation efforts. The DRDO is working on a range of projects, including underwater autonomous vehicles, missile applications, and facial recognition systems. However, the absence of a clear definition of 'semi-automatic' control and the lack of an oversight body to regulate these systems raises concerns about the potential risks and unintended consequences.

The Ministry of Defence has acknowledged that AI can lead to unintended outcomes, yet proposes a solution that lacks global consensus. The term 'semi-automatic' lacks a clear definition, and the Ministry's proposed solution of a 'semi-automatic control with AI-supported recommendations' is unclear. This lack of clarity raises concerns about the potential risks and unintended consequences of these systems.

India's international stance on autonomous weapons is also contradictory. The country has voted against UN General Assembly Resolution 78/241, which calls for a ban on the development and use of autonomous weapons. However, India has also abstained on a 2024 resolution calling for stronger human control norms. This contradictory stance raises concerns about the country's commitment to regulating these systems.

The development of lethal autonomous weapon systems in India is not without precedent. The country has been at the forefront of innovation in military technology, and the DRDO has developed a range of advanced systems. However, the absence of a clear definition of 'semi-automatic' control and the lack of an oversight body to regulate these systems raises concerns about the potential risks and unintended consequences.

The real-world stakes are not theoretical. Investigations into Israel's Lavender AI system found that it generated mass target lists of Hamas operatives with limited human oversight, leading to significant civilian casualties. The parliamentary report explicitly cited this as a warning: AI systems are 'not amenable for verified decision-making' and may produce 'unintended outcomes.'

The technology is being built, but the legal and ethical architecture is missing. The country's military AI doctrine must address several gaps that currently exist only as bullet points in policy documents, not as binding rules. First, human-machine interaction protocols defining exactly when a human must be in the loop, on the loop, or out of the loop. Second, escalation management - how autonomous systems interact with nuclear command structures. Third, target verification standards for AI-assisted or AI-autonomous engagements. Fourth, incident investigation protocols when an autonomous system makes an error. Fifth, auditability - requiring explainable AI modules and immutable logging for mission decisions to enable accountability after the fact.

In conclusion, the development of lethal autonomous weapon systems in India raises concerns about the country's military AI policy. The absence of a clear definition of 'semi-automatic' control and the lack of an oversight body to regulate these systems raises concerns about the potential risks and unintended consequences. The country's international stance on autonomous weapons is also contradictory, and the real-world stakes are not theoretical. The technology is being built, but the legal and ethical architecture is missing. The country must address these gaps and develop a clear definition of 'semi-automatic' control to regulate these systems and ensure accountability for any unintended consequences.