This was published 3 years ago
Artificial intelligence weapons creates ‘moral imperative’ to study them, US body says
By Jeffrey Dastin and Paresh Dave
San Francisco: The United States should not agree to ban the use or development of autonomous weapons powered by artificial intelligence (AI) software, a US government-appointed panel said in a draft report for the Congress.
The panel, led by former Google chief executive Eric Schmidt, concluded two days of public discussion about how the world’s biggest military power should consider AI for national security and technological advancement.
Eric Schmidt, former Google CEO.Credit: Bloomberg
Its vice chairman, Robert Work, a former deputy secretary of defence, said autonomous weapons were expected to make fewer mistakes than humans do in battle, leading to reduced casualties or skirmishes caused by target misidentification.
“It is a moral imperative to at least pursue this hypothesis,” he said.
The discussion waded into a controversial frontier of human rights and warfare. For about eight years, a coalition of non-governmental organisations has pushed for a treaty banning “killer robots,” saying human control is necessary to judge attacks’ proportionality and assign blame for war crimes. Thirty countries including Brazil and Pakistan want a ban, according to the coalition’s website, and a United Nations body has held meetings on the systems since at least 2014.
While autonomous weapon capabilities are decades old, concern has mounted with the development of AI to power such systems, along with research finding biases in AI and examples of the software’s abuse.
The US panel, called the National Security Commission on Artificial Intelligence, in meetings this week acknowledged the risks of autonomous weapons. A member from Microsoft for instance warned of pressure to build machines that react quickly, which could escalate conflicts.
The panel only wants humans to make decisions on launching nuclear warheads.
Still, the panel prefers anti-proliferation work to a treaty banning the systems, which it said would be against US interests and difficult to enforce.
Mary Wareham, coordinator of the eight-year Campaign to Stop Killer Robots, said, the commission’s “focus on the need to compete with similar investments made by China and Russia [...] only serves to encourage arms races.”
Beyond AI-powered weapons, the panel’s lengthy report recommended use of AI by intelligence agencies to streamline data gathering and review; $US32 billion in annual federal US funding for AI research; and new bodies including a digital corps modelled after the army’s Medical Corps and a technology competitiveness council chaired by the US vice-president.
The commission is due to submit its final report to Congress in March, but the recommendations are not binding.
Reuters