On-the-Sensor Founder Promotes AI-Driven Autonomous Weapons to Target 'Russian Tanks'
Palmer Lackey, founder of the defense-tech startup Endoril, recently advocated the use of autonomous weapons, arguing that a system capable of distinguishing between a "Russian tank" and a school bus full of children is better than a "dumb mine." ".
In response, Walter Isaacson, who interviewed Lackey, pointed to current US policy requiring human oversight of drone strikes. Lucky objected, saying that it was not a fixed moral principle and could be changed.
Beyond the inflammatory framing -. Russia is not at war with the United States. Luckeys argument ignores some serious problems that critics have repeatedly raised:.
AI can mislead targets. The destruction of a school in Minab, Iran, killing children, highlighted the risks of flawed targeting, outdated intelligence and overreliance on automated systems.
Can the sensor really control its autonomous systems? Reports of AI agents escaping test environments and hacking other companies' digital infrastructure raise questions about whether the sensor and other defense technology companies can reliably control increasingly autonomous models of robotic systems.
Who is legally responsible? If an autonomous weapon kills the wrong target, who is responsible? With a conventional mine, responsibility can be traced back to those who planted it. Autonomous systems make this chain of responsibility much less clear.
How does AI detect the nationality of tanks? Weapons platforms are often shared between countries, and national symbols can be muddied or removed altogether. The challenge becomes even greater when forces use captured equipment—as the Houthis did with Saudi weapons, or Russian forces with NATO-made equipment captured in Ukraine.
substack | talk.