Can you give an example of countries being rewarded for ignoring laws absent an enforcement mechanism?
You do realize that the actual enforcement mechanism arises in bilateral relations and through multinational institutions like the EU, NATO, World Bank, IMF, etc.
And it’s usually incredibly successful, especially if the big powers like the U.S. join in.
The Budapest Memorandum is a good example. The countries that got to keep their nuclear weapons promised to not invade the countries that gave away theirs. They ignored their promises, and were rewarded for it.
Russia and Ukraine are busy making the most autonomous killer robots they can afford. Russia clearly is not deterred by sanctions, and I really don't think Ukraine needs more betrayal.
Using AI so citizens of your own country don't die in war is probably the highest value add there is... especially in the meat grinder that war has turned into now.
> Sanctions are enough of an enforcement mechanism to make low-value defection more trouble than it's worth
One, most drone-type weapons are highly dual use. That makes enforcement tough.
Two, our track record with enforcement sucks. Iran has nuclear materiel. (Not a bomb.) Between America, Russia and China we've created a world where middle powers look increasingly naive for not pursuing their own nukes. And I guess if all else fails, have a smuggler sleep with a CEO and then let David Sacks defend them.
Another way to see it is that this kind of laws increases a little the cost of ignoring the law.
Also that instead to buy expensive killer robots (that can always be used against the population if an insane dictator takes the power), other countries can invest their non-finite resources in research of defense against killer robots. Also in how to scrap each killer robot destroyed for valuable metals and stuff.
> why folks continue to use nuclear weapons and poison gases
Nuclear proliferation is enforced at gunpoint by the nuclear powers.
As for chemical weapons, "they are dismantling these systems because they do not expect they will ever have a use for these weapons. Not because chemical weapons are immoral. Because they are ineffective, whereas landmines, cluster munitions and nuclear weapons are assumed to have future uses. Morality was never at issue, effectiveness was" [1].
How so? Cluster munitions have been used by all parties in both Ukraine and the Middle East. There have been no consequences, and what would they even be when everyone uses them?
> Nuclear proliferation is enforced at gunpoint by the nuclear powers.
About all UN enforcement in general, how about I just let the UN GA talk: they voted, again, yesterday, on legally preventing anyone from taking action on human rights. In case you think you didn't read that correctly, yes, PREVENTING:
As the UN's own document notes extensively, they have done this vote for 40+ years.
As for nuclear specifically, are you serious? That must be why the UK, France, China, and Russia are helping so much in the US's war on Iran! (and how they stopped China in the 1980s, and ...) (and please don't repeat "but the nuclear deal" Iran was caught TWICE, by the UN, having violated it, and I don't think the US negotiators were lying in the article about how Iranian negotiators were boasting about violating the nuclear deal in Oman, nor do I believe that Trump blew up the nuclear deal out of ego). Just about the only real enforcement the UN does is provide a neutral party to check nuclear proliferation (or should I say semi-enforcement. After all the UN has voted many times to call the IAEA a conspiracy)
We have very publicly chosen to abandon the security architecture of the 20th century. Everyone has, Russia and China, obviously, because they want to attack. But Europe, including the European nuclear powers (yes, France was a bit of a holdout, as they were after WW2), have abandoned largely enforcement on nonproliferation ... and on human rights. In fact if they do anything it's sanctions, and sanctions are both very self-serving and have proven to be utterly ineffective, for many reasons, and the European powers have not changed tactics (we all know why: sanctions are "free", by which I mean they're more expensive than any other measure BUT don't need budget approval, AND sanctions are extremely good for corruption: for moving business to your friends). And while France held out a bit, US is the last Bastion of NATO, and frankly the last state to actually take action, as in do something militarily, on human rights.
When the UN did act, it was far worse than nothing. Their last 3 efforts (by end date) were Haiti, where an earthquake destroyed the state and the UN sent in soldiers who proceeded to start a cholera epidemic with prostitutes, then abandoned the resulting children. Before that the UN was going to prevent escalation in Lebanon, and (just one example) a rocket was fired into Israel less than 2 meters from a UN military base. Hezbollah killed 4 UN soldiers, and nobody ever faced any consequences. Oh and war broke out. And Mali. War broke out with UN soldiers watching. Everyone wanted the UN to leave. If we look back and look at the first 3 UN interventions it would read similarly.
Again, the US military saved (more or less) the situation in Haiti. The US military intervened in Lebanon many times, which was generally, mostly, appreciated. And as for Mali, France tried to intervene but ran away rather than face the Russian Wagner group.
Oh and of course, the UN is the same buildings, and initially the same people, as the League of Nations. The League of Nations, who negotiated the treaty of Versailles, now generally considered the cause of WW2.
So this is not a new thing.
As for alliances, NATO has held, but it is still under US control (mostly because despite how much Europeans scream they hate US power, or the current administration, or ... they demonstrate regularly they hate the idea that another European power might be in control of their military far more than they hate the US). Other European alliances have outright been betrayed. African and some Asian older-colonial alliances, essentially all of them, most under messy circumstances, have ended. Oh and of course one might remark the Budapest memorandum stated that if Crimea was attacked in any way half of Europe would declare war on Russia. Instead, Ukraine got a few loans (and UK/Boris Johnson gave them the Javelins that saved Kyiv)
Yes, I get I'm going to be downvoted for what will no doubt be interpreted as support for 2 very popular politicians (Trump and Johnson), but whatever.
> please don't repeat "but the nuclear deal" Iran was caught TWICE, by the UN, having violated it
On what dates, and what "agreement" was violated?
Are you referring to the 2005 UN finding that Iran was in noncompliance with IAEA safeguards that occurred before the first iteration of "the nuclear deal" Joint Plan of Action (JPOA) 2013, and the following iteration of "the nuclear deal" Joint Comprehensive Plan of Action (JCPOA) 2015 ?
Not just that (there's also the 3 statements, and the timing of those statements), plus looking up how enrichment works (the lower the %, the slower it goes, exponentially) which means that Iran was doing nuclear enrichment during the nuclear deal, with the number of centrifuges clearly indicating it was to produce nuclear weapons, not for any other reason. Again, I am very, very sorry, but Trump's and others statements on this particular issue are correct. I understand that it is currently considered critical to people's political beliefs that this isn't true. But the laws of nature (well, engineering) say different.
And as pointed out before, I believe the US negotiators weren't lying when they stated Iran was actually boasting about their enrichment.
Oh and it's not just the US current political views that are offended with this statement. WHO sold Iran those centrifuges, knowing full well the numbers meant that they were meant for nuclear weapons? The German green party and CDU approved that sale ... but it can't be discussed. I mean, were they deceived? Maybe, probably I'm going to say, but it cannot be talked about and especially the obvious question "What is Germany's responsibility here?" can't be asked.
I mean it's like the Netherland's and Belgium's role in giving Pakistan and North Korea nuclear weapons. There, too, the "... and your plan to fix that, dear Belgium and Netherlands, is what, exactly?"
But it's critical to current political beliefs to say otherwise, half of people are mad enough to deny Iran even wants nuclear weapons, so you're probably about to deny physical reality. Have at it.
Kind of like the "detail" from the Iraq war nobody is allowed to talk about anymore. That Ali Chemicali was convicted of using chemical weapons, first by the UN, then by Iraqi courts, in both cases supported by people standing there with chemical burns. But there NEVER WERE chemical weapons (and certainly not a research program or production facilities) in Iraq. NEVER!
The US politically approved history is as stupid and full of lies as any other countries' history.
So there. Pretty sure I have offended and insulted the preferred political beliefs of a solid 90% of USians and Europeans. Sadly, doesn't make it any less true.
So ... you're either referring to Iran being non compliant to a deal eight years before it was made, or you're referring to Iran being non compliant to a deal after a major party to the deal withdrew.
I don't care much for this discussion. Obviously, the deal doesn't actually matter for anything other than feelings. And no, I don't mean official findings I mean statements. Plus there was "a deal" before the deal (before 2013 I mean), which Iran violated even more than the nuclear deal. Iran technically first agreed to not enrich uranium in 1968 and the current government first promised not to enrich uranium in 1974, and they haven't even bothered to withdraw from that (oh, and technically that agreement says it can never be withdrawn from, but let's call that a problem with the usual UN level of realism. It's like what UN GA keeps doing with that "other" conflict: pointing out Hamas has signed a multiple treaties to fight terrorism, therefore they must be fighting terrorism and then saying that Israeli actions violated those treaties)
The simple fact is that Iran cannot be allowed to enrich uranium under any circumstances, deal, no deal, conditions, ... this is political, when push comes to shove it doesn't matters. It cannot be allowed to happen, obviously.
Iran has been under agreement that they weren't going to enrich uranium for longer than the current Iran exists. All Iranian nuclear actions violated NPT, and of course the help they got from Russia and Germany, and the help they gave to North Korea also violated NPT, but that, I'm sure doesn't matter. 1000 violations by Iran, 10 really big violations, and one by Trump/US. Three guesses which part of the list you'll be focusing on ...
This does also mean that the details, AND any blame or who violated what treaty first doesn't matter (cue the endless discussion you're about to start trying to make it sound reasonable what Iran did, it's the "US's fault", right? Or maybe Europe? I've read tankies claiming that. Hell some communists are making the point that if Iran beats the US in this conflict, they'll finally become a true communist state, what they were prevented before by evil Britain capitalist oil companies. Really. An article saying that is on marxist.com). Obviously Iran was the first to violate NPT, both as a principle and as a deal/treaty, but let's say you're right and it wasn't Iran. Or that the JCPOA somehow forgave them and makes everything that happened previously just peachy, which it of course doesn't ...
Fact is Iran has attacked everyone they possibly could, from Argentina to Saddam Hussain, from the Taliban to Norway. Everyone knows what will happen if they get nukes.
For the US, I think the history of a distorted 2nd amendment dialogue may make this even worse: "If the government reserves the right to use autonomous killing drones, then the citizens must have a right to the same!"
And the difference between a bot that navigates and carries stuff and a bot that navigates and carries and uses a weapon may be a small modification.
Slaughterbots was a great way of illustrating the issue, but I think Daniel Saurez's "Kill Decision" talk is a lot more useful and more accurately predicts where we are today in issues of autonomous warfare and mitigation, despite being even older: https://www.youtube.com/watch?v=pMYYx_im5QI
He recommends an international framework where no human kill decision is left to be made autonomously (we're well past this stage), all robots announcing their presence and identification at all times where all citizens can track them, drones that patrol other drones not adhering to these requirements. That's where discussions should have started. Historically, it seems weapons have to be abused first to demonstrate how terrible they are, before treaties are enacted
> all robots announcing their presence and identification at all times where all citizens can track them, drones that patrol other drones not adhering to these requirements
Sorry what, we're going to have drones patrolling checks notes the Arabian Peninsula and also all of Eastern Ukraine, Crimea and Western Russia to make sure all sides' drones there are constantly squawking that they're on a bombing run? Do air-defense missiles and drones have the same obligation?
This sounds like a global no-fly zone. It's unclear the U.S. military can even enforce one over Iran.
> Sorry what, we're going to have drones patrolling checks notes the Arabian Peninsula and also all of Eastern Ukraine, Crimea and Western Russia to make sure all sides' drones there are constantly squawking that they're on a bombing run?
As opposed to drones not announcing themselves, acting with impunity? Yes, I'd rather take the treaty that enforces this. You cannot simply "ban drones" or "ban robots" today, which is the point Daniel makes. You can only mitigate them
I'm not sure where you got the idea about this creating a "global no-fly zone". I think your argument is essentially "patrolling robots effectively results in no fly zone" but that's not what Daniel is saying. Mitigating robots != mitigating all things that fly. Not all robots are flying either. I'd encourage you to watch the talk if you haven't already
From what I can see, this video from 13 years ago has almost completely predicted where we are today, which is terrifying. Perhaps I believe perfect is the enemy of good and its better to unwind from somewhere. I do really like the idea of robot makers being forced to add publicly-visible identification signals into their robots as a start. It's not perfect, of course
I appreciate you watching the video and offering your counter perspective
> this video from 13 years ago has almost completely predicted where we are today, which is terrifying
I'm not loving his history of war and politics mapping feudal economies to armor and castles being broken by scale armies, which in turn enabled nation-states. We had massive armies before: Rome fielded them. Before them, Alexander the Great and phalanxes built scaled armies. The same breaking of armor, in fact, happened with chariots and long spears in the Bronze Age.
As for the threat to democracy, it seems professional armies allow leaders to separate themselves and their populations from the gory effects of war almost as effectively as AWS. Suarez also claims AWS will let leaders decouple population from power (a real concern, I think). But then he says it will permit anonymous war, which also means anonymous rebellion, which undercuts that first risk.
On AWS enabling offense over defense, meanwhile, we've seen that's currently dead wrong. The defender's advantage has grown. Not because air defenses are better. But because mass manufacturing cheap short-range munitions allows one to make their own territory lethal much faster than someone far away can bring their lethality to you.
In summary, I think Suarez offers a prescient and compelling summary of leading thought on AWS thirteen years ago. But he misses some marks. Internally contradicts at times. And as such, I'm not convinced in his proposed solution.
It does, however, contain a kernel of wisdom. Perhaps I could expand on it. Maybe what we need is open-source intelligence from space-based platforms that monitor, real time, the global airspace and ground for likely autonomous activity. What I'm proposing is a panopticon, but no more than Suarez's. It is, however, economically possible. And it could be enacted unilaterally. Knowing who is fielding what in what capacity will let us draw more thoughtful lines. It's not like we don't have a bunch of conflicts brewing as laboratories anyway.
Civilian "slaughterbots" would get you into preposterously serious legal problems for a cornucopia of reasons:
0. FAA / ATC stuff
1. Adding self-guidance packages to any rocket to steer it to a specific spot will get attention very rapidly, because any tech info you disperse is going to be ITAR-controlled. This happened a couple decades ago to a few model rocket guys who added GPS targeting, and it happened again not too long ago to some dudes who published a youtube showing their flying widget with an onboard AI Decider/Navigator that flew itself back home. This is helped along by point 0, see above.
2. Your payload is an NFA "destructive device" no matter how you slice it. It's going to need a dozen or so grams of HE, and anything more than 7g OR any amount outside of a gun barrel is legally DD. Also, under Heller, the Second Amendment protects those weapons that are in “common use” by law-abiding citizens, and SC Bruen, SC Rahimi didn't scew with that, but no one is going to say that killbots are "common use" . . . which brings me to . . .
3. “Bearable arms.” - a doohickey that flies off, loiters and engages isn’t “borne” in any ordinary sense. This hasn't been tested in a court yet, but I would bet dollars to donuts that it doesn't come off like "quadcopter == bullet"
You could dodge some or all of these right up until the moment of deployment, but once you hook all the pieces together they're coming down on you like a load of bricks.
Oh no no no no they do not want their citizens/property to be getting their hands on stuff that can actually fight. Here, have an AR instead that you can cuddle.
Seems pretty clear in the context of the revolutionary war that the purpose of the 2A was to protect the ability of citizens, or more specifically militias, to overthrow a tyrannical government.
Interestingly this has actually happened once in the USA since the revolutionary war, the Battle of Athens in Tennessee in 1946 (1)! Small scale sure but it worked as intended.
Back in those days quite a lot of Americans were moving west fighting coyotes and indians.
It doesnt help to pretend it was some noble freedom, or that America is an actual democracy today, because i highly doubt nobody in American wishes to build a ballroom or invade Venezuela.
It doesn't really matter. The modern 2a argument is based on an argument that was never considered valid in its time. 2a arguments and stances are malleable.
There are backpack-sized nukes that fit the definition of bearable arms too [1]. I think there are reasonable limits. Except for myself, I should be allowed to own a DJI drone with hbomb payload, no one else though
This path leads unavoidably to one or two top Russian politicians killed. Then they will change their point of view really fast.
Why to train your expensive robot to kill an anonymous child in a beach? is a bad use of your money when you can train it to kill a general in their house.
The only part that they didn't realized still is that using $10000 drones to launch bombs is also antieconomical and makes you look bad on TV. Eventually psychos will realize that the future is $500 mosquito drones delivering poison to one particular target. Much more digestible for the public opinion.
I hope that we are still at the moment to stop this future, but humans seem dumber and dumber by the day.
Their whole war is a bad use of money. You just don't realize that not all things people do they do for money. Ideology, religion, propaganda have much larger impact on decision making than love for money. Especially in non- or half-capitalist societies.
> I hope that we are still at the moment to stop this future, but humans seem dumber and dumber by the day.
You're living about 5 years behind if you think it's future. It's the present. There's nothing you can do to prevent it.
The issue here is that by the time you realize your adversary stopped holding their punches the war will be over. Autonomous systems totally break conventional warfare, there is no ramp up period or chance of retaliation when the rules get broken. Things are going to move well beyond the pace of humans and software at the edge is going to make just as much of a impact as hardware.
> there is no ramp up period or chance of retaliation when the rules get broken
This has been true of all ranged weapons, across history, over their weapon ranges. Which, since the advent of ICBMs, has been global. (And since when runaway auto-escalation has been a real concern–drones don't materially change that.)
I don't see how this is true? It depends on the designs, e.g. robustness, weight, agility, etc. Though there is the classic disturbing "slaughterbots" presentation about using cheap drones armed with a few grams of high explosive and facial recognition technology used to cheaply sow chaos.
The argument is more that existing systems could be automated. There’s probably lots of roles on a battleship robots couldn’t do yet, but the humans steering the ship or clicking where ordinance should land could be replaced with autonomous systems
If both sides were hiding capabilities behind software flags then the hardware might not matter.
US drones today have to go through a long kill chain to decide if it can take action against a target. We’ve already seen this heavily eroded in Ukraine/Russia. It’s not hard to imagine to losing side removing the human element entirely with just a software flag.
My argument is that autonomous systems will move war so quickly that by the time you react and engage your systems as well the war will be over.
And how will you feel when killer robots from other countries are roaming yours killing your young men, women, and children? Don't assume you will always be untouched.
Of course, that's life. But we have to explore all possibilities and equip ourselves as best we can, accepting any such ban would be detrimental to us and give the advantage to those other countries who may one day find themselves roaming here.
That's not my point. I was addressing the notion that these technologies will somehow keep your people safe in a war when it goes both ways. Sure, you won't have to send your people into battle, but neither will the enemy.
And with these sorts of systems there will absolutely be a lot of civilians killed either due to the systems inability to distinguish between non-combatant and combatant or more likely the fact that shitty regimes simply don't value human live, their own country's or others.
> you won't have to send your people into battle, but neither will the enemy.
Perhaps between nuclear powers. But we've already been doing set-piece battles as proxy wars without drones. Just other people.
At a certain point, you start hitting the other side's production. That means strikes on the homeland. Even if we're in a world where those factories are automated, that's going to result in errors and civilian deaths from time to time.
Yes, there is asymmetry between bigger powers and smaller ones, and the smaller often resorts to terrorism. I really don't think there is anything here to crow about. Technology definitely has changed the battlefield, but I wouldn't assume it will necessarily be for the better.
I'm also not saying any given country shouldn't build these things. We all do what we have to in order to survive. I think that's the reality, rather than any illusion that these things will make your people any safer.
I've never understood the opposition to precision weapons, because dumb weapons like wooden planes dropping unguided bombs are far more devastating to bystanders than cruise missiles or AI-guided loitering munitions.
30 years ago, that guy would've been a barely visible smudge in a grainy video feed on a gunship's sight. He would've been killed because helicopter crew wouldn't have been able to tell that he was a civilian. With 2026 tech, they can properly identify him, steer the drone away just a few meters before hitting him, and fly down the road to hit the actual enemy group in the area. That guy survived only because modern weapons beam down high-def video and provide control link until the very end instead of just flying or shooting into the nearest heat source once a trigger has been pulled.
In the right hands yes they can minimize casualties. I'd love nothing more than for all wars to be fought only between robots. But it only takes one asshole yee ha to let these things wipe out a city or two. That's the price. So we'll all build them, but I don't think we should be happy about it.
Finland spent ~ half a billion Euros getting rid of its landmines, only to withdraw from the treaty and rebuild its landmine arsenal in the last couple years.
Landmines are very effective. Likely one of the most effective for defending a long boarder with no natural geographic boundaries. and they are harmful (on purpose).
I mention it because some dangerous things are very effective deterrents. They may sound scary, but they are a lot better than any alternative.
Why would the world's most active and powerful armed forces sign anything banning the use of an effective tool?
Even in the books where the hardware had this magic there were problems, and that was the entire point of the books.
Reality cannot work in the way the books did, at least not with any type of computing architecture we've made so far. I'd go further and say it's antithetical to general intelligence and problem solving.
I would say the books showed correctly, that it is impossible to avoid "trolley problems", but that is okay and expected. It's still directionally correct to imbue machines with the directive to not harm humans.
People use robots (and soldiers) to dodge responsibility. By making the operator anonymous, hidden beneath layers of "chain of command", the fiction of "nobody was responsible" is conjured up.
By refusing to outlaw autonomous weapons, the absence of any human operator built-in, the US follows its greed, their wish for killing without remorse and the fiction of "untouchability".
It's worth considering why bans on nuclear, biological, and chemical weapons seem to work pretty well. We basically have norms against using them, and that works. Nuclear weapons are hard for anyone but a well-resourced nation-state to make, but the other two aren't hard to make or get.
So, what's the difference here?
Is it that killer robots are somehow not norm-breaking? There's something about how we imagine they will be that seems...okay for war? Versus poison gas, which somehow seems not okay for war to most everybody.
"They are dismantling these systems because they do not expect they will ever have a use for these weapons.
Not because chemical weapons are immoral. Because they are ineffective, whereas landmines, cluster munitions and nuclear weapons are assumed to have future uses. Morality was never at issue, effectiveness was.
That has some big consequences, most of which are actually unpleasant. It means that efforts to ban ‘immoral’ weapons that are effective will likely never succeed. The model that activists thought they were building on is a foundation of sand – the only way you ban weapons is after they are basically useless anyway (to cut that point finer: you get to ban weapons after they stop being useful to the great powers, who may then enforce the ban on smaller states). The idea that we might summon up enough moral indignation to set these weapons aside seems unfounded. We are not nearly so moral as my high school teachers imagined, nor are we so cowardly as a ‘Fremen apologist’ might think. We’ve simply made an amoral calculation about effectiveness" [1].
> Everyone thinks their killer robots will kill the other guys killer robots first.
... and that there definitely won't be some horrific disaster where one (or many more than just one) such killer robots malfunction or run amok, or are taken over by malicious actors hellbent on causing exactly such a disaster.
I'm not even joking, almost every "ban on X" in the context of warfare happened after unspeakable atrocities where, once the dust settled, the parties involved looked at the sea of dead bodies and agreed not to do it again. I guess countries learn by doing.
Non-signatories include the US, China, Russia, India, Pakistan, Israel and Iran. And Ukraine decided to withdraw from the treaty after being invaded by Russia.
So a ban with a lot of signatories, but not by any means universal.
A lot of these treaties will be abandoned once a war becomes existential for a countyr. As far as I know, chemical and biological weapons weren't used in WW2 because they don't make much sense. Same for nuclear weapons after WW2. They aren't very useful and may trigger world wide destruction.
Chemical and biological weapons are both more notable for being relatively ineffective against prepared military forces, but devastating to civilians. They don't usefully generate tactical results on the battlefield. (in part due to their uncontrollability: a bullet goes where you point it, a bomb lands where you throw it, a cloud of gas can hit your own forces if the wind changes at a bad moment).
Land mines mainly rip off limbs of children and framers so nobody really cares. I think it's terrible by the US that haven't joined the ban.
As far as nuclear weapons go, they haven't been banned but we have the non-proliferation treaty that worked to some degree. The use of nuclear weapons is also viewed as a line that after WW2 nobody has tried to cross.
Globally there are 6-8,000 land mine casualties (including deaths) a year, very few of which occur along the Korea's joint border - that's a clearly marked, well known, patrolled, enforced, entrenched moat with few children or farmers at risk.
The three South Korean soldiers recently injured raised awareness of the mines there, but they were patrolling an area with known risks.
The greatest issue in my mind for the past four decades or so are the very many civilian areas about the globe with scattered mines throughout areas where children ideally should be able to play and food grown safely.
When you travel in Laos or Cambodia it's highly recommended not to jump into the bushes to pee because you may step onto a mine or a not exploded bomb.
UN treaties are worth the paper they are written on. I doubt the current US admin cares much about any of the UN treaties, except for when it supports sanctions they want to impose.
TBF we've had killer robots for decades. Every now and then we shoot down an airliner full of people with them.
Not to be overly glib but that cat has been out of the bag for a long fucking time. Name a capability and I'll give you a conventional munition that has had said capability for over a decade.
We've had the Tomahawk since 1983, the Minuteman since 1962, and at a much smaller scale, the Javelin since 1996. If you want to go back further, the Germans had the V2 as early as 1944. The cat has been out of the bag almost as long as we've had the gift of flight, and predating the modern computer.
I think people also just don't know the broader capabilities of those systems beyond point-and-shoot. There are a number of systems that have had the ability to loiter and look for targets before engaging. The recent advancement has been the ability to do that on higher resolution FPA imagers but it doesn't actually change much fundamentally.
What people should actually be worried about is an AI chain of command. The weapons are very secondary to the kill chain that initiates them.
> Landmines are a rudimentary form of killer robot
I don't think I've ever heard of a landmine that autonomously hunts down it's target. AFAIK you gotta go to where it's been buried and step on it. A killer robot will come to you with or without your consent or any action or lack thereof on your part.
There's an interesting future if autonomous decision making increasingly becomes accepted. We've already seen glimpses of it with drone strikes target selection going back to post-911 actions, we've seen it more recently with almost the first bombing in Iran hitting a school. "out-dated intelligence".
It seems no one was responsible for Skynet.
AI/autonomous decision making absolves those being paid to be responsible of any responsibility. Can we at least save the ridiculous salaries that they're being paid to no longer make these decisions? It's becoming increasingly obvious that the decision makers are resentful of having to make decisions, and are jumping as quickly as possible to offloading it to "new, well marketed thing".
US is the country providing weapons and being active in wars only they've started themselves. Otherwise not taking into account people life value, never in history.
> Rather than negotiating a binding treaty, the U.S. has proposed five more years of work by the CCW's expert group to develop a nonbinding instrument, according to a November 4 working paper.
> Washington maintains that existing international humanitarian law already applies to autonomous weapons and that a new legally binding treaty is unnecessary.
I suspect the "no" votes will coincide with the countries who stand to gain from the production or use of killer robots. And the "yes" votes will coincide with states that have nothing to gain.
Countries who stand to gain from the production or use of killer robots will vote "yes" on a ban of killer robots? How would this bolster use or production?
"We dissociate from preambular paragraph 13 because it inaccurately implies that sanctions are not in accordance with international law and pose a danger to food security and nutrition."
So essentially, we reserve the right to murder children by famine.
Absent an enforcement mechanism, laws like this just reward countries that are more willing to ignore the law.
And the UN has repeatedly proven it does not have an effective enforcement mechanism.
Can you give an example of countries being rewarded for ignoring laws absent an enforcement mechanism?
You do realize that the actual enforcement mechanism arises in bilateral relations and through multinational institutions like the EU, NATO, World Bank, IMF, etc.
And it’s usually incredibly successful, especially if the big powers like the U.S. join in.
Israel, Russia, to name a couple.
The Budapest Memorandum is a good example. The countries that got to keep their nuclear weapons promised to not invade the countries that gave away theirs. They ignored their promises, and were rewarded for it.
Israeli occupation of Palestine
Sanctions are enough of an enforcement mechanism to make low-value defection more trouble than it's worth.
They aren't a big enough stuck to make high-value defection work, but this seems to squarely fall under low-value.
Russia and Ukraine are busy making the most autonomous killer robots they can afford. Russia clearly is not deterred by sanctions, and I really don't think Ukraine needs more betrayal.
Russia could be deterred by sanctions if they were enforced hard enough. They're literally using american parts in their drones.
"this seems to squarely fall under low-value"
Using AI so citizens of your own country don't die in war is probably the highest value add there is... especially in the meat grinder that war has turned into now.
Sure, if you ascribe infinite value to the life of one citizen in a war, you can justify any degree of barbarity.
> Sanctions are enough of an enforcement mechanism to make low-value defection more trouble than it's worth
One, most drone-type weapons are highly dual use. That makes enforcement tough.
Two, our track record with enforcement sucks. Iran has nuclear materiel. (Not a bomb.) Between America, Russia and China we've created a world where middle powers look increasingly naive for not pursuing their own nukes. And I guess if all else fails, have a smuggler sleep with a CEO and then let David Sacks defend them.
Another way to see it is that this kind of laws increases a little the cost of ignoring the law.
Also that instead to buy expensive killer robots (that can always be used against the population if an insane dictator takes the power), other countries can invest their non-finite resources in research of defense against killer robots. Also in how to scrap each killer robot destroyed for valuable metals and stuff.
Yep, that's why folks continue to use nuclear weapons and poison gases!
Fair point, but I wonder how much is the fear of UN sanctions vs the fear of these weapons being used against them in retaliation.
> why folks continue to use nuclear weapons and poison gases
Nuclear proliferation is enforced at gunpoint by the nuclear powers.
As for chemical weapons, "they are dismantling these systems because they do not expect they will ever have a use for these weapons. Not because chemical weapons are immoral. Because they are ineffective, whereas landmines, cluster munitions and nuclear weapons are assumed to have future uses. Morality was never at issue, effectiveness was" [1].
[1] https://acoup.blog/2020/03/20/collections-why-dont-we-use-ch...
Cluster munition use gets intense scrutiny and/or serious retaliation. Except in maybe one US-backed case that is widely reviled even in the US.
How so? Cluster munitions have been used by all parties in both Ukraine and the Middle East. There have been no consequences, and what would they even be when everyone uses them?
Hmm, wasn't aware of Iranian usage as well. Indeed the waters are murkier than I had naively assumed.
> Nuclear proliferation is enforced at gunpoint by the nuclear powers.
About all UN enforcement in general, how about I just let the UN GA talk: they voted, again, yesterday, on legally preventing anyone from taking action on human rights. In case you think you didn't read that correctly, yes, PREVENTING:
https://docs.un.org/en/A/C.3/81/L.30
As the UN's own document notes extensively, they have done this vote for 40+ years.
As for nuclear specifically, are you serious? That must be why the UK, France, China, and Russia are helping so much in the US's war on Iran! (and how they stopped China in the 1980s, and ...) (and please don't repeat "but the nuclear deal" Iran was caught TWICE, by the UN, having violated it, and I don't think the US negotiators were lying in the article about how Iranian negotiators were boasting about violating the nuclear deal in Oman, nor do I believe that Trump blew up the nuclear deal out of ego). Just about the only real enforcement the UN does is provide a neutral party to check nuclear proliferation (or should I say semi-enforcement. After all the UN has voted many times to call the IAEA a conspiracy)
We have very publicly chosen to abandon the security architecture of the 20th century. Everyone has, Russia and China, obviously, because they want to attack. But Europe, including the European nuclear powers (yes, France was a bit of a holdout, as they were after WW2), have abandoned largely enforcement on nonproliferation ... and on human rights. In fact if they do anything it's sanctions, and sanctions are both very self-serving and have proven to be utterly ineffective, for many reasons, and the European powers have not changed tactics (we all know why: sanctions are "free", by which I mean they're more expensive than any other measure BUT don't need budget approval, AND sanctions are extremely good for corruption: for moving business to your friends). And while France held out a bit, US is the last Bastion of NATO, and frankly the last state to actually take action, as in do something militarily, on human rights.
When the UN did act, it was far worse than nothing. Their last 3 efforts (by end date) were Haiti, where an earthquake destroyed the state and the UN sent in soldiers who proceeded to start a cholera epidemic with prostitutes, then abandoned the resulting children. Before that the UN was going to prevent escalation in Lebanon, and (just one example) a rocket was fired into Israel less than 2 meters from a UN military base. Hezbollah killed 4 UN soldiers, and nobody ever faced any consequences. Oh and war broke out. And Mali. War broke out with UN soldiers watching. Everyone wanted the UN to leave. If we look back and look at the first 3 UN interventions it would read similarly.
Again, the US military saved (more or less) the situation in Haiti. The US military intervened in Lebanon many times, which was generally, mostly, appreciated. And as for Mali, France tried to intervene but ran away rather than face the Russian Wagner group.
Oh and of course, the UN is the same buildings, and initially the same people, as the League of Nations. The League of Nations, who negotiated the treaty of Versailles, now generally considered the cause of WW2.
So this is not a new thing.
As for alliances, NATO has held, but it is still under US control (mostly because despite how much Europeans scream they hate US power, or the current administration, or ... they demonstrate regularly they hate the idea that another European power might be in control of their military far more than they hate the US). Other European alliances have outright been betrayed. African and some Asian older-colonial alliances, essentially all of them, most under messy circumstances, have ended. Oh and of course one might remark the Budapest memorandum stated that if Crimea was attacked in any way half of Europe would declare war on Russia. Instead, Ukraine got a few loans (and UK/Boris Johnson gave them the Javelins that saved Kyiv)
Yes, I get I'm going to be downvoted for what will no doubt be interpreted as support for 2 very popular politicians (Trump and Johnson), but whatever.
> please don't repeat "but the nuclear deal" Iran was caught TWICE, by the UN, having violated it
On what dates, and what "agreement" was violated?
Are you referring to the 2005 UN finding that Iran was in noncompliance with IAEA safeguards that occurred before the first iteration of "the nuclear deal" Joint Plan of Action (JPOA) 2013, and the following iteration of "the nuclear deal" Joint Comprehensive Plan of Action (JCPOA) 2015 ?
Not just that (there's also the 3 statements, and the timing of those statements), plus looking up how enrichment works (the lower the %, the slower it goes, exponentially) which means that Iran was doing nuclear enrichment during the nuclear deal, with the number of centrifuges clearly indicating it was to produce nuclear weapons, not for any other reason. Again, I am very, very sorry, but Trump's and others statements on this particular issue are correct. I understand that it is currently considered critical to people's political beliefs that this isn't true. But the laws of nature (well, engineering) say different.
And as pointed out before, I believe the US negotiators weren't lying when they stated Iran was actually boasting about their enrichment.
Oh and it's not just the US current political views that are offended with this statement. WHO sold Iran those centrifuges, knowing full well the numbers meant that they were meant for nuclear weapons? The German green party and CDU approved that sale ... but it can't be discussed. I mean, were they deceived? Maybe, probably I'm going to say, but it cannot be talked about and especially the obvious question "What is Germany's responsibility here?" can't be asked.
I mean it's like the Netherland's and Belgium's role in giving Pakistan and North Korea nuclear weapons. There, too, the "... and your plan to fix that, dear Belgium and Netherlands, is what, exactly?"
But it's critical to current political beliefs to say otherwise, half of people are mad enough to deny Iran even wants nuclear weapons, so you're probably about to deny physical reality. Have at it.
Kind of like the "detail" from the Iraq war nobody is allowed to talk about anymore. That Ali Chemicali was convicted of using chemical weapons, first by the UN, then by Iraqi courts, in both cases supported by people standing there with chemical burns. But there NEVER WERE chemical weapons (and certainly not a research program or production facilities) in Iraq. NEVER!
The US politically approved history is as stupid and full of lies as any other countries' history.
So there. Pretty sure I have offended and insulted the preferred political beliefs of a solid 90% of USians and Europeans. Sadly, doesn't make it any less true.
So ... you're either referring to Iran being non compliant to a deal eight years before it was made, or you're referring to Iran being non compliant to a deal after a major party to the deal withdrew.
Is that correct?
I don't care much for this discussion. Obviously, the deal doesn't actually matter for anything other than feelings. And no, I don't mean official findings I mean statements. Plus there was "a deal" before the deal (before 2013 I mean), which Iran violated even more than the nuclear deal. Iran technically first agreed to not enrich uranium in 1968 and the current government first promised not to enrich uranium in 1974, and they haven't even bothered to withdraw from that (oh, and technically that agreement says it can never be withdrawn from, but let's call that a problem with the usual UN level of realism. It's like what UN GA keeps doing with that "other" conflict: pointing out Hamas has signed a multiple treaties to fight terrorism, therefore they must be fighting terrorism and then saying that Israeli actions violated those treaties)
The simple fact is that Iran cannot be allowed to enrich uranium under any circumstances, deal, no deal, conditions, ... this is political, when push comes to shove it doesn't matters. It cannot be allowed to happen, obviously.
Iran has been under agreement that they weren't going to enrich uranium for longer than the current Iran exists. All Iranian nuclear actions violated NPT, and of course the help they got from Russia and Germany, and the help they gave to North Korea also violated NPT, but that, I'm sure doesn't matter. 1000 violations by Iran, 10 really big violations, and one by Trump/US. Three guesses which part of the list you'll be focusing on ...
This does also mean that the details, AND any blame or who violated what treaty first doesn't matter (cue the endless discussion you're about to start trying to make it sound reasonable what Iran did, it's the "US's fault", right? Or maybe Europe? I've read tankies claiming that. Hell some communists are making the point that if Iran beats the US in this conflict, they'll finally become a true communist state, what they were prevented before by evil Britain capitalist oil companies. Really. An article saying that is on marxist.com). Obviously Iran was the first to violate NPT, both as a principle and as a deal/treaty, but let's say you're right and it wasn't Iran. Or that the JCPOA somehow forgave them and makes everything that happened previously just peachy, which it of course doesn't ...
Fact is Iran has attacked everyone they possibly could, from Argentina to Saddam Hussain, from the Taliban to Norway. Everyone knows what will happen if they get nukes.
> I don't care much for this discussion
Then why did you start this tangent?!
Its nothing more than a gentlemans agreement.
Yea like WMD in Iraq
When Stuart Russell did the Slaughterbots film in 2017, some people thought it was over-the-top, and yet here we are. https://en.wikipedia.org/wiki/Slaughterbots
For the US, I think the history of a distorted 2nd amendment dialogue may make this even worse: "If the government reserves the right to use autonomous killing drones, then the citizens must have a right to the same!" And the difference between a bot that navigates and carries stuff and a bot that navigates and carries and uses a weapon may be a small modification.
> When Stuart Russell did the Slaughterbots film in 2017, some people thought it was over-the-top, and yet here we are. https://en.wikipedia.org/wiki/Slaughterbots
Slaughterbots was a great way of illustrating the issue, but I think Daniel Saurez's "Kill Decision" talk is a lot more useful and more accurately predicts where we are today in issues of autonomous warfare and mitigation, despite being even older: https://www.youtube.com/watch?v=pMYYx_im5QI
He recommends an international framework where no human kill decision is left to be made autonomously (we're well past this stage), all robots announcing their presence and identification at all times where all citizens can track them, drones that patrol other drones not adhering to these requirements. That's where discussions should have started. Historically, it seems weapons have to be abused first to demonstrate how terrible they are, before treaties are enacted
> all robots announcing their presence and identification at all times where all citizens can track them, drones that patrol other drones not adhering to these requirements
Sorry what, we're going to have drones patrolling checks notes the Arabian Peninsula and also all of Eastern Ukraine, Crimea and Western Russia to make sure all sides' drones there are constantly squawking that they're on a bombing run? Do air-defense missiles and drones have the same obligation?
This sounds like a global no-fly zone. It's unclear the U.S. military can even enforce one over Iran.
> Sorry what, we're going to have drones patrolling checks notes the Arabian Peninsula and also all of Eastern Ukraine, Crimea and Western Russia to make sure all sides' drones there are constantly squawking that they're on a bombing run?
As opposed to drones not announcing themselves, acting with impunity? Yes, I'd rather take the treaty that enforces this. You cannot simply "ban drones" or "ban robots" today, which is the point Daniel makes. You can only mitigate them
> I'd rather take the treaty that enforces this. You cannot simply "ban drones" or "ban robots" today
Creating a de facto global conflict no-fly zone is about as realistic as banning drones.
I'm not sure where you got the idea about this creating a "global no-fly zone". I think your argument is essentially "patrolling robots effectively results in no fly zone" but that's not what Daniel is saying. Mitigating robots != mitigating all things that fly. Not all robots are flying either. I'd encourage you to watch the talk if you haven't already
> not sure where you got the idea about this creating a "global no-fly zone"
"Drones that patrol other drones" requires the resources of a no-fly zone.
> Not all robots are flying
No-fly zones are seldom maintained totally aerially.
> I'd encourage you to watch the talk
Will do. That said, I can't see any military power agreeing to have its drones (or air defenses) broadcasting like this.
From what I can see, this video from 13 years ago has almost completely predicted where we are today, which is terrifying. Perhaps I believe perfect is the enemy of good and its better to unwind from somewhere. I do really like the idea of robot makers being forced to add publicly-visible identification signals into their robots as a start. It's not perfect, of course
I appreciate you watching the video and offering your counter perspective
> this video from 13 years ago has almost completely predicted where we are today, which is terrifying
I'm not loving his history of war and politics mapping feudal economies to armor and castles being broken by scale armies, which in turn enabled nation-states. We had massive armies before: Rome fielded them. Before them, Alexander the Great and phalanxes built scaled armies. The same breaking of armor, in fact, happened with chariots and long spears in the Bronze Age.
As for the threat to democracy, it seems professional armies allow leaders to separate themselves and their populations from the gory effects of war almost as effectively as AWS. Suarez also claims AWS will let leaders decouple population from power (a real concern, I think). But then he says it will permit anonymous war, which also means anonymous rebellion, which undercuts that first risk.
On AWS enabling offense over defense, meanwhile, we've seen that's currently dead wrong. The defender's advantage has grown. Not because air defenses are better. But because mass manufacturing cheap short-range munitions allows one to make their own territory lethal much faster than someone far away can bring their lethality to you.
In summary, I think Suarez offers a prescient and compelling summary of leading thought on AWS thirteen years ago. But he misses some marks. Internally contradicts at times. And as such, I'm not convinced in his proposed solution.
It does, however, contain a kernel of wisdom. Perhaps I could expand on it. Maybe what we need is open-source intelligence from space-based platforms that monitor, real time, the global airspace and ground for likely autonomous activity. What I'm proposing is a panopticon, but no more than Suarez's. It is, however, economically possible. And it could be enacted unilaterally. Knowing who is fielding what in what capacity will let us draw more thoughtful lines. It's not like we don't have a bunch of conflicts brewing as laboratories anyway.
Civilian "slaughterbots" would get you into preposterously serious legal problems for a cornucopia of reasons:
0. FAA / ATC stuff
1. Adding self-guidance packages to any rocket to steer it to a specific spot will get attention very rapidly, because any tech info you disperse is going to be ITAR-controlled. This happened a couple decades ago to a few model rocket guys who added GPS targeting, and it happened again not too long ago to some dudes who published a youtube showing their flying widget with an onboard AI Decider/Navigator that flew itself back home. This is helped along by point 0, see above.
2. Your payload is an NFA "destructive device" no matter how you slice it. It's going to need a dozen or so grams of HE, and anything more than 7g OR any amount outside of a gun barrel is legally DD. Also, under Heller, the Second Amendment protects those weapons that are in “common use” by law-abiding citizens, and SC Bruen, SC Rahimi didn't scew with that, but no one is going to say that killbots are "common use" . . . which brings me to . . .
3. “Bearable arms.” - a doohickey that flies off, loiters and engages isn’t “borne” in any ordinary sense. This hasn't been tested in a court yet, but I would bet dollars to donuts that it doesn't come off like "quadcopter == bullet"
You could dodge some or all of these right up until the moment of deployment, but once you hook all the pieces together they're coming down on you like a load of bricks.
Oh no no no no they do not want their citizens/property to be getting their hands on stuff that can actually fight. Here, have an AR instead that you can cuddle.
2A dialogue is, at present, about "bearable arms" (Caetano vs. Massachusetts).
So the question becomes, "Are drones bearable arms?"
Seems to me the answer is an obvious "yes". Since they're small and you can carry them around.
Sometimes court cases get so weird.
Seems pretty clear in the context of the revolutionary war that the purpose of the 2A was to protect the ability of citizens, or more specifically militias, to overthrow a tyrannical government.
Interestingly this has actually happened once in the USA since the revolutionary war, the Battle of Athens in Tennessee in 1946 (1)! Small scale sure but it worked as intended.
1: https://www.libertarianism.org/articles/battle-athens-obscur...
Not quite.
Back in those days quite a lot of Americans were moving west fighting coyotes and indians.
It doesnt help to pretend it was some noble freedom, or that America is an actual democracy today, because i highly doubt nobody in American wishes to build a ballroom or invade Venezuela.
Genuine question, what is the legal test for bearability? If you can carry it? Because a suitcase nuke is, by definition, man portable.
It doesn't really matter. The modern 2a argument is based on an argument that was never considered valid in its time. 2a arguments and stances are malleable.
There are backpack-sized nukes that fit the definition of bearable arms too [1]. I think there are reasonable limits. Except for myself, I should be allowed to own a DJI drone with hbomb payload, no one else though
1. https://en.wikipedia.org/wiki/Special_Atomic_Demolition_Muni...
So is a grenade or a rocket launcher, but we've been pretty well able to regulate private ownership of those, no?
Russia also opposes this, and they're already letting AI select targets and kill people without human oversight. See this incident from July in Ukraine: https://www.nytimes.com/2026/08/24/world/europe/russia-drone...
This path leads unavoidably to one or two top Russian politicians killed. Then they will change their point of view really fast.
Why to train your expensive robot to kill an anonymous child in a beach? is a bad use of your money when you can train it to kill a general in their house.
The only part that they didn't realized still is that using $10000 drones to launch bombs is also antieconomical and makes you look bad on TV. Eventually psychos will realize that the future is $500 mosquito drones delivering poison to one particular target. Much more digestible for the public opinion.
I hope that we are still at the moment to stop this future, but humans seem dumber and dumber by the day.
Their whole war is a bad use of money. You just don't realize that not all things people do they do for money. Ideology, religion, propaganda have much larger impact on decision making than love for money. Especially in non- or half-capitalist societies.
> I hope that we are still at the moment to stop this future, but humans seem dumber and dumber by the day.
You're living about 5 years behind if you think it's future. It's the present. There's nothing you can do to prevent it.
Would supporting this ban be perceived as more pressure on Ukraine?
The issue here is that by the time you realize your adversary stopped holding their punches the war will be over. Autonomous systems totally break conventional warfare, there is no ramp up period or chance of retaliation when the rules get broken. Things are going to move well beyond the pace of humans and software at the edge is going to make just as much of a impact as hardware.
> there is no ramp up period or chance of retaliation when the rules get broken
This has been true of all ranged weapons, across history, over their weapon ranges. Which, since the advent of ICBMs, has been global. (And since when runaway auto-escalation has been a real concern–drones don't materially change that.)
I don't see how this is true? It depends on the designs, e.g. robustness, weight, agility, etc. Though there is the classic disturbing "slaughterbots" presentation about using cheap drones armed with a few grams of high explosive and facial recognition technology used to cheaply sow chaos.
The argument is more that existing systems could be automated. There’s probably lots of roles on a battleship robots couldn’t do yet, but the humans steering the ship or clicking where ordinance should land could be replaced with autonomous systems
I can see that being done. I dislike autonomous weapons, but I don’t see how that amounts to an insurmountable edge on a battleship.
there are no more wars, just war games. we have a world order.
> there are no more wars, just war games. we have a world order
Comforting notion. Unsupported by any evidence.
https://x.com/atrupar/status/2122339020642398536/video/1?s=4...
what’s a world order to a asymmetric conflict
Why isn't there time for ramp up? Production doesn't go from not existing to ubiquitous over night... usually.
Why isn't there a chance for retaliation? Why couldn't we, you know, shoot back?
If both sides were hiding capabilities behind software flags then the hardware might not matter.
US drones today have to go through a long kill chain to decide if it can take action against a target. We’ve already seen this heavily eroded in Ukraine/Russia. It’s not hard to imagine to losing side removing the human element entirely with just a software flag.
My argument is that autonomous systems will move war so quickly that by the time you react and engage your systems as well the war will be over.
"Killer robots" is a distasteful phrase, but their use is of course preferable to sending our young men to die in war.
And how will you feel when killer robots from other countries are roaming yours killing your young men, women, and children? Don't assume you will always be untouched.
Of course, that's life. But we have to explore all possibilities and equip ourselves as best we can, accepting any such ban would be detrimental to us and give the advantage to those other countries who may one day find themselves roaming here.
I'm gonna feel bad, but it's not my fault. THEY started it first.
> when killer robots from other countries are roaming yours
Genuinely unclear how this is different from the drones we've been fielding for decades. Or getting potted by a B-52 from BVR. Or firebombed.
That's not my point. I was addressing the notion that these technologies will somehow keep your people safe in a war when it goes both ways. Sure, you won't have to send your people into battle, but neither will the enemy.
And with these sorts of systems there will absolutely be a lot of civilians killed either due to the systems inability to distinguish between non-combatant and combatant or more likely the fact that shitty regimes simply don't value human live, their own country's or others.
> you won't have to send your people into battle, but neither will the enemy.
Perhaps between nuclear powers. But we've already been doing set-piece battles as proxy wars without drones. Just other people.
At a certain point, you start hitting the other side's production. That means strikes on the homeland. Even if we're in a world where those factories are automated, that's going to result in errors and civilian deaths from time to time.
Yes, there is asymmetry between bigger powers and smaller ones, and the smaller often resorts to terrorism. I really don't think there is anything here to crow about. Technology definitely has changed the battlefield, but I wouldn't assume it will necessarily be for the better.
I'm also not saying any given country shouldn't build these things. We all do what we have to in order to survive. I think that's the reality, rather than any illusion that these things will make your people any safer.
I've never understood the opposition to precision weapons, because dumb weapons like wooden planes dropping unguided bombs are far more devastating to bystanders than cruise missiles or AI-guided loitering munitions.
Check out this video of Ukrainian drone narrowly avoiding a civilian: https://x.com/NAAF0Racoon/status/2118492156008841231
30 years ago, that guy would've been a barely visible smudge in a grainy video feed on a gunship's sight. He would've been killed because helicopter crew wouldn't have been able to tell that he was a civilian. With 2026 tech, they can properly identify him, steer the drone away just a few meters before hitting him, and fly down the road to hit the actual enemy group in the area. That guy survived only because modern weapons beam down high-def video and provide control link until the very end instead of just flying or shooting into the nearest heat source once a trigger has been pulled.
In the right hands yes they can minimize casualties. I'd love nothing more than for all wars to be fought only between robots. But it only takes one asshole yee ha to let these things wipe out a city or two. That's the price. So we'll all build them, but I don't think we should be happy about it.
People need to study game-theory. If there were ever a ban on killer robots, it would be entirely performative.
Finland spent ~ half a billion Euros getting rid of its landmines, only to withdraw from the treaty and rebuild its landmine arsenal in the last couple years.
Landmines are very effective. Likely one of the most effective for defending a long boarder with no natural geographic boundaries. and they are harmful (on purpose).
I mention it because some dangerous things are very effective deterrents. They may sound scary, but they are a lot better than any alternative.
Why would the world's most active and powerful armed forces sign anything banning the use of an effective tool?
Has unilateral disarmament ever worked out well?
We haven't had a nuclear war yet.
But on the flipside, Ukraine gave up it's nuclear weapons on a promise from Russia that they wouldn't invade.
Australian citizens havent carried guns for a long time and its significantly safer than other countries where many citizens do carry guns.
Bilateral disarmament and arms limitations has an okay track record.
I wish I can say I am surprised, but I am not. There was a time when I believed these laws would become real, but now we know they won't.
https://en.wikipedia.org/wiki/Three_Laws_of_Robotics
Even in the books where the hardware had this magic there were problems, and that was the entire point of the books.
Reality cannot work in the way the books did, at least not with any type of computing architecture we've made so far. I'd go further and say it's antithetical to general intelligence and problem solving.
I would say the books showed correctly, that it is impossible to avoid "trolley problems", but that is okay and expected. It's still directionally correct to imbue machines with the directive to not harm humans.
A drone is a robot as well.
People use robots (and soldiers) to dodge responsibility. By making the operator anonymous, hidden beneath layers of "chain of command", the fiction of "nobody was responsible" is conjured up.
By refusing to outlaw autonomous weapons, the absence of any human operator built-in, the US follows its greed, their wish for killing without remorse and the fiction of "untouchability".
The US is the biggest arms dealer in the world, what made you think we were ever going to ban drones?
It's worth considering why bans on nuclear, biological, and chemical weapons seem to work pretty well. We basically have norms against using them, and that works. Nuclear weapons are hard for anyone but a well-resourced nation-state to make, but the other two aren't hard to make or get.
So, what's the difference here?
Is it that killer robots are somehow not norm-breaking? There's something about how we imagine they will be that seems...okay for war? Versus poison gas, which somehow seems not okay for war to most everybody.
What do you think?
"They are dismantling these systems because they do not expect they will ever have a use for these weapons.
Not because chemical weapons are immoral. Because they are ineffective, whereas landmines, cluster munitions and nuclear weapons are assumed to have future uses. Morality was never at issue, effectiveness was.
That has some big consequences, most of which are actually unpleasant. It means that efforts to ban ‘immoral’ weapons that are effective will likely never succeed. The model that activists thought they were building on is a foundation of sand – the only way you ban weapons is after they are basically useless anyway (to cut that point finer: you get to ban weapons after they stop being useful to the great powers, who may then enforce the ban on smaller states). The idea that we might summon up enough moral indignation to set these weapons aside seems unfounded. We are not nearly so moral as my high school teachers imagined, nor are we so cowardly as a ‘Fremen apologist’ might think. We’ve simply made an amoral calculation about effectiveness" [1].
[1] https://acoup.blog/2020/03/20/collections-why-dont-we-use-ch...
Everyone thinks their killer robots will kill the other guys killer robots first.
> Everyone thinks their killer robots will kill the other guys killer robots first.
... and that there definitely won't be some horrific disaster where one (or many more than just one) such killer robots malfunction or run amok, or are taken over by malicious actors hellbent on causing exactly such a disaster.
We'll pass this right after WWIII.
I'm not even joking, almost every "ban on X" in the context of warfare happened after unspeakable atrocities where, once the dust settled, the parties involved looked at the sea of dead bodies and agreed not to do it again. I guess countries learn by doing.
Agreed. And after a few decades/centuries people will forget how bad war is and they will do it again.
This is mostly but not entirely true. An international ban on blinding laser weapons was enacted before they became widely used.
https://en.wikipedia.org/wiki/Protocol_on_Blinding_Laser_Wea...
I don't think we passed a global ban on nuclear weapons or land mines.
https://en.wikipedia.org/wiki/Ottawa_Treaty 162 states have signed a land mine ban.
Non-signatories include the US, China, Russia, India, Pakistan, Israel and Iran. And Ukraine decided to withdraw from the treaty after being invaded by Russia.
So a ban with a lot of signatories, but not by any means universal.
A lot of these treaties will be abandoned once a war becomes existential for a countyr. As far as I know, chemical and biological weapons weren't used in WW2 because they don't make much sense. Same for nuclear weapons after WW2. They aren't very useful and may trigger world wide destruction.
Chemical and biological weapons are both more notable for being relatively ineffective against prepared military forces, but devastating to civilians. They don't usefully generate tactical results on the battlefield. (in part due to their uncontrollability: a bullet goes where you point it, a bomb lands where you throw it, a cloud of gas can hit your own forces if the wind changes at a bad moment).
Land mines mainly rip off limbs of children and framers so nobody really cares. I think it's terrible by the US that haven't joined the ban.
As far as nuclear weapons go, they haven't been banned but we have the non-proliferation treaty that worked to some degree. The use of nuclear weapons is also viewed as a line that after WW2 nobody has tried to cross.
I think one of the biggest issues is the border between the Korea's. One of the more heavily mined areas in Earth.
Globally there are 6-8,000 land mine casualties (including deaths) a year, very few of which occur along the Korea's joint border - that's a clearly marked, well known, patrolled, enforced, entrenched moat with few children or farmers at risk.
The three South Korean soldiers recently injured raised awareness of the mines there, but they were patrolling an area with known risks.
The greatest issue in my mind for the past four decades or so are the very many civilian areas about the globe with scattered mines throughout areas where children ideally should be able to play and food grown safely.
* global distribution: https://www.statista.com/chart/26209/landmines-contamination...
* N-S Korea border discussion: https://www.lowyinstitute.org/the-interpreter/almost-a-milli...
When you travel in Laos or Cambodia it's highly recommended not to jump into the bushes to pee because you may step onto a mine or a not exploded bomb.
UN treaties are worth the paper they are written on. I doubt the current US admin cares much about any of the UN treaties, except for when it supports sanctions they want to impose.
In other slightly related news, the US Secretary of State made mockery of International Criminal Court this morning. https://www.reuters.com/world/us/rubio-assails-international...
Rubio to International Law is Hegseth to Rules of Engagement.
If Rubio finds that an offensive parallel to draw, then it shows how much he has bent his reality lens.
Why on earth would the US allow a ban on fully autonomous weapons? Death-causing is a very profitable business and the US is all about profit.
TBF we've had killer robots for decades. Every now and then we shoot down an airliner full of people with them.
Not to be overly glib but that cat has been out of the bag for a long fucking time. Name a capability and I'll give you a conventional munition that has had said capability for over a decade.
We've had the Tomahawk since 1983, the Minuteman since 1962, and at a much smaller scale, the Javelin since 1996. If you want to go back further, the Germans had the V2 as early as 1944. The cat has been out of the bag almost as long as we've had the gift of flight, and predating the modern computer.
I think people also just don't know the broader capabilities of those systems beyond point-and-shoot. There are a number of systems that have had the ability to loiter and look for targets before engaging. The recent advancement has been the ability to do that on higher resolution FPA imagers but it doesn't actually change much fundamentally.
What people should actually be worried about is an AI chain of command. The weapons are very secondary to the kill chain that initiates them.
Landmines are a rudimentary form of killer robot
> Landmines are a rudimentary form of killer robot
I don't think I've ever heard of a landmine that autonomously hunts down it's target. AFAIK you gotta go to where it's been buried and step on it. A killer robot will come to you with or without your consent or any action or lack thereof on your part.
Landmines have claimed over 165,000 casualties just in the 21st century. ED-209 is very scary but also still largely imaginary.
There's an interesting future if autonomous decision making increasingly becomes accepted. We've already seen glimpses of it with drone strikes target selection going back to post-911 actions, we've seen it more recently with almost the first bombing in Iran hitting a school. "out-dated intelligence".
It seems no one was responsible for Skynet.
AI/autonomous decision making absolves those being paid to be responsible of any responsibility. Can we at least save the ridiculous salaries that they're being paid to no longer make these decisions? It's becoming increasingly obvious that the decision makers are resentful of having to make decisions, and are jumping as quickly as possible to offloading it to "new, well marketed thing".
We're all Shaggy now. "Wasn't me".
Good luck to all of us!
US is the country providing weapons and being active in wars only they've started themselves. Otherwise not taking into account people life value, never in history.
They abandoned the Paris Climate agreement, the Iran Nuclear deal, The Trans Pacific partnership, NAFTA, and UNESCO just to name a few.
US international agreements aren't worth the paper they're printed on, so why not just lie?
Because its a bluff so others "fear" that America is building killer robots.
The best defense is for your opponent's imagination to run wild.
Americans sign their treaties with pencil.
> Rather than negotiating a binding treaty, the U.S. has proposed five more years of work by the CCW's expert group to develop a nonbinding instrument, according to a November 4 working paper.
> Washington maintains that existing international humanitarian law already applies to autonomous weapons and that a new legally binding treaty is unnecessary.
Sounds like diplomatic stalling
All UN members vote in their own self-interest.
I suspect the "no" votes will coincide with the countries who stand to gain from the production or use of killer robots. And the "yes" votes will coincide with states that have nothing to gain.
Killer robots already exist. The only choice is between being the ones getting shot or also having the ones doing the shooting.
Why not both!
Countries who stand to gain from the production or use of killer robots will vote "yes" on a ban of killer robots? How would this bolster use or production?
I accidentally swapped my words, whoopsie
This is similar to how America refuses to agree that food for children is a human right. At the UN, we are a supervillain.
https://usun.usmission.gov/explanation-of-position-on-a-thir...
"We dissociate from preambular paragraph 13 because it inaccurately implies that sanctions are not in accordance with international law and pose a danger to food security and nutrition."
So essentially, we reserve the right to murder children by famine.
JD Vance is a killer pleasure droid.