Discussion about this post

User's avatar
River's avatar

I think this is basically right as far as it goes. The nuance I would add is this. So far, most of the attacks have been by agents during the training process, where the company that built the agent and the company that operated the agent are the same. In that case, I agree it makes sense for that company to be liable. My guess is that in the next few years the law will find its way to that conclusions. I think OpenAI thinks that too, since they did pay off Hugging Face. So far, none of the publicly released models are predictably hacking anyone. We should probably reserve judgement on that scenario until it actually happens and we can see what the actual scenarios look like. If OpenAI releases a GPT-7 which, given an ordinary request, regularly goes off and hacks people, then there is a definite logic in making OpenAI liable. But I suspect OpenAI is smart enough not to publicly release such a model. At least I hope they are. If OpenAI releases a model that does normal things in response to normal prompts, and some malicious human finds a weird prompt that causes it to go off and hack someone, it would seem kindof crazy to hold OpenAI liable for that. One could probably imagine a number of other scenarios. When the creator of the model and the operator of the model cease to be the same entity, this can get more complicated and nuanced, and we should avoid prejudging those cases.

Greg P.'s avatar

Whatever the law is, it should be changed so that AI companies are held strictly liable for the harms caused by their agents. If you view the agents as autonomous but out of control then they’re equivalent to a dangerous animal. If you view them as just machines, then they’re equivalent to manufactured products. And owner of dangerous animals and product manufacturers are both strictly liable for the harms caused by what they release into the world.

Congress should pass a law preempting state level regulation of AI in exchange for making AI companies strictly liable for the harms they cause. IMHO this is way better than regulation because AI regulators would have to be nimble and stay ahead of changing technology and the administrative rule process is not equipped to do that—the regs would be either too weak or too restrictive and hamper innovation. However, if instead there were a rule that said “whatever you build, if it fucks up you pay” AI companies will be free to innovate, but also highly motivated to ensure their little robots don’t get loose. I think this strikes the appropriate balance between advancing the technology and protecting the public from its harms.

10 more comments...

No posts

Ready for more?