Critique of Roman Yampolskiy's impossibility proofs
Roman Yampolskiy has stated on many occasions that he has published multiple proofs of why AI control is impossible; this is causally upstream of his infamous 99.9x% [1] . I believe most of the proofs are in the paper "On the Controllability of Artificial Intelligence: An Analysis of Limitations". (See 6:31 of this speech .) Is AI safety provably impossible? Given that the answer changes my main motivation for working on AI safety, settling whether or not this claim is accurate is important to me and to (I assume) many other people (Cf. death with dignity ). He has also stated many times that his dream is that someone would go ahead and "prove him wrong " and engage with his arguments; from what I've found, nobody has yet done so in depth. This is my attempt to give Professor Yampolskiy an early birthday present. I'll analyze the claims and arguments in the paper, which I mostly find unconvincing. The paper itself is quite long, which is why I'll mostly include short quotations (you can find the paper here ). A lot of it consists of long quotations from other authors, which are likely familiar to most readers here. I've removed the citation markers for readability and added my own