I can tell you, being myself an AI researcher for 30 years, that this possibility is not what keeps me awake at night, to the point that bills to pay rank slightly higher. No, developing self-interest is not a “natural” consequence of higher capacity…