My two cents on this topic are a distinction between “Behavioral Understanding” and “Experiential Understanding” – take a look at my post: https://medium.com/generative-ai/i-started-to-think-chatgpt-might-actually-understand-after-all-6a7eec0209a0