I think this is the real danger of AI - that we want to believe. Chatbots are so plausible they draw us in, even when we should know better. They give confident, and completely wrong answers, in a way that we are all too happy to accept. They seem to have generated a veneer of respectability and credibility which is wholly unearned.
When we use machine learning for really important things like recruitment and health, we need to be immensely cautious and rationally sceptical of the results that we get.
There truly is no such thing as Artificial Intelligence. But, but ChatGPT, you cry! But self-driving cars! But The Algorithm! None of these are even close to intelligent. But how do we know?
Artificial Intelligence is not the problem. It’s our education system that needs to become intelligent, and fit for purpose at last. ChatGPT could be the kick that we've been waiting for - an impetus that could propel us into a more engaging, useful, and valid form of education.
"It's actually interesting to observe the things people are trying to do with data as a way of assessing our civilisational maturity."