A.I. has become proficient at recognizing faces, understanding speech, reading and writing, and diagnosing diseases, and it has potential to discover new medicines. Hanson Robotics’ Sophia, a lifelike bot, could converse naturally with a person and sprinkle the conversation with irony. ChatGPT, launched by Open AI in November, writes papers of higher quality than most humans can write. And in February, Bing’s A.I. Chat program stunned a New York Times columnist by claiming to be in love with him and saying “I want to be alive.”
A.I. is not only becoming scarily intelligent in some respects; it is also learning voraciously and surprising us with novelty.
Now that A.I.’s novelty is starting to make people wonder whether a program might have desires and interests of its own, we face tough questions. First: At what point can we realistically judge that an artificial system has its own consciousness, or subjective experience, rather than simply sounding as if it does? Second: If and when we reach that point, should we acknowledge that the system has moral status or rights? And if so, what follows practically for our relationship to A.I.?