ChatGPT independently compiles psychological profiles of users, often without their knowledge, - research by scientists from Germany, India and the Netherlands.
Researchers analyzed archives of correspondence from 80 ChatGPT users and found 2050 entries stored in the neural network's memory. In 96% of cases, the AI created these notes on its own, without directly asking the user to remember anything.
At the same time, 28% of the records contained personal data subject to European data protection legislation, and 52% contained psychological characteristics of users: their preferences, habits, interests and perceived personality traits.
Moreover, ChatGPT is able not only to remember what was said, but also to draw its own conclusions. For example, if a person asked to recommend bands similar to Nirvana, the neural network recorded that he liked Nirvana, even though the user did not directly state this.
According to researchers, chatbots are gradually transforming from ordinary tools into interlocutors that people trust with personal problems, political opinions and experiences. As a result, AI can know much more about a person than ordinary web services.
Scientists warn that such personalization carries not only privacy risks, but also the risk of reinforcing biases, since if the neural network knows the user's views well and agrees with them all the time, it may only reinforce their misconceptions.
channel.