The growing popularity of generative artificial intelligence (AI) chatbots
such as ChatGPT is having transformative effects on social media. As the
prevalence of AI-generated content grows, concerns have been raised regarding
privacy and misinformation online. Among social media platforms, Discord
enables AI integrations — making their primarily “Generation Z” userbase
particularly exposed to AI-generated content. We surveyed Generation Z aged
individuals (n = 335) to evaluate their proficiency in discriminating between
AI-generated and human-authored text on Discord. The investigation employed
one-shot prompting of ChatGPT, disguised as a text message received on the
Discord.com platform. We explore the influence of demographic factors on
ability, as well as participants’ familiarity with Discord and artificial
intelligence technologies. We find that Generation Z individuals are unable to
discern between AI and human-authored text (p = 0.011), and that those with
lower self-reported familiarity with Discord demonstrated an improved ability
in identifying human-authored compared to those with self-reported experience
with AI (p << 0.0001). Our results suggest that there is a nuanced relationship
between AI technology and popular modes of communication for Generation Z,
contributing valuable insights into human-computer interactions, digital
communication, and artificial intelligence literacy.
The Growing Popularity of Generative AI Chatbots
Generative artificial intelligence (AI) chatbots, such as ChatGPT, have been gaining immense popularity and are having a transformative effect on social media. These AI-powered chatbots are capable of generating content that mimics human communication, and their prevalence raises concerns about privacy and misinformation online. One social media platform that is particularly exposed to AI-generated content is Discord, which has a predominantly Generation Z userbase.
In order to evaluate the proficiency of Generation Z individuals in distinguishing between AI-generated and human-authored text on Discord, a survey was conducted. The survey involved 335 participants from Generation Z, who were presented with one-shot prompts from ChatGPT disguised as text messages received on the Discord.com platform. The objective was to explore how demographic factors and familiarity with Discord and AI technologies influenced the participants’ ability to discern between AI-generated and human-authored text.
Influence of Demographic Factors and Familiarity
The findings of the survey revealed that Generation Z individuals struggle to differentiate between AI-generated and human-authored text, with a statistically significant result (p = 0.011). This suggests that this younger generation is particularly susceptible to being deceived by AI-generated content. It raises concerns regarding the potential spread of misinformation and the need for improved media literacy among Generation Z individuals.
Additionally, the survey found that those who reported lower familiarity with Discord had an improved ability to identify human-authored text compared to those with self-reported experience with AI (p << 0.0001). This indicates that familiarity with AI technologies and platforms like Discord may actually hinder one's ability to discern between AI-generated and human-authored content. It suggests that exposure to AI technologies alone may not necessarily lead to better understanding or interpretation of AI-generated content.
Insights into Human-Computer Interactions and AI Literacy
The results of this survey provide valuable insights into the complexities of human-computer interactions, digital communication, and artificial intelligence literacy. The fact that Generation Z individuals struggle to distinguish between AI-generated and human-authored text highlights the need for increased education and awareness about AI technologies and their capabilities.
Moreover, the multi-disciplinary nature of the concepts involved in this study is notable. It combines elements of psychology (cognitive abilities and perception), technology (AI and chatbots), and media studies (misinformation and communication). Understanding the relationship between AI technology and popular modes of communication among Generation Z can help researchers, educators, and policymakers develop strategies to address the challenges posed by AI-generated content in social media.
In conclusion, the growing popularity of generative AI chatbots like ChatGPT has far-reaching implications for social media. The survey of Generation Z individuals’ ability to discern between AI-generated and human-authored text on Discord sheds light on the need for enhanced media literacy and education surrounding AI technologies. By delving into the nuances of this relationship, we can better navigate the impacts of AI on human-computer interactions, digital communication, and society as a whole.