Associations Between COVID-19 Misinformation Exposure and Belief With COVID-19 Knowledge and Preventive Behaviors: Cross-Sectional Online Study

1COVID-19 has brought significant challenges to public health with its high infectivity and severity, particularly in vulnerable groups (eg, older adults, those with chronic diseases), leading to a rapid rise in cases worldwide. On top of managing the response to the COVID-19 global health crisis, the World Health Organization (WHO) and governments also face the challenge of an “infodemic,” which causes people to experience difficulties in finding credible and trustworthy sources amid an excess of information. Although the concept of an infodemic is not a new one, the digital age we are currently living in has magnified its effects and added complexities to the challenge it poses. With the widespread use of social media such as internet websites, social networking services (SNSs), and instant messaging services, people all over the world are more connected than ever, allowing information to be shared easily and quickly. However, a recent study has found that in the midst of the global pandemic, COVID-19 misinformation is just as likely to spread and engage users on social media platforms as accurate information, which can pose an equal threat to the COVID-19 public health response by affecting public awareness and knowledge of the disease.

2Misinformation can be defined as information that is false or inaccurate and not supported by scientific evidence. Misinformation in the context of COVID-19 can include inaccurate information regarding the virus and its transmission, conspiracy theories, and fabricated reports regarding methods of prevention and treatment. Some of its consequences include the panic-buying and hoarding of goods, taking ineffective and potentially harmful remedies, ignoring advice from health authorities, and engaging in behavior that increases the risk of virus transmission. Despite the many efforts by the WHO and public health organizations to battle the infodemic, such as conducting campaigns against COVID-19 misinformation, cooperating with social media platforms, and regularly providing evidence-based information to the public (eg, COVID-19 advice for the public: myth busters), the proliferation of misinformation worldwide has remained rampant. Although social media can be used effectively to provide essential health-related information to the global community, misinformation does not require professional verification or review, and thus has the potential to proliferate quicker and be disseminated farther on social media due to existing algorithms that highlight popular or desired content. This highlights the tall challenge health authorities face in delivering accurate information to the public in precedence to the proliferation of misinformation and the need for new strategies to build preparedness against future infodemics.

3South Korea (hereafter Korea) has one of the most developed technological infrastructures in the world, and the use of the internet is well-integrated into Koreans’ everyday lives. As such, information and communication technology (ICT) has also been employed in Korea’s response to the COVID-19 pandemic, including the monitoring and tracking of COVID-19 cases, conveying of health information to professionals and the public, and for allocating and distributing resources, such as COVID-19 test kits and protective equipment. With the deep integration of ICT such as social media into Koreans’ daily lives and activities, it is expected that Koreans will be highly exposed to COVID-19 information and misinformation, through either active searches for information or passive receiving of information through messages, emails, or news feeds. Notwithstanding our awareness of misinformation and the risk it poses to public health, there remains little evidence on the prevalence of COVID-19 misinformation exposure and its effects on health beliefs and behaviors, including psychological well-being.

4We aimed to investigate the following: (1) the prevalence of COVID-19 misinformation exposure and misinformation belief, (2) associated factors including psychological distress with misinformation exposure; and (3) the associations between misinformation exposure and COVID-19 knowledge as well as preventive behaviors in Korean adults.

5A cross-sectional online survey was conducted using the largest online survey platform in Korea. This platform was chosen as it has 5 million survey panel members nationwide (as of 2020) and has been used to conduct more than 160,000 surveys for academic (such as those by Kim et al and Ra et al), government, and industry research. The inclusion criteria were the following: (1) aged ≥20 years (according to Korea’s civil law, those aged ≥20 years are regarded as adults), (2) a resident in the Seoul Metropolitan area (including the Seoul, Gyeonggi-do, and Incheon areas, in which 50.0% of the Korean population resides as of 2020), (3) has encountered COVID-19 information from any source, and (4) a Korean speaker.

6The company sent survey invitations containing general information about the survey such as its aim and participation incentive (KRW 1000 [US $1 is about KRW 1200]) via emails and a smartphone app to registered survey panel members who met the inclusion criteria on April 23, 2020. The survey closed on the same date (ie, recruitment was conducted for one day due to the cost involved). Details of the survey and consent statement were provided on the first page of the online survey. Respondents provided consent by clicking “Agree to participate in this survey” on the same page, before moving on to answer the survey questions. The survey took approximately 15 minutes to complete. The survey questionnaire is attached as Multimedia Appendix 1. Ethical approval was obtained from an institutional review board at Sahmyook University in Seoul (Ref: 2-1040781-A-N-012020021HR). Meanwhile, as of April 23, 2020, Korea had 10,708 confirmed cases of COVID-19 since the first case was reported on January 24, 2020. The daily new cases of COVID-19 peaked on March 3, 2020 (803 cases), after which there was a downward trend until April 23, 2020 (14 new cases).

7Sociodemographic characteristics including sex, age, education level, household arrangement, and monthly personal income were collected.

8COVID-19 misinformation items used in this study were extracted from COVID-19 misinformation reports by the WHO, the main coordinator of the global COVID-19 pandemic response. In total, 12 misinformation items about COVID-19 transmission, infectivity, prevention, and treatment were included (see Question 2 in Multimedia Appendix 1). Respondents were allocated to one of two groups: misinformation exposure (defined as having seen one or more items of misinformation, through active searching or passive receiving means) or misinformation nonexposure. Respondents were then asked if they believed any of the 12 misinformation items to be correct (hereafter misinformation belief) or incorrect.

9Measures for psychological distress included anxiety and depressive symptoms, using the Patient Health Questionnaire-4 (PHQ-4; four items), which consists of two subscales: the Generalized Anxiety Disorder-2 (GAD-2; two items) and Patient Health Questionnaire-2 (PHQ-2; two items). The score of each subscale ranges from 0 to 6, and a score of ≥3 indicates a high risk of anxiety (GAD-2) and depression (PHQ-2), respectively. PHQ-4 was validated in Korean (Cronbach α=.79; acceptable convergent validity). An additional Primary Care Post-Traumatic Stress Disorder Screen for DSM-5 (PC-PTSD-5; five items) that was validated in Korean (Cronbach α=.87; acceptable concurrent validity) was also adopted to screen respondents for posttraumatic stress disorder (PTSD) risk. The scores range from 0 to 5 and the cutoff score for high risk of PTSD is 3.

10COVID-19 knowledge was assessed using five COVID-19 knowledge questions (definition, transmission modes, main symptoms, prevention, and treatment) that were extracted from a questionnaire developed by the WHO (see Questions 4-8 in Multimedia Appendix 1). Higher scores indicate a higher COVID-19 knowledge level.

11The number of COVID-19 preventive behaviors that the respondents performed during the past three months was assessed with 10 answer options that were extracted from the COVID-19 preventive methods recommended by the WHO and Korea Centers for Disease Control and Prevention, such as washing hands regularly, covering one’s mouth and nose when coughing, and social distancing (see Question 9 in Multimedia Appendix 1). Higher scores indicated a higher engagement in COVID-19 preventive behaviors.

12All data were weighted by age and sex distributions in the Seoul Metropolitan area, according to the Korea census data in 2018. Descriptive statistics were reported in numbers, proportions, means, and standard deviations (SD), as appropriate. The differences between the two groups (COVID-19 misinformation exposure group versus nonexposure group), including the respondents’ sociodemographic characteristics, source of information, COVID-19 misinformation belief, psychological well-being (ie, anxiety, depressive, and PTSD symptoms), and COVID-19 knowledge and preventive behaviors were analyzed by chi-square test or t test, as appropriate. The responses on the knowledge and preventive behavior questions were categorized into binary groups according to the mean scores for the chi-square analysis. Logistic regression was used to compute odds ratios (ORs) and adjusted ORs (aORs) to identify the association of misinformation exposure (a binary variable) with the sociodemographic characteristics, source of information, and COVID-19 misinformation belief. The associations of COVID-19 misinformation belief with COVID-19 knowledge and COVID-19 preventive behaviors among the respondents who encountered misinformation were also investigated. As subgroup analyses, we included the interaction term to test if demographic characteristics modify the associations of COVID-19 knowledge, preventive behaviors, misinformation belief, and psychosocial distress following misinformation exposure. Sex, age, highest education level, household arrangement, and monthly personal income were adjusted for the adjusted regression models. STATA 15 (StataCorp LLC) was used to conduct all analyses.

13Of 1054 people who initially responded to the survey, five were excluded from the study as they reported that they had not encountered any COVID-19 information and therefore could not complete the survey. Among the 1049 respondents, 50.04% (n=505) were male, the mean age was 40.60 years (SD 12.87), 74.94% (n=786) had tertiary education or higher, 88.50% (n=929) lived with others, and 55.95% (n=587) had a monthly personal income <KRW 3,000,000 (US $2500; the average monthly income among those employed was KRW 2,970,000 [US $2475] in 2018; Table 1).

14The majority of the respondents encountered COVID-19 information from diverse media including television, newspapers, internet websites, SNSs, and instant messaging. Overall, 57.45% (n=603) had high levels (score of 25-35) of COVID-19 knowledge and 63.01% (n=661) reported conducting ≥7 COVID-19 preventive behaviors. In total, 18.68% (n=196), 31.55% (n=331), and 13.95% (n=146) reported anxiety, depressive, and PTSD symptoms, respectively (Table 1). Overall, 41.14% (n=432) reported believing in one or more of the 12 COVID-19 misinformation items, while exposure to at least one COVID-19 misinformation item in the preceding three months was reported by 67.78% (n=711) of the respondents. In addition, 49.76% (n=354) and 48.14% (n=342) encountered misinformation about reusing masks (Table 2), which was the most common item of misinformation reported.

15COVID-19 misinformation exposure was negatively associated with being older (60-69 years age group: aOR 0.40, 95% CI 0.25-0.64 versus 20-29 years age group) and having a higher monthly personal income (KRW 3,000,000-4,990,000 [US $2500-$4158]: aOR 0.66, 95% CI 0.47-0.93 versus <KRW 3,000,000 [US $2500]). COVID-19 misinformation exposure was positively associated with a tertiary education or above (aOR 1.42, 95% CI 1.02-1.96 versus high school or below). Of the information sources, misinformation exposure was associated with SNSs (aOR 1.75, 95% CI 1.31-2.35 versus other information sources) and instant messaging (aOR 1.79, 95% CI 1.27-2.51 versus other information sources), while offline and online television, radio, and newspapers and other websites were not statistically significant. Misinformation exposure was also significantly associated with misinformation belief (aOR 7.33, 95% CI 5.17-10.38 versus no misinformation belief) and with psychological distress, including anxiety (aOR 1.80, 95% CI 1.24-2.61 versus no anxiety symptoms), depressive (aOR 1.47, 95% CI 1.09-2.00 versus no depressive symptoms), and PTSD symptoms (aOR 1.97, 95% CI 1.42-2.73 versus no PTSD symptoms). However, misinformation exposure was not associated with COVID-19 knowledge and preventive behaviors (Table 3).

16Subgroup analyses showed that the associations of misinformation exposure with misinformation belief, COVID-19 knowledge, preventive behaviors, and psychological distress differed according to the respondents’ demographics (sex, age, education, and monthly personal income; Multimedia Appendix 2). Among the respondents who reported misinformation exposure, misinformation belief was associated with lower COVID-19 knowledge levels (high: aOR 0.62, 95% CI 0.45-0.84 versus low) and fewer COVID-19 preventive behaviors (≥7 behaviors: aOR 0.54, 95% CI 0.39-0.74 versus 0-6 behaviors; Table 4).

17In this cross-sectional survey of Korean adults, more than two-thirds of the respondents reported COVID-19 misinformation exposure between the end of January 2020 and the end of April 2020, as COVID-19 evolved into a global pandemic. A previous study identified a similar prevalence, where 70% of respondents reported misinformation exposure during the 2018 Ebola virus epidemic, affirming a substantial exposure risk to inaccurate or false health-related information during serious infectious disease outbreaks.

18We identified that misinformation exposure was significantly associated with younger age, higher education levels, and lower incomes. Existing studies reported that younger people, including university students, preferred to obtain health information via online means and perceived themselves as having a high level of digital health literacy. Such characteristics would expose young people to more COVID-19 misinformation and information. However, contrary to their perceptions, they lacked the skills to evaluate health resources and apply gathered information to health-related decisions. This indicates that despite their proficiencies in using technology and the internet, effective interventions are required to improve young people’s digital health literacy, which is the ability to search for, understand, and critically evaluate health information through electronic sources, then apply gained knowledge to health issues. Meanwhile, to our best knowledge, the associations between misinformation exposure and demographic characteristics have been underinvestigated in the existing literature. We performed subgroup analyses that offer additional details of interactions between the respondents’ demographic characteristics and COVID-19 variables. Further studies that provide in-depth understanding on how and why these demographic characteristics are associated with misinformation exposure will be useful.

19Consistent with previous reports on the role of social media in health information dissemination and misinformation propagation, respondents in this study reported greater COVID-19 misinformation exposure through SNSs and instant messaging. This can also be attributed to the significance of social media like SNSs and instant messaging in Koreans’ daily lives, as those services also include product marketing, shopping, and payment services, contributing to Korea having the third highest social media usage penetration in the world.

20Many recent studies have identified that the COVID-19 pandemic and fear of being infected have had negative effects on public mental health, reporting increased depression and anxiety. The respondents in this study were similarly identified to be at high risk of psychological distress; compared to the nonexposure group, the misinformation exposure group notably had around 1.8 and 1.47 times higher anxiety and depressive symptoms, respectively. This demonstrates the alarming negative effect that misinformation can have on public mental health. Higher levels of social media use during the COVID-19 pandemic have been shown to result in higher levels of anxiety (OR 1.72) and a combination of depression and anxiety (OR 1.91). It is purported that prolonged and frequent use of social media throughout the ongoing pandemic increases exposure to misinformation along with accurate information. The mixture of accurate and false information can deliver conflicting messages and amplify uncertainties regarding COVID-19 and its perceived health risks, resulting in psychological distress. A vicious cycle can be triggered, as evidence has shown that psychological distress itself can drive people to look for more information, which in turn causes further distress. Despite the ongoing COVID-19 situation, this study also identified that the respondents had symptoms of PTSD in relation to the pandemic, raising concern that the psychological impact can persist and lead to poor physical health outcomes.

21In this study, no association between misinformation exposure and COVID-19 knowledge as well as preventive behaviors was found. However, we identified that COVID-19 misinformation belief was negatively associated with COVID-19 knowledge and preventive behaviors, while it was positively associated with misinformation exposure. Similar to our findings, Allington et al found that frequent use of SNSs, which propagate more misinformation than any other media, for COVID-19 information was associated with having conspiracy beliefs. Conspiracy beliefs, in turn, showed a negative relationship with COVID-19 preventive behaviors. Vinck et al also reported that the belief in Ebola virus misinformation resulted in a lower likelihood of adopting preventive behaviors.

22The Health Belief Model (HBM) is a theoretical framework widely used in public health to understand heath behaviors for disease prevention (see Champion and Skinner). It theorizes that people’s beliefs about their susceptibility to COVID-19 infection and its severity (collectively known as perceived threat), as well as perceptions about the benefits of and barriers to engaging in preventive behaviors will be predictive of their likelihood of engaging in those behaviors, while cues trigger engagement. Additionally, one’s understanding about COVID-19 can alter individual beliefs and thus indirectly influence behavior. Based on the HBM, our findings suggest that those who believed in misinformation that they were exposed to had lesser accurate knowledge of COVID-19, which could include inaccurate knowledge about preventive behaviors. A less accurate understanding of COVID-19 in turn altered the perceptions they had about COVID-19, such as reduced perceived COVID-19 threat, reduced perceived benefits from preventive behaviors, heightened perceived benefits from inappropriate preventive behaviors, or heightened perceived barriers to preventive behaviors. These altered perceptions and beliefs regarding COVID-19 thus resulted in reduced engagement in recommended preventive behavior, as our findings show, or potentially increased engagement in inappropriate preventive behaviors. The HBM thus offers insights into interventions that can improve engagement in recommended preventive behaviors by delivering information targeted at the core HBM beliefs of perceived susceptibility, severity, benefits, and barriers. Although our findings show no association between misinformation exposure and COVID-19 knowledge, increasing exposure to accurate or corrective COVID-19 information can be useful to denormalize misinformation beliefs, thus changing perceptions of COVID-19 to increase the likelihood of engaging in recommended preventive behaviors.

23As misinformation exposure is associated with misinformation belief, it is essential to manage and stem the propagation of misinformation through popular mediums like social media and counteract misinformation exposure with evidence-based information exposure. A study identified that official authorities had produced only a few COVID-19 information videos through a popular video streaming website (YouTube, a website with around 2 billion monthly users), while videos containing misinformation were disproportionately increasing. Governments, health agencies, and researchers should take advantage of such social media outlets by producing and sharing evidence-based and corrective information through YouTube videos and simple but impactful infographics. Additionally, governments and health agencies can work closely with social media platforms to ensure that health-related information has increased visibility without involving unilateral censorship, develop misinformation alerts, and provide verification of information source quality, particularly in the event of global health crises. These can accordingly mitigate the development of misinformation belief.

24Increasing digital health literacy among the public, particularly young people, will also be essential, as misinformation exposure did not reflect improved COVID-19 knowledge or preventive behaviors but was associated with misinformation belief. Educational or training programs on digital health literacy should be developed and delivered to the public and can be introduced in schools to cultivate these skills from a young age.

25In-depth, follow-up, and longitudinal studies that explore misinformation selection and beliefs, as well as how misinformation beliefs transform health behaviors will be beneficial as foundations to digital health literacy program development and anti-misinformation strategies.

26This study has several limitations. First, the causal relationships between COVID-19 misinformation exposure and belief, COVID-19 knowledge, and psychological distress were uncertain due to the cross-sectional study design. Second, we used survey questions to measure respondents’ COVID-19 misinformation exposure, COVID-19 knowledge, and preventive behaviors, which are not validated. Third, we collected self-reported data from the respondents that would cause recall and social desirability biases. Fourth, although all data were weighted according to the South Korea census data, there were relatively fewer people aged ≥60 years who participated in this study. We recruited adult respondents only and did not recruit teenagers (ie, those aged <20 years), who popularly use social media for information acquisition. The inclusion of younger people in future studies would provide additional evidence about their misinformation exposure and belief. Fifth, we conducted an online survey by recruiting panel members using a survey company and thus there is a possibility of sampling bias. For instance, those sampled were based in urban, not rural, areas and drawn from a high-income Asian country with prior experience of managing outbreaks of infectious diseases (eg, Middle East Respiratory Syndrome).

27We investigated the prevalence of misinformation exposure and factors that were associated with misinformation exposure and belief, including psychological distress, COVID-19 knowledge, and preventive behaviors in an adult population in the Seoul Metropolitan area, Korea. COVID-19 misinformation exposure was associated with misinformation belief, while misinformation belief was associated with poorer knowledge and engagement in fewer preventive behaviors. Given the potential of such misinformation to undermine global efforts in the COVID-19 response, public health strategies should be kept up-to-date and involve collaborations with multiple stakeholders, including social media platforms, to counter the proliferation of misinformation and win the fight against the infodemic.