Potential Immune-Related Adverse Events Associated With Monotherapy and Combination Therapy of Ipilimumab, Nivolumab, and Pembrolizumab for Advanced Melanoma: A Systematic Review and Meta-Analysis

1Melanoma is a type of skin cancer, with increasing in incidence over the past several years. It is estimated to be the fifth most common cancer in the USA in 2019 and was the 21st most common cancer worldwide in 2018. Surgery is the standard primary treatment for melanoma. However, pharmacotherapy choices for patients with advanced melanoma have greatly expanded over the last few years, including the use of immune checkpoints inhibitors (ICIs) that target the cytotoxic T lymphocyte antigen-4 (CTLA-4) and programmed death-1 (PD-1) pathways. The US Food and Drug Administration (FDA) approved ipilimumab as the first ICI (anti-CTLA-4) therapy for advanced melanoma in 2011, followed by the anti-PD-1 drugs nivolumab and pembrolizumab in 2014. The combined use of anti-CTLA-4 and anti-PD-1 drugs provides better clinical benefits over monotherapies, leading to the FDA-approved combination regimen of nivolumab and ipilimumab in 2015.

2The clinical benefits of ICIs are associated with a spectrum of adverse events (AEs) owing to the activation of the immune system that can affect healthy tissues of the body organs. These immune-related adverse events (irAEs) require close monitoring, use of corticosteroids and infliximab, holding the ICIs, or discontinuation of the drugs in case of severe irAEs such as diarrhea and colitis. The reported incidence of irAEs is higher after anti-CTLA-4 treatment (90%) than after anti-PD-1 treatment (70%) across several types of advanced cancer, and the rates may vary based on the cancer type.

3The incidences of irAEs owing to anti-CTLA-4 or anti-PD-1 monotherapy as well as those owing to concomitant or sequential combination of these drugs are not well-estimated for advanced melanoma. Therefore, the aim of systematic review and meta-analysis was to profile the incidence of potential irAEs associated with mono- and combination therapies of ipilimumab, nivolumab, and pembrolizumab in advanced melanoma.

4To identify eligible trials, we performed a comprehensive search of Medline, Embase, and Cochrane library from inception until October 30, 2018 (Table S1). We further searched clinicaltrials.gov as well as the websites of regulatory bodies in the USA (FDA), Europe [the European Medicines Agency (EMA)], Australia [Therapeutic Goods Administration (TGA)], and Japan [Pharmaceuticals and Medical Devices Agency (PMDA)]. In addition, we screened the references of published reviews, meta-analyses, and relevant trials to include any related citation. We have reported this systemic review and meta-analysis following the Cochrane recommendations for the preferred reporting items for systematic reviews and meta-analyses (PRISMA).

5We included phase 1–3 clinical trials reporting any treatment-related AEs that could potentially be classified as irAEs following the use of anti-CTLA-4 or anti-PD-1 as monotherapy or in any concomitant or sequential combination of these agents in patients with advanced melanoma. We excluded trials reported in a non-English language, those restricted to uveal melanoma or pediatric populations, and those in the settings of compassionate care and expanded access programs or adjuvant therapy. We selected the most recently updated safety data for each included trial.

6The primary outcome of interest was the incidence of potential irAEs across all regimens and doses studied in the trials. We obtained these events across all included trials if an AE was reported in any trial as “irAE,” “AE of special interest,” “selected treatment-related AE of special interest,” or listed in the clinical practice guidelines for managing toxicities related to immunotherapies published by the European Society for Medical Oncology (ESMO), the American Society of Clinical Oncology (ASCO), and the National Comprehensive Cancer Network (NCCN). We used the highest incidence of a potential irAE to estimate the overall incidence of irAEs if the information was not given in the included trials. The secondary outcome was the incidence of potential irAEs for the FDA-approved doses of anti-CTLA-4 and anti-PD-1 therapies.

7We used the citation management software Endnote® (version X7.3; Clarivate Analytics, Philadelphia, PA, USA) in the selection process. One reviewer (A.A.) removed the duplicates, after which, two reviewers (A.A. and A.M.) independently performed the selection in two stages: (1) screening of the title and abstract of each citation; and (2) reviewing the full text of the retained articles. During each stage, disagreements were resolved by consensus or escalated to a third reviewer (I.A.). One reviewer (A.A.) extracted the data into a Microsoft Excel file, including the trial title, trial phase, the total number of patients, and the number of patients who experienced AEs (all grades and grade ≥3). A second reviewer (A.M.) verified the extraction file.

8To assess the risk of bias in the included trials, we used the Cochrane Collaboration risk of bias assessment tool for randomized trials and the Newcastle-Ottawa Scale for non-randomized trials. Two investigators (A.A. and A.M.) performed the quality assessment of the trials and resolved any disagreement by internal discussion or escalation to a third investigator (I.A.).

9We performed random effect meta-analyses of binomial data to estimate the incidence of potential irAEs. We employed the Freeman-Tukey double arcsine transformation to stabilize the variance and avoid overestimation bias that might be introduced by continuity correction for zero events. The 95% confidence interval (95%CI) was estimated by using the score test owing to its better performance than the Wald and Exact CIs. We assessed heterogeneity based on the I2 statistic and conducted subgroup analyses when heterogeneity of I2 >75% was observed. We evaluated publication bias using the funnel plot and Egger's test. Meta-analyses were performed using R software version 3.4.3 (“meta” package).

10We initially identified 13,897 records through database searching and additional sources. After removing the duplicates, screening the titles and abstracts, and applying the inclusion and exclusion criteria, we retained 58 records (34 published articles, 7 updates, 15 results published on clinicaltrials.gov, and 2 regulatory documents) of 35 unique trials (Figure 1).1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17

11The 35 trials included 6,331 advanced melanoma patients treated with anti-CTLA-4 or anti-PD-1 monotherapy or combination therapy: 2,726 received ipilimumab in 21 studies12,, 1,019 received nivolumab in 7 studies, 1,632 received pembrolizumab in 5 studies, 630 received the concomitant combination of nivolumab and ipilimumab in 5 studies, 103 patients received the sequential combination of ipilimumab followed by nivolumab in 2 studies including 33 patients previously treated with ipilimumab then used nivolumab therapy every 2 weeks for up to 48 doses within 4–12 weeks from the ipilimumab treatment, and 70 patients treated with ipilimumab every 3 weeks for 4 doses followed 3 weeks later by nivolumab therapy every 2 weeks up to progression, unacceptable toxicity or withdrawal from the study, 68 patients received the sequential combination of nivolumab followed by ipilimumab in 1 study in which patients treated with nivolumab every 2 weeks for 6 doses then followed 2 weeks later by ipilimumab therapy every 3 weeks for 4 doses, and subsequently followed by nivolumab therapy every 2 weeks up to progression, unacceptable toxicity or withdrawal from study, and 153 received the combination of pembrolizumab and ipilimumab in 1 study. Approximately 50% of the patients included in these trials had received prior systemic therapy before starting the assigned ICI therapy. Of the trials included, 11 were phase 1, 18 phase 2, 2 phase 1/2, and 6 phase 3 studies (Table 1).

12Our quality assessment of the 19 randomized trials revealed that 10 trials were not blinded (Figure 2). All the non-randomized trials (16 trials) were open-label, and most of them were single arm (Table S2). Open-label trials are susceptible to detection bias and may lead to over-reporting of irAEs. Results from funnel plots and the Egger's test did not show evidence of publication bias (Figures S1–S16).

13The incidence of all grade and grade ≥3 potential irAEs owing to all the doses or FDA-approved doses of ICIs based on system disorders is summarized in Tables 2–5.

14All-grade lymphopenia was more likely to occur after pembrolizumab, with an incidence of 4.8%; however, the incidence of grade ≥3 lymphopenia was 0.8% in nivolumab users. In the FDA-approved doses, the incidence of all-grade and grade ≥3 lymphopenia reached 6.8 and 2.2% respectively, in nivolumab users.

15The combination of ipilimumab and nivolumab resulted in an incidence of 1.1% of all-grade ventricular arrhythmia. Moreover, the incidence of ventricular arrhythmia and pericarditis (all-grade and grade ≥3) was 0.4% in nivolumab users.

16The incidence of all-grade and grade ≥3 potential endocrine irAEs frequently occurred after the combination of pembrolizumab and ipilimumab or nivolumab and ipilimumab. Hyperthyroidism, hypothyroidism, hypophysitis, and thyroiditis were the most frequent potential endocrine irAEs. After anti-PD-1 therapy (nivolumab or pembrolizumab), the incidence of all-grade hyperthyroidism and hypothyroidism was 3.0–3.4 and 7.0–8.3%, respectively. After ipilimumab treatment, the observed incidence of all-grade and grade ≥3 hypophysitis and all-grade and grade ≥3 hypopituitarism was 4.1, 2.1, 1.5, and 1.0%, respectively. The estimated incidence of all-grade adrenal insufficiency and thyroiditis was 1.6% after nivolumab. On administering the FDA-approved dose of ipilimumab, the incidence of all-grade hypophysitis was 2.6% and that of grade ≥3 hypophysitis was 1.2%, with only <1% of patients developed hypopituitarism.

17The incidence of all-grade uveitis was 2.6% after the combination of ipilimumab and pembrolizumab and 2.0% after the combination therapy with ipilimumab and nivolumab, but the incidence after monotherapies was <1%.

18The ICI combinations (ipilimumab and nivolumab or ipilimumab and pembrolizumab) resulted in the most frequent incidence of colitis (all-grade and grade ≥3), pancreatitis (all-grade and grade ≥3), diarrhea (all-grade), and autoimmune colitis (grade ≥3). Ipilimumab use was associated with developing diarrhea (all-grade in 29.2% and grade ≥3 in 5.9%) and colitis (all-grade in 8.0% and grade ≥3 in 5.4%).

19All-grade infusion-related reaction was observed in 7.4% of users of the sequential therapy of nivolumab followed by ipilimumab and in 3.9% of users of the concomitant therapy of ipilimumab and pembrolizumab. However, among the monotherapies, nivolumab resulted in an incidence of 3.0% of all-grade infusion-related reactions.

20Hepatitis was the most common frequent potential irAE reported after ICI monotherapy or combination therapies. The incidence of all-grade and grade ≥3 hepatitis after the combination of pembrolizumab and ipilimumab was 9.8 and 5.9%, respectively; the corresponding values after the combination of nivolumab and ipilimumab were 4.9 and 3.5%, and those after the sequential therapy of nivolumab followed by ipilimumab were 4.4 and 4.4%. Nivolumab monotherapy resulted in an incidence of 3.0% of all-grade hepatitis.

21The incidence of all-grade hypersensitivity after nivolumab alone or in combination with ipilimumab including the FDA-approved doses was 2.0 and 2.9%, respectively.

22The incidence of all-grade and grade ≥3 aseptic meningitis and encephalitis was 1.5% after sequential therapy of nivolumab followed by ipilimumab. Ipilimumab users had an incidence of 1.7% for all-grade conjunctivitis.

23The incidences of elevated or abnormal levels of most enzymes and hormones (all-grade) were reported at higher frequency after the combination of ICIs. The elevated enzymes and hormones that were reported frequently following the combination therapies included alanine aminotransferase (ALT), aspartate aminotransferase (AST), amylase, lipase, blood alkaline phosphatase, and blood bilirubin. The incidence of all-grade abnormal thyroid stimulating hormone (TSH) was 3.3 and 6.7% after concomitant combinations of ipilimumab and pembrolizumab or ipilimumab and nivolumab, respectively; the incidence of all-grade and grade ≥3 elevated gamma-glutamyl transferase (GGT) was, respectively, 7.2 and 1.3% after concomitant ipilimumab and pembrolizumab and 3.3 and 1.0% after concomitant ipilimumab and nivolumab. Among the monotherapies, after ipilimumab, the incidence of all-grade elevated ALT was 3.9%; after nivolumab, the incidence of all-grade and grade ≥3 elevated amylase was 5.8 and 1.5%, respectively, with an incidence of all-grade elevated blood alkaline phosphatase of 3.8% and an incidence of abnormal TSH of 2.8%. After pembrolizumab, the incidence of all-grade AST was 4.9%, that of all-grade elevated blood bilirubin was 1.6%, and that of all-grade elevated transaminases was 1.2%. For the FDA-approved doses, the combination of nivolumab and ipilimumab had the most frequent incidence of most all-grade and grade ≥3 elevated or abnormal enzymes or hormones. The most frequent enzymes and hormones abnormalities associated with nivolumab use were all-grade and grade ≥3 elevated lipase (3.1 and 2.2%, respectively), all-grade and grade ≥3 elevated amylase (5.8 and 1.5%, respectively), all-grade elevated blood alkaline phosphatase (3.8%), and all-grade elevated blood creatinine (1.1%). The incidence of all-grade elevated blood bilirubin, AST, ALT, and abnormal TSH was high among pembrolizumab users.

24Type 1 diabetes mellitus (all-grade and grade ≥3) showed an incidence of 2.0% after the combination of ipilimumab and pembrolizumab and an incidence of 1.0% after the combination of ipilimumab and nivolumab. The incidence of all-grade hyperglycemia was 7.4% after sequential nivolumab followed by ipilimumab and that of grade ≥3 hyperglycemia was 2.9% after sequential ipilimumab followed by nivolumab. After the FDA-approved dose of pembrolizumab, the incidence of both all-grade and grade ≥3 type 1 diabetes mellitus was 2.4% and that of all-grade hyperglycemia was 5.6%. The incidence of all-grade and grade ≥3 hyperglycemia was 2.6 and 1.6%, respectively, after the FDA-approved doses of the combination of nivolumab and ipilimumab.

25The most common musculoskeletal and connective disorders, i.e., potential irAEs, were arthralgia and myalgia. They were reported frequently after combination therapies. Among monotherapies, pembrolizumab users had the most frequent incidence of all-grade arthralgia (12.2%), all-grade myalgia (5.9%), and all-grade arthritis (1.2%). Moreover, the incidence of all-grade muscle spasm was 3.4% after nivolumab. The most frequent potential irAEs among ipilimumab monotherapy users were all-grade arthralgia (6.3%) and all-grade myalgia (3.2%). Regarding the FDA-approved doses of ICIs, the combination of nivolumab and ipilimumab resulted in the highest incidence of all-grade arthralgia (14.6%), all-grade myalgia (11.9%), all-grade muscle spasm (2.2%), all-grade polymyositis (2.1%), and all-grade rhabdomyolysis (1.1%). After the FDA-approved doses of monotherapies, the incidence of all-grade arthralgia and myalgia was, respectively, 6.2 and 3.2% for ipilimumab; 9.4 and 4.2% for nivolumab; and 7.7 and 4.9% for pembrolizumab. All-grade muscle spasm was reported in 3.4% of nivolumab users.

26The combination of nivolumab and ipilimumab resulted in an incidence of 3.5% for all-grade peripheral neuropathy. The incidence of all-grade myasthenia gravis and neuropathy was 1.5% after sequential nivolumab followed by ipilimumab. After pembrolizumab and ipilimumab combination therapy, the incidence of all-grade lethargy was 5.9% and that of all-grade peripheral neuropathy was 2.6%. Among pembrolizumab users, the incidence of all-grade lethargy was 1.1%. The incidence of all-grade peripheral neuropathy was 2.4% after nivolumab monotherapy. The incidence of irAEs was similar after FDA-approved doses of the combination of nivolumab and ipilimumab as well as nivolumab and pembrolizumab therapies, as described above. Moreover, the incidence of myasthenia gravis was 1.3% after ipilimumab.

27The incidence of all-grade and grade ≥3 acute renal failure was 1.3 and 1.1%, respectively, after combination nivolumab and ipilimumab. Sequential nivolumab followed by ipilimumab resulted in an incidence of 1.5% for all-grade and grade ≥3 acute renal failure. All-grade nephritis was observed in 1.3% of patients receiving the combination of pembrolizumab and ipilimumab and in 1% of those receiving nivolumab and ipilimumab combination therapy. After ICI monotherapies, the frequency of renal and urinary disorders with potential irAEs was <1%. The incidence of potential irAEs related to the renal system was also <1% after FDA-approved doses of ICI combination or monotherapies.

28Pneumonitis (all-grade and grade ≥3) was the most common potential respiratory irAE reported in the included trials, especially after combination therapies. The incidence of all-grade pneumonitis was 2.0% after pembrolizumab and 1.4% after nivolumab monotherapies. After ipilimumab, the incidence of all-grade alveolitis was 15%, while after nivolumab, the incidence of all-grade pulmonary toxicity was 4.4%. After the FDA-approved dose of ICIs, the incidence of all-grade pneumonitis was 7.5% after combination nivolumab and ipilimumab, 1.5% after pembrolizumab, and 1.4% after nivolumab.

29Combination therapies resulted in frequent potential skin irAEs, especially all-grade alopecia, pruritus, rash, macular rash, maculopapular rash, toxic skin eruptions, vitiligo, and grade ≥3 pruritus and rash. After nivolumab and ipilimumab combination therapy, the incidence of grade ≥3 rash was 3.6% and that of maculopapular rash was 1.4%. After ipilimumab, all-grade rash was observed in 31.1% of patients, pruritus in 26.8%, dermatitis in 9.5%, skin exfoliation in 5.0%, generalized rash in 2.7%, pruritic rash in 2.3%, and night sweats in 2.0%. After pembrolizumab, the incidence of all-grade eczema was 3.1%, that of toxic skin eruptions was 2.4%, that of urticaria was 9.5%, and that of vitiligo was 9.4%. After nivolumab, all-grade alopecia was observed in 2.0% of patients, erythema in 3.5%, photosensitivity reaction in 2.2%, erythematous rash in 1.1%, maculopapular rash in 13.1%, papular rash in 1.7%, and skin hypopigmentation in 2.2%. After the FDA approved doses of the combination of nivolumab and ipilimumab, the incidence of all-grade pruritus and rash and grade ≥3 rash was 33.7, 30.7, and 3.0%, respectively. The most frequent potential skin-related irAEs after the FDA-approved dose of ipilimumab included all-grade rash (20.5%), pruritus (24.9%), dermatitis (4.7%), generalized rash (1.3%), pruritic rash (2.4%), and night sweats (2.0%). The FDA-approved dose of pembrolizumab was associated with all-grade alopecia (3.4%), eczema (4.5%), erythema (4.7%), toxic skin eruptions (2.4%), and urticaria (9.5%). The FDA-approved dose of nivolumab resulted in all-grade photosensitivity reaction (3.8%), maculopapular rash (16.1%), papular rash (1.7%), skin hypopigmentation (2.2%), and vitiligo (9.1%).

30The incidence of all-grade and grade ≥3 thromboembolic events was most frequent after the combination therapies. After monotherapies, the incidence of all-grade and grade ≥3 thromboembolic events was <1%; however, the FDA-approved dose of pembrolizumab resulted in an incidence of 1.1% for all-grade thromboembolic events.

31A high heterogeneity (I2 > 75%) was observed in 60 outcomes (Tables 2 and 3). Restricting the doses to the FDA-approved doses of ICIs decreased the heterogeneity in 21 outcomes to I2 <75% (Tables 4 and 5). Subgroup analyses were not feasible because the data were presented from two trials only in 10 outcomes of sequential ipilimumab followed by nivolumab (Figures S17–S26), 4 outcomes of nivolumab monotherapy (Figures S27–S30), and 1 outcome of ipilimumab and nivolumab combination therapy (Figure S31). For the remaining outcomes, subgroup analysis based on the prior systemic anticancer therapy use showed a reduction in the heterogeneity in most studies that included previously untreated patients (Figures S32–S55). There were 7 more outcomes in the FDA-approved doses of ICIs with high heterogeneity (Tables 4 and 5). Four outcomes were based on 2 studies, and subgrouping was not applicable (Figures S56–S59). In the remaining 3 outcomes, subgrouping based on prior systemic anticancer therapy showed a low heterogeneity in previously untreated patients (Figures S60–S62).

32This systematic review and meta-analysis summarized the final evidence on irAEs reported in clinical trials of mono- and combination therapy of ipilimumab, nivolumab, and pembrolizumab in the treatment of advanced melanoma, and profiled the potential irAEs rates across these trials. The beneficial effects of using a combination of anti-CTLA-4 or anti-PD-1 agents were associated with an elevated incidence of potential irAEs. Anti-CTLA-4 therapy was mostly associated with an elevated incidence of potential irAEs of the gastrointestinal tract (colitis, diarrhea, enterocolitis, and gastrointestinal perforation), renal system (nephritis), skin (rash and pruritus), and endocrine system (hypophysitis and hypopituitarism). In contrast, the most frequent potential irAEs of anti-PD-1 therapies involved the endocrine system (hypothyroidism, hyperthyroidism, thyroiditis, and adrenal insufficiency), gastrointestinal tract (pancreatitis and peritonitis), hepatobiliary system (hepatitis, and hepatocellular injury), endocrine system (diabetes mellitus, diabetic ketoacidosis, hyperglycemia, and type 1 diabetes mellitus), musculoskeletal system (arthritis, myalgia, and myositis), nervous system (Guillain-Barre syndrome), renal system (acute renal failure, and renal failure), and respiratory system (pneumonitis).

33Our finding that the combination of anti-CTLA-4 and anti-PD-1 therapies resulted in a frequent incidence of potential irAEs is consistent with the findings of three published reviews. The point estimates of the incidence of the potential irAEs in our study were slightly different from those obtained in previous meta-analyses because of different inclusion criteria; specifically, including phase1-3 ICI trials in advanced melanoma. Therefore, our analyses included a larger number of ICI studies and patients, and thus had broader evidence base and more statistical power. Furthermore, our-analysis took a step further by comprehensively profiling potential irAEs while previously reported meta-analyses were restricted to certain irAEs.

34Furthermore, our findings of the most frequent incidence of potential irAEs after anti-CTLA-4 or anti-PD-1 monotherapies—especially the higher frequency of diarrhea, colitis, rash, pruritus, hypophysitis, hypothyroidism, hyperthyroidism, and pneumonitis—are similar to the findings of previous reviews and meta-analyses. Previous studies showed that the irAE profile might vary between nivolumab and pembrolizumab. Hypothyroidism, colitis, and pneumonitis were more common after pembrolizumab. We also found a similar pattern among pembrolizumab users.

35In our analysis, we observed a trend of elevated incidence of diabetes among nivolumab users versus pembrolizumab users. After applying a pre-specified restriction of our analysis to the FDA approved doses, the incidence of diabetes was higher in pembrolizumab users. A prior meta-analysis of endocrine adverse events of ICIs across different types of cancers showed an elevated incidence of diabetes among nivolumab users versus among pembrolizumab users. Although nivolumab and pembrolizumab share a similar mechanism of action, the incidence of diabetes can be triggered by other factors such as the cancer types and the presence of genetic factors or autoimmune bodies. A recent meta-analysis by Lu et al. showed that the incidence of diabetes due to ICIs differs from one cancer type to another. Several studies have concluded that patients with an underlying genetic predisposition to diabetes or having autoimmune bodies such as antiglutamic acid decarboxylase 65 (GAD) antibody, are at risk of developing diabetes following treatment with anti-PD1 therapies. Moreover, subgroup analysis for the FDA doses reduced the number of studies as well as the sample of patients treated with ICIs, which may have affected the estimation of the risk of the incidence of diabetes.

36Although a previous meta-analysis showed a trend of a high incidence of elevated levels of ALT and AST in melanoma patients treated with nivolumab versus pembrolizumab, our analyses revealed a higher incidence of these potential irAEs in patients treated with pembrolizumab. Note that our estimates of the incidence of elevated levels of ALT and AST was based on five pembrolizumab studies (1262 patients) and six nivolumab studies (996 patients), whereas the prior meta-analysis involved only two pembrolizumab studies (173 patients) and five nivolumab studies (955 patients). This differences in the number of studies and the higher aggregate of patients observed may explain the variation in the estimated incidence of these potential irAEs in our analysis compared to the previous meta-analysis.

37Our findings are important for clinicians as they provide valuable information about the expected frequencies of potential irAEs in patients with advanced melanoma treated with anti-CTLA-4 or anti-PD-1 monotherapies or combination therapies. In the current study, the overall incidence of each potential irAE was presented across different doses as well as for the FDA-approved doses of ICIs. Moreover, the findings of our study could help clinicians including non-oncologists such as primary care providers be vigilant about serious potential irAEs and to raise their awareness about the expected incidence rates of potential irAEs. Also, our findings provide a safety reference of ICIs in advanced melanoma against which new data such as real-world data can be compared.

38Our study has some strengths. To the best of our knowledge, the current meta-analysis is the first that was limited to advanced melanoma, included different combination of ICIs, and comprehensively presented the frequencies of potential irAEs for FDA-approved doses of ICIs. We used data from the regulatory bodies and clinicaltrials.gov to obtain more comprehensive data about potential irAEs, especially for trials that were not published as journal articles. Moreover, we included patients treated with ICI monotherapy or a combination of ICIs (anti-CTLA-4 and anti-PD-1) and excluded any combination of other active treatments to accurately estimate the incidence of potential irAEs.

39This study nevertheless has some limitations. Classifying an adverse event as a potential irAE is very challenging and may vary across trials or observers, which may lead to detection bias because we included open-label trials as well as double-blind trials. These variations may lead to overestimating the incidence of potential irAEs. However, we included only patients treated with anti-CTLA-4 or anti-PD-1 monotherapies or combination therapies to avoid including AEs that could be related to other therapies or other immunotherapies. Moreover, we utilized the random-effect model for the meta-analyses as well as subgroup analyses for high heterogeneity to account for possible variation in the outcomes of the included studies. In addition, the use of trial-level data rather than patient-level data may have introduced bias in estimating the incidence of potential irAEs owing to the variation in patient characteristics, which may be associated with the occurrence of potential irAEs. While we agree that identifying modifiers from patient-level data tends to be more robust than using trial-level data, we performed subgroup analyses to explore heterogeneity based on the available information on possible modifiers reported at the trial level.

40Overall, we found that the incidence of potential irAEs was high after using a combination of anti-CTLA-4 and anti-PD-1 therapies. Ipilimumab users tended to be at a higher risk of developing diarrhea, colitis, rash, pruritus, and hypophysitis than anti-PD-1 users. Pembrolizumab users were at a high risk of potential irAEs including thyroid disorders (hypothyroidism and hypothyroidism), endocrine disorders (hyperglycemia, and type 1 diabetes mellitus), respiratory disorders (pneumonitis), skin disorders (eczema, toxic skin eruptions, urticaria, and vitiligo), and musculoskeletal disorders (myalgia and arthralgia). Nivolumab users were likely to have a high incidence of maculopapular rash, erythema, hepatitis, infusion-related reaction, hypersensitivity, thyroiditis, elevated levels of amylase and lipase, muscle spasms, peripheral neuropathy, and renal failure. Accordingly, clinicians should be cognizant of variations in the potential irAE profiles of ICIs and weigh the benefits and risks of irAEs associated with these agents as mono or combination therapies. Nevertheless, further studies are needed to identify key predictors associated with the occurrence of irAEs as well as to compare their incidences in the real-world setting to help clinicians personalize treatment for patients and effectively manage any potential irAEs.

41All the analyzed data in this study were included in the published article.

42All authors: study concept and design, critical revision of the manuscript, and interpretation of data. AA: data acquisition and management and statistical analysis. AA and IA: drafting of the manuscript. IA: study supervision.

43The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.