Meta-Analytic Evaluation of AI-Based Chatbots and Self-Help Apps for Social Anxiety (2015–2025)
DOI:
https://doi.org/10.55737/psi.2025c-43100Keywords:
Social Anxiety, Chatbot, Mobile Apps, AI Therapy, Self-Help, Digital InterventionsAbstract
Due to stigma, cost, and a lack of trained specialists, social anxiety disorder (SAD), one of the most common and debilitating mental health conditions, is still challenging to treat using evidence-based methods (Kessler et al., 2005). In recent years, scalable tools for managing mental health conditions like SAD have emerged, including self-guided mobile applications and chatbots powered by artificial intelligence (AI) (Fulmer et al., 2018; Inkster et al., 2018). This systematic review and meta-analysis assessed the efficacy of AI-based interventions, specifically chatbots and self-help apps, in lowering symptoms of social anxiety from 2015 to 2025. Following PRISMA guidelines, only peer-reviewed randomized controlled trials (RCTs) that measured social anxiety using validated measures such as the SPIN, LSAS, and SIAS were included. The results of quantitative synthesis using Hedges' g consistently supported digital interventions over control conditions, with a small to moderate pooled effect size (g ≈ 0.36, 95% CI [0.29, 0.43]) (Stolz et al., 2018; Ivanova et al., 2016). The resources included modular self-help apps built with CBT or ACT frameworks and AI chatbots like Woebot and Wysa. Even though the results point to significant short-term advantages, there are still a number of limitations, such as the absence of long-term monitoring, a small sample diversity, and low capacity for cultural adaptation. More beneficial for settings having limited resources as these tools show potential alternatives or substitutes for therapist-led care. Future studies should concentrate on ethical inclusion, culturally sensitive design, and comparative trials with traditional therapies.
References
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Publishing.
Andrews, G., Cuijpers, P., Craske, M. G., McEvoy, P., & Titov, N. (2010). Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: A meta-analysis. PLoS ONE, 5(10), e13196. https://doi.org/10.1371/journal.pone.0013196
Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2016). Mental health smartphone apps: Review and evidence-based recommendations for future developments. JMIR Mental Health, 3(1), e7. https://doi.org/10.2196/mental.4984
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Wiley. https://doi.org/10.1002/9780470743386
Bress, J. N., Falk, A., Schier, M. M., Jaywant, A., Moroney, E., Dargis, M., Bennett, S. M., Scult, M. A., Volpp, K. G., Asch, D. A., Balachandran, M., Perlis, R. H., Lee, F. S., & Gunning, F. M. (2024). Efficacy of a mobile app–based intervention for young adults with anxiety disorders: A randomized clinical trial. JAMA Network Open, 7(8), e2428372. https://doi.org/10.1001/jamanetworkopen.2024.28372
Chandrashekar, P. (2018, March 23). Do mental health mobile apps work: Evidence and recommendations for designing high-efficacy mental health mobile apps. mHealth, 4(6). https://doi.org/10.21037/mhealth.2018.03.02
DerSimonian, R., & Laird, N. (1986). Meta-analysis in clinical trials. Controlled Clinical Trials, 7(3), 177–188. https://doi.org/10.1016/0197-2456(86)90046-2
Fehm, L., Pelissolo, A., Furmark, T., & Wittchen, H.-U. (2008). Size and burden of social phobia in Europe. European Neuropsychopharmacology, 15(4), 453–462. https://doi.org/10.1016/j.euroneuro.2005.04.002
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017). The efficacy of smartphone-based mental health interventions for depressive symptoms: A meta-analysis of randomized controlled trials. World Psychiatry, 16(3), 287–298. https://doi.org/10.1002/wps.20472
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017). Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): A randomized controlled trial. JMIR Mental Health, 4(2), e19. https://doi.org/10.2196/mental.7785
Fulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018). Using psychological artificial intelligence (Tess) to relieve symptoms of depression and anxiety: Randomized controlled trial. JMIR Mental Health, 5(4), e64. https://doi.org/10.2196/mental.9782
Garvert, M. M., McFadyen, J., Linke, S., McCloud, T., Meyer, S. S., Sobanska, S., Sharp, P. B., Long, A., Huys, Q. J. M., & Ahmadi, M. (2025, April 10). Safety and efficacy of modular digital psychotherapy for social anxiety: Randomized controlled trial. Journal of Medical Internet Research, 27, Article e64138. https://doi.org/10.2196/64138
Gulliver, A., Griffiths, K. M., & Christensen, H. (2010). Perceived barriers and facilitators to mental health help-seeking in young people: A systematic review. BMC Psychiatry, 10, 113. https://doi.org/10.1186/1471-244X-10-113
Hedman, E., Andersson, E., Ljótsson, B., Andersson, G., Rück, C., & Lindefors, N. (2011). Internet-based cognitive behavior therapy vs. cognitive behavioral group therapy for social anxiety disorder: A randomized controlled non-inferiority trial. PLoS ONE, 6(3), e18001. https://doi.org/10.1371/journal.pone.0018001
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ, 327(7414), 557–560. https://doi.org/10.1136/bmj.327.7414.557
Inkster, B., Sarda, S., & Subramanian, V. (2018, November 23). An empathy-driven, conversational artificial intelligence agent (Wysa) for digital mental well-being: Real-world data evaluation mixed-methods study. JMIR mHealth and uHealth, 6(11), Article e12106. https://doi.org/10.2196/12106
Ivanova, E., Lindner, P., Ly, K. H., Dahlin, M., Vernmark, K., Andersson, G., & Carlbring, P. (2016). Guided and unguided acceptance and commitment therapy for social anxiety disorder and/or panic disorder provided via the internet: A randomized controlled trial. Journal of Anxiety Disorders, 44, 27–35. https://doi.org/10.1016/j.janxdis.2016.09.012
Kählke, F., Berger, T., Schulz, A., Baumeister, H., Auerbach, R. P., Berking, M., … Ebert, D. D. (2019, June). Efficacy of an unguided internet-based self-help intervention for social anxiety disorder in university students: A randomized controlled trial. International Journal of Methods in Psychiatric Research, 28(2), e1766. https://doi.org/10.1002/mpr.1766
Kan, C., Wang, Y., Hu, R., Chen, K., & Zhang, Y. (2025, July 22). Smartphone-based self-help virtual reality exposure therapy for college students’ social anxiety: A randomized controlled study. Virtual Reality, 29, Article 113. https://doi.org/10.1007/s10055-025-01195-0
Karkosz, S., Szymański, R., Sanna, K., & Michałowski, J. (2024, March 20). Effectiveness of a web-based and mobile therapy chatbot on anxiety and depressive symptoms in subclinical young adults: Randomized controlled trial. JMIR Formative Research, 8, Article e47960. https://doi.org/10.2196/47960
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry, 62(6), 593–602. https://doi.org/10.1001/archpsyc.62.6.593
Linardon, J., Cuijpers, P., Carlbring, P., Messer, M., & Fuller-Tyszkiewicz, M. (2019). The efficacy of app-supported smartphone interventions for mental health problems: A meta-analysis of randomized controlled trials. World Psychiatry, 18(3), 325–336. https://doi.org/10.1002/wps.20673
Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. SAGE Publications.
McCall, H. C., Helgadottir, F. D., Menzies, R. G., Hadjistavropoulos, H. D., & Chen, F. S. (2019, January 10). Evaluating a web-based social anxiety intervention among community users: Analysis of real-world data. Journal of Medical Internet Research, 21(1), Article e11566. https://doi.org/10.2196/11566
McDonald, S. D., Thompson, N. L., Stratton, K. J., VA Mid-Atlantic Mental Illness Research, Education, Clinical Center (MIRECC) Workgroup, & Calhoun, P. S. (2014). Diagnostic accuracy of three scoring methods for the Davidson Trauma Scale among U.S. military veterans. Journal of Anxiety Disorders, 28(2), 160–168. https://doi.org/10.1016/j.janxdis.2013.09.004
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., ... & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71
Powell, J., Williams, V., Atherton, H., Bennett, K., Yang, Y., Davoudianfar, M., Hellsing, A., Martin, A., Mollison, J., Shanyinde, M., Yu, L.-M., & Griffiths, K. M. (2020). Effectiveness and cost-effectiveness of a self-guided internet intervention for social anxiety symptoms in a general population sample: Randomized controlled trial. Journal of Medical Internet Research, 22(1), Article e16804. https://doi.org/10.2196/16804
Rickwood, D., Deane, F. P., Wilson, C. J., & Ciarrochi, J. (2005). Young people’s help-seeking for mental health problems. Australian e-Journal for the Advancement of Mental Health, 4(3), 218–251. https://doi.org/10.5172/jamh.4.3.218
Rodebaugh, T. L., Holaway, R. M., & Heimberg, R. G. (2008). The treatment of social anxiety disorder. Clinical Psychology Review, 24(7), 883–908. https://doi.org/10.1016/j.cpr.2004.07.007
Scholten, H., Malmberg, M., Lobel, A., Engels, R. C. M. E., & Granic, I. (2016, January 27). A randomized controlled trial to test the effectiveness of an immersive 3D video game for anxiety prevention among adolescents. PLOS ONE, 11(1), Article e0147763. https://doi.org/10.1371/journal.pone.0147763
Schwob, J. T., & Newman, M. G. (2023). Brief imaginal exposure exercises for social anxiety disorder: A randomized controlled trial of a self-help momentary intervention app. Journal of Anxiety Disorders, 98, 102749. https://doi.org/10.1016/j.janxdis.2023.102749
Stein, M. B., & Stein, D. J. (2008). Social anxiety disorder. The Lancet, 371(9618), 1115–1125. https://doi.org/10.1016/S0140-6736(08)60488-2
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., ... & Higgins, J. P. T. (2019). RoB 2: A revised tool for assessing risk of bias in randomized trials. BMJ, 366, l4898. https://doi.org/10.1136/bmj.l4898
Stolz, T., Schulz, A., Krieger, T., Vincent, A., Urech, A., Moser, C., & Berger, T. (2018). A mobile-based intervention for social anxiety in university students: A randomized controlled trial. Behavior Therapy, 49(3), 393–407. https://doi.org/10.1016/j.beth.2017.09.006
Torous, J., Myrick, K. J., Rauseo-Ricupero, N., & Firth, J. (2020). Digital mental health and COVID-19: Using technology today to accelerate the curve on access and quality tomorrow. JMIR Mental Health, 7(3), e18848. https://doi.org/10.2196/18848
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019). Chatbots and conversational agents in mental health: A review of the psychiatric landscape. Canadian Journal of Psychiatry, 64(7), 456–464. https://doi.org/10.1177/0706743719828977
Vokinger, K. N., & Gasser, U. (2021). Regulating AI in medicine in the United States and Europe. Nature Machine Intelligence, 3(9), 738–739. https://doi.org/10.1038/s42256-021-00386-z
Wang, P. S., Aguilar-Gaxiola, S., Alonso, J., et al. (2007). Use of mental health services for anxiety, mood, and substance disorders in 17 countries. The Lancet, 370(9590), 841–850. https://doi.org/10.1016/S0140-6736(07)61414-7
Wasil, A. R., Venturo-Conerly, K. E., Shingleton, R. M., & Weisz, J. R. (2019). A review of popular smartphone apps for depression and anxiety: Assessing the inclusion of evidence-based content. Behaviour Research and Therapy, 123, Article 103498. https://doi.org/10.1016/j.brat.2019.103498
Yardley, L., Spring, B. J., Riper, H., Morrison, L. G., Crane, D. H., Curtis, K., ... & Blandford, A. (2016). Understanding and promoting effective engagement with digital behavior change interventions. American Journal of Preventive Medicine, 51(5), 833–842. https://doi.org/10.1016/j.amepre.2016.06.015
