GENERATIVE AI AND THE CYBERBULLYING OF CHILDREN IN INDIA: LEGAL GAPS, RISKS, AND PRACTICE-BASED POLICY SAFEGUARDS
DOI:
https://doi.org/10.46763/Abstract
The rapid evolution of generative artificial intelligence (Gen-AI) has fundamentally transformed digital interactions, while simultaneously intensifying the scale and complexity of cyberbullying against children. In India, wheredigital adoption among youth is rapidly expanding, Gen-AI has enabled new forms of online harm, including deepfakes, AI-driven impersonation, misinformation, and the generation of exploitative content. Despite a growing body ofliterature on cyberbullying and AI, the literature on their intersection within the Indian legal and policy framework remains limited. This study adopts a qualitative doctrinal methodology supplemented by a comprehensive overviewof key legislative frameworks, including the Information Technology Act (IT), 2000, Information Technology (Intermediaries Guidelines and Digital Media Ethics Code) 2021, the Protection of Children from Sexual Offences Act(POCSO), 2012, and the Bharatiya Nyaya Sanhita (BNS), 2023. It also evaluates secondary literature to examine both normative structures and practical enforcement challenges. In addition, the study undertakes a comparativeassessment of regulatory approaches in jurisdictions such as the European Union, the United Kingdom, the United States and Australia to situate India within emerging global governance trends. The findings reveal a significantregulatory gap, as existing legal frameworks remain inadequately equipped to address AI-driven cyberbullying, particularly in relation to synthetic content, anonymity, and algorithmic amplification. Structural challenges such as weak enforcement, limited digital literacy, and a lack of AI-specific safeguards further exacerbate children’s vulnerability, resulting in psychological harm, social exclusion, and long-term developmental consequences. This studycontributes to the emerging field of AI and child protection by (i) offering a conceptual integration of Gen- AI risks with cyberbullying frameworks, (ii) providing a comparative legal critique of existing regulatory regimes, and (iii) proposing a multi-layered, child-centric policy framework that combines legal reform, platform accountability, and ethical AI governance.
Keywords: Gen- AI, Cyberbullying, Child Protection, Deepfakes, Digital Safety, AI Regulation, India
Downloads
References
Agnihotri, A. (2024). Parenting guide: 10 effective strategies for parents to foster digital literacy in adolescents. Hindustan Times. Retrieved May 7, 2026, from https://www.hindustantimes.com/lifestyle/relationships/parenting-guide-10-effective-strategies-for-parents-to-foster-digital-literacy-in-adolescents-101716814723512.html
Badawy, W. (2025). The ethical implications of using children’s photographs in artificial intelligence: Challenges and recommendations. AI and Ethics, 1–12.
Bastian, M. (2024, November 13). Generative AI reduces demand for some freelance jobs in writing, coding and design, study says. The Decoder. Retrieved May 7, 2026, from https://the-decoder.com/generative-ai-reduces-demand-for-some-freelance-jobs-in-writing-coding-and-design-study-says/
Beaumont, R. (2022, March 31). LAION-5B: A new era of open large-scale multimodal datasets. LAION. Retrieved May 7, 2026, from https://laion.ai/blog/laion-5b/
Bharatiya Nyaya Sanhita, (2023). No. 45 of 2023 (India). Retrieved May 7, 2026, from https://www.indiacode.nic.in/handle/123456789/20062?view_type=browseB
Bickert, M. (2020, February 17). Charting a way forward on online content regulation. Facebook. Retrieved May 7, 2026, from https://about.fb.com/news/2020/02/online-content-regulation/
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021). On the opportunities and risks of foundation models. arXiv. https://doi.org/10.48550/arXiv.2108.07258
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901. https://doi.org/10.48550/arXiv.2005.14165
Chakrabarty, S. P., & Chattopadhyay, S. (2024). Criminal liability of artificial intelligence-generated deepfakes in India. In Proceedings of the 5th International Ethical Hacking Conference (pp. 233–250). Springer Nature Singapore. https://doi.org/10.1007/978-981-99-1234-5_20
Chowdhury, R., & Lakshmi, D. (2023). Your opinion doesn’t matter, anyway: Exposing technology-facilitated gender-based violence in an era of generative AI. United Nations Educational, Scientific and Cultural Organization.
Committee on the Rights of the Child. (2021). General comment No. 25 (2021) on children’s rights in relation to the digital environment (CRC/C/GC/25). United Nations.
DePaolis, K. J., & Williford, A. (2019). Pathways from cyberbullying victimization to adverse health outcomes among elementary school students: A longitudinal investigation. Journal of Child and Family Studies, 28(9), 2390–2403. https://doi.org/10.1007/s10826-018-1104-6
European Commission. (2025, July 14). Commission publishes guidelines on the protection of minors. Retrieved May 7, 2026, from https://digital-strategy.ec.europa.eu/en/library/commission-publishes-guidelines-protection-minors
Gillespie, T. (2018). Custodians of the internet: Platforms, content moderation, and the hidden decisions that shape social media. New Haven, CT: Yale University Press
Goel, H., & Chaudhary, G. (2024). Securing the digital footprints of minors: Privacy implications of AI. Balkan Social Science Review, 23(23), 235–?. https://doi.org/10.46763/BSSR242323235G
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014). Generative adversarial networks. arXiv. https://doi.org/10.48550/arXiv.1406.2661
Gorwa, R., Binns, R., & Katzenbach, C. (2020). Algorithmic content moderation: Technical and political challenges in the automation of platform governance. Big Data & Society, 7(1), 2053951719897945. https://doi.org/10.1177/2053951719897945
Goyat, A. (2025, August 26). Panjab University students’ elections: Fake Instagram page circulates private photos of candidate, probe on. The Indian Express. Retrieved May 8, 2026, from https://indianexpress.com/article/cities/chandigarh/panjab-university-students-elections-fake-instagram-page-circulates-private-photos-of-candidate-probe-on-10211305/
Grassini, S. (2024). Computational power and subjective quality of AI-generated outputs: The case of aesthetic judgement and positive emotions in AI-generated art. International Journal of Human–Computer Interaction. https://doi.org/10.1080/10447318.2024.2422755
Gupta, R., Tiwari, S., and Chaudhary, P. (2025). Applications of generative AI models. In Generative AI: Techniques, models and applications (Lecture Notes on Data Engineering and Communications Technologies, Vol. 241). https://doi.org/10.1007/978-3-031-82062-5_8
He, S., & Lu, Y. (2024). Effectiveness of Gen AI in assisting students’ knowledge construction in humanities and social sciences courses: Learning behaviour analysis. Interactive Learning Environments, 32(10), 7041–7062. https://doi.org/10.1080/10494820.2024.2415444
Hinduja, S. & Patchin, J. W. (2024). Bullying Beyond the Schoolyard: Preventing and Responding to Cyberbullying (3rd Ed.). Thousand Oaks, CA: Sage Publications
Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021 (India). Retrieved May 7, 2026, from https://www.meity.gov.in/static/uploads/2024/02/Information-Technology-Intermediary-Guidelines-and-Digital-Media-Ethics-Code-Rules-2021-updated-06.04.2023-1-2.pdf
Information Technology Act, 2000, No. 21 of 2000 (India). Retrieved May 7, 2026, from https://www.indiacode.nic.in/bitstream/123456789/1999/1/A2000-21%20(1).pdf
INHOPE. (2022, November 2). What is CSAM? INHOPE. Retrieved May 8, 2026, from https://www.inhope.org/EN/articles/what-is-csam
Internet Watch Foundation. (2023). How AI is being abused to create child sexual abuse imagery. IWF. Retrieved May 8, 2026, from https://www.iwf.org.uk/about-us/why-we-exist/our-research/how-ai-is-being-abused-to-create-child-sexual-abuse-imagery/
Just Rights for Children Alliance v. S. Harish, 2024 SCC OnLine SC 2611 : 2024 INSC 716, Criminal Appeal Nos. 2161-2162 of 2024, decided on 23 September 2024. Retrieved May 8, 2026, from linkinglaws.com
JustAI. (2024, September 29). School students in UP booked for posting AI-generated obscene image of teacher, stressing on urgent need for cyber awareness. Retrieved May 8, 2026, from https://justai.in/school-students-in-up-booked-for-posting-ai-generated-obscene-image-of-teacher-stressing-on-urgent-need-for-cyber-awareness-29-09-24/
Kanders, K., Stupple-Harris, L., Smith, L., & Gibson, J. L. (2024). Perspectives on the impact of generative AI on early-childhood development and education. Infant and Child Development, 33(4), e2514. https://doi.org/10.1002/icd.2514
Kowalski, R. M., & McCord, A. (2020). Perspectives on cyberbullying and traditional bullying: Are they the same or different? In The Routledge companion to digital media and children (pp. 460–468). London: Routledge.
Lakatos, S. (2023, December 8). A revealing picture: AI-generated ‘undressing’ images move from niche pornography discussion forums to a scaled and monetised online business. Graphika. Retrieved May 8, 2026, from https://graphika.com/reports/a-revealing-picture
Levine, A. S. (2024, May 20). ‘I want that sweet baby’: AI-generated kids draw predators on TikTok and Instagram. Forbes. Retrieved May 8, 2026, from https://www.forbes.com/sites/alexandralevine/2024/05/20/ai-generated-kids-tiktok-instagram-social-media-child-safety-predators/
Malsia, E., & Loku, A. (2024). Generative artificial intelligence in health system management: Transformative insights. Journal of Service Science and Management, 17(2), 107–117. https://doi.org/10.4236/jssm.2024.172005
McStay, A., & Rosner, G. (2021). Emotional artificial intelligence in children’s toys and devices: Ethics, governance, and practical remedies. Big Data & Society, 8(1), 2053951721994877. https://doi.org/10.1177/2053951721994877
Milosevic, T., Van Royen, K., & Davis, B. (2022). Artificial intelligence to address cyberbullying, harassment, and abuse: New directions in the midst of complexity. International Journal of Bullying Prevention, 4, 1–5. https://doi.org/10.1007/s42380-022-00117-x
Milosevic, T., Verma, K., Carter, M., Vigil, S., Laffan, D., Davis, B., & O’Higgins Norman, J. (2023). Effectiveness of artificial intelligence–based cyberbullying interventions from youth perspective. Social Media + Society, 9(1). https://doi.org/10.1177/20563051221147325
Mishna, F., Birze, A., Greenblatt, A., & Khoury-Kassabri, M. (2021). Benchmarks and bellwethers in cyberbullying: The relational process of telling. International Journal of Bullying Prevention, 3(4), 241–252. https://doi.org/10.1007/s42380-020-00082-3
Mishna, F., McInroy, L. B., Lacombe-Duncan, A., Bhole, P., Van Wert, M., Schwan, K., & Johnston, D. (2016). Prevalence, motivations, and social, mental health, and health consequences of cyberbullying among school-aged children and youth: Protocol of a longitudinal and multi-perspective mixed method study. JMIR Research Protocols, 5(2), e83. https://doi.org/10.2196/resprot.5292
NDTV. (2024, September 28). Case against UP school students for posting AI-generated obscene image of teacher. Retrieved May 8, 2026, from https://www.ndtv.com/india-news/case-against-up-school-students-for-posting-ai-generated-obscene-image-of-teacher-6671522
O’Higgins Norman, J. (2020). Tackling bullying from the inside out: Shifting paradigms in bullying research and interventions. International Journal of Bullying Prevention, 2(3), 161–169. https://doi.org/10.1007/s42380-020-00076-1
OECD. (2025). How’s life for children in the digital age? OECD Publishing. https://doi.org/10.1787/0854b900-en
Ofcom. (2026, March). Online safety industry bulletin - March 2026. Retrieved May 8, 2026, from https://www.ofcom.org.uk/cy/online-safety/illegal-and-harmful-content/online-safety-industry-bulletins/online-safety-industry-bulletin-march-2026
Online Safety Act 2021 (Cth). (2021). Federal Register of Legislation. Retrieved May 8, 2026, from https://www.legislation.gov.au/Series/C2021A00076
Online Safety Act 2023 (UK). (2023). UK Legislation. Retrieved May 8, 2026, from https://www.legislation.gov.uk/ukpga/2023/50/contents
Online Safety Amendment (Social Media Minimum Age) Act 2024 (Cth). (2024). Federal Register of Legislation. Retrieved May 8, 2026, from https://www.legislation.gov.au/C2024A00127
Otis, N., Clarke, R., Delecourt, S., Holtz, D., & Koning, R. (2024). The uneven impact of generative AI on entrepreneurial performance. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4671369
Prabhu, S., Prabhu, S., & Noronha, F. (2023). Knowledge of child sexual abuse and attitudes towards reporting it among teachers and parents of children studying in selected primary schools of Udupi Taluk, India. Egyptian Journal of Food Science, 13 (1). https://doi.org/10.1186/s41935-023-00365-y
Protection of Children from Sexual Offences Act, 2012 (Act No. 32 of 2012). Retrieved May 8, 2026, from https://www.indiacode.nic.in/bitstream/123456789/2079/1/AA2012-32.pdf
Ranjith, P. J., Vranda, M. N., & Kishore, M. T. (2023). Predictors, prevalence, and patterns of cyberbullying among school-going children and adolescents. Indian Journal of Psychiatry, 65(7), 720–728.
Reeder, B., & Lee, K. (2024). Evaluating and incorporating generative AI in nursing informatics and data science graduate courses. Studies in Health Technology and Informatics. 315, 205–209. https://doi.org/10.3233/SHTI240135
Regulation (EU) 2022/2065 of the European Parliament and of the Council of 19 October 2022 on a single market for digital services and amending Directive 2000/31/EC (Digital Services Act). (2022). EUR-Lex. Retrieved May 8, 2026, from https://eur-lex.europa.eu/eli/reg/2022/2065/oj/eng
Reuters. (2025, August 29). Meta created flirty chatbots of Taylor Swift, other celebrities without permission. Retrieved May 8, 2026, from https://www.reuters.com/business/meta-created-flirty-chatbots-taylor-swift-other-celebrities-without-permission-2025-08-29/
Reznikov, R. (2024). Leveraging generative AI: Strategic adoption patterns for enterprises. Modelling the Development of the Economic Systems, 1, 201–207. https://doi.org/10.31891/mdes/2024-11-29
Singh, S., Saini, R., & Sagar, R. (2022). Quality of online news media reports of child sexual abuse in India. Industrial Psychiatry Journal, 31(2), 336. https://doi.org/ 10.4103/ipj.ipj_238_21
Smith, P. K. (2016). Bullying: Definition, types, causes, consequences, and intervention. Social and Personality Psychology Compass, 10(9), 519–532. https://doi.org/10.1111/spc3.12266
Sood, Y. (2023). Addressing algorithmic bias in India: Ethical implications and pitfalls. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4466681
TAKE IT DOWN Act, Pub. L. No. 119-12, 139 Stat. 55 (2025). Retrieved May 8, 2026, from https://www.congress.gov/119/plaws/publ12/PLAW-119publ12.pdf
Tamboer, S. L., Kleemans, M., & Daalmans, S. (2022). ‘We are a neeeew generation’: Early adolescents’ views on news and news literacy. Journalism, 23(4), 806–822. https://doi.org/10.1177/1464884920924527
Times of India. (2025, August 28).Classmates circulate AI pics of Hwh school girls on social media. Times of India. (2025, August 28). Retrieved May 8, 2026, from https://timesofindia.indiatimes.com/city/kolkata/classmates-circulate-ai-pics-of-hwh-school-girls-on-social-media/articleshow/123569994.cms
Thiel, D. (2023). Identifying and eliminating CSAM in generative ML training data and models. Stanford Internet Observatory. Retrieved May 8, 2026, from https://cyber.fsi.stanford.edu/io/news/csam-generative-ai
TIME. (2024, January 26). Taylor Swift deepfakes highlight the need for new legal protections. Retrieved May 8, 2026, from https://time.com/6589263/taylor-swift-deepfakes-legal-protections/
Tornatzky, L. G., & Fleischer, M. (1990). The processes of technological innovation. Lexington, Mass.: Lexington Books.
Tyagi, R. (2025, May 29). Virtual scars, real harm: India’s legal shift on child abuse in the digital space [Opinion]. NDTV. Retrieved May 8, 2026, from https://www.ndtv.com/opinion/virtual-scars-real-harm-indias-legal-shift-on-child-abuse-in-the-digital-space-8538786
UNICEF Innocenti. (2025). Childhood in a digital world: Screen time, digital skills and mental health. Retrieved May 8, 2026, from https://www.unicef.org/innocenti/reports/childhood-digital-world
United Nations. (1989). Convention on the Rights of the Child. Office of the United Nations High Commissioner for Human Rights. Retrieved May 8, 2026, from https://www.ohchr.org/en/instruments-mechanisms/instruments/convention-rights-child
Yang, K.-C., Singh, D., & Menczer, F. (2024). Characteristics and prevalence of fake social media profiles with AI-generated faces. Journal of Online Trust and Safety, 2(4). https://doi.org/10.54501/jots.v2i4.197
Yu, Y., Sharma, T., Hu, M., Wang, J., & Wang, Y. (2025). Exploring parent-child perceptions on safety in generative AI: Concerns, mitigation strategies, and design implications. In Proceedings of the 46th IEEE Symposium on Security and Privacy (SP 2025) (pp. 2735–2752). https://doi.org/10.1109/SP61157.2025.00090
Zhou, C., & Hou, F. (2024). Can AI empower L2 education? Exploring its influence on EFL teachers’ and language learners’ behavioural, cognitive, and emotional engagement. European Journal of Education, 59(4). https://doi.org/10.1111/ejed.12750https://doi.org/10.1111/ejed.12750
Zsila, Á., & Reyes, M. E. S. (2023). Pros & cons: Impacts of social media on mental health. BMC Psychology, 11, Article 201. https://doi.org/10.1186/s40359-023-01243-x
Downloads
Published
Issue
Section
License
Permissions
Authors are expected to obtain permission from copyright holders for reproducing any illustrations, tables, figures or lengthy quotations previously published elsewhere. BSSR will not be held accountable for any copyright infringement caused by the authors.
Copyright
The content offered in the BSSR remains the intellectual property of the authors and their publishers respectively. University “Goce Delcev”- Shtip, R. Macedonia and BSSR keap the right to promote and re-publish the texts.
