IJCOPE Journal

UGC Logo DOI / ISO Logo

International Journal of Creative and Open Research in Engineering and Management

A Peer-Reviewed, Open-Access International Journal Supporting Multidisciplinary Research, Digital Publishing Standards, DOI Registration, and Academic Indexing.
Journal Information
ISSN: 3108-1754 (Online)
Crossref DOI: Available
ISO Certification: 9001:2015
Publication Fee: 599/- INR
Compliance: UGC Journal Norms
License: CC BY 4.0
Peer Review: Double Blind
Volume 02, Issue 10

Published on: October 2026

AI-BASED VOICE TO MUSIC GENERATION SYSTEM

ABDUL RAZZAQ ARUN KUMAR KH BHASKAR V LOHITH C N

Mounashree HS

CSE department VTU University Belagavi,India

Article Status

Plagiarism Passed Peer Reviewed Open Access

Available Documents

Abstract

The rapid advancement of Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), and generative models has created new opportunities for automating creative processes, particularly in music composition and audio production. Traditional music creation often requires musical knowledge, instrument-playing skills, professional audio-editing tools, and considerable time. These requirements can make music production challenging for beginners and individuals without formal musical training. To address these challenges, this research proposes an AI-Based Voice-to-Music Generation System that enables users to create musical compositions through natural voice commands.

The proposed system aims to integrate speech recognition, natural language processing, audio signal processing, and AI-based music generation into a unified framework. Users can provide voice commands through a microphone or upload audio recordings describing their musical preferences. The system processes the input using speech recognition techniques to convert speech into text. Natural Language Processing is then applied to identify relevant musical characteristics, including genre, mood, tempo, and instrument preferences. Based on the extracted information, an appropriate generative music model produces a musical composition corresponding to the user's instructions.

 

 

The generated audio is subsequently processed and made available for playback, saving, and downloading through an interactive user interface. The effectiveness of the proposed system will be investigated through experiments evaluating speech recognition accuracy, musical command interpretation, music generation quality, processing time, and user satisfaction.

 

Keywords— Artificial Intelligence, Voice-to-Music Generation, Natural Language Processing, Speech Recognition, Machine Learning, Deep Learning, Generative Music Models, Audio Signal Processing, Music Composition.

How to Cite this Paper

RAZZAQ, A., KH, A. K., V, B. & N, L. C. (2026). AI-Based Voice to Music Generation System. International Journal of Creative and Open Research in Engineering and Management, <i>02</i>(10), 1-9. https://doi.org/10.55041/ijcope.v2i10.179

RAZZAQ, ABDUL, et al.. "AI-Based Voice to Music Generation System." International Journal of Creative and Open Research in Engineering and Management, vol. 02, no. 10, 2026, pp. 1-9. doi:https://doi.org/10.55041/ijcope.v2i10.179.

RAZZAQ, ABDUL,ARUN KH,BHASKAR V, and LOHITH N. "AI-Based Voice to Music Generation System." International Journal of Creative and Open Research in Engineering and Management 02, no. 10 (2026): 1-9. https://doi.org/https://doi.org/10.55041/ijcope.v2i10.179.

Search & Index

References


  • Agostinelli et al., “MusicLM: Generating Music From Text,” arXiv preprint arXiv:2301.11325, 2023.

  • Copet et al., “Simple and Controllable Music Generation,” in Advances in Neural Information Processing Systems (NeurIPS), vol. 36, 2023.

  • Liu et al., “AudioLDM 2: Learning Holistic Audio Generation with Self-Supervised Pretraining,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 32, pp. 2871–2883, 2024.

  • Zhao, M. Yang, Y. Lin, X. Zhang, F. Shi, Z. Wang, J. Ding, and H. Ning, “AI-Enabled Text-to-Music Generation: A Comprehensive Review of Methods, Frameworks, and Future Directions,” Electronics, vol. 14, no. 6,article 1197, 2025.



  • Copet, F. Kreuk, I. Gat, T. Remez, D. Kant, G. Synnaeve, Y. Adi, and A. Défossez, “Simple and Controllable Music Generation,” in Advances in Neural Information Processing Systems (NeurIPS), vol. 36, 2023.

  • Liu, Y. Yuan, X. Liu, X. Mei, Q. Kong, Q. Tian, Y. Wang, W. Wang, Y. Wang, and M. D. Plumbley, “AudioLDM 2: Learning Holistic Audio Generation with Self-Supervised Pretraining,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 32, pp. 2871–2883,2024.

Ethical Compliance & Review Process

  • •All submissions are screened under plagiarism detection.
  • •Review follows editorial policy.
  • •Authors retain copyright.
  • •Peer Review Type: Double-Blind Peer Review
  • •Published on: Oct 26 2026
CCBYNC

This article is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. You are free to share and adapt this work for non-commercial purposes with proper attribution.

View License
Scroll to Top