The project timeline of 2023-24 also happened to be an explosive year for Music GenAI.
John Oestmann was in the fortunate position to be involved in all parts of this project, while also working as a professional game composer himself.
Experience the project’s outcomes and development, reflections from industry interviews, and the simultaneous global evolution of GenAI, through John’s perspective:
Also available to watch on PeerTube
CHAPTERS
0:00 Introduction and Context
1:20 Summer 2023: Project Conception
1:51 Autumn 2023: Digital Futures Grant
3:56 Winter 2023: Life ReSounding Video Game
4:39 Winter 2023: MetaMIDI Toolkit
6:37 Winter 2023: Gearing up for our Interviews
7:02 Spring 2023: Interviews with Game Professionals
8:06 Spring 2023: OpenAI Turmoil
9:29 Spring 2023: Suno (Music GenAI)
10:37 Summer 2024: Surprising Interview Discussions
13:06 Summer 2024: Pitchfork Merger
15:29 Summer 2024: MIDI Support in our Toolkit
18:24 Autumn 2024: Udio (Music GenAI)
18:57 Autumn 2024: Transparent Automation/AI Design
21:03 Autumn 2024: Interviews Key Trends
22:47 Autumn 2024: Playing through Life ReSounding
24:08 Reflection: Personal Impact of AI News Cycle
27:27 Autumn 2024: RIAA Sues Suno and Udio
28:41 Winter 2024: Special Thanks
29:32 Winter 2024: Further Insights from our Results
REFERENCES
Adamu, H. (2024, April 30). Can you turn off Meta AI on Facebook, Instagram, and WhatsApp? Android Authority. https://www.androidauthority.com/turn-off-meta-ai-3437314/
Akers, T. (2024, May 10). DeviantArt and Midjourney deny wrongdoing in copyright infringement lawsuit over in AI image generators. The Art Newspaper – International Art News and Events. https://www.theartnewspaper.com/2024/05/10/deviantart-midjourney-stable-diffusion-artificial-intelligence-image-generators
Apple. (2024). Apple Intelligence Preview. Apple. https://www.apple.com/sg/apple-intelligence/
APRA AMCOS. (2023a, March 10). APRA AMCOS Digital Futures Initiative. APRA AMCOS. https://www.apraamcos.com.au/about-us/news-and-events/digital-futures-initiative
APRA AMCOS. (2023b, June 13). Digital Futures Initiative for Adelaide team led by Dr. Sam Whiting. APRA AMCOS. https://www.apraamcos.com.au/about-us/news-and-events/digital-futures-initiative-recipients-2023
Ballve, M. (2024, March 15). Jan-Erik Asplund Co-Founder jan@sacra.com. https://sacra.com/c/openai/
Bastian, M. (2023, September 17). Suno AI’s new text-to-music model generates impressive songs. THE DECODER. https://the-decoder.com/suno-ais-new-text-to-music-model-generates-impressive-songs/
bearbarebere. (2024, February 25). AI art isn’t the problem. Capitalism is. [Reddit Post]. R/DefendingAIArt. http://www.reddit.com/r/DefendingAIArt/comments/1b02piv/ai_art_isnt_the_problem_capitalism_is/
Brittain, B. (2024, January 8). Microsoft, OpenAI hit with new lawsuit by authors over AI training. Reuters. https://www.reuters.com/legal/microsoft-openai-hit-with-new-lawsuit-by-authors-over-ai-training-2024-01-05/
Cafe Booleans. (n.d.). Cafe Booleans: A Game Dev Podcast. Spotify. Retrieved August 21, 2024, from https://open.spotify.com/show/7q1kZzT9tk1uMtEzlpSgBT
Chan, G. (2023, May 25). AI-generated artwork by bank employees raises questions of copyright and artistic licence. The Straits Times. https://www.straitstimes.com/singapore/ai-generated-artwork-by-bank-employees-raises-questions-of-copyright-and-artistic-licence
Cockos. (n.d.). REAPER | ReaScript. Retrieved August 22, 2024, from https://www.reaper.fm/sdk/reascript/reascript.php
Connelly, R. (2024, June 24). Record Companies Bring Landmark Cases for Responsible AI Against Suno and Udio in Boston and New York Federal Courts, Respectively. RIAA. https://www.riaa.com/record-companies-bring-landmark-cases-for-responsible-ai-againstsuno-and-udio-in-boston-and-new-york-federal-courts-respectively/
Correa, T., & Pavez, I. (2016). Digital Inclusion in Rural Areas: A Qualitative Exploration of Challenges Faced by People From Isolated Communities. Journal of Computer-Mediated Communication, 21(3), 247–263. https://doi.org/10.1111/jcc4.12154
Davis, W. (2024, April 6). OpenAI transcribed over a million hours of YouTube videos to train GPT-4. The Verge. https://www.theverge.com/2024/4/6/24122915/openai-youtube-transcripts-gpt-4-training-data-google
DiCrescenzo, B. (2000, October 2). Radiohead: Kid A. Pitchfork. https://pitchfork.com/reviews/albums/6656-kid-a/
Dr. Gloria Willcox. (n.d.). The Feeling Wheel. Retrieved August 21, 2024, from https://www.gnyha.org/wp-content/uploads/2020/05/The-Feeling-Wheel-Positive-Psycology-Program.pdf
Ebrahim, A. (2023, November 30). OpenAI is a nonprofit-corporate hybrid: A management expert explains how this model works − and how it fueled the tumult around CEO Sam Altman’s short-lived ouster. The Conversation. http://theconversation.com/openai-is-a-nonprofit-corporate-hybrid-a-management-expert-explains-how-this-model-works-and-how-it-fueled-the-tumult-around-ceo-sam-altmans-short-lived-ouster-218340
Epic Games. (n.d.). MIDI in Unreal Engine | Unreal Engine 5.3 Documentation | Epic Developer Community. Epic Games Developer. Retrieved August 22, 2024, from https://dev.epicgames.com/documentation/en-us/unreal-engine/midi-in-unreal-engine
Epic Games. (2024). Unreal Engine 5.4 Release Notes | Unreal Engine 5.4 Documentation | Epic Developer Community. Epic Games Developer. https://dev.epicgames.com/documentation/en-us/unreal-engine/unreal-engine-5.4-release-notes
Fowler, G. A. (2023, September 8). Analysis | Your Instagrams are training AI. There’s little you can do about it. Washington Post. https://www.washingtonpost.com/technology/2023/09/08/gmail-instagram-facebook-trains-ai/
Google. (2024). Making AI helpful for everyone—Google AI. Google AI. https://ai.google/
Hadero, H. & The Associated Press. (2024, June 30). Amazon is reviewing reports that Perplexity AI is scraping online news content without approval. Fortune. https://fortune.com/2024/06/29/amazon-web-services-perplexity-ai-scraping-online-news-content-without-approval/
Hutchinson, A. (2024, June 9). No, You Can’t Opt Out of Meta Using Your Posts for AI Training. Social Media Today. https://www.socialmediatoday.com/news/meta-posts-for-ai-training-cannot-opt-out/718410/
Isaac, M., Roose, K., & Metz, C. (2023, November 20). Microsoft Hires Sam Altman Hours After OpenAI Rejects His Return. The New York Times. https://www.nytimes.com/2023/11/20/business/openai-altman-ceo-not-returning.html
iZotope Inc. (n.d.). RX Post Production Suite 8 Plugin Bundle | iZotope. Retrieved August 22, 2024, from https://www.izotope.com/en/products/rx-post-production-suite.html
iZotope Inc. (2023, April 19). AI & Automated Mastering: What to Know. https://www.izotope.com/en/learn/ai-mastering.html
Jackson, G. (2021, January 26). Hustle Culture In The Age Of Artificial Intelligence. https://www.linkedin.com/pulse/hustle-culture-age-artificial-intelligence-gs-jackson
Kerr, D. (2023, November 22). OpenAI reinstates Sam Altman as its chief executive. NPR. https://www.npr.org/2023/11/22/1214621010/openai-reinstates-sam-altman-as-its-chief-executive
Khan, A. W. (2023, January 31). Hustle Culture: The Rise of A New Work Ethic. Sify. https://www.sify.com/digital-transformation/hustle-culture-the-rise-of-a-new-work-ethic/
King, H. (2023, December 20). Generative AI startup Suno wants to make songwriting as easy as taking iPhone photos. Axios. https://www.axios.com/2023/12/20/suno-gen-ai-music-microsoft
Knight, W. (2023, November 20). OpenAI Staff Threaten to Quit Unless Board Resigns. Wired. https://www.wired.com/story/openai-staff-walk-protest-sam-altman/
Kois, D., Pahwa, N., & Winkie, L. (2024, March 19). The Oral History of Pitchfork, From the Careers It Made to the Bands It Killed. Slate. https://slate.com/culture/2024/03/pitchfork-oral-history-music-festival-conde-nast-review.html
Kowald, D., Muellner, P., Zangerle, E., Bauer, C., Schedl, M., & Lex, E. (2021). Support the underground: Characteristics of beyond-mainstream music listeners. EPJ Data Science, 10(1), Article 1. https://doi.org/10.1140/epjds/s13688-021-00268-9
Lake, S. (2024, June 25). AI could kill creative jobs that ‘shouldn’t have been there in the first place,’ OpenAI’s CTO says. Fortune. https://fortune.com/2024/06/24/ai-creative-industry-jobs-losses-openai-cto-mira-murati-skill-displacement/
Larson, J. D. (2018, October 23). Greta Van Fleet: Anthem of the Peaceful Army. Pitchfork. https://pitchfork.com/reviews/albums/greta-van-fleet-anthem-of-the-peaceful-army/
Sonic Charge. (2024). Sonic Charge—Synplant 2. Sonic Charge. https://soniccharge.com/synplant2
Lopatto, E. (2024, March 19). Pitchfork lived and died by the internet. The Verge. https://www.theverge.com/24070565/pitchfork-gq-conde-nast-music-industry-change
Melonhead Games. (2023). Rooftop Renegade. Rooftop Renegade. https://rooftoprenegade.com
Meta. (2024a). AI at Meta. AI at Meta. https://ai.meta.com/
Meta. (2024b). Meta AI. AI at Meta. https://ai.meta.com/meta-ai
Metz, R., & Ghaffary, S. (2024, May 17). OpenAI Dissolves High-Profile Safety Team After Chief Scientist Sutskever’s Exit. Yahoo Finance. https://finance.yahoo.com/news/openai-dissolves-high-profile-safety-190246027.html
Meyer, A. M., David. (2022, December 12). The advent of OpenAI’s ChatGPT may be the most important news event of 2022. Fortune. https://fortune.com/2022/12/12/openai-chatgpt-biggest-news-event-of-2022/
Microsoft. (2024). Microsoft Copilot | Microsoft AI. https://www.microsoft.com/en-us/copilot
Midjourney. (2024, August). Midjourney. Midjourney. https://www.midjourney.com/website
Millman, E. (2024, June 24). AI’s Most Ambitious Music Generators Accused of “Massive” Infringement In New Lawsuit. Rolling Stone. https://www.rollingstone.com/music/music-news/record-labels-sue-music-generators-suno-and-udio-1235042056/
Morrow, A. (2024, May 10). Welcome to the AI dystopia no one asked for, courtesy of Silicon Valley | CNN Business. CNN. https://www.cnn.com/2024/05/10/business/ai-dystopia-silicon-valley-nightcap/index.html
Newton, C. (2023a, January 24). The consumer AI era has begun. Platformer. https://www.platformer.news/the-consumer-ai-era-has-begun/
Newton, C. (2023b, November 28). The OpenAI saga isn’t over just yet. Platformer. https://www.platformer.news/the-openai-saga-isnt-over-just-yet/
Nguyen, A. (2024, August 19). Can You Disable Microsoft Copilot? – ComputerCity. https://computercity.com/software/windows/can-you-disable-microsoft-copilot
Oestmann, J. (2024). Johnoestmannmusic/MetaMIDI_Toolkit [Computer software]. https://github.com/johnoestmannmusic/MetaMIDI_Toolkit (Original work published 2024)
OpenAI. (2015, December 11). Introducing OpenAI. https://openai.com/index/introducing-openai/
OpenAI. (2022, November 30). Introducing ChatGPT. https://openai.com/index/chatgpt/
OpenAI. (2023a, November 17). OpenAI announces leadership transition. https://openai.com/index/openai-announces-leadership-transition/
OpenAI. (2023b, November 20). OpenAI. https://web.archive.org/web/20231120013952/https://openai.com/
OpenAI. (2024a). OpenAI. https://openai.com/
OpenAI. (2024b, August). ChatGPT. https://chatgpt.com/
Perplexity. (2024). Perplexity Blog. https://www.perplexity.ai/hub
Pitchfork. (2015, October 13). Pitchfork Acquired by Condé Nast. Pitchfork. https://pitchfork.com/news/61621-pitchfork-acquired-by-conde-nast/
Powers, A., Lim, M., Shapiro, A., & Handel, S. (2024, January 18). Pitchfork faces layoffs and restructuring under Condé Nast. NPR. https://www.npr.org/2024/01/18/1225446347/pitchfork-faces-layoffs-and-restructuring-under-conde-nast
Reid, L. (2024, May 14). Generative AI in Search: Let Google do the searching for you. Google. https://blog.google/products/search/generative-ai-google-search-may-2024/
RIAA. (n.d.). RIAA Members. RIAA. Retrieved August 23, 2024, from https://www.riaa.com/about-riaa/riaa-members/
Richman, J. (2024, April 9). Podcast Episode: Antitrust/Pro-Internet. Electronic Frontier Foundation. https://www.eff.org/deeplinks/2024/04/podcast-episode-antitrustpro-internet
Robinson, K. (2024, June 24). Major Labels Sue AI Firms Suno and Udio for Alleged Copyright Infringement. Billboard. https://www.billboard.com/pro/major-label-lawsuit-ai-firms-suno-udio-copyright-infringement/
Ross. (2023, July 12). The Jevons Paradox: When Efficiency Leads to Increased Consumption. Green Choices. https://www.greenchoices.org/news/blog-posts/the-jevons-paradox-when-efficiency-leads-to-increased-consumption
Schwartz, E. H. (2024, July 3). Suno takes a “What, me worry?” approach to legal troubles and rolls out AI music-generating mobile app. TechRadar. https://www.techradar.com/computing/artificial-intelligence/suno-takes-a-what-me-worry-approach-to-legal-troubles-and-rolls-out-ai-music-generating-mobile-app
Shaffi, S. (2023, January 23). ‘It’s the opposite of art’: Why illustrators are furious about AI. The Guardian. https://www.theguardian.com/artanddesign/2023/jan/23/its-the-opposite-of-art-why-illustrators-are-furious-about-ai
Shaw, D. (2023, August 29). Opinion: AI art severs human connection. The Shorthorn. https://www.theshorthorn.com/opinion/opinion-ai-art-severs-human-connection/article_14416872-46bc-11ee-a3ad-f3da219f86e4.html
Smith, D. R. (2023, February 21). Authenticity is Scarcity: AI Art and Capitalism. Medium. https://medium.com/@happymeld/authenticity-is-scarcity-ai-art-and-capitalism-8c1df41876ec
Smith, M. (2024, April 26). Democratizing creativity through AI with The New Yorker_’s Matthew Hutson_. https://www.zendesk.com/au/blog/hutson-ai-podcast/#
SocietyPuffin. (2024, January 17). Pitchfork is being “merged with GQ,” unclear what this means for the future of the fest but thought it was worth sharing [Reddit Post]. R/PitchforkMusicFest. http://www.reddit.com/r/PitchforkMusicFest/comments/19951wg/pitchfork_is_being_merged_with_gq_unclear_what/
SorryEm. (2023, June 17). If AI art technology required consent it would not exist at the level it is currently at. [Reddit Post]. R/Aiwars. http://www.reddit.com/r/aiwars/comments/14c0lwl/if_ai_art_technology_required_consent_it_would/
Spangler, T. (2023, November 22). OpenAI Reaches Deal With Sam Altman to Return as CEO, With New Board in Place. Variety. https://variety.com/2023/digital/news/openai-deal-sam-altman-return-ceo-new-board-1235805171/
Suno. (2024, August). Suno. https://suno.com/
Suzuki, R. (2006, October 2). Jet: Shine On. Pitchfork. https://pitchfork.com/reviews/albums/9464-shine-on/
Svoboda, O. (2023, January 2). The Dark Side of AI Training: Artists’ Works Used Without Permission. TechLife. https://medium.com/techlife/the-dark-side-of-ai-training-artists-works-used-without-permission-f313a9c7a601
Sylvester, N. (2004, July 18). The Hives: Tyrannosaurus Hives. Pitchfork. https://pitchfork.com/reviews/albums/3892-tyrannosaurus-hives/
Talagala, N. (2023, January 10). Why 2023 Will Be The Year Of AI Education. Forbes. https://www.forbes.com/sites/nishatalagala/2023/01/10/why-2023-will-be-the-year-of-ai-education/
Taylor, C. (2023, November 3). Elon Musk says AI will create a future where ‘no job is needed’: ‘The AI will be able to do everything.’ Yahoo Finance. https://finance.yahoo.com/news/elon-musk-says-ai-create-130446741.html
The Associated Press. (2024, June 24). Music record labels sue AI song-generators Suno and Udio for copyright infringement. AP News. https://apnews.com/article/ai-music-generators-sued-suno-udio-riaa-37a398d326ebb53105538f0d1088233e
The Straits Times. (2024, May 21). Microsoft unveils ‘Copilot Plus’ PC amped with AI. The Straits Times. https://www.straitstimes.com/tech/microsoft-unveils-copilot-plus-pc-amped-with-ai
Udio. (2024, August). Udio | AI Music Generator—Official Website. Udio. https://udio.com
University of British Columbia. (2024, June 18). Indigenous data stewardship stands against extractivist AI. Faculty of Arts. https://www.arts.ubc.ca/news/indigenous-data-stewardship-stands-against-extractivist-ai/
University of South Australia. (n.d.). Magill campus. Home. Retrieved August 21, 2024, from https://unisa.edu.au/visit/magill-campus/
University of South Australia. (2023). Musical Automation in the Australian Games Industry. Home. https://unisa.edu.au/research/creative-people-products-places/research-projects/musical-automation-in-the-australian-games-industry/
Vanian, J. (2022, December 13). Why tech insiders are so excited about ChatGPT, a chatbot that answers questions and writes essays. CNBC. https://www.cnbc.com/2022/12/13/chatgpt-is-a-new-ai-chatbot-that-can-answer-questions-and-write-essays.html
Vanian, J. (2023, November 17). OpenAI’s Sam Altman exits as CEO because “board no longer has confidence” in his ability to lead. CNBC. https://www.cnbc.com/2023/11/17/sam-altman-leaves-openai-mira-murati-appointed-interim-boss.html
Velazco, C. (2024, July 5). ‘The Washington Post March’ needed an update. I tried using AI to replace it. Washington Post. https://www.washingtonpost.com/technology/2024/07/05/suno-ai-music-iphone-app/
Ward, A. (2023, December 21). How to Use Microsoft Copilot’s New Suno AI Music Creation Tool. Tech.Co. https://tech.co/news/how-to-use-microsoft-copilot-suno-ai-music
West, R. (2024). Randolph West on LinkedIn: How do I turn off the AI prompts under every post in LinkedIn? | 38 comments. https://www.linkedin.com/posts/randolphwest_how-do-i-turn-off-the-ai-prompts-under-every-activity-7187135575399829505-AL_W
Whiting, S. (2023). Small Venues: Precarity, Vibrancy and Live Music.
Williams, S. (2024, February 26). AI and Artists’ IP: Exploring Copyright Infringement Allegations in Andersen v. Stability AI Ltd. – Center for Art Law. https://itsartlaw.org/2024/02/26/artificial-intelligence-and-artists-intellectual-property-unpacking-copyright-infringement-allegations-in-andersen-v-stability-ai-ltd/
Wright, G. (2024, January 18). Anger and sadness over Pitchfork merger with GQ. https://www.bbc.com/news/world-us-canada-68014108
Yup, K. (2023, January 23). What AI art means for society, according to Yale experts. Yale Daily News. https://yaledailynews.com/blog/2023/01/23/what-ai-art-means-for-society-according-to-yale-experts/
Zhao, I. (2022, November 17). Introducing Notion AI: Your AI-Powered Writing Assistant in Private Alpha. Notion. https://www.notion.so/blog/introducing-notion-ai
Zhu, E. (2024, January 24). Is the GQ merger the end of Pitchfork as we know it? CBC Arts. https://www.cbc.ca/arts/commotion/is-the-gq-merger-the-end-of-pitchfork-as-we-know-it-1.7093862
MetaMIDI Toolkit 