AI to transform visual content creation for musicians

Welcome, rebels, visionaries, and trailblazers, to the intersection of AI and creative entrepreneurship. Here, we shart the future, share the tools of innovation, and spotlight the pioneers of a new frontier.

This isn't just a newsletter, it's a manifest for the new world.
Welcome to the revolution.

Here’s what’s cooking today:

  • Indie hacker uses AI to transform visual content for musicians

  • A ChatGPT hack to spy on your competitors for endless content ideas

  • Jamiroquai's 'Virtual Insanity' Using VR-Only Sounds & Instruments

Let’s get to it!

Physicist-Turned-Indie Hacker Employs AI to Revolutionize Visual Content for Musicians

“I want neural frames to become THE platform for musicians, music video producers, and digital artists who enjoy tinkering without the hassle of actually tinkering”.

When the wave of AI was first unleashed into the wild, musician and physicist-turned-indie hacker Nicolai Klemke saw an opportunity.

In addition to working on his Ph.D. in Physics, Klemke spent 12 years writing, recording, and producing rap songs, consistently confronted by the hassle and expense of creating visuals for his music.

Then, in November 2022, he discovered Deforum, a Stable Diffusion-based text-to-video open-source library, and it sparked an idea.

Klemke's vision was neural frames, a platform designed to democratize the creation of visual content for music. With no experience in React or production systems, Klemke threw himself into building it, entering a six-week "zen mode" of coding, eating, and sports.

"Back then, there were no tools other than their Github repository and Automatic1111, both of which were complex to set up and use, even for developers,” said Klemke. "I just started building it, relied heavily on ChatGPT, and everything kind of came together. And I loved it.”

Despite an encouraging initial launch of the MVP in January 2023, he realized by March that the product needed a significant overhaul. So Klemke went back into zen mode, rewrote the code, and relaunched in mid-April with the current Timeline approach.

“Neural frames is more than a tool; it is a sanctuary for creators seeking to express their artistic vision without technical complexities.”

Klemke's unique tinkering approach lent neural frames a blend of structure and spontaneity that sets it apart. Musicians, app developers, barkeepers, artists, and individuals have since used it to create music videos, animations, website enhancements, NFTs, and to explore AI-generated visuals for themselves.

Despite larger competitors, Klemke's focus has always been on carving out a niche where neural frames could thrive. His emphasis on the unique tinkering aspect, a feature he personally contributed, resulted in a product that appeals to individuals across various applications. The simplicity of neural frames didn't compromise its complexity, making it both fun and rewarding for users.

“I want to build a product that ultimately feels like a digital audio workstation (DAW), and stable diffusion should feel like a visual synthesizer," Klemke said, hinting at the exciting future of neural frames with a backlog of 120 features to be implemented.

Nicolai Klemke's story is not just a tale of a physicist and musician turned tech entrepreneur. It's a testament to the transformative power of technology in the hands of those who understand the needs of their peers.

With neural frames, Klemke has created a tool that not only alleviates the pains he once faced but also opens up new realms of possibility for artists worldwide. As his journey continues, the future of neural frames promises to be an exciting spectacle of innovation and creativity.

Unity's new AI features are bringing game creation to your fingertips — From prompting actions in-game to creating real-time dialogue, the features are designed to revolutionize the creative process.

ChatGPT mobile app adds web surfing to its features — The 'Browsing' feature, a new add-on to ChatGPT Plus, helps the bot answer queries beyond its 2021 training data.

What Are Dropbox's Latest AI Features? — Dropbox’s latest AI and machine learning (ML) features will help anyone who finds themselves in an unorganized limbo.

Straight out of a sci-fi movie, NASA is using AI in space — NASA is developing a ChatGPT-esque system to assist astronauts on its forthcoming Lunar Gateway space station.

Use this ChatGPT hack for endless content ideas

It seems every time the sun says hello, a new ChatGPT plugin springs to life, which makes it pretty difficult to stay on top of what's happening. YouTuber Matt Wolfe had the same thought, so he recently published a video that delves into eight of these plugins to gauge their potential.

Take a look at his video for all the golden nuggets.

But one particular trick caught our attention—in Matt’s video, he uses the “browsing” feature to analyze a website link and generate potential questions a visitor might have about the business or brand. Now, imagine turning that tool into a secret weapon.

You can use it to analyze your own site and gauge content ideas from that, but…

What if you could use it to discreetly glean insights from your competitors and create content to answer the questions they're leaving unanswered?

Here's how to give it a go:

  1. Head over to ChatGPT and activate the “browsing with Bing” feature.

  2. Type in the following prompt: "I'll give you a website link. You give me a list of questions that visitors to the site might have ".

  3. And just like that, you've got yourself a treasure trove of content inspiration. Plus, you're now poised to snag those potential clients your competitor is leaving on the table.

A 20th-century art movement, reimagined.

Prompt courtesy of @umesh_ai

/imagine: de stijl art::1 of [an object / person / place] --style raw

Thanks for reading! This is a newsletter and community in the making. If there’s anything you’d like us to explore, reply to this email and let us know what you'd like to see more of.

We’re on a mission to build a hub where creatives and coders come together and co-create the future of AI. And we’re happy to have you.

Until next time!

p.s. A cool human forwarded this to you? Get on the list and never miss another issue again. (And pay it forward by sending it to someone else).