Tech

I tried adding audio to videos in Dream Machine, and Sora’s silence sounds deafening in comparison

Share
Share

  • Luma Labs’ Dream Machine can now add audio to video clips for free
  • You can prompt the audio or let the AI come up with something it decides is appropriate
  • Sora and other AI video makers mostly lack even an imperfect AI audio creator to go with their visuals

Luma Labs has added a score to the AI videos produced on its Dream Machine platform. The new feature brings audio to your video, custom-generated to match a written prompt or created by the AI, and is based solely on what’s happening in the video. That could mean chirping birds at the sunrise scene, a spaceship’s distant hum for your sci-fi animation, the chaotic clatter of a busy café, or anything else you care to hear.

The new feature is free in beta for all users. After generating a video with Dream Machine, you’ll see a new “Audio” button along the row at the bottom of the video next to the existing “Extend” and “Enhance” buttons. Click it, and you get two choices: let the AI decide the best fitting sounds on its own, or take the wheel and provide a text prompt describing exactly what you want. Maybe you’ve got a dreamy nature scene and want to hear a distant waterfall, or maybe you want to hear how the AI does it; either way, it works.

Luma AI – Introducing Video to Audio – YouTube
Luma AI - Introducing Video to Audio - YouTube


Watch On

Sound Idea

Share

Leave a comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Related Articles
Sustainable method produces high-purity material for use in green hydrogen production
Tech

Sustainable method produces high-purity material for use in green hydrogen production

The study was conducted as part of Bruno Leuzinger da Silva’s doctoral...

Sidewalks, crosswalks and lighting reduce crashes more effectively than fixed geometric road design attributes: Study
Tech

Sidewalks, crosswalks and lighting reduce crashes more effectively than fixed geometric road design attributes: Study

Researchers demonstrate the importance of pedestrian and roadside facilities in reducing crash...

Key units in AI models mirror human brain’s language system
Tech

Key units in AI models mirror human brain’s language system

Identifying specialized and causally task-relevant units in LLMs. Credit: arXiv (2024). DOI:...