Brian Lovin
/
Hacker News

Show HN: Open-source AI video editor

github.com

Hey HN community! I'm one of the lead devs of this project at fal.ai and we created an open source lightweight video editor powered by the latest media AI models. The main goal was to tackle some challenges when dealing with complex media handling and encoding on the browser.

It all started as an internal experiment but as we tackled some of the issues it was clear there could be some value sharing it with the open source community.

Some of the key points and tech stack details:

- It uses IndexedDb, so all data is local (i.e. no auth, no cloud db)

- Multiple AI models for video, image, music and voice-over. APIs are provided by fal.ai

- Built with the typical React+Next.js, Shadcn front-end

- Used remotion.dev for the realtime video preview (this is such a great project, without it the codebase would be twice as large)

- File uploads so you can bring your own media by uploadthing.com

- ffmpeg for encoding the final video and also some ui tricks, like the audio waveform

We deployed a version of it and for now it's free to use. We do plan to add some rate limiting and a bring your own API Key next, but it's open source and I'm curious about what the community will build on top of it, or derive from it. Customize your own video app and if you do, please share.

If you have any questions, hit me up!

Daily Digest email

Get the top HN stories in your inbox every day.

nikolayasdf123

someone please add "AI Video Editing". I don't care about generating assets with AI.

scrolling frame by frame through hours of hundreds of tiny videos, fixing their exposure, fixing their dropped frames, fixing transitions, fixing and matching visual narration to textual and audio narration, aligning music to video, making "vlog" like templates. there is just so much to be fixed in this industry, but everyone is concerned with generating assets. that's just not the biggest issue video editors are facing. like not at all.

burningion

I'm working on this! Here's an example using Claude and Model Context Protocol: https://www.youtube.com/watch?v=bEDA9lkkGVM

You can sign up at https://www.video-jungle.com/ and I'll send an invite over.

farzd

very cool, been looking to make some applications using something like this. What kinda of pricing model is this going to have ?

nikolayasdf123

nice. is there any examples of final results what the best it can do?

EyMaddis

Because for generation you just have to make a prompt to OpenAI and get a VC to throw money at you. Why bother with the hard thing

nikolayasdf123

you don't even need VC. people would love it and more than happy to pay for it, high price! I bet China has already some of such apps. I see many very similar vlogs in Little Red Note, likely edited automatically by some kind of software. build it and. ship it

t0bia_s

Absolutely agree. I don't care about generating footages with non existing content, just let me help with editing of already taken real life footages to speed up post-production!

lastdong

Thank you for open sourcing the project, the UI looks fantastic. I noticed that several comments have mentioned the potential to improve functionality by allowing users to replace the backend with local models, such as Hunyuan. Would you be open to considering this feature in the future? Additionally, if other developers were to contribute, do you think this could be a possibility?

drochetti

Absolutely. The idea of being open source with a permissive license is that we're encouraging anyone to do whatever fits their use case.

You can replace anything, deploy on your own server, port it to other stacks... whatever brings value to you.

We're also open to PRs, cut an issue in the repo and we can get the conversation going.

voiper1

Wow, that's so fun. Just upload and generate assets super easily... queue the next one while it's working.

popalchemist

Wow, very impressive. Is there any way to use the video editor UI component in a package, separately from the rest of this project?

drochetti

Thanks! Not as a component, but you can clone or copy it and modify as needed.

It's a quite complex UI, so it's not easy to export it as a single component.

newusertoday

you can use remotion which this project is using

dgreensp

Thanks for posting it!

Remotion does look really cool for in-browser video editing. People should note that you can’t make free-to-use software with Remotion. It is a paid product, and you can download and run the code for free in very limited circumstances that let you experiment with it. You can’t use the output of your own software built on Remotion for any for-profit purpose, nor can anyone else, without a license.

jerriclynsjohn

Hey, co-founder of oss.incredible.dev here. @drochetti this is an amazing project, I love the codebase and I honestly think this is the future of video production.

During the days of oss.incredible.dev we found that the biggest friction for our user in video production was themselves, It's extremely hard for anyone to come in front of a camera and record themselves, while we were able to solve for everything else like scripting, story boarding, layouts, animations, collaboration, block based recording etc it was the inability to record themselves that caused them to leave the workspace hanging. With AI, users won't have to record themselves, they can have a saved avatar and just give it a script to make it work! This was the missing puzzle.

I'm planning to revive oss.incredible.dev, but with the intention to make it AI first product. Let me know if anyone here would like to join hands.

grugagag

It is quite a terrible thing if AI technology completely replaces the human with their own flaws with something that mimics human but is completely devoid of it and obediently executes the deed, reads the scripts that is fed and never fails. Yes it is more efficient this way but is this consumption geared towards humans or just to the human as cattle? Seems perfect for propaganda though.

jerriclynsjohn

I think about this as democratization of content creation, now people who were shy but have immense knowledge can share what they know to the world. Think about the accessibility unlock that happens with a product like this. The biggest problem we saw when we created incredible.dev was that extremely talented developers were reluctant to come in front of a camera, but they wrote amazing scripts. They knew what they were talking about, but the only blocker was themselves. This product can unlock knowledge like never before, people get to stay relevant in the fast-paced video first world.

asadm

this looks great! I would like standard timeline scrup, drag-drop etc.

Some eta on how long a generation will likely take.

kfarr

Second on timeline scrub (move timeline position depending on x position of click on timeline) and drag and drop asset from media into timeline. Also spacebar is usually a basic universal shortcut to play/pause

drochetti

Drag and drop the media to the timeline, and drag the media along the timeline track is already supported.

We will keep improving the UI, including shortcuts. Thanks a lot for the feedback.

drochetti

Thanks for the feedback, eta would be great indeed. I'll look into it.

satvikpendem

I was just looking for something like this, is this similar to RunwayML and their editor?

Jayakumark

Great release , where is the source code for FFMPEG library used?

oldgradstudent

Cool project, I played with it a bit a few hours ago.

A small bug report: if you have both a still image and a video in the timeline, the video does not play in the preview.

aykutkardas

Glad you liked it. And thanks for reporting, I'll look into the issue.

atentaten

Nice work! It would be cool to be able to do a basic cross fade along with fade in fade out with the clips.

wanderingmind

Please add a dockerfile to generate a docker image that makes it easy to setup and test

Daily Digest email

Get the top HN stories in your inbox every day.