Using AI to Create Slow Motion Footage

Very cool.

I got my deep learning rig set up since yesterday 8 RTX 2070, so I can start playing with CUDA10.1 I guess this will be one of the first things ill play with :D

Thanks for sharing!

Yeah that monster should definitely be able to crank out some footage very quickly. This video was all done with a single GTX 1070 and took about 9 hours in total to render.

Does anyone else hear the voice of Common when you read the title?

Very cool Astromut!

Any way you could post the original, unedited footage as a comparison to see how dramatic the interpolation and AI effect/enhancement is?

Not sure reframing fps perameters even gets CLOSE to calling it AI.


ITS A COMPUTER PROGRAM JUST LIKE EVERY OTHER COMPUTER PROGRAM TGAT REFRAMES FPS RATE.


LORD why do you people call EVERYTHING AI? Hardly anything at all has ever been AI

Here are the original launch videos:

Great footage Dr. Astro!

Seems as though it's A.I.'s version of frame interpolation? Man this tech has a lot of potential.

Ya mean, it's an app?
Very useful to investigate all the fakery on the innernet.

Yeah.. but can it play Crysis?

Whether a program is AI or not is not a function of what it does but rather how it does it. I mean you could make a deep learning algorithm that just resizes images. Just because it's a simple function doesn't mean that it's not AI. It's not artificial general intelligence, but it is a deep learning algorithm based on an artificial neural network. This allows it to interpolate between frames using unsupervised learning, and the final result is in my opinion much better than existing conventional solutions.
[link to en.m.wikipedia.org (secure)]

Yep. It's quite powerful, though it works best with objects that are moving in a smooth fashion. And best of all, Nvidia released it for free. Of course it's only designed to work with their graphics cards so I guess you could say it's a way to promote their own product, but still it's quite cool that you can do this.

Not this AI, but you certainly could train an artificial neural network to do that. One guy trained one to play GTA V and he had it streaming on twitch around the clock. Keep in mind, this is unlike a bot that's within the game which has direct knowledge of the exact coordinates of everything moving around inside the game. Rather, this bot could only see what the player would see and had to figure out what it was looking at on its own.



This is giving me some thought as to whether you could train an AI to play some of these massively multiplayer online games where people already buy and sell leveled up accounts. If you could train a bot that will effectively go out on its own and level up an account for you playing day and night non-stop, you could sell the leveled up accounts to make some extra money. The question is whether or not the money you would make would have a positive return on investment for the electrical and wear and tear cost of running the computer and whether it would beat the return on investment from Bitcoin mining. Of course the latter is highly volatile so the answer probably depends month-to-month. Still it's just a little thought I had.

On a more practical level, I already use a different AI algorithm to function as my security camera system for my house. It looks at images from cameras and it sends me an alert on my phone if it detects a person stepping foot onto my property. It's not triggered by motion, it's actually triggered by recognizing a person as opposed to any other type of object. It has successfully sent me alerts when someone walking down the street has just stepped 1 inch onto my grass, even though the camera is way back on the house.

Last Edited by Astromut on 08/17/2019 09:40 AM

It's like using zoom but instead of optical a digital one. Is it worth it?

It doesn't change the magnification of the video, just frame rate. It took 30 frame per second video and turned it into 120 frame per second video. It's free and I think it's useful, but even with my fairly new graphics card it still took several hours to render this much footage. It's probably best to use it here and there when there's some particular segment of your video you want to slow down and emphasize.

So this got me to thinking and bare with me if I go off the rails a bit but I wonder if this could work with say gaming monitors to artificially increase refresh rates exponentially? Maybe to say infinite? Imagine something like a 16k monitor with infinite refresh rate. That would be as clear and smooth as reality it's self. Perhaps even more clear.

It can't affect the refresh rate of your monitor, that's a hardware limitation, but it could enhance the fps of recorded gameplay footage. Also keep in mind that this AI doesn't run in realtime even with the latest greatest RTX 2080ti. But let's say you're running a game channel on YouTube and you're playing a game with max graphics settings but your card can't maintain 60 fps, so you record your footage at 30 fps. You could run your footage through this AI overnight so that you can upload it as a 60 fps video, which is a smoother viewing experience.

Last Edited by Astromut on 08/17/2019 09:59 AM

Yeah I get it but I really can see at some point AI being able to augment those hardware limitations. Not exactly sure how but it's interesting to think about. Hahaha!

What's cool about what you're showing here is that you don't need high frame rates to get really clear, beautiful slow motion footage. Add this into an iPhone and you could just shoot at 30fps and basically create anything you want. Very cool stuff!

I'm not sure what exactly Astromut is talking about because I don't have research time this week, but you can easily outdo the old double frame slow motion these days with simple predictive motion algorithms. That would easily allow you to create a sequence from one frame to the next, without human input, simply by extrapolating pixel input from one frame to the next frame and then interpreting what might have happened between those frames, with the highest probability factor of course. It's actually not a high level algo...

The boost back burn looks like an extreme closeup of somebodies iris.

Astro, please remove that shill stuff from your screen name. You are better than that, Darling Man.

Very nice!



I liked them all, but my favorite was the Atlas V.
Also, I really liked the way you had the natural sound effects, with the slow motion, at the end of this video:

so did you shoot that vid of the double launch and then just slowed it down with that program

I recommend a big spliff of weed and start the video at 2:33

Proper enchanting


Nice

Double launch? Yes, I did shoot all the video footage you see, and I slowed it down with Nvidia's algorithm.

That video has 53 thumbs up and 31 thumbs down...what the hell is wrong with people?

I thought that was super cool. (It had 52 thumbs up)

Thanks, Astro!

Thanks, I think one of the flat earthers hit it with dozens of sock accounts earlier. It was at about 31 thumbs down immediately after I posted this thread.

Last Edited by Astromut on 08/17/2019 11:57 AM

Leveled up bot accounts been going on foreve