AI is going to take over the world in 2021...
But AI can certainly help VR filmmakers to save money and create silky smooth 60
frame-per-second VR video for the latest Oculus Quest 2 VR headset.
You don't need a $15,000 VR camera to get 60fps. You can shoot with a ONE X2,
ONE R or a GoPro MAX and get 6K 60FPS 360 video - as you are seeing it right now - a comedy VR
short I shot completely on an Insta360 ONE X2. You can't see the result unless you sideload
the video onto your Oculus Quest 2. So find the video download link in the description down below,
sideload it onto your Quest 2 using sidequest, and watch the magic happen.
If you want to learn the post-production AI magic, absolutely free, well keep watching.
hey what's up everybody's your boy who here from ...
Wait, let me rewind.
Hey, what's up, everybody? It is your boy Hugh here from CreatorUp - bringing you another
fresh VR filmmaking tutorial that you can't find anywhere else. So if you are new here,
hit the subscribe button and the notification bell so you can be ahead of the game.
This time, I am collaborating with GRisk AI - the creator, developer behind the famous DAINAPP
AI. In the 2021 alpha release, the AI app is going to support high resolution 360 or VR180 video.
As you all know by now, cinematic VR videos look great in 60fps in the Oculus Quest 2.
If you don't know the max resolution and frame rate of the Quest 2, you should watch my Oculus
Quest 2 review right here. Now, let me show you how
to use AI to interpolate 360 videos. Before we start, make sure your source
video is in the highest resolution in ProRes or Cineform if you use GoPro MAX. For ONE X2
or ONE R, you can use the Insta360 Studio 2021 desktop app to render out ProRes file. MP4 files
are compressed, and you will lose quality. If you don't know this , you should check out my
360 VR filmmaking masterclass, link, right here. In the Masterclass, I will explain the best
rendering workflow for any VR or 360 camera in detail.
The AI app requires a Nividia Graphic card. Sorry AMD!
And you should have at least 8G of Video RAM. But ideally, you should have 12G - 24G V-ram.
I have the Nividia Titan RTX. But I will recommand getting the 3090 RTX - this AI
app will use 100% your fancy GPU resource - make your investment well worth it.
Download the free app on GRisk AI Patreon page, link down below. Please support the
creator b/c they work hard so you can save money. Unzip your download and just run the exe file
right here. If you want a MAC version, you should comment below.
Input File, pick the ProRes MOV file. The output folder is whatever. The Important step is here,
pay attention. Go to Interpolation Options - the second tap. Make sure the AI App is using your
GPU card. I have the TITAN RTX as you see right here. Here, type in 1 instead of -1. If not,
you will run into out of memory error. 24G memory will never run out if you have the 3080 or 3090.
Set your output frame rate. You can try 3X to get 90fps if you are feeling crazy. But 60fps,
in general, is more than enough. Then, right here, I like to set to 0 with no compression
PNG sequence. The app will generate a mp4 video for you as well. But we want the best quality,
so we only care about PNG not the mp4. If you are low in hard drive space, you can check this
option to SKIP png sequence entirely. Hit Perform all steps: Render button and wait.
The new version RIFE-APP is a lot faster than DAIN-APP.
Since we are still in Alpha of the RIFE APP, I will recommand open up Task Managers to check
GPU memory usable. As you see here, when rendering kick in, the GPU memory usage jumps up to 11G at
60%. If you are low on GPU memory - make sure to kill any application that uses your GPU.
This is an 8K 360 Video. If you do not have a high spec GPU, I will recommand stay within 5.7K
for ONE X2 or even lower like 4K. If you get 4K playing in 60fps on Oculus Quest 2 - it is
still a lot better than most of the video out there. Since you are generating PNG sequence.
If, in any point, your memory runs out. Just start a new render from when you left off.
We are done here. Now instead of importing the mp4 file - you import the PNG
image sequence into Premiere. Right Click the Project window, Import, go to the png folder,
and select the first image, make sure you check the image sequence and okay.
After importing the PNG sequence, make sure you right-click on the sequence, modify, interpret
footage, assume this frame rate to 59.97 to make the image sequence into 60fps. Then you are done!
Here is a render on a RED KOMODO fisheye VR180 footage.
It does generate some artifacts if your subject is moving very fast and there is a busy background
also moving behind the subject. As you see right here. But the AI is doing a pretty good job.
Here is the result using Re:Vision Twixtor - another famous After Effects plugins to slow down
footage. The result is not as good as the AI. Well, to be fair, the correct way to
use Twixtor is to use Pro version and create a vector path with rotoscoping to key the
subject out. I have a tutorial coming up to get you the absolute best result. Better than AI for
sure. But, if you don't have Twxitor, the free AI solution is not bad at all.
Thank you for watching! To support me to bring you the latest tips & tricks in VR filmmaking,
VR camera review, and immersive video content,
please give me a thumb up, share this video on your social media and drop me a thank you
comment down below. Not like other YouTubers, I usually respond, like a real human not AI.
If you are new to the Channel, please consider subscribing and hit the notification bell for more
cool tutorial just like this. I will see you next time! Stay creative!