Right after I released this 360 photo to 360 AI art Masterclass using Stable Diffusion,
Nvidia dropped a new update on Canvas that allows you to turn this doddle into
this HDRI 360 photo. And this photo, as you see here, it is photorealistic. This
place does not exist in the real world - it is 100% AI-generated.
Mindblow!
The best part is, Canvas 360 is completely free. So, let’s
learn how to use AI to create a 8K 360 photo that you can post on Facebook 360,
loaded into VR headset like Meta Quest Pro right here, and use the 360 photo as HDRI
background for Blender, Unreal Engine 5 and, the FREE Nvidia Omniverse.
Hey, what’s up everybody! It is your Boi Hugh here back on another AI for
immersive 360 tutorial. If you are new here, don’t forget to subscribe and hit
the notification bell so you don’t miss any new immersive photography and filmmaking technique.
If you don’t know about Nvidia Canvas, go check out Karen X Cheng original post on her instagram
right here. Pretty mindblowing AI stuffs. Yesterday, they just launched another update
to enable us to draw 360 photo. Yes, you can draw 360 photos with AI! You don’t need a 360 camera
like the Insta360 X3 here anymore. The result is HDRI EXR file - just like the HDR feature
in your One RS 1” or Theta Z1. Let's learn how to do it now.
Let's talk about the interface. On the left we have the tools right here
just like Photoshop. In the middle is the working area. The top is the doodle area, and the bottom
is the LatLong output. If you come from the 360 photo world, this is no stranger for you. If you
are new to this view, consider this is the world map, the top and bottom area will have distortion.
If you need help painting a realstic 360 photo, I will refer to an actual 360 landscape photo. I
provided mine for download below as a reference. Another good reference site is polyhaven right
here. On the right, we have the 3D Preview windows - which is used to see your image in
full 360. Like on Facebook 360. So always use this as a reference what your final image looks like.
Here is the Materials you can use to paint. More are coming as Canvas 360 comes out of beta. Styles
here you can pick time of day and landscape style. Each landscape style has 10 AI-powered
Variation you can choose from. As you see later I come back here a lot to get the result I want.
Layers is just like Photoshop. Right now, you can only have up to 16 layers in total.
I will separate each material as its own layers so we can hide and show them to see the AI magic.
go ahead and open Nvidia canvas now go ahead and select the Panorama beta right here and go ahead
and hit continue and already generating a sky plate and a ground plate for you I kind of want
to create some kind of like Island and in the ocean so I'm gonna paint an ocean right here so
go in right here here you can select your brush sizes right here so I'll just use a big brush
biggest brush I can get and instead of brush too I gotta pick a line tool and then from here
I want to create layers go ahead and hit that add a layer and I will name that as ocean I'll try to
use a line tool right here here is the material right so go ahead and pick material with ocean
so go find ocean here Sea yeah sea is ocean so go ahead and draw a ocean right here yeah that's
what I want and so I want a bigger ocean so now if you see here in 360 view it is kinda
little green island in the middle of the ocean that is not realistic right it's strange so I
actually kind of paint a beach right here because ocean should have sand so go ahead and create a new layer
right here sand so I got a great little Beach right here so again I'm on line tool just draw a
straight line right here look at that that's very nice a little bit sand a little bit more
so we got a little Beach right here it's kind of a Lonely Island right here uh I'm not kind
realistic uh we are not doing the Tom Hand Cast Away style I kind of want to create a
little landscape so I'm gonna continue to create a layer but this time let's get in
hill maybe. This is brush tool line tool eraser you're gonna erase the
any thing you paint you can fill the whole area you can pick up the material and reuse
it and that's the pen too so uh this all the tools you have so go ahead I'm gonna bring some mountains here
so look at that right now it look really I think we need more land right here
oh look at that that's exactly what we want look at that foliage look at the scene right now you
look in the 360 right now and it kind of reminds me like Cannon Beach where's Cannon Beach okay
let's actually go on internet and look at what Canon beach look like Oregon okay oh look at
that look at the image get some inspiration right here so Canon Beach oh this is a good
picture right here after that ah this is a good one look at that Cannon beaches look like rock
coming out in the ocean and that is exactly what I want right I want to paint it I want
to recreate Cannon Beach here from Oregon so uh next thing we're gonna do a new layer I'm
gonna do that it's gonna medium brush right here mountain right here it's mountain right
right just do one thing on there whoa okay it's strange uh because you have more Bass
oh yes it's Cannon Beach Cannon Beach up too much foliage though
this can be a one but I kind of want a Cannon Beach it's just giant rocks
let's try stone wall how about that it's a little rock right here
oh yes that can be a Cannon Beach
so so now you kind of like Cannon Beach Cannon Beach is the the rock is kind of like
yeah okay what is this what is this guys what AI just did so we need to fix this how can we
fix this let's add some grass on it how about that the tip oh okay now it looks a little bit natural
now it look like Jurassic Park right here before we go any further let me
see we have a different variation as a I don't give me something oh right here
which one you like guys which one you like tell me
okay we'll keep in four but this time let's get in some clouds so make sure
the color is selected select Some Cloud a few moments later
Now we are happy with our painting, let's export it. You can just export it as a PNG file to
upload directly on Facebook or your Virtual Tour Platform. But we are going to export it
as an EXR file as we are technically getting an HDR image from Canvas. This is an optional
step but will make your image look a lot better. Open any HDR editing tool, I use SNS HDR Pro here.
Pick an HDR preset and adjust some settings to make the image pop. Now just like my previous AI
360 tutorial, we are going to import the 4K 360 photo generated by Canvas into Topaz Photo AI.
In Topaz Photo AI, we are going to upscale it into 8K. Inject Facebook 360 Metadata using EXIF Fixer,
and upload it onto your Facebook Page. Now put on your Meta Quest 2 or the
Meta Quest Pro, open your Facebook App inside Meta Quest, and go to your page. Here you go,
a fully immersive 360 photo-generated by AI. From here, you can follow my previous tutorial
to add music and special in VR headset Effects to make an interactive experience.
Thank you for watching another AI to 360 tutorial. The next tutorial, I will teach you how to
use the HDRI skybox in Nvidia Omniverse and Unreal Engine 5 to create a 360 film with Metahuman and
AI. All this knowledge is the foundation to help you make immersive movie fully using AI.
So don't forget to subscribe and I will see you next time. Or see you in the metaverse.