Today I am going to teach you how to use AI FREE to remove anything in a 360 photo for a
virtual tour in both Adobe Photoshop and Affinity Photo. I am not talking about removing a tripod,
because that is easy. I am talking about removing a person like me - the operator here! Before
AI, it is almost impossible to remove a person from the center of the frame. But now with AI
and this tutorial, you can remove anything in your Virtual Tour photos that your client doesn't like.
It feels like you have a super power. NOW, let me give you that super power. Let's go!
Hey, what's up everybody! It is your boi Hugh here, back for a new episode of Virtual Tour
creation masterclass - FREE with Love. Virtual Tour is now getting more and
more popular thanks to my original editing tutorial here, and 1-shot HDR camera like
the Insta360 One RS 1" 360 here. But that also means you have more
competition now.
Today, I will give you an edge that no one knew
before this tutorial - using AI in Virtual Tour. Using AI to generate images and videos is not a
new concept now, thanks to AI masters like Karen X. If you have not followed her on Instagram,
you should. The principal idea of this tutorial is thanks to her original post on her Instagram.
While you are on Instagram, please do consider following me as well.
I post very different content - short tutorials on my Instagram
that you don't want to miss. Also, you can directly DM me on there.
We will use the latest OpenAI Dall-E 2 in this tutorial. But you can do the exact
same in-painting technique in other AI engines, like the completely open source,
free AI - Stable Diffusion, thanks to the latest update from the Runway ML model,
which we will cover in this tutorial as well.
Let's use a real case study here. We have this 360 photo capture with the Insta360
ONE RS 1" 360 camera using 9-bracket HDR. If you don't know how to capture HDR 360 virtual tour,
please refer to my original tutorial using Rioch Theta Z1 here. Insta360 One RS 1-inch 360 edition is just like
a faster Theta Z1 with 360 video support. If you need help to pick the best 1-shot HDR 360 camera
within your budget, I will highly recommand checking out this video right here in VR 360,
using your Meta Quest Pro or Meat Quest 2.
To make your life easier on object moval, it is ideal for getting the unwanted object as smaller
as possible in the frame. Here, the operator, me is the unwanted object. So I use a 3-meter pole,
fully extended, and poke it out of the Virgin Voyagers boat. It is like
an invisible drone shot. As you all know, you absolutely can not fly a drone around
a cruise ship. Lots of my "drone" shot, you see in my 360 videos, are done in this way.
Lastly, remember you are capturing an HDR photo. It requires the camera to
capture 9 individual photos at the same time in different exposure. So keep your
hand perfectly still. Lucky, One RS 1" capture really fast HDR photos,
and the software will automatically deghost for you. One less thing to worry about.
Now just follow this tutorial here to color grade your RAW 360 photo. You should have
this one. It is a great sunrise HDR photo with beautiful color, but then, we have this
ugly guy right in the center of the frame! And what the hell is he wearing? Some old Chinese
zombie pajama?
Referring to my old tutorial with Affinity Photo here, it is impossible to stamp myself
out with clone blush. We need to generate a new frame to fill the hole. So, we are going to
use AI.
We are going to use OpenAI Dall-E 2 here.
Dall-E is not completely free. BUT, it does give you 50 time of AI generation when you sign
up and 25 new credits each month. That's 50 360 photos. That is a lot just for a free account. If
you need more than 50 a month, well, you should pay some of your money to AI. That's just fair.
An alternative is Stable Diffusion - which is 100% free for life forever. So if you need more
than 50 images a month and you hate the idea of paying or a subscription, I will teach you
how to get Stable Diffusion working as well to do the exact same thing with 360 photos.
And you better use those saving and donate to this awesome channel. If not,
I will personally come find you and smash your a$$!
Preparation. I am going to teach you
how to do it in Affinity Photo first. Because it is lot cheaper than Adobe Photoshop. If you
don't know how to use Affinity photo for Virtual Tour, please, do yourself a favor and watch this
tutorial over and over again. It is best on the Internet and saves you lots of subscription money.
Photoshop users don't worry. I will teach you how to do it in
Photoshop as well. You can skip to this timecode for photoshop users.
Bring in your 360 photos inside Affinity Photo. Go to Layer - Live Projection - equirectangular
projection. Pan the 360 photos to the problem area. Fisheye distortion will throw the AI
engine off as the AI engine is trained in regular photos - not a photo with fisheye
distortion. That is why this step is necessary. We are going to create a new layer here. Use the
markey tool to draw a box and copy the problem area onto the new layer. Hide the background
layer. This is the layer you are working with. To help yourself later to align the image,
draw some guides around the selection like so. Now go ahead to export this problem area as png
file. I will set the height to 1024 px. As this is just a very small portion within the 6K 360
photo captured by the Insta360 One RS 1". Now bring the new image back into Affinity photo.
Go to document, click "clip canvas" to remove all transparent areas. Use the blush tool to remove
my face and any human faces within your frame. Dall-E is weird. They don't like Human faces
for copyright reasons. So just paint all the human faces to black or white. As we are going
to remove them anyway, so it does not really matter. Go ahead and export it again as png.
Now go to OpenAI Dall-E. Link in description. Register a free account. Then click upload a
new image to edit. Accept crop and hit edit image. Now use the erase tool to erase me.
You can change your blush size here. Let's make the blush size smaller to be more precise. You
can be very precise, but I am just gonna be rough here to show you the power of AI.
Don't forget to remove the reflection in the glasses. Glasses are a nightmare in 360 photos
but not anymore after today's tutorial. Type in some text to tell AI what you want
to generate. I am not trying to be creative here. So just type in "voyages boat outside
balcony" - a very creative description. Hit generate and let AI do its thing.
Holy Moly, this is like magic! AI fills my frame perfectly! I like option 1. So I pick it,
downloaded and saved it as a local file. Now bring it back to your original 360
files inside the Affinity photo. Unhide your 360 photo layer and resize and align the new
AI generate image to the older 360 photo. Delete all the other intermedia layer,
merge down the new AI image layer to the 360 layer. Go to layer and remove projection to
undistorted back to fisheye. Look at that, I am disappeared! Now Richard should be happy.
If you pay attention, OpenAI actually inserts a logo onto the image right here. Let's clear
up the image with some clone stamp. Go back to Equiretaugle projection. Pan to the openAI
logo. Pick the inpainting blush tool and paint on top of the logo. While we at it,
we will clear up some of the imprefection generated by AI. AI is never prefect but
we can always make it better in post with the magic techinc I am showing you here.
If you appreciate all the education on this channel, please support us by subscribing,
sharing this video on your social media and giving this video a thumb up and a thank you comment down
below. And please, follow my Instagram here. If you want shorter version AI tutorials.
Now you can get out of projection, export this image as full resolution jpg
and upload it onto your favorite virtual tour platform. I use TeleportMe here,
as they are the easiest to use that support up to 100mb 360 photo. I really care about my
Virtual Tour image quality more than anything else. And this is the only platform that adds
no compression onto my high end 360 photo. Matterport and 3DVista are also good choices.
Okay, now let me quickly run tho Adobe Photoshop workflow.
Bring the same image into Adobe Photoshop. We are going to use fisheye version this
time directly. If the removal subject is not in top or bottom super distorted part of the image,
you can kinda get away in AI inpainting process even in fisheye mode. So we just
draw guides here around the problem area. Copy that into a new layer. Make sure you
paint out people's faces with a soft blush. Now export just that part as a PNG file. Easy.
Now go back to Dall-E, upload that image onto Dall-E. Use the easer tool to paint out me and
my reflection. Type in your AI generation text description. There you go. It is not
as good as the non-fisheye version, but it is still really good and honestly, no one can tell
this is AI generated image. Download version 1 here. Import it back onto the 360 photo inside
photoshop. Unhide the 360 photo and align the new AI image onto the original image. Now use
the clone blush to clone out the OpenAI logo. Touch up the image and there you go. Almost
the same result as the Affinity Photo version. Now you should be a master in AI photo editing.
Now, let me show you how to do it in Stable Diffusion with the new Runway ML inpainting
update, released last week. If you want to learn how to install Stabel Diffusion in
your local computer without writing a single line of code as a complete AI noob, like me.
Comment and let me know. This tutorial is already super long, so I will skip the installation part.
and save that for the next tutorial if you're interesting so now you're in a stable diffusion=
web UI folder right here after install just go ahead and hit the webUI.bat will just
open up stable diffusion and we just launch it and that is create URL on your local computer
as you see opened up as a web UI interface which is kind of cool and you can also server up this
URL so people from around the world can actually use your stable diffusion server if you want to
provide that for free make sure here using the version is above 1.5 because that's the
new one-way ml model allow you to do like Photo realistic in painting effects okay so
now go ahead and go to image to image right here in paint and then go ahead and drop in the image
a stable diffusion there's no copyright issue so I can leave my face un-pain right here and then
go ahead and uh comfortable brush size and I'm gonna gonna blush myself out in stable diffusion
same process as DallE exact same process I'm just gonna roughly paint myself out
that should be good enough uh so right here you can Define your mask blurry and go ahead and use
a few uh I think the rest can leave it as a default right here yeah everything's to be fine
here I want to have at least like let's say the eight different versions batch count of
8 different version for me to pick from so I can pick from and here is like basically telling you
how much uh you want AI to be creative so I don't want it to be too creative right here maybe just
keep in the seven and then the denoise strength is how much is relevant to the original let me try to
use default first and see what we can get so go ahead and hit generate oh wait hold on in the type in
the prompt right here it's not gonna work we're going to take a look at each version of it um
well okay after couple trials and errors and we actually need to have a more descriptive text
right here and we also change some of the value right here uh to make it like let a little bit
more creative and less less of the noise string so basically makes it better I will
show you what what's that supposed to mean and actually get a pretty unrelated image to
get this kind of result and this image is kind of the best we can get uh to replace this image
it's kind of creative we actually generate a red pillow right here it's kind of cool um but
I think this will work so go ahead and hit save downlod the same image now go ahead open Photoshop
here (Kimchi my Shibu is running in the background)
if you forgot to draw a guide you can also just like turn the transparency
off and try to just match it exactly that is another way to really like align everything
as right here it should be good now go ahead and turn on the transparency to 100 boom
there you go uh that is the stable diffusion generation it's a little
bit more noisy but I think the result if you just re-look at it uh you can't
really tell it's there it's kind of also remove me completely it just
generation new red pillow right here kind of cool uh so yeah there you go
Thank you so much for learning with me, and pushing the quality of Virtual Tour to the
next level as a Virtual Tour Pioneer. Re-watch and practice what I just taught you. Send this to your
friend if they need help on removing things after the 360 pano has been taken. Help other virtual
tour creators. With great power come with great responsibility. Sharing is loving, let's help each
other to grow instead of making money from others Virtual Tour creators who just want to learn.
The next Virtual Tour tutorial, I will teach you how to create Mixed
Reality Virtual Tour with my brand new Meta Quest Pro. How you can leverage new
technology to give your Virtual Tour business an edge with VR, AR and MR.
And we will also talk about a free giveaway of a brand new Meta Quest Pro. Now I give you a
REAL reason to subscribe, and hit the bell. Until next time, stay creative my friends.