(soft electronic music)
- Eye trackers might sound like something
from a futuristic sci-fi film,
but Tobii, who have been building eye trackers
for over 18 years now, more specifically,
their new gaming division Tobii Gaming,
have been rapidly developing new features for streamers
to bring a whole new level of immersion
and interactivity to your live stream.
If you have been around on Twitch for a little while,
you've probably seen one
of these eye trackers being used before,
maybe just a streamer using it
to show exactly what they're looking at in game,
or you've watched esports competitions
that are now including eye trackers
to break down the strategic plays
that these top level players are using,
or you've just watched one
of the countless try not to look challenges,
but we're not going to get into that.
(screen beeps)
Now, no matter how much of a unique experience it is
to watch a streamer use an eye tracker
and be able to get that extra level of insight
as to what they're doing in game,
I completely agree that it's not for everyone.
Sometimes, I just want to watch a streamer
with the gameplay, and I don't want to see
exactly where that eye is looking in game,
but that is where Tobii Gaming has really come in clutch.
With their new eye tracker,
they have developed an extension with Twitch
that completely moves the control over to the viewer,
and away from the streamer.
So, the streamer still streams
with the eye tracker running,
but the viewer takes full control
as to whether to enable the eye tracker,
how it looks if they do choose to enable it,
the color, the shape, the size,
all of that control goes to the viewer,
so if they want to watch with an eye tracker,
they can enable it through the extension.
Now, full disclosure, I met with Tobii Gaming
nearly a full year ago now at TwitchCon 2018,
the one that was in San Jose,
and they first asked if I wanted
to review their new eye tracker.
At the time, the implementation wasn't that great.
When I tested it out,
you had to hard code the eye tracker
actually into the data that you were sending to Twitch,
so if you were streaming with an eye tracker,
viewers that didn't like it, well, it was tough luck.
You were effectively splitting your audience in two,
those that did want to watch
with an eye tracker and those that didn't,
and you could only ever appeal to half of them.
Now, you know me.
I only like working with sponsors on this channel
if I genuinely believe and use the product,
and I legitimately think that it has a use
for you guys, the streaming community.
Thankfully, I met again with Tobii Gaming
at the TwitchCon in Berlin a few months ago,
and I was genuinely impressed with the amount
of work that they've been putting in
to their streaming integrations.
So yes, this video is sponsored by Tobii Gaming,
but only because I now believe
that their eye trackers are at a point
where the integration that they've built
with Twitch makes it a worthy upgrade
for your streaming setup.
So the eye tracker works best
if you attach it just below your monitor,
to one of the monitor bezels,
and Tobii have included these two magnetic strips,
you only need one of them,
that you just stick to the bezel of your monitor.
So, now that we have the eye tracker installed
onto our monitor and plugged into our computer via USB,
we need to download a few different bits
of software to get everything working nicely.
The three bits, firstly, the Core Eye Tracking Software
from Tobii, secondly, Tobii Ghost,
which is actually the overlay
that allows you to track where you are looking in game,
and then thirdly, the Twitch extension,
which passes all of that control over
to your Twitch viewers in terms
of enabling, disabling it,
and customizing exactly how they want the ghost to look.
So first, we're going to install the Core Software.
Now, during your installation for the Core Software,
it's going to do some actual setup
of the eye tracker to make sure it's configured
for the screen that you're using,
as well as, obviously, for your eyes,
and one thing to note is,
these eye trackers work absolutely fine with glasses.
They'll actually probably work fine even with sunglasses,
so if somebody like Dr DisRespect was to use one,
because they are sending infrared beams to your eyes,
and then measuring where you are looking based
on that data that they get back,
so it doesn't matter if you are wearing glasses.
The only thing to mentions is,
if you sometimes stream with glasses
and sometimes stream without,
then you probably want to make two separate profiles,
because the measurements are going to be different depending
on whether you're wearing glasses or not,
and then you can just switch
between those profiles when you are
and aren't wearing glasses.
So here, inside the Tobii Ghost settings,
you can see that we can customize
the actual default look of the overlay.
So remember, I said
that the Twitch viewers can actually control it
if you install the extension.
There's a default one that you can set up
that the viewers will get
when they first start watching a stream
before they've started customizing it,
and you can preview it just by toggling this here.
So, if I toggle it, you can see
that this is now following my eyes,
and you can get an idea
of the exact color, shape, size, responsiveness.
I'm going to turn the responsiveness up a bit
so I think it's a little bit quicker.
Let's go all the way to the top,
and there, you can see,
it's tracking exactly where my eyes are looking.
So you can, of course, change the color
and things like that, but I'm not going to spend too much time
fiddling around with that.
I'm just going to get onto actually connecting this
to the Twitch extension
so that your viewers can control the ghost.
So, by clicking to connect with Twitch,
we get this popup where we can actually log in
to the Twitch API, and then we get the option
to actually authorize Tobii eye tracking
with our Twitch account.
So, now that we have connected to Twitch,
the last thing to do is to actually enable the extension
on Twitch to give your viewers control,
so to do that, all we have to do is go across
to our Twitch dashboard.
From our Twitch dashboard, we just need to come down here
to Extensions, and then search for extension.
All we're searching here is Tobii Ghost,
and you can see the extension here.
Click Install.
You can see it's installed,
and we can configure it right from here.
It actually gives you a little list
of things that we've already done,
so obviously, get the eye tracking device,
download the Core Software, download the Ghost software,
connect the Twitch account,
turn on and personalize your overlay.
Then the last thing that we need to do is
to actually activate the Twitch extension,
make sure that it's set to overlay one,
and then set the actual latency
between our eye tracker and it being sent to Twitch.
So, come our Tobii Ghost eye tracker,
make sure that we set it as overlay one, our main overlay.
The last thing that we want to do is just
to sync the latency between our eye tracker
and our actual Twitch stream.
Unfortunately, Twitch doesn't release what the latency is
between you streaming
and it actually going out live on Twitch.
Obviously, it's usually quite a low number,
but Tobii has to then be manually set up
to make sure that the latency
of what your viewers are seeing
in terms of the eye tracker and what the viewers are seeing
in terms of your stream
are completely in sync with each other.
So, the way you do that is,
you actually use your streaming software
to add the ghost as an overlay,
which'll then remove, once you have the two things in sync.
So let's do that now.
Okay, so, open up your streaming software of choice.
I'm using OBS.
This doesn't matter if you're using Streamlabs OBS,
or OBS Live, it's exactly the same setup.
What you need to do, just to get the latency set, is,
you need to add another source,
which is a game capture.
Just call this Tobii Ghost.
And you need to change the mode
from full screen application to specific window,
and the window you're looking for is this one,
ssoverlay.ext Tobii Ghost.
The last thing you need to check is just Allow Transparency.
This will allow it to be on top of your game,
or, for me, it's just an image,
but you can see, that is now enabled,
and wherever I am looking, it is following.
Now we need to go actually live to our channel,
so click Start Streaming,
and if we head across to our channel,
and we actually go to the video page itself
once it goes live, you can see it's gone live now,
so head across to our channel
so we can actually see this in a bit of a bigger screen,
and we get this popup saying,
"This streamer is using the Eye Tracking extension,"
and a bit of info about what that is.
This is the thing that your viewer will actually see.
I'm just going to click, "OK, got it," for now,
and you can see both my eye tracker
from the overlay and my eye tracker
from the extension on top of each other,
and you can see that there's some latency between the two,
so I'm just going to change the color
of the one on the extension
just to make this easier to do, change that to a green,
and then our idea here is that we want
to get these two to be completely in sync,
so I'm going to get the Tobii Ghost application open as well,
and just lower this latency a little bit,
and then try that.
So you can see that the green one,
if I just leave my eyes focusing
in one place for a little bit,
and then I move it to the right,
the green, for me, is first, and then the blue,
so the latency needs to go up a little bit more.
Let's try 600.
Again, I'm going to look at the middle of the crosshair.
You can see this is getting closer now.
(speaks quickly)
So you can see, the latency is now synced
between the two, and that's all you need to do,
and you only need to do that once.
As long as you keep streaming
to the same Twitch server,
so you don't actually change the server
that you're streaming to,
you can now go back into your streaming software,
and actually disable the Tobii ghost layer
or delete it completely.
I like to leave it there just in case
I ever want to do the calibration again,
and now we should just have the exact thing
that I'm looking at as that's happening in game.
So now that you've got everything set up,
it's worth spending some time
just choosing the default ghost that appears
when somebody arrives at your stream.
As you saw then, when somebody does come to your stream,
there's a nice little popup explaining
exactly what this flying bubble thing is,
and how users can disable it
or customize it if they wish to,
but the actual default one
that they see is set up by you in the software.
So play around with the colors
and the type of ghost.
I would recommend setting the responsiveness
as high as it can go for FPS games or battle royale games
because you want that, really,
to be moving around the screen and showing
how much information you're taking in,
but for slower-paced games, you can turn that down
so it doesn't jump around quite as much.
And also, I'd just recommend choosing a color
and a style that isn't too intrusive.
You want this to be adding an element to your gameplay,
and being interesting for people that do want to watch it,
but you don't want to completely distract
from the actual gameplay in choosing,
you know, a solid bubble that's really large
and kind of taking over most of your screen.
I would also recommend probably setting up
some kind of chat command in your chat bot.
So, !eyetracker, or maybe you have it on a timer
so it repeats every few minutes,
just for new people that arrive in your stream,
explaining exactly what the eye tracker is,
and how they can disable it,
and how they can customize it should they wish to.
So let's say you're convinced,
and you want to pick up yourself one
of these Tobii Gaming eye trackers.
Well, they are sold for around $150
in most stores around the world.
I will have some links down in the description
to Amazon, global stores where it will redirect you
to the right store of the country you're in,
as well as tobiigaming.com,
and either of those, you can purchase yourself one
of these eye trackers.
If you want to check out some streamers
who are actually using this eye tracker in their streams,
Tobii does a great job of keeping up to date
on their website a list of streamers
that are currently live and using the eye tracker,
so feel free to jump into some of those streams,
maybe ask a few questions
to the streamer that is using the eye tracker.
I'm sure most people will be happy
to help you out with any questions you have.
And if you want a streamer to follow,
I'm going to be doing more streaming,
and definitely using the eye tracker,
so make sure you're following me on Twitch as well.
If you are new to the Gaming Careers YouTube channel,
I would highly recommend checking out some
of our other videos.
All of them are about improving your live stream,
so do subscribe if that's something that interests you,
and hit that notification bell if you haven't already.
As always, a massive thanks to my patrons this month,
who help me run this channel,
and if you have yet to have joined the Discord
for Gaming Careers, that's also linked
in the description below.
Peace.