um hello everyone it's my honor to
present
our work OralViewer the 3d
demonstration of dental surgeries for
patient education
so patient education is very important
in dental phoenix and one of the reasons
is
the dental fear dental fear is defined
as an irrational and uncontrollable
feeling
for incoming dental treatment or surgery
and it is very common among general
population
and one of the roots reason for dental
fear
is the fear of unknown things and
because of that
efficient patient education that unveils
the treatment process is a key method to
relieve such kind of fear
and in a current practice dentists
mostly rely on verbal descriptions for
further education
however it is this can be inefficient
because dental surgeries can be very
complex and there is a high
knowledge barrier between the dentist
and
the patient so in this work we propose a
totally different way
to do the education
so to inform the requirement of an
ideal education tool we
perform a formative study with dentist
and
here are what we've learn so
first the dental tool should
should be based on a patient's specific
3d dental model
so for one thing the 3d model is more
intuitive and complete
than the 2d ones and for the other thing
the patient-specific model
can better explain why a certain step is
carried out or not
for example there are multiple ways to
do
a wise tooth extraction and the decision
is made mainly based on the dental
condition of a certain patient
and second the 3d model should be
generated
from 2d x-ray rather than from 3d
imaging for example
ct this is because of the 3d screening
is not a standard practice in
in dental clinics with its high
radiation
and a high cost but on the contrary the
2d actuary
is mostly required
for all the dental service or treatment
and third the complete oral cavity model
should be provided
which can include the tooth the jaw
bones
and the periodontal tissues all of those
components are important
to let the patient fully understand what
to expect
in a surgery lastly
the two should be able to animate
the models during the demonstration
and should also be easy to carry out
of a dentist with simple interactions
so informed with those kind of
requirements
we developed the OralViewer
so here is the demonstration of the tool
based on
a real dental patient case
so the patient here has fractured tooth
and the surgery repair the tooths by
installing an artifact chrome upon it
so note that the whole
software is a web-based application and
all the operations can be done on the
dentist laptop using the mouse as a
very easy input device
so overall speaking the two is
consist of
two cascaded parts one is the 3d
reconstruction of
oral cavity from 2d imaging and the
second one is the demonstration
interface
with a multiple virtual dental
instrument
so regarding the 3D
reconstruction
there have been multiple studies doing
very fancy reconstructions
but there are two challenges that make
our tasks
to be unique one is that
most of the existing methods are
dealing with the reconstruction of a
single
unified object but in our task there are
multiple objects
and a second the x-ray
imaging is of much higher resolution
than the regular rgb photos which can be
a challenge for the computation
so we proposed
the very first model to deal
with the task
and i will pass the details but will the
main
idea here is to
is to solve the challenge of
reconstructing a whole oracle model into
two
sub-tasks the first task
is a teeth localization and the second
one
is the single tooth reconstruction from
a local patch
and moreover the dental arc curve
information is totally lost from the
screening process
of x-ray and to recover
to pick up those information two photos
of a patient one for upper jaw and the
other
lower jaw is collected by dentists
and we have developed an active
counter-based method
to do the curve estimation without any
supervised training so with the
prediction of the dental
teeth localization and the single tooth
reconstruction
and the dental curve information we can
finally
reconstruct the full teeth structure
and also we need to reconstruct the
jawbone
and the periodontal tissues so
basically we built a template model for
them
by extracting from existing 3d imagings
the reason is that those structures
cannot be
well reflected in x-ray imaging
and for any incoming patient we
register the models to the estimated
arc curve and correspondingly deform
them
deform them and then
assemble them together with the
reconstructed teeth
for the final complete oral cavity model
so regarding the demonstration interface
we allowed a dentist to import
a reconstruction model and freely
rotate and scale the model for
demonstration
and we have implemented seven common
virtual instruments which are sufficient
to demonstrate a wild
variety of dental surgeries
and for each selected instrument
we visualize the two and also we allow
the user to customize
the animation effect of the two
by using the sliders
and to apply the tools
the tool can be directly applied
to any of the object by using the very
simple
operations including the clicking
pressing
the dragging and we can show the
real-time effect
of them and also
since surgery can consist of
like multiple steps using different
surgeries they are using different
instruments
our tool enables the
demonstration to be done
incrementally by applying
multiple instruments
on a single 3d dental model
so we run the patient study and expert
study
with tell real patients from dental
clinics
and with three dentists doing the
demonstration so
briefly speaking we compare the patient
understanding
of the surgery after the patient and
education
and between using the OralViewer
and the traditional verbal based method
and we find that our method can
significantly
outperform the existing ways
and we interview the three dentists
to verify that our dental instruments
are easy to use
and the demonstration effect is
clinically valid
for the patient education purpose and
our reviver is actually preferred to
integrate
into the existing pipeline of dentist
so to summarize we
show we develop and show the first 3d
demonstration tool
for patient education
for the dental surgeries and the two is
enabled by a novel deep learning based
model
to do the 3d patient-specific and
accurate
reconstruction of dental structures
based on only a 2d imaging
which makes these two to be wildly
available
for different surgeries and without
adding any actual
screening cost and the tool is
also equipped with easy to use
virtual instrument which enable
the tool to do the realistic and
real-time demonstration of the dental
surgery