[MUSIC PLAYING]
[MUSIC PLAYING]

MARWA MABROUK: Hi, I'm Marwa Mabrouk.
MARWA MABROUK: Hi, I'm Marwa Mabrouk.

Today, I'm going to share how Android's camera can
Today, I'm going to share how Android's camera can

help you build great camera experiences
help you build great camera experiences

in your applications.
in your applications.

Let's get started.
Let's get started.

I would like to open our talk today with some information
I would like to open our talk today with some information

that I call the Android camera report.
that I call the Android camera report.

It's a very high level set of app trends
It's a very high level set of app trends

that we took notice of.
that we took notice of.

Knowing this, hopefully, you will
Knowing this, hopefully, you will

see why the plans we will talk about next are very exciting.
see why the plans we will talk about next are very exciting.

Let's start with some key trends that we're
Let's start with some key trends that we're

observing among apps.
observing among apps.

AR filters and effects on social media apps
AR filters and effects on social media apps

are very popular among users, and we're
are very popular among users, and we're

seeing apps that provide that kind of functionality,
seeing apps that provide that kind of functionality,

use the camera API in a new way by capturing using the preview
use the camera API in a new way by capturing using the preview

output stream rather than the traditional capture output
output stream rather than the traditional capture output

stream.
stream.

And for that, I'll talk about what
And for that, I'll talk about what

we're doing to improve preview output stream quality later.
we're doing to improve preview output stream quality later.

Another popular use case on the rise
Another popular use case on the rise

is the use of multi-camera API, which
is the use of multi-camera API, which

allows apps to use all rear cameras as one logical camera,
allows apps to use all rear cameras as one logical camera,

enabling users to do smooth, zoom in and out, utilizing
enabling users to do smooth, zoom in and out, utilizing

every rear camera powering the phone as one.
every rear camera powering the phone as one.

It's a really cool feature, and it's
It's a really cool feature, and it's

great to see getting more support among device makers
great to see getting more support among device makers

and more use by app developers.
and more use by app developers.

Also, no surprise the rise of video
Also, no surprise the rise of video

in different forms, short videos and video conferencing,
in different forms, short videos and video conferencing,

given the changing times and circumstances we
given the changing times and circumstances we

all have been seeing the last two years.
all have been seeing the last two years.

You will hear about all the exciting features
You will hear about all the exciting features

coming with video later on.
coming with video later on.

Finally, we have to mention new devices
Finally, we have to mention new devices

like the cool foldable phones and large screens
like the cool foldable phones and large screens

becoming an important area for Android and camera apps.
becoming an important area for Android and camera apps.

Now I'll mention how apps will get the best out
Now I'll mention how apps will get the best out

of our work in that area.
of our work in that area.

Updating you with trends is something
Updating you with trends is something

that we plan to start doing as a way to provide app developers
that we plan to start doing as a way to provide app developers

and device makers insights across Android camera,
and device makers insights across Android camera,

with a goal to bring alignment across the Android camera
with a goal to bring alignment across the Android camera

stack.
stack.

Innovations in the camera space are amazing,
Innovations in the camera space are amazing,

and our goal is to empower the diverse ecosystem
and our goal is to empower the diverse ecosystem

to innovate in alignment.
to innovate in alignment.

So apps and devices can provide users
So apps and devices can provide users

with the most amazing camera experiences.
with the most amazing camera experiences.

Let's get started by learning about what is new in Android
Let's get started by learning about what is new in Android

camera this year.
camera this year.

Speaking of the Android camera stack,
Speaking of the Android camera stack,

let's take a look at the full stack,
let's take a look at the full stack,

where Android camera sits between device makers and app
where Android camera sits between device makers and app

developers.
developers.

You can see Camera2, the camera framework API,
You can see Camera2, the camera framework API,

on top of it CameraX the Jetpack library for camera.
on top of it CameraX the Jetpack library for camera.

We also see what is becoming a core part of our architecture
We also see what is becoming a core part of our architecture

to provide consistency and quality, the test
to provide consistency and quality, the test

suites, and test labs.
suites, and test labs.

To the OEMs, we offer XTS, a set of testing suites
To the OEMs, we offer XTS, a set of testing suites

to cover different needs.
to cover different needs.

They cover a range of tests from testing the
They cover a range of tests from testing the

how to unit test for compatibility and image tests
how to unit test for compatibility and image tests

for end-to-end camera testing.
for end-to-end camera testing.

Alongside XTS, we have the performance class metadata
Alongside XTS, we have the performance class metadata

which informs developers on their device capabilities
which informs developers on their device capabilities

when they exceed average expectations so they
when they exceed average expectations so they

can take advantage of that.
can take advantage of that.

At the CameraX level, we at Google
At the CameraX level, we at Google

do the testing of the CameraX API ourselves
do the testing of the CameraX API ourselves

on the devices in our labs, and as we find inconsistencies,
on the devices in our labs, and as we find inconsistencies,

we add compatibility fixes to provide developers
we add compatibility fixes to provide developers

with a very consistent experience
with a very consistent experience

in the API across the devices that we test.
in the API across the devices that we test.

As you can see from the stack, CameraX
As you can see from the stack, CameraX

is positioned to help you get the best
is positioned to help you get the best

value out of the whole Android camera stack.
value out of the whole Android camera stack.

Being based on Camera2, apps will get the performance value,
Being based on Camera2, apps will get the performance value,

packed with all the best practices and knowledge
packed with all the best practices and knowledge

base of the Android camera team on how to use Camera2.
base of the Android camera team on how to use Camera2.

The CameraX API empowers developers
The CameraX API empowers developers

to develop their applications faster and be
to develop their applications faster and be

up and running really quickly.
up and running really quickly.

As I've mentioned before, CameraX lab
As I've mentioned before, CameraX lab

provides a powerful compatibility layer
provides a powerful compatibility layer

within CameraX to achieve consistency across the devices
within CameraX to achieve consistency across the devices

that we test.
that we test.

A good example worth mentioning here,
A good example worth mentioning here,

apps that use CameraX do not have to worry about new devices
apps that use CameraX do not have to worry about new devices

like foldables and large screens, as fixes for issues
like foldables and large screens, as fixes for issues

found in our lab will already be included in CameraX.
found in our lab will already be included in CameraX.

Apps that use CameraX will already
Apps that use CameraX will already

get the benefit to work well on those devices
get the benefit to work well on those devices

without having to make changes on their side.
without having to make changes on their side.

And finally, as a Jetpack library,
And finally, as a Jetpack library,

CameraX enables us to respond to bugs
CameraX enables us to respond to bugs

that you report, making the fixes available to you
that you report, making the fixes available to you

much faster.
much faster.

We're able to test new experimental innovations
We're able to test new experimental innovations

and support new timely features on a faster launch
and support new timely features on a faster launch

schedule due to the flexibility that comes with Android's
schedule due to the flexibility that comes with Android's

Jetpack libraries.
Jetpack libraries.

Let's quickly recap the main use cases
Let's quickly recap the main use cases

that were launched in CameraX version 1.0 before this year.
that were launched in CameraX version 1.0 before this year.

Preview, a view finder that enables getting
Preview, a view finder that enables getting

the preview on the screen.
the preview on the screen.

Image analysis, which enables access to the output buffer
Image analysis, which enables access to the output buffer

seamlessly for use with algorithms
seamlessly for use with algorithms

such as the ones provided in ML Kit, and finally,
such as the ones provided in ML Kit, and finally,

capture, which is used to save high quality images.
capture, which is used to save high quality images.

Version 1.0 was packed with many features
Version 1.0 was packed with many features

to support fast development, such as managing
to support fast development, such as managing

the lifecycle of the camera and other abstractions
the lifecycle of the camera and other abstractions

while utilizing a lot of capabilities that made image
while utilizing a lot of capabilities that made image

capture easy to implement.
capture easy to implement.

Earlier this year, version 1.1 beta was launched,
Earlier this year, version 1.1 beta was launched,

and now the release candidate has just been announced.
and now the release candidate has just been announced.

This version includes the long awaited for video capture.
This version includes the long awaited for video capture.

It is an important moment for CameraX.
It is an important moment for CameraX.

Starting with this version, it will
Starting with this version, it will

be possible to record video and audio
be possible to record video and audio

with all the same advantages that we just
with all the same advantages that we just

mentioned CameraX brings.
mentioned CameraX brings.

With video capture, users will be
With video capture, users will be

able to choose which camera to use,
able to choose which camera to use,

whether to have audio or not, and pick the resolution
whether to have audio or not, and pick the resolution

for their video capture.
for their video capture.

Resolutions can range from SD to 4K Ultra HD,
Resolutions can range from SD to 4K Ultra HD,

depending on the device.
depending on the device.

Apps will be able to provide what
Apps will be able to provide what

you see is what you get experience,
you see is what you get experience,

while using the most needed camera
while using the most needed camera

controls available like Zoom, focus metering, and exposure
controls available like Zoom, focus metering, and exposure

compensation.
compensation.

Important to mention here, that as part
Important to mention here, that as part

of launching video capture, we're enabling the integration
of launching video capture, we're enabling the integration

with the MediaStore API.
with the MediaStore API.

So now, applications can configure the MediaStore output
So now, applications can configure the MediaStore output

options for the recorder, and then
options for the recorder, and then

configure the recorder with the MediaStore output options
configure the recorder with the MediaStore output options

and start recording with just a few lines of code.
and start recording with just a few lines of code.

This is an example of one of many cases, where
This is an example of one of many cases, where

we are putting a lot of time and attention
we are putting a lot of time and attention

to the overall camera journey that apps and users need.
to the overall camera journey that apps and users need.

We are doing this to drive more productivity for developers
We are doing this to drive more productivity for developers

when it comes to camera experiences and higher quality
when it comes to camera experiences and higher quality

for applications using the Android camera API.
for applications using the Android camera API.

And as part of version 1.1, we also
And as part of version 1.1, we also

expanded our CameraX lab, increasing
expanded our CameraX lab, increasing

our significant investments in that space.
our significant investments in that space.

We now test on devices that reach 685 million
We now test on devices that reach 685 million

28 daily active users, and we include
28 daily active users, and we include

devices that represent different ranges
devices that represent different ranges

from all around the world.
from all around the world.

Android 13 will be launched later this year,
Android 13 will be launched later this year,

and we wanted to share with you some
and we wanted to share with you some

of the very exciting features that
of the very exciting features that

will be part of that launch.
will be part of that launch.

As I mentioned earlier, the preview output stream
As I mentioned earlier, the preview output stream

is important for social media and other apps that
is important for social media and other apps that

depend on effects and AR.
depend on effects and AR.

We wanted to really improve the quality of the preview output
We wanted to really improve the quality of the preview output

stream by focusing on a number of features in that area.
stream by focusing on a number of features in that area.

Features will be launching according to Android 13
Features will be launching according to Android 13

timeline and will be available through Camera2 and CameraX.
timeline and will be available through Camera2 and CameraX.

Preview stabilization will allow apps
Preview stabilization will allow apps

to avoid different results between what
to avoid different results between what

a user sees in preview and the outcome after they capture.
a user sees in preview and the outcome after they capture.

So no more unexpected cropping in the results after a user
So no more unexpected cropping in the results after a user

tried so hard to get the right composition.
tried so hard to get the right composition.

Stabilization for preview and capture
Stabilization for preview and capture

will be the same, resulting in better consistency.
will be the same, resulting in better consistency.

Another feature, jitter reduction,
Another feature, jitter reduction,

is also meant to provide smoother preview
is also meant to provide smoother preview

by syncing the camera frames for display
by syncing the camera frames for display

during preview with the camera sensor output
during preview with the camera sensor output

avoiding dropped frames and resulting
avoiding dropped frames and resulting

in a much smoother preview.
in a much smoother preview.

Apps will also be able to use high stream configuration in 60
Apps will also be able to use high stream configuration in 60

frames per second in addition to 30 frames per second
frames per second in addition to 30 frames per second

were supported.
were supported.

Other features coming will also include
Other features coming will also include

being able to provide use case configuration to optimize
being able to provide use case configuration to optimize

the [INAUDIBLE] and torch control through the camera API.
the [INAUDIBLE] and torch control through the camera API.

Another feature that is coming to Android 13
Another feature that is coming to Android 13

as part of the camera API is HDR video.
as part of the camera API is HDR video.

The APIs will provide apps with the ability to preview
The APIs will provide apps with the ability to preview

and capture through a common API that will allow them
and capture through a common API that will allow them

to use front and rear camera.
to use front and rear camera.

The features will be available through both Camera2
The features will be available through both Camera2

and CameraX.
and CameraX.

If you're familiar with HDR video,
If you're familiar with HDR video,

you must be wondering, which of the available profiles that
you must be wondering, which of the available profiles that

are out there will be supported with capture?
are out there will be supported with capture?

A big part of this effort is to improve
A big part of this effort is to improve

the consistency of this encoding across devices in Android.
the consistency of this encoding across devices in Android.

We're defining a minimum required profile
We're defining a minimum required profile

to provide this alignment.
to provide this alignment.

In this case, for capture, that will be HLG10.
In this case, for capture, that will be HLG10.

And additional profiles can be provided on devices
And additional profiles can be provided on devices

based on device makers choices.
based on device makers choices.

To support HDR video, we have taken special care
To support HDR video, we have taken special care

to ensure this will work across the different APIs of Android,
to ensure this will work across the different APIs of Android,

like media and display.
like media and display.

For more details around those APIs,
For more details around those APIs,

we encourage you to check what they
we encourage you to check what they

will share about HDR video.
will share about HDR video.

We are working with different partners in our camera stack
We are working with different partners in our camera stack

to ensure support from device makers
to ensure support from device makers

and apps will grow for this feature.
and apps will grow for this feature.

I also wanted to talk to you about an exciting space
I also wanted to talk to you about an exciting space

in Android camera that will be seeing
in Android camera that will be seeing

more attention from us in the future, and that is extensions.
more attention from us in the future, and that is extensions.

In prior years, we talked about extensions as part of CameraX.
In prior years, we talked about extensions as part of CameraX.

It's important to note.
It's important to note.

Now that extensions are available through both Camera2
Now that extensions are available through both Camera2

and CameraX.
and CameraX.

Both APIs have five extensions already
Both APIs have five extensions already

in place, portrait Bokeh, HDR, night, face retouch, and auto.
in place, portrait Bokeh, HDR, night, face retouch, and auto.

Since CameraX can provide faster launches, in the future,
Since CameraX can provide faster launches, in the future,

new extensions and experimental features
new extensions and experimental features

will be launched first through CameraX.
will be launched first through CameraX.

I would also like to talk about a new approach
I would also like to talk about a new approach

that we are currently working on exploring.
that we are currently working on exploring.

Our focus for extensions has always
Our focus for extensions has always

been to work with the device makers
been to work with the device makers

to bring the capabilities of the extensions already enabled
to bring the capabilities of the extensions already enabled

on their device through the API.
on their device through the API.

That will continue to be the case with no change,
That will continue to be the case with no change,

and when and where the device maker has enabled an extension,
and when and where the device maker has enabled an extension,

that will continue to be the default for an app.
that will continue to be the default for an app.

But what about devices that don't have an extension enabled
But what about devices that don't have an extension enabled

by the device maker and what about entry level devices,
by the device maker and what about entry level devices,

where it's harder to see consistent implementations
where it's harder to see consistent implementations

across the diversity of devices?
across the diversity of devices?

This is where we're looking into providing an extension
This is where we're looking into providing an extension

from Google to fill that space.
from Google to fill that space.

In this case where there is no extension enabled by the device
In this case where there is no extension enabled by the device

maker, apps will find a consistent solution
maker, apps will find a consistent solution

as an alternative to fall back to.
as an alternative to fall back to.

The extensions from Google will be an all software
The extensions from Google will be an all software

implementation unlike the device maker's extensions
implementation unlike the device maker's extensions

that are usually optimized with the hardware.
that are usually optimized with the hardware.

It's our aim to make the extensions
It's our aim to make the extensions

from Google consistent to work on entry level devices as well.
from Google consistent to work on entry level devices as well.

We will explore this by providing the first extension
We will explore this by providing the first extension

for selfies, the bokeh portrait extension
for selfies, the bokeh portrait extension

as an initial extension in CameraX.
as an initial extension in CameraX.

We will be very happy to see you try it and provide us
We will be very happy to see you try it and provide us

with feedback through our community channels
with feedback through our community channels

and processes.
and processes.

We have covered a lot of details.
We have covered a lot of details.

Now, let's recap the important takeaways.
Now, let's recap the important takeaways.

Consistency and quality are becoming a core part
Consistency and quality are becoming a core part

of our architecture.
of our architecture.

Our focus includes quality at every layer
Our focus includes quality at every layer

and across the camera user journeys.
and across the camera user journeys.

CameraX now supports video and audio capture
CameraX now supports video and audio capture

and it's time to consider it if you haven't already.
and it's time to consider it if you haven't already.

It's the best way to get the most value from the Android
It's the best way to get the most value from the Android

full camera stack.
full camera stack.

We want to empower innovations with Android camera
We want to empower innovations with Android camera

by helping our app developers focus
by helping our app developers focus

on their apps and their innovation
on their apps and their innovation

by bringing to them more alignment
by bringing to them more alignment

in the stack and higher quality across the diversity
in the stack and higher quality across the diversity

of devices.
of devices.

That, of course, in addition to many exciting features
That, of course, in addition to many exciting features

on the way.
on the way.

Please reach out to us through the different channels.
Please reach out to us through the different channels.

It means a lot to us to see your engagement, get your feedback,
It means a lot to us to see your engagement, get your feedback,

and input and to continue to collaborate with all of you.
and input and to continue to collaborate with all of you.

We thank you for your continued interest in Android camera
We thank you for your continued interest in Android camera

and look forward to partnering with all of you
and look forward to partnering with all of you

to bring the users of the world the best camera experiences.
to bring the users of the world the best camera experiences.

[MUSIC PLAYING]
[MUSIC PLAYING]