Hello everyone, welcome to our program, today I am very happy to bring you a topic of Alibaba
cloud computing.
Alibaba's chief technology officer Cheng Li said on Nov 11 that alibaba's businesses have
all run on Aliyun, and the experience is as smooth as silk.
After years of double 11 "big test", Ali technology to achieve multi-level jump.
Until now, no major tech company in the world has put all its business on its own public
cloud, which means aliyun has the ability to deal with the technical challenges in a
difficult and complex environment.
And in more than ten years ago, Ali cloud is still in that piece of invisible data construction
site, difficult to grow.
Back in 2008, Taobao's business was developing rapidly, accumulating massive data assets.
Because of the C2C attribute of Taobao, there are countless data intersection behind every
transaction.
The increasing transaction data brings about massive data storage, data mining and data
analysis needs At that time, Taobao still used the IOE system
for data storage, namely IBM server, Oracle database and EMC centralized storage), but
the IOE system could not meet the business development needs of Taobao.
After the development of software reached the extreme, it was the hardware that really
restricted its development.
When the IOE system could no longer meet the business needs of Taobao, in 2009, Ali Cloud
computing system "Flying" was established.
At that time, no one knew that this domestic cloud computing service would support the
cloud operation of countless small and medium-sized enterprises in ten years.
At that time, Feitian had to compete with taobao's business development speed, which
was equivalent to changing the wheels of a car at high speed.
Moreover, in the process of changing the wheels, there could not be any mistakes, and it was
more difficult to ensure the perfection and independence of the cloud system.
As Cheng li said at the tmall Double 11 in 2021, it is a huge challenge to move all alibaba's
business to the public cloud, not only to ensure uninterrupted business, but also to
deal with unexpected situations that may occur during the period.
Earlier this year, Alibaba moved one of its most onerous businesses -- search -- to the
cloud without consumers or merchants realizing it.
Perhaps great things are full of thorns at the beginning, But Ali did not shrink back,
and did a good job in the cloud to fight a protracted strategy: one year to invest billion,
insist on investing for ten years.
Sometimes, the birth of a new thing is not a lack of money, but the time to see the return,
when the demand for cloud services is not clear, many people are questioning the significance
of Alibaba Cloud Sky investment.
Because, from the point of view of the input-output ratio, Ali Cloud is a bottomless pit, and
see no return in the short term.
Fortunately, Ali did not limit the development of Ali Cloud from the perspective of economy,
and quietly persisted until 2016, Ali Cloud shone brilliantly.
In this year, Hangzhou city brain was established.
Hangzhou hopes to record traffic flow information according to traffic cameras and dynamically
adjust the status of traffic lights to avoid congestion.
However, no matter how to process traffic flow data at the frequency of 10,000 times
per second, or obtain the optimal solution of traffic light adjustment instantly, it
cannot rely on manual calculation.
But Aliyun could easily afford the computing power of the city brain, and as a result,
Hangzhou's traffic congestion fell from fourth to 57th in the country.
Through this battle, Hangzhou City Brain lets people see the power of cloud computing, and
also makes the road of cloud services for civil and commercial use more smooth.
As the core project of Alibaba, Ali Cloud (container team and big data team), in cooperation
with Alibaba resource efficiency team and Ant Container Arrangement team, has achieved
a comprehensive upgrade from "mixed technology" to today's "unified scheduling technology"
after more than one year of research and development and technical breakthrough.
Today, unified scheduling has realized the comprehensive unification of scheduling of
Alibaba e-commerce, search promotion, MaxCompute big data and ant business, the unification
of POD scheduling and high-performance task scheduling, the unification of complete resource
view and scheduling coordination, and the improvement of mixing and utilization rate
of a variety of complex business forms.
It fully supports the large-scale resource scheduling of dozens of data centers, millions
of containers and tens of millions of cores around the world.
The essence of cloud computing is to turn small computing fragments into larger resource
pools, fully cutting peak and filling valley, and providing the ultimate energy efficiency
ratio.
Under the pursuit of low carbon energy saving, green environmental protection, technological
development and more efficient operation of data center, Alibaba's exploration of technology
is endless.
Alibaba's technologists have a vision of turning the computing power of data centers into infrastructure
like water, electricity and gas, right out of the box.
In order to maximize the advantages of peak-valley complementarity between businesses, in the
past, we built the mixed-part technology to break the fragmentation of multi-resource
pools and make multi-scheduling brains in different computing fields cooperate and share
resources.
The old generation of mixing technology has brought great improvement in resource unification
and utilization, but the nature of multi-scheduler limits our pursuit.
Alibaba continues to pursue the construction of a new generation of scheduling technology
that can support more complex tasks with undifferentiated mixing, extreme flexibility and complementary,
leading to achieve the ultimate global optimal scheduling and provide higher quality computing
power.
This year we reached a new tipping point in technology when container services ACK led
and partnered with many teams to launch a new generation of UNIFIED scheduling based
on ACK.
This year's Unified scheduling, the first large-scale launch of Singles' Day, achieved
a new breakthrough in the industry by unified management of computing, storage and network
resources at the bottom through a set of scheduling protocols and a set of system architecture,
with super-large scale, high efficiency and automatic resource flexibility.
In offline mixing department, offline mixing department, the new fast up and down technology,
reduce tens of thousands of server procurement, bring hundreds of millions of resource cost
optimization and greatly promote efficiency improvement.
This year for the first time to introduce large-scale data intelligent scheduling ability,
to further enrich provides including real-time load sensing, automatic specification recommended
(VPA), differential SLO workload scheduling, CPU normalization, support periodic prediction
of HPA, time-sharing multiplexing, and so on, provide more dimensions of cost optimization
technology and high reliable security container runtime.
Centering on the unified scheduling of the new generation, alibaba's e-commerce, search,
big data and other platforms and different types of complex computing resources apply
for resources in a consistent way.
The coordinated quota management and resource planning can be completed by borrowing hundreds
of thousands of nuclear resources in seconds.
Based on unified scheduling, Ali Cloud and Ant have also realized the integration of
scheduling technology, and ant ecology has been comprehensively upgraded to unified scheduling.
The scheduling platform brings more imagination space for the future.
For example, we can use various means, such as price lever and other economic factors,
to drive alibaba's internal businesses to make more rational use of the resources of
each data center, ensure that the global resource level of the data center is balanced as far
as possible, and improve the energy efficiency ratio of the data center.
Ali cloud container service ACK to the standard Kubernetes further enhanced, higher performance
throughput and lower response delay to build a stable and reliable super large scale single
cluster capacity, stable support for 12,000 nodes over 1 million cores of super large
scale cluster, for unified scheduling of large resource pool production operation provides
a solid base.
Alibaba's various types of complex resources have also achieved comprehensive integration
and upgrading based on container service base ACK.
In addition to e-commerce, search, big data and other ali classic scenes, unified scheduling
is also greatly empowered by new technological innovation.
Take live TV shopping mall as an example, decision-making has a high demand for real-time
computing, such as second-level data analysis of real-time data such as browsing and trading
generated by more than 90 million online viewers in the Via Double 11 live broadcast room.
This year, Alibaba upgraded Blink real-time computing engine to a new generation engine
based on unified scheduling, which greatly improves the cost, performance, stability
and user experience.
Compared with Yarn, the pulp-up performance of large-scale operations is 40% faster, and
the error recovery efficiency is 100% higher.
The unified scheduling technology can save hundreds of thousands of CPUS in the double
11.
When the CPU water level of the cluster exceeds 65%, the global zero hot spot can be realized,
ensuring the timeliness of all live streams.
In terms of Serverless, function service has been implemented on a large scale in the group
for the first time, and has been applied to double 11 to support more than 10 business
scenarios such as Taobao search recommendation, data processing and front-end SSR.
With the help of unified scheduling technology, function calculation can realize large-scale
mixed running with Ali resource pool, make full use of cluster fragment resources, and
completely solve the problem of idle resource cost in Serverless scenario during low traffic
peak period.
Based on ACK image loading on demand and network stack optimization, the cold start time of
function instance is less than 150ms, and the cold start rate of function calculation
container is less than 5% combined with pooling technology, which is the key to ensure the
success of double 11.
Time has come to 2021 Tmall Double 11, Alibaba announced that it has achieved 100% online
cloud for the first time, successfully withstanding the world's largest traffic peak.
Just 26 seconds after midnight on November 11, Tmall Double 11 ushered in a new traffic
peak, with the order creation peak reaching 583,000 times per second.
As one of the largest digital projects in the world, Singles Day is a "big test" of
Alibaba's technology.
From the adoption of self-developed database to carry the trading system in 2014, the realization
of the world's largest hybrid cloud architecture in 2015, the cloud on the core trading system
in 2019, and the support of full-stack self-developed technology in this year's Double 11, these
series of operations also reveal that this year's Double 11 is not worthy of being compared
with the previous double 11.
Now, Ali Cloud supports the entire Ali ecosystem.
With the support of cloud computing, Alibaba is growing inexorably.
A series of new species, such as cainiao (intelligent logistics), ant (financial technology) and
Hema (new retail), begin to create legends.
And Ali Cloud do far more than these, one side is internal empowerment, the other side
is external output.
For today's Internet companies, the use of Aliyun products and a series of open source
projects has almost become a must.
Earlier, Zhang Jianfeng, president of Ali Cloud intelligence and president of Dharma
Institute, said in an interview that in the next three years, Ali Cloud will invest another
200 billion yuan to engage in new technology and new infrastructure.
Now it seems that Ali Cloud's first product, called "Feitian", has represented the ambition
to pave the way with technology.
Perhaps the new basic technology does not bring economic benefits at the beginning,
just like people only pay attention to the gorgeous flowers, but ignore the root system
buried in the soil.
But the roots are where the flowers come from, and similarly, a world built on technology
will make people's lives better, because the value of technology is often hidden in the
future.
In the future, container service ACK will export alibaba's unified scheduling experience
to the whole industry, support more new computing load ecology and architecture evolution of
new technology forms, realize cloud computing everywhere, comprehensively empower more enterprises
and release greater low-carbon value dividends.
That's all for this episode, thanks for watching, and we'll see you next time