(IPv6 Series Ebook) DIP Networking
(IPv6 Series Ebook) DIP Networking
and other Huawei trademarks are trademarks of Huawei Technologies Co., Ltd.
All other trademarks and trade names mentioned in this document are the property of their respective holders.
Notice
The purchased products, services and features are stipulated by the contract made between Huawei and the
customer. All or part of the products, services and features described in this document may not be within the
purchase scope or the usage scope. Unless otherwise specified in the contract, all statements, information, and
recommendations in this document are provided "AS IS" without warranties, guarantees or representations of
any kind, either express or implied.
The information in this document is subject to change without notice. Every effort has been made in the
preparation of this document to ensure accuracy of the contents, but all statements, information, and
recommendations in this document do not constitute a warranty of any kind, express or implied.
Preface
Author Introduction
Xiaoliang Zheng: Expert in the Router Design Department of Huawei's Data
Communication Product Line. He joined Huawei in 2005 and has served as a
development engineer, architect, system engineer, and maintenance system
engineer. Currently a system engineer in deterministic IP (DIP) networking
technology research, his extensive working experience has given him a
comprehensive understanding of data communication products.
Wei Shao: As a senior datacom documentation engineer in Huawei, she has long
been engaged in developing technical documentation for key features of
datacom products. She participated in the planning of IPv6 series eBooks and is
dedicated to promoting relevant technologies.
i
Preface
explains how DIP networking works. This book aims to give you a deeper
understanding of the technical advantages of DIP networking.
Intended Audience
This book is intended for network planning engineers, network design engineers,
mid- and senior-level managers at service providers and enterprises, and readers
who want to understand cutting-edge IP network technologies. Because DIP
networking involves many network concepts, readers of this book should be
familiar with IP network basics, such as the IP network architecture, Segment
Routing over IPv6 (SRv6), and Time-Sensitive Networking (TSN).
ii
Preface
Acknowledgments
In writing and publishing this book, we received extensive help and support from
both inside and outside Huawei. We sincerely thank Jinzhu Chen, Meng Zuo,
Zhenbin Li, Zhiqiang Du, Zhaokun Ding, Dawei Fan, Chenxi Wang, Wenjun Meng,
Tao Han, Hongkun Li, Fenghua Zhao, Yue Liu, and other leaders and experts
from Huawei Data Communication Product Line for their guidance and support.
Our thanks also go to Hui Tian, Shujun Han, Danni Ma, and other experts from
China Academy of Information and Communications Technology, who not only
provided valuable technical guidance but also carefully reviewed the book.
This book focuses on the most cutting-edge IPv6 technologies, which are still
evolving and deepening. While we have made significant efforts to ensure
accuracy, there might be omissions or deficiencies in the book. Your comments
and feedback are warmly welcomed.
i
Preface
Table of Contents
ii
Table of Contents
5.3 Interval Mapping ............................................................................................ 22
iii
Table of Contents
Chapter 1
Overview of DIP Networking
1
Overview of DIP Networking
Figure 1-1 Bounded latency and jitter
2
Overview of DIP Networking
Chapter 2
Background of DIP
Networking
Abstract
Traditional IP networks do not provide deterministic latency during E2E
packet forwarding. However, both the industrial Internet and 5G vertical
industries require networks to provide deterministic transport. It is for
this purpose that DIP networks emerge.
3
Background of DIP Networking
Connectionless-Oriented STDM Network
An IP network is connectionless-oriented and implements Statistical Time-
Division Multiplexing (STDM). Figure 2-1 shows how packets are multiplexed.
Packets from different inbound interfaces are first aggregated and then sent
from the same outbound interface. Which packet is scheduled first depends on
the sequence in which they arrive at the outbound interface's queue. Specifically,
packets that arrive first are sent out first.
In synchronous TDM, each user is assigned a fixed time slice and fixed
bandwidth. In STDM, time slices are dynamically divided among users based on
their traffic usage, and the bandwidth used by each user is uncertain and
changeable.
4
Background of DIP Networking
forwarding latency due to severe packet bursts. This results in the long-tail
effect.
5
Background of DIP Networking
Figure 2-3 Traffic bursts at different time scales on an IP network interface
6
Background of DIP Networking
network and an Operational Technology (OT) network, of which the latter is
further classified into a field network and a factory/workshop network. As shown
in Figure 2-4, a field network is responsible for the connection between the
Programmable Logical Controller (PLC), Input/Output (I/O) subcard, sensor, and
actuator, whereas a factory/workshop network is responsible for the connection
between the Supervisory Control and Data Acquisition (SCADA) system and PLCs.
7
Background of DIP Networking
An I/O subcard connects a sensor and an actuator through an industrial bus,
such as Process Field Bus (PROFIBUS) and Control & Communication Link
(CC-LINK). The type of the industrial bus used may vary between field
networks.
A PLC is connected to an I/O subcard typically over an industrial Ethernet
protocol, such as Process Field Network (PROFINET), Ethernet Control
Automation Technology (EtherCAT), or EtherNet/Industrial Protocol
(EtherNet/IP). The type of the industrial Ethernet used may vary between
field networks.
A SCADA system is connected to PLCs typically over a standard Ethernet and
occasionally over an industrial Ethernet.
8
Background of DIP Networking
Figure 2-5 Classification of PROFINET communication types
9
Background of DIP Networking
2.3 Deterministic Transport Required
by 5G to Enable Numerous Industries
In June 2015, the International Telecommunication Union-Radiocommunication
Sector (ITU-R) 5G working group determined the following three major
application scenarios of 5G at its 22nd meeting:
As per the URLLC KPIs defined in 3GPP TS 22.261, services in some industries
have high requirements for low latency, low jitter, and high reliability. For
details, see Table 2-1.
10
Background of DIP Networking
In addition, TS 22.104, TS 22.186, and TS 22.289 defined KPIs for the application
scenarios of network physical control, Internet of Vehicles, and railway
communications. Many of these scenarios require a maximum allowed E2E
latency of 10 ms.
11
Background of DIP Networking
Chapter 3
Value of DIP Networking
Abstract
DIP networking helps facilitate the continuous evolution of the
industrial Internet, advance the access of all industries to 5G networks,
and accelerate new service incubation.
12
Value of DIP Networking
Figure 3-1 Evolution of the Industrial Internet's OT network structure
1. A large amount of field industrial data is obtained and stored on the cloud
through the cloudified PLC system. This facilitates data transmission and
exchange with the SCADA system and even the systems on the IT network,
and subsequently enables industrial big data analysis.
2. The transformation from the physical PLC to IT-based software system is
implemented, which accelerates PLC upgrade and better adapts to the
increasing trend of customized products.
13
Value of DIP Networking
3.2 Advancing All-Industry Access to
5G Networks
The rapid development of 5G has led to fast-tracked digitalization of various
industries, including electric power, transportation, finance, education,
healthcare, mining, and ports. Each industry has a wide range of service
scenarios, which have different requirements on deterministic forwarding
latency. The strict deterministic latency that some of them require on the
transport network makes traditional IP forwarding technologies unviable.
1. New services, such as remote driving, remote mining, and remote medical
treatment, can be deployed no matter the distance, which in turn maximizes
resource utilization and allocation.
2. Existing IT technologies, such as big data analysis and intelligent analysis,
can be utilized to reconstruct existing industry services, improving efficiency.
14
Value of DIP Networking
3.3 Accelerating New Service
Incubation
When the Internet was just established, it would have been hard to imagine that
PCs, mobile phones, watches, automobiles, home appliances, and more could
access the Internet.
Likewise, when mobile phones were first launched, it would have been hard to
imagine that they could offer so many applications to make life easier, such as
shopping, travel, video, financial management, and online courses.
This is where we are now with DIP networking. It is still in its infancy, but its
potential to provide deterministic forwarding capabilities with bounded jitter and
bounded latency has already been demonstrated. It has been proven to meet the
microsecond-level latency and jitter assurance requirements of a variety of
future-oriented services, such as industrial automation, industrial teleoperation,
holographic communication, and vehicle-road synergy. Building on this, it will
play a big role in promoting the smart manufacturing strategy, accelerating
industry digitalization, and ultimately improving economic competitiveness.
Given time, this promising "fertile soil" will gradually grow into a lush,
blossoming garden.
15
Value of DIP Networking
Chapter 4
Overall Architecture of DIP
Networking
As shown in Figure 4-1, the overall DIP networking architecture consists of three
parts: edge shaping, interval mapping, and SRv6 explicit path planning. Edge
shaping and interval mapping are used on the forwarding plane, whereas SRv6
explicit path planning is used on the control plane.
16
Overall Architecture of DIP Networking
Figure 4-1 Overall architecture of DIP networking
Edge shaping shapes traffic on the ingress Provider Edges (PEs) of a network.
Through edge shaping, packets with irregular arrival times are shaped to
different T intervals. Edge shaping eliminates the dependence on strict
packet entrance time. It allows packets to enter a device at irregular times
rather than only at strict intervals. It also supports burst traffic.
Interval mapping is responsible for controlling the latency of packet
forwarding hop by hop on the Provider (P) devices or egress PEs on a
network. Through interval mapping, the packets sent from an upstream
device within an interval of T are sent out within another interval T by the
local device's outbound interface. Interval mapping allows a high
transmission latency on links between devices and therefore supports large-
17
Overall Architecture of DIP Networking
scale networks. In addition, interval mapping only cares about the interval
— not the flow — to which the packets belong. This simplifies the
implementation on the P devices, making it easier to expand their flow
specifications and simplifying the identification of inner flows by the P
devices when various types of tunnel encapsulation are performed on a
Layer 3 network.
SRv6 explicit path planning is used for controlling forwarding paths and
reserving hop-by-hop forwarding resources. This is essential for achieving
deterministic latency.
As shown in Figure 4-2, a packet is shaped to interval T0 on the ingress PE, and a
jitter interval of T is generated. Through hop-by-hop interval mapping with a
fixed offset across multiple transit P nodes, the latency is always deterministic.
On the egress PE, the packet is sent within another interval T. The packet is the
first one in a specific interval on the ingress PE, and becomes the last one in
another interval when it reaches the egress PE due to the packets sent from
other P nodes being placed in front. In this case, a jitter interval of T is
generated. DIP networking can always control the jitter during E2E packet
forwarding within two T intervals, demonstrating its accurate jitter control
capability.
18
Overall Architecture of DIP Networking
Figure 4-2 Jitter implementation of DIP networking
19
Overall Architecture of DIP Networking
Chapter 5
Key Technologies of DIP
Networking
Abstract
This chapter describes the key technologies of DIP networking. Among
them, gate scheduling is the foundation; edge shaping, interval
mapping, and SRv6 explicit path planning are used together to provide
deterministic capabilities; and dual fed and selective receiving is used to
improve network-level reliability.
20
Key Technologies of DIP Networking
Figure 5-1 Edge shaping
21
Key Technologies of DIP Networking
Figure 5-2 Gate scheduling
A DIP flow uses six gates, which are opened one by one at an interval of 10
μs. After reaching gate 5, it cycles back to gate 0 for the next 10 μs. This
process repeats.
A common IP flow uses two gates, which are always in the open state.
Strict Priority (SP) scheduling is configured for the eight gates. When the
gate control queues for a DIP flow are opened, DIP packets (if any) are sent
first.
22
Key Technologies of DIP Networking
Figure 5-3 Interval mapping
23
Key Technologies of DIP Networking
Figure 5-4 SRv6 explicit path planning
24
Key Technologies of DIP Networking
5. Packets of this flow enter the network and are forwarded along the planned
explicit path. The E2E forwarding latency and jitter can then meet the
requirements of this flow.
The network is bound to have a certain failure rate. On the network shown in
Figure 5-5, traffic passes through the ingress PE, P1, and P2 to reach the egress
PE. The traffic traverses three links in total: ingress PE-P1, P1-P2, and P2-egress
PE. If we assume that the reliability of each link is 0.99999, then the reliability of
the E2E link that the traffic traverses is the product of the reliability of the three
links: 0.99999 x 0.99999 x 0.99999 ≈ 0.99997. When high traffic reliability is
required, dual fed and selective receiving can be used to improve the overall
reliability.
On the network shown in Figure 5-6, a traffic flow arrives at the egress PE over
two paths. The path ingress PE-P1-P2-egress PE is path 1, and its reliability is
0.99997. The path ingress PE-P3-P4-egress PE is path 2, and its reliability is also
25
Key Technologies of DIP Networking
0.99997. The reliability calculation method of path 2 is the same as that of path
1. In dual fed and selective receiving mode, E2E traffic forwarding is normal so
long as one of the two paths is normal. Therefore, the formula for calculating
the reliability of dual fed and selective receiving is as follows: 1 – (1 –
0.99997) x (1 – 0.99997) = 1 – 0.00003 x 0.00003 = 1 – 0.0000000009 =
0.9999999991. We can see from the above that dual fed and selective receiving
greatly improves the reliability of traffic forwarding.
5.6 Summary
A DIP network uses edge shaping, gate scheduling, interval mapping, SRv6
explicit path planning, and dual fed and selective receiving technologies to
ensure that the jitter is bounded and small, the latency is bounded, and the
reliability is very high — regardless of when a packet flow reaches the network
ingress and how many hops it traverses before being forwarded by the network
egress.
In industrial Internet and 5G vertical industry scenarios, DIP networks well meet
the requirements of jitter- and latency-sensitive services. The bounded jitter and
latency of a DIP network can be calculated theoretically and guaranteed in real-
world scenarios, ensuring What You See Is What You Get (WYSIWYG).
26
Key Technologies of DIP Networking
Chapter 6
Applications of DIP
Networking
Abstract
DIP networking has been tested in China Environment for Network
Innovations (CENI) and China Telecom Shanghai's cloudified PLC
project, where it has shown excellent results. These results have been
released at the Future Network Development Conference and the
Global Network Technology Conference, attracting wide attention from
the industry.
6.1 CENI
Huawei and Nanjing's Purple Mountain Laboratories (PML) are long-established
partners and co-conducted DIP networking tests on the CENI. As shown in Figure
6-1, the test traffic first traveled from the PML in Nanjing to the CENI lab in
Beijing through numerous network nodes, including Hefei, Wuhan, Zhengzhou,
and Shijiazhuang, before traveling back to the PML through the same network
27
Applications of DIP Networking
nodes in the reverse order, spanning a total length of 2000 km. Bidirectional
interference flows were injected using testers at the two sites.
Figure 6-2 shows the test results: The E2E jitter is large on a traditional IP
network but small on a DIP network.
28
Applications of DIP Networking
Figure 6-2 Latency of the CENI loopback test between Beijing and Nanjing
29
Applications of DIP Networking
Figure 6-3 Jitter comparison of the CENI loopback test between Beijing and Nanjing
On August 15, 2020, the PML released the world's first test results on
deterministic WAN innovation at the 4th Future Network Development
Conference. The PML stated an E2E experimental jitter of less than 30
microseconds was achieved for 2000 km network transmission through 13
network nodes between Nanjing and Beijing. This was a world first. They also
noted that this technology lays a solid foundation for implementing super-long-
distance control. It's a milestone in industrial Internet development, and will
pave the way for the Internet to achieve even greater success in the real
economy than in the consumer field.
30
Applications of DIP Networking
Figure 6-4 Networking test for China Telecom Shanghai's cloudified PLC project
As shown in Figure 6-5, the test results demonstrate that for traditional IP
forwarding, the latency is low when the load is light and is high when the load is
heavy. However, for DIP networking, the latency is always low regardless of
whether the load is light or heavy. Further to this, as shown in Figure 6-6, when
the network is heavily loaded, the jitter of traditional IP forwarding is large, with
obvious fluctuations. However, for DIP networking, the latency is stable, with
little jitter.
31
Applications of DIP Networking
Figure 6-5 Latency comparison between traditional IP and DIP forwarding in light and heavy
load scenarios
32
Applications of DIP Networking
Figure 6-6 Latency comparison between traditional IP and DIP forwarding in heavy load
scenarios
33
Applications of DIP Networking
Chapter 7
Future Prospects of DIP
Networking
Abstract
Even the largest trees start as a seed.
There are many factors that determine whether a technological concept
takes shape. Broadly speaking, national policies and industry standards
are required. Narrowly speaking, key technology breakthroughs are
needed. More importantly, there must be a consensus around the
concept. The same is true for DIP networking.
National Policies
Over the past two years, China has released several influential documents on
accelerating digital industrialization and promoting economic and social digital
transformation.
34
Future Prospects of DIP Networking
reconstructing enterprises' intranets and promoting the convergence of IT and
OT networks.
Industry Standards
Over the past two years, China has approved the DIP networking standards
initiation work relating to the overall architecture and technical requirements for
DIP networking of telco networks as well as DIP technical requirements on telco
network devices.
Consensus Formation
DIP is supported by national policies, related industry standards are being
formulated, and breakthroughs in key technologies are being made. As such, we
believe that with the propagation of related technical knowledge, a consensus
on DIP networking will eventually be reached among all stakeholders in the
industry to promote its comprehensive application.
35
Future Prospects of DIP Networking
Contact Us
networkinfo@huawei.com
36
TOF/TOT1