HIKVISION

AI Product & Solution

Introduction
Brandon Chen
 1. Preface of Hikvision AI Introduction
2. Face Recognition Applications

3. Human Body Analysis Applications

4. Human Behavior Analysis Applications

Content 5. Vehicle Analysis Applications

6. Perimeter Protection

7. Smart streetlamp
 History of the Industrial Artificial Intelligence Revolution

First Revolution Second Revolution Third Revolution Fourth Revolution

Information Systems Expert Systems Deep Learning

Logical Reasoning Knowledge construction Abundant big data Machines have conditioned
Symbolized by: Symbolized by: and search in a system Strong computing ability reflections, and machines
Deep learning algorithms develop complex intelligence
Steam-powered and Internal-combustion
1956 Dartmouth Rosenblatt Rumellhart and Hinton formally
other engines engine conference invented neural McCleland found proposed deep AI Applications:
defining artificial network learning in 2006 and
BP algorithms in
intelligence perception in
1986. Deep conducted empirical • Self-learning
1957
1784 1870 Blue study AlphaGo
• Self organization
First textile machine First production line:
• Self-adaption
An expert system cannot learn on its Training-based
Cincinnati slaughterhouse Failure of automated translation own. Capacity of neural network
autonomous learning
Perception is too simple resources is insufficient. • Self action

Symbolized by: 1969

• Internet First PLC
• Computer
Mechanization Electrification Digitization Intellectualization

Late 18th Century Late 19th Century 1950s 1980s Today

Technical Development of the Hikvision Research Institute (HRI)

Deep learning Deep learning AI technology begins to

The algorithm team is Basic intelligence and
initiated, AI contributes to and accelerate in many industries
formed and the intelligent industry intelligence
research begins enables the security to solve industrial pain points
algorithm research begins algorithms released
industry

2006 2007- 2012 2013 2014-2015 2016-2020

Passenger flow License Video License Clustered training Open AI platforms

statistics number structuring number platforms
recognition recognition Behavior analysis
Traffic incident Binocular and facial DarkFighterX
detection Facial camera recognition cameras Audio recognition
recognition based on DL
ATM protection Smart265 Self-driving vehicles Natural language
Perimeter …… processing
…… protection Multi-dimensional
big data ……
…… ……
Three Key Factors for Artificial Intelligence

Basic Data
The volume and diversity of data are growing rapidly.
Hikvision has accumulated abundant CCTV-based data.

Computing Ability
Data Computing Computing abilities are growing along with the
diversification of AI chips. Collaboration with the world’s
first-class GPU vendor.

Algorithms
Algorithms
Deep learning research continuously drives algorithm
optimization. More than 1,000 engineers have now been
working on AI algorithms for several years.
Hikvision’s Advantages in Artificial Intelligence

Algorithm Innovation Training Platform Rapid Customization

Action Recognition: No.1 1. Thousands of nodes in high-
Moments in Time Challenge performance training platform with Thirteen years of algorithm R&D,
1 thousands of large-scale researchers
2018 AI training algorithms developed
in-house. supporting flexible customizations.
Text Recognition: No.1 2. Industry leading multi-card system
1 ICDAR 2017 improved training efficiency.
Manufacturing CCTV Buildings
3. Proprietary deep learning training
Object Detection: No.1 framework supports a variety of
Education Police Agriculture
mainstream training frameworks.
1 PASCAL VOC 2016
Energy Traffic Economy
Scene Classification: No.1
Open AI platform service, zero-base
ImageNet 2016 1 user one-stop algorithm training
platform, high-speed online intelligent
Multi-object Tracking: No.1 applications

MOT challenge 2018 1

Vehicle Detection: No.1

KITTI 2018 1

Low-Illumination Target Detection: No.1 DARWIN

1 UG2+ Challenge 2019
Abundant AI Products

AI
Products

Front End Back End Servers VMS

p Intelligent PTZs Big Data Servers HikCentral

Behavior Analysis Master
NVRs
Fusion Intelligent
8 IPCs Full Analysis
Servers

HikCentral
7 Intelligent IPCs DeepinMind NVRs Enterprise
Intelligent Fusion
Servers

6 Special IPCs

Behavior Analysis HikCentral

Servers Professional
3 AcuSense IPCs
One stop solution provider
Abundant AI Success Stories

Retail ANPR Management, Thailand Shopping Mall List Alarm, Malaysia Safe City Vehicle Management, South Africa

Exam Facial Access Control, Uzbekistan Building Facial Access Control, Ukraine Smart Retail, Poland
 1. Preface of Hikvision AI Introduction

2. Face Recognition Applications

3. Human Body Analysis Applications

4. Human Behavior Analysis Applications

Content 5. Vehicle Analysis Applications

6. Perimeter Protection

7. Smart streetlamp
Up to faces that appear in the screen can be detected and captured.
 List alarm
 Stranger alarm
 High frequency alarm
 Face attendance
 1 V 1 comparison
 Identity verification
 Search by face picture
 Face attribute analysis and search by face attribute
 Personal archive
 Privacy protection
• Recognizing faces in real time and giving
alarms on people in face libraries, such as
VIPs and blacklists
• Blacklist alarm: preventing potential criminals
• VIP detection: recognizing potential customers
to help boost the sale Captured face Compared with blacklist/VIP list Alarm Linkage

• Scenarios: retail stores, banks, stations, office Matched! Alarm!

buildings, hotels, etc.

Retail Bank

Blacklist Alarm VIP Detection

Station Office Building
• Recognizing faces in real time, gives alarms on
strangers (people that are not in the face library)
• Keeping strangers away from open but sensitive
areas.
• Scenarios: important places where only insiders
are allowed to enter, such as office buildings, Captured face Compared with blacklist/VIP list Alarm Linkage
Not Matched! Alarm!
residences, laboratories, warehouses, vaults, etc.

Warehouse Vault

Laboratory Office Building

• Choosing one picture (captured or uploaded picture),
comparing it with all the pictures in the face library
• Usually compared with face library of criminals or
population database
• Quickly confirm the identity of someone Choose one Get the picture with highest
• Scenarios: airport customs, subway stations, police picture
Compared with face library
similarity,
Confirm identification
stations, etc.

Station Main road

• Searching by attributes of faces, and getting all the Gender
matching captured pictures. Age
Glasses
• Face attributes (optional): gender, age, glasses,
Smiling
smiling, wearing mask Wearing mask
Finding all the
• Quickly finds a target captured pictures that
Choose attributes
meet these attributes

Shopping mall Residence

Station Business park

 • Human face/body region
Video info. and marker info.
stream • Realize the function of
Live View mosaic live view through
inherent play library
DeepinMind NVR HikCentral
(Customization) (Customization) • Select mosaic targets
• Drawing mosaic on
• Enable mosaic channels face/body area
• Enable fixed area mosaic
• Overlay coordinate area info. Export Video
Face Capture
3 Series AcuSense DeepinView 7 DeepinView 8 DF Series PTZ 8 Series – Fusion iDS-2PT9A144MXS-D/T2
Cameras Series Series Cameras Intelligent

Face Recognition

DeepinView 7 DeepinView 8 8 Series – Fusion iDS-2PT9A144MXS- DeepinMind NVR Intelligent Fusion Full Analysis Server
Series Series Intelligent D/T2 Server
 1. Preface of Hikvision AI Introduction

2. Face Recognition Applications

3. Human Body Analysis Applications

4. Human Behavior Analysis Applications

Content 5. Vehicle Analysis Applications

6. Perimeter Protection

7. Smart streetlamp
Human Body Attributes Analysis

In CCTV monitoring, the camera can't always capture clear face images, sometimes even just capture
back images, which is a challenge to identify or search target. However, different person with different
attributes such as age, gender, cloth color, etc. These data can be extracted by the devices to realize
abundant applications.

Human body attributes extraction

Teenage Youth Middle-aged Elderly

Wearing
Male Female Time Glasses

Riding Bike Top color: Red, Yellow,

or Not Green
Blue, White, Black
Smart Human Body Search

• Search by attributes: gender, age, • Search by picture: uploading target

glasses, tops color, baggage, bicycle image (Up to 16 MP(single picture size ≤ 8 MB), PNG, TIF,
BMP, JPEG, and static GIF)
Products Package

Product image Model name Matching products Mark

iDS-2CD70XXG0 Standalone solution, I series NVRs Video structuration only

iDS-2CD71XXG0
iDS-2CD75XXG0 or Hikcentral VMS.
iDS-2CD7AXXG0

Standalone solution, I series NVRs Video structuration only

iDS-2CD8CXXX or Hikcentral VMS.

iDS-2PT9A144MXS- Standalone solution, I series NVRs 4X PTZ lens can capture human body
D/T2 or Hikcentral VMS. up to 151.7 meters according to DORI.

DeepinMind series DeepinMind NVR supports 4 channels;

NVR IP cameras; Hikcentral P DeepinMind Super NVR supports 12 or
24 channels;
DS-IX2001-A3U/X 30 channels video structuration;
DS-IX2003-A3U/X IP cameras; Hikcentral P/E 90 channels video structuration;
Cluster up to 5 pieces.
Cluster storage; big data 32 channels video structuration;
DS-IF1032-03U/X IP cameras; Hikcentral M No limitation for cluster.
Dual Lenses People Counting

 3D binocular stereo vision and deep learning algorithms.

Multiple cameras configuration on Hikcentral VMS.
 Height filter and children counting.
 Reverse alarm, one camera covers from 2.1—6 meters.
 Data stored in flash directly, up to 1 million data. DS-2CD6825G0/C-I(V)(S)
DS-2XM6825G0/C-IV(S)(M)
 OSD data can be configured to clean every day or not clean.
Passing by Passing by Counting 1
Dual Lenses People Counting

Flexible statistics including daily, weekly, monthly, annual date (people entered, exited and children)
can be showed as table, bar and line separately. It can be exported as an excel file to Hikcentral
VMS or 3rd party VMS.
Face-Recognize People Counting

 Filter staff to improve accuracy

 Filter people who appeared multiple times to
improve accuracy

iDS-2CD70/71/75/7A series Hikcentral V1.5  Output report, showing the number, gender
and age group
 Line or region crossing based counting
People Counting Products Package

Product image Model name Matching products Mark

DS-2CD63C5G0-I(V)(S) Standalone solution, I series NVRs Ideal for super market, store, office, etc.
DS-2CD6365G0-I(V)(S) or Hikcentral VMS. When customer needs heat map or
360° monitoring, we can use counting
With –V Model Without–V Model

as a benefit function only.

Standalone solution, I series NVRs Counting based on face recognition, it

iDS-2CD70/71/75/7A or Hikcentral VMS. is ideal for some places need to filter
series staffs or analyze customers’ attributes.

DS-2CD6825G0/C-I(V)(S) Standalone solution, I series NVRs The most professional/trending people

DS-2XM6825G0/C- or Hikcentral VMS. counting solution, it can be used in
IV(S)(M)
harsh scenarios such as low light
condition, busy customer flow.
 Heat Map

Deeper color,
more people

Customers
quantity

Dwell time

Customer quantity and dwell time can be displayed on the image intuitively, which helps owners to analyze where
was most visited.
Global heat map is supported on customized Hikcentral VMS. Both customer quantity and dwell time can be
displayed on heat map or chart. Camera can send data to back-end devices every minute to daily. SD card or
NAS are required for heat map function.
Installing from height 2.5—4.5 meters and it covers 10 meters range.
Matching Products

AI powered fisheye camera will detect human

and allocate ID for everybody entering the
image, so the accuracy is higher compared
with normal solutions.

Deep learning

Human

With –V Model Without–V Model

Targets Classifying

DS-2CD63C5G0-I(V)(S) Hikvision
DS-2CD6365G0-I(V)(S) AI Chips Deep Learning Algorithm
Others
 1. Preface of Hikvision AI Introduction

2. Face Recognition Applications

3. Human Body Analysis Applications

4. Human Behavior Analysis Applications

Content 5. Vehicle Analysis Applications

6. Perimeter Protection

7. Smart streetlamp
Behavior Analysis Overview

However!

Behavior analysis is necessary. Behavior analysis is a difficult task.

• Some behaviors are dangerous • 24/7 hours video surveillance
• Some behaviors are forbidden • Lots of monitoring channels
• Some behaviors require special attention • Limited monitoring screens
• Limited number of staff on duty
• Behavior analysis takes a lot of time to observe

Hikvision deep learning technology solves the problem of efficient behavior analysis!
 Hikvision Behavior Analysis Functions

Not wearing hard hat detection Falling-down detection

Absence detection Line crossing detection

Sleep on duty detection

Intrusion detection
Using mobile phone detection
Region entrance detection
Abnormal people detection
Region exiting detection
People gathering detection
Crowd density alarm
People running detection

Violent motion detection Real-time people counting

Physical conflict detection Overall people counting

Not wearing hard hat detection

• Detects whether a person wears a hard hat or not, despite the color.
• Timely triggers alarm when someone does not wear a hard hat, which is essential
to ensure safety. No hard hat
• Facial recognition is supported ( only by DeepinMind NVR), identifying who is Alarm!
not wearing a hard hat, which benefits management.
Absence/ sleep on duty detection

• Detecting the movement of a person on duty in the detection Three Modes:

area who is absent or staying motionless. • Absence
• Application Scenarios: fire control room, nurse station, • Sleep on Duty
board post, service center, monitoring center, etc. • Absence or Sleep on Duty

Fire Control Room

People gathering detection

• Detecting gathering behavior of people in street scenario.

• For example, during the COVID-19, people are suggested to stay at home, this function could help to detect if there are
people gathering in public area.
• Application Scenarios: street, square, park, office building, etc.

Square
Physical conflict detection

• Detecting the violent motion of people in the scenario, such as

fight.
• Application Scenarios: bank, school campus, street, etc.

Bank
Falling-down detection

• Detecting people in the area who falls down suddenly and

give an alarm in time. √
• Making good use of video surveillance, no need the elderly
to wear any device.
• Application scenarios: nursing home, community with ×
many empty nesters, hospital, street, etc.

Nursing Home
 1. Preface of Hikvision AI Introduction

2. Face Recognition Applications

3. Human Body Analysis Applications

4. Human Behavior Analysis Applications

Content 5. Vehicle Analysis Applications

6. Perimeter Protection

7. Smart streetlamp
DeepinView ANPR Cameras

Applications: 5-10 m Workflow

For short distance scenarios,
such as entrance & exit, indoor
driveway.
Network
Camera
Applications: 10-150 m
For longer distance scenarios,
such as street, parking lot and
etc.
PTZ DF
camera Typical Performance for
On camera alone Entrance & Exit, wide
angle white light models.
Support vehicle speed ≤
160 km/h, Capture Rate >
99%, Recognition Rate >
98% (European and
Intelligent Fusion Normal Camera Russian-Speaking
Server Regions)
Applications: old project without ANPR camera
Server can recognize plate number based on
videos.
On Server
Vehicle Attributes Analysis

HIKVISION DeepinMind video structuralizaton analysis server DS-

IF1032-03U/X  Real time video structuralization
analysis
 History video structuralization analysis
Video Stream  Upload video structuralization analysis

Vehicle Features

ANPR Car Color Brand

Plate Type Sub Brand Sun Shield

Danger Car Body Color Safety Belt

Vehicle Attributes Analysis – Quick search

X series NVR
iDS-7700NXI-I4/X (B) DeepinMind Super NVR
2nd 7 series 8 series V4.22.200 Attributes
iDS-9600NXI-I8/X (B)

Bicycle

Vehicle Type
Vehicle Color

• Search by appearance: vehicle

type, vehicle color, plate number
• Detects 30 vehicles at most at
same time
Illegal Parking

H.265 Codec Illeagal Vehicle Event

GPU-supported Deep
Saving bandwidth greatly
Detection
Learning Algorithm

Function Illegal Parking

Rapid focus Wrong direction driving
Features
Detecting illegal parking Instant focus with Illegal lane change
and providing colorful no blur
images with street lamps Over lane line
Wrong U-turn
iDS-2VS435-F840-EY

24/7 working hours Vehicle plate number Real-time alarm

Weather adaptive
accurate recognition and record
Product List

Vehicle Attributes
Analysis X series NVR
DeepinMind Super NVR iDS-7700NXI-I4/X (B)
V4.22.200 iDS-9600NXI-I8/X (B)
DS-IF1032-03U/X Intelligent Fusion
Server

ANPR Camera 8 series

（June） 2nd 7 series
DF series

Illegal Parking Camera

iDS-2VS435-F840
 1. Preface of Hikvision AI Introduction

2. Face Recognition Applications

3. Human Body Analysis Applications

4. Human Behavior Analysis Applications

Content 5. Vehicle Analysis Applications

6. Perimeter Protection
7. Smart streetlamp
Perimeter Protection

Pain Points of Traditional Solution for Perimeter Protection

False Alarm by Animal False Alarm by Light False Alarm by Rain

Too Many unimportant alarm information

Low alarm effectiveness

High cost trouble for end -users

Low product satisfaction

Too Much Information!

False Alarm by Spider Web False Alarm by Shaking
Leaves
Perimeter Protection

✘ ✔
1
Intrusion Line Crossing Storage
ALARM!
Detection Detection Target Classification Reduction

DeepinMind NVR
Normal Cam
Storage
Human Recognition  Search by
picture

The intelligent algorithm in DeepinMind NVR can identify the human presence in the
image, improving the alarm accuracy ,and you can search target more quickly.
Perimeter Protection – Target Classification

Reducing search time, and saving labor costs.

All project cameras and
Based on deep learning technology, it can detect and classify DeepinMind NVR
support target
human and vehicle accurately, and automatically track the
classification.
classified targets. DE7A PTZ camera
Intrusion Detection support audio & light
alarm.
 Zone intrusion
 Line crossing
 Human and vehicle
classification
Line Crossing Detection  Audio alarm and strobe light
alarm
 Auto tracking

Human and vehicle classification

Perimeter Protection - Audio Alarm Selectable

(Siren)
Warning, this is a restricted area.
Warning, this is a restricted area. Please keep away!
DS-2DE7A232MX-AE
Warning, this is a no-parking zone.
Warning, this is a no-parking zone. Please keep away!
Attention please! The area is under surveillance.
Welcome! Please notice that the area is under surveillance.
Welcome!
Danger! Please keep away!
(Siren) Danger! Please keep away!

* Audio alarm customization available

Extraordinary Imaging
More vivid, more detailed

• Superior low-light performance

0.0005 lux DarkFighter (8-inch
camera)

• Up to 42x large zoom ratio

• 24/7 colorful imaging

• F1.0 super-large aperture

• Advanced sensor
• Active alignment technology
International Product and Solution Center
Product List

3 series 5 series 7 series DF PTZ series DeepMind NVR

Intrusion / line Y
Y Y Y Y
crossing (except /F model)

Target Y
Y NA Y Y
classification (except /F model)

audio & light

Part NA NA DS-2DE7A232MX-AE NA
alarm
Auto-tracking
NA NA NA Y NA
3.0
Suitable for normal
NOTE For new project
IPC camera
 1. Preface of Hikvision AI Introduction

2. Face Recognition Applications

3. Human Body Analysis Applications

4. Human Behavior Analysis Applications

Content 5. Vehicle Analysis Applications

6. Perimeter Protection

7. Smart streetlamp
Current Pain Point

1. The non-adjustable brightness of streetlamps will lead to high power

consumption. And these energy losses cannot be monitored and queried.

2. Manual Inspection and verification are required during streetlamps

maintenance, which is low efficient and consume lots of human labor.

3. The lack of design style and the repetitive

construction of streetlamps affect the municipal
appearance.
Solution Design
Smart Community Smart Park Safe City Smart Traffic Urban Management

Vertical
Applications

Smart streetlamp Management Platform (HikCentral-P)

Intelligent Lighting Intelligent Security Information Publish
Smart
Lighting Control Video Monitoring Advertising Release
streetlamp
Strategy Control Emergency Alarm Convenient Service Platform
Map Based Control Voice Broadcast Road Traffic

Energy Consumption Statistics

Private Network
Integrated smart Independent smart
streetlamp streetlamp
Central control box
（ODH）

Power & Network Supply

ZigBee streetlamp

NEMA
LED Camera Speaker Emergency Screen
Alarm
*Customization
Intelligent Applications –
Energy Management 19：30-00：00 00：01-02：30
2：31-03：30

Time
Period
Adjusting

80% Brightness 30% Brightness

Traditional Light

Strategy Time period switch, brightness adjustment

Configuration
LED Light

LED Light + Control

Device

Grouping
Energy saving advantages Management

On-interval Two interval

Group lighting strategy

 Intelligent Applications – Lighting Control

Strategy Control Light Control Base On MAP Consumption Search

Flexible configuration of light on/off time, brightness Based on GIS map, realize the lighting control of on/off, brightness,
Support display energy consumption by equipment;
percentage make is possible for energy saving. blink test and call test to get light information;

On Off Blink Get Info

Turn On

Turn Off

Turn Up The
Brightness
Turn Down The
Brightness
 Intelligent Applications – Lighting Control - Device Management

• Lighting Device management.

Resource management and streetlamp management

• streetlamp Stragety Management

Flexible configuration of light on/off time, brightness, etc
 Intelligent Applications – Light Control Base On MAP

Based on GIS map, realize the lighting

control of on/off, brightness, blink test and
get light information;
Intelligent Streetlamp Data Visualization
Intelligent dashboard supports visualization and analysis of lighting data so as to
effectively improve the efficiency of maintenance

 Energy consumption analysis

 Street map of O&M

 Facility failure analysis

 Operating condition statistics

 Customizable for more features…

 Smart Streetlamp
Environ. monitor Smart Lighting
• Air quality Index • Streetlamp
• Meteorological Index • Lighting Controller
 Make the idle property of city
facilities from single function to

•
Video Monitor
Face Recognition
be sustainable management.
• Violations Trapping
IP broadcast • Intelligent Parking  The smart streetlamp system
which provides GIS, physical

Info. Display Wireless Comm. installation, electric supply and

• Traffic Signs • Micro Base Station
•
•
Public Information
Parking Information
• Wi-Fi AP wireless network could help the
• Advertisement
plenty of city facilities set up
the sense system to suit with
Emergency

•
Energy Unit
EV Charging
• Alarm Station
smart city.
• USB Charging
Smart Streetlamp Return
Module Profit Point Department

Provide urban environmental

Environmental monitoring Meteorological Department
data services
LED Streetlighting Saving 80% Power Energy company
Provide urban safety CCTV
CCTV MOI
resources
Screen Advertisement Income Advertising company

Toll Gate Road toll Traffic

IP Broadcast Advertisement Income Advertising company

Wifi AP City Internet Service Telephone company

Provide urban safety alarm
Emergency Alarm MOI
services
Provide electric vehicle
Charging Unit Energy company
charging services
 THANKS
Accelerate Your Business with AI