Highly customizable video surveillance platform for manufactures and system integrators

Intelligent Video Surveillanceintegrated hardware and software solutions

for manufactures and system integrators

10/04/2023 1www.synesis.ru

Contents

1. Market overview2. TI’s DaVinci hardware reference designs3. Open API Linux ONVIF/PSIA middleware4. End-to-end integrated solution5. Edge video analytics modules for DSP6. Applications and use-cases7. Business models8. Unique selling position

10/04/2023 www.synesis.ru 2

Key trends in video surveillance• High definition / megapixel resolution• Hybrid DVRs - a less expensive migration to IP• H.264 cuts storage costs compared to MJPEG• Emerging standards such as ONVIF and PSIA

overcame the interoperability barriers• Embedded video analytics becoming a major

force in future video surveillance• Intelligent storage in serverless computing• Video surveillance as service10/04/2023 3www.synesis.ru

Synesis intelligent video framework• Unified video

module based onTI’s DaVinci DM6467

• Extension modulesfor HD IP-camera & encoderwith embedded analytics

• Comprehensive middleware with ONVIF and PSIA support

• Powerful video analytics 1080p

embedded HD video analytics

10/04/2023 4www.synesis.ru

Unified video processing module• Design goal: development

and manufacturingcost/risk reductions

• DDR2 up to 256 Mb• NAND flash up to 2 Gb• All the DM6467 functions

accessible viathree 80 pins connectors

• Board support package• Catalogue OEM price $200

80 х 55 х 14 mm

10/04/2023 5www.synesis.ru

Balanced system configurations

HD Video analytics camera

• HD camera– 1-5 MP sensors– 1080p/720p H.264 encoding– Dual streams– Digital image stabilizer– Video analytics

Video analytics encoder

• Dual channel encoder– 1-2 PAL/NTSC inputs– D1 H.264 encoding– Digital image stabilizer– Video analytics

• Quad channel encoder

10/04/2023 6www.synesis.ru

HW-6467-CORE Video processing module

10/04/2023 7

Full board support package (BSP) and expansion board design guide included

www.synesis.ru

10/04/2023 8

HW-6467-CAM Camera extension board• PoE consumption < 10W• 85 x 55 mm form factor• -40⁰...+85 ⁰ C

www.synesis.ru

HW-6467-CORE and CAM assembled

10/04/2023 9www.synesis.ru

Dual channel video analytics encoder

04/10/2023 10

• Two analogue inputs (BNC)• Two managed outputs (BNC)

and digital video over IP• H.264 & MJPEG encoding• Embedded video & audio analytics• POE+ and backup power• ONVIF 1.01 support• - 40⁰...+50⁰ С• Lightning guard

ANALOG + IPHYBRID TECHNOLOGY

Dual channel video analytics encoder

Edge device architecture

1080p

10/04/2023 12

Codec Engine ServerMiddleware

DSP Core

DSP/BIOS

PSIA

ONVIF

DSP/BIOS Link

Mid

dlew

are

API

Vide

o An

alyti

cs A

PI

Video analytics

G.711

MJPEG

H.264Encoding

AAC

Video filtersMW Controller

Config ManagerEvent Manager

StreamerDisplay (opt)

Analytics ProcessSoftware Upgrade

PTZ Manager

ARM Core

Linux

Sensor driver TCP/IPARM/DSP

Communication

Third-party softwarethttpdMTD SSHBusybox

Third-party Interface

www.synesis.ru

Choice of codecs fromTI’s partner ecosystem

Supplier AdvantagesTexas Instruments

MJPEG and audio codecsat no extra cost

Human Monitoring

Quality main profile (MP)H.264 AVC and antishaker

Ittiam Multi-channel MP H.264 AVC encoderHD H.264 AVC and SVC encoders

Radvision H.264 Scalable Video Coding (SVC)

10/04/2023 13www.synesis.ru

Synesis’ ONVIF middleware overview

• Native ONVIF 1.01 support– All MUST and most SHOULD functions– Discovery, Device, Media, Imaging, Analytics, Events

• Multiple channels & advanced video analytics• Highly configurable and customizable

– Services, GUI, API, Streamer, optional PSIA module• Secure firmware update• Availability: DM6467 – now, DM36x – AUG-2010

Middleware component diagram

10/04/2023 www.synesis.ru 15

Device Web Service

Events Web Service

Analytics Web Service

Media Web Service

PTZ Web Service

WS-Discovery Web Service

HTTP/HTTPSServer

LAN

Network Video ClientNetwork

Video Client...

...

LIBONVIFservice

(daemon)

MAPIlibrary

Streamerapplication

Operating SystemAPI

USERAPPLICATION

Onvif Application Development Suite Copmonents

Configurationstorage

USER NETWORK VIDEO DEVICE

Imaging Web Service

End-to-end integrated solution

10/04/2023 www.synesis.ru 16

SynesisHD video analytics

camera

SynesisHD video analyticsnetwork video recorder

IP networkcarrying

media streams and metadata

3rd partyvideomanagementsystem

legacy analoguecameras

Synesis video analytics

encoder

Synesis’ DK-6467-CAM integratedwith Milestone XProtect via ONVIF

Itiam H.264 AVC Encoderon Synesis HW-6467-CORE

Off-the-shelf evaluation kits

Part number:DK-6467-ENC2

Part number:DK-6467-CAM

Synesis DSP algorithm portfolio• Video filters

– Digital antishaker with subpixel compensation• Tamper detectors

– Reorientation, over/under exposure, blurring,loss of signal, loss of video synchronization

• Universal motion detector and object tracker– Operational alerts– Event recording – ONVIF-compliant metadata streams

10/04/2023 19www.synesis.ru

Digital image stabiliser (antishaker)• Eliminates video shaking

caused by wind and industrial vibrations • Essential for analytics performance• Differentiates the camera movements

from scene background/foreground movements

Tampering and malfunction detectors• Loss of signal• Obstruction• Out of focus and lens

dusting• Blackout and overexposure • AE failure• Lighting

failure

i-LIDS® approved video analytics

• i-LIDS® approved primary detection system for operational alert use in sterile zone monitoring applications

• i-LIDS® approved event based recording system for sterile zone monitoring applications

10/04/2023 www.synesis.ru 22

Metadata sent over IP network / ONVIF• Event type, data and time• Zone or tripwire number• 2D object feature:

– Position, size, area, speed• Real 3D features

– Estimated from 2D featuresusing calibration data

• JPEG frame image withobject trajectory annotation

Video analytics calibration

• Two human figures define scale & angle

• Drag’n’drop calibration

• Tracking region

• 2D to 3D coordinate transform

Video analytics parameters1. Service detectors2. Antishaker3. Object tracker

1. Contrast sensitivity2. Special sensitivity3. Min. stabilisation time

4. Object filters1. Maximum object speed2. Min and max areas

1

2

3

4

Event handling scripts• PTZ-targeting• System notification

over IP network to VMS– Sound and visual alarms, SMS etc

• ‘Dry contact’ signal• High quality recording to local

or remote storage (NAS)• Analogue output to legacy

systems (matrix or DVR)

Applications and use-casesVideo analytics camera and encoder

10/04/2023 www.synesis.ru 27

Self-contained intelligence for perimeter security

Integrated solution:1. Embedded video analytics2. Automatic PTZ targeting3. Unlimited, multizone sensor

integration (I/O, RS485)4. Active illumination5. Two-way intercom6. Backup power &

battery management MB

Cost-effective upgrade oflegacy analogue infrastructure

• No cable or camera replacement required• Increase storage efficiency by 10-100 times• Automatic operational alerts• Intelligent search using recorder events• Future proof network surveillance via ONVIF

Local/backup storage• Detachable video storage

– USB 2.5” hard drive or flash memory• Accurate timestamp (NTP sync)• Backup storage if NAS not available• Portable player, video can be played on any PC

Extended perimeter,sophisticated landscape

Strategic infrastructure

Railway safety and security

10/04/2023 www.synesis.ru 33

ATM embedded intelligence & recorder

• Fraud prevention– card tampering, skimming, ATM breaking-in

• Robbery• Vandalism

Petrol stations

10/04/2023 www.synesis.ru 35

Unique selling position1. Fully embedded analytics

– Real-time processing of uncompressed video– HD/Megapixel resolution– Highly scalable

2. Outstanding video analytics performancein challenging outdoor environment

– Developed for severe Russian climate– i-LIDS® approved primary detection

3. Wide interoperability– ONVIF compliance, third party protocol integration

Synesis business models

1. Turn-key solutions / OEM-product supply2. Hardware design and software licensing

– Two options: one-off payment or royalties– Upfront payments can be avoided completely– Customer is flexible in building their own

hardware and software without vendor lock-in

3. R&D contracting and consultancy4. Joint ventures to develop a vertical solution

10/04/2023 37www.synesis.ru

Codec Engine ServerMiddleware

DSP Core

DSP/BIOS

PSIA

ONVIF

DSP/BIOS Link

Mid

dlew

are

API

Vide

o An

alyti

cs A

PI

Video analytics

G.711

MJPEG

H.264Encoding

AAC

Video filtersMW Controller

Config ManagerEvent Manager

StreamerDisplay (opt)

Analytics ProcessSoftware Upgrade

PTZ Manager

ARM Core

Linux

Sensor driver TCP/IPARM/DSP

Communication

Third-party softwarethttpdMTD SSHBusybox

Third-party Interface

Potential for product differentiation• Custom enclosures & lenses• Custom extension boards• Custom embedded software

– Differentiator features– Middleware integration

via open API– Custom protocol support– Web user interface

• Custom video filtersand analytics via xDAIS

10/04/2023 38

ALL MODULESCAN BE

CUSTOMISED

www.synesis.ru

Summary: benefits of the framework1. Complete turn-key solution

– hardware design + middleware + codecs + analytics

2. Significant potential for product differentiation3. Industry standard compliance - ONVIF and PSIA4. Development and manufacturing cost/risk

reductions thanks to the unified module design5. Power/price balanced configurations

for camera and multi-channel encoders

10/04/2023 39www.synesis.ru

Thank you!

10/04/2023 40

www.synesis.ru

Nikolai Ptitsynnp@synesis.ruskype: nptitsynmobile: +7 (916) 978-8429office: +7 (495) 660-7747

www.synesis.ru