37
Media Streams in IOT Girls in Technology , powered By @altanai In collaboration with Campus Diaries , Workbench Projects & Lean In chapter

Media Streams in IOT via WebRTC

Embed Size (px)

Citation preview

Page 1: Media Streams in IOT  via WebRTC

Media Streams in IOT

Girls in Technology , powered By @altanai

In collaboration with

Campus Diaries , Workbench Projects & Lean In chapter

Page 2: Media Streams in IOT  via WebRTC

Hello! 4 Years in Telecom Industry1 Year in R&D on Media Codecs ,IOT and RoboticsInventor of Ramudroid and author of WebRTC Integrator’s Guide. Frequently write , discuss and contribute to Open source software.

Website : http://altanaitelecom.wordpress.com

You can find me at @altanai

I am Altanai

Page 3: Media Streams in IOT  via WebRTC

Contents

1. Impact of IOT

2. Timeline

3. Enablers

4. Streaming Multimedia

5. WebRTC

6. Building Home surveillance

7. Ramudroid

8. Bottlenecks for media Streaming

Page 4: Media Streams in IOT  via WebRTC

Impact of IOT

MonitoringControlOptimizationAutomation

It can be part of engineering , manufacturing , field services , from plants to oil fields , from roadways and smart cities to utilities

Page 5: Media Streams in IOT  via WebRTC

TimelineJourney and statistics

I T @altanai

Page 6: Media Streams in IOT  via WebRTC

RADIO, WIRELESS AND REMOTE CONTROL Nikola Tesla created a basic design for radio and on November 8, 1898 he patented a wireless radio controlled robot-boat

Source : teslasociety.com

Page 7: Media Streams in IOT  via WebRTC

Only 47 years ago , on 29 October 1969 ,the first message was sent over the ARPANET, the predecessor of the Internet.

Page 8: Media Streams in IOT  via WebRTC

Nov. 26, 1974: Liberty Bank offers ATM demonstrations

In retrospect ATM machines

were one of the first IOT

devices in 1974.

source:http://history.buffalonews.com/

Page 9: Media Streams in IOT  via WebRTC

“1999 , British entrepreneur Kevin Ashton used the term Internet Of Things, while

working at Auto-ID Labs (originally called Auto-ID centers, referring to a global network

of objects connected to radio-frequency identification, or RFID).

Page 10: Media Streams in IOT  via WebRTC

Today 2016

Connected Vehicle

Google Self driven cars

Tesla spark Wearable Tech

Watches ( fitbit , apple watch )

Smart Glasses

BLE tags

GPS shoes

Home appliances

Smart TV, fridge , washing machine , lights , etc

Smart Cities

Power grid

Transporation

ecommerce

Page 11: Media Streams in IOT  via WebRTC

2020

installed base of the Internet of Things (IoT)

by category

Page 12: Media Streams in IOT  via WebRTC

50 billionThings

$1.5 billionIndia

$19 trillionRevenue

By 2020

Page 13: Media Streams in IOT  via WebRTC

Enablers for IOTFactors that led to onset of Internet of Things

Page 14: Media Streams in IOT  via WebRTC

Rapid Manufacturing

IPV6/ 6LoWPAN

Sensors

Protocols

Connectivity

Processors and Moore's Law

Increased Bandwidth

Growth Factors

fieldsManufacturing

Field force management

Supply chain management

Home Automation

Page 15: Media Streams in IOT  via WebRTC

Streaming Multimedia Content in IOT over Open

source Standardized Media Stack ( WebRTC )

Page 16: Media Streams in IOT  via WebRTC

Streaming Event data and Multimedia

With IOT , machinery in plants , industries , motor vehicles,

smart cities have sensors emitting enormous streams of

data in real time.Media capture devices ( surveillance cameras , scanners ,

readers ) and user agents ( smartphones, watches ,

desktops , appliances , kiosks ) can stream audio /video

data.

next generation of applications will see, hear and understand.

Page 17: Media Streams in IOT  via WebRTC

Why is WebRTC suited for handling media streams in IOT ?

No plugins No installations of flash or any other 3rd party plugins

Royalty free codecVP8 , VP9 , OPUS MIT , GPL

Rapid SupportCommunity support and adoption by major browsers, native SDKs

JavascriptSupport for js is the key to making it easily adoptable by developers

Integrate with any signalling method➜ SIP➜ XMPP➜ Socketio➜ websocket

Page 18: Media Streams in IOT  via WebRTC

Media Streaming & WebRTC

Surveillance and Security

Asset Manageme

nt

Machine to Machine

communication through MEdia

Streaming

data handling in IOT

Robotics & remote

navigation

Wearables

Smart Cities

Power Grid MAnageme

nt

connected Vehicle

Page 19: Media Streams in IOT  via WebRTC
Page 20: Media Streams in IOT  via WebRTC

Place your screenshot hereBuild your own Home

Surveillance System on IOT

Page 21: Media Streams in IOT  via WebRTC

Setting up the Surveillance Device

Camera Hardware : Raspberry Pi 3 or above + camera module

Communication : Dongle with 3G/4G

Encoder : Webm encoder on Rpi uv4l-webrtc

Page 22: Media Streams in IOT  via WebRTC

MQTT Broker

Architecture

WebRTC uv4ldriver

Https webserver

WebRTC browser

Signalling over wss

@altanai

http://raspberrypi:9000/stream/webrtc

VP8/VP9/Opus

Live Streaming on WebRTC Peer 2 peer

Camera Feed

Live stream

MQTT

JS MQTT client

websockets

Page 23: Media Streams in IOT  via WebRTC

User Console

WebRTC incoming stream is accessible in almost all Operating Systems through chrome browsers . Exception iphone.

Page 24: Media Streams in IOT  via WebRTC

RamudroidBot to clean roads and outdoors

Page 25: Media Streams in IOT  via WebRTC

Page 26: Media Streams in IOT  via WebRTC

Stages of garbage collection

1. Litter comes between rotating brushes

2. Litter is picked by brushes and pushed upwards

3. Brushes push it towards the tray

Page 27: Media Streams in IOT  via WebRTC
Page 28: Media Streams in IOT  via WebRTC

WebRTC uv4ldriver

Node Js webserver

WebRTC browser

Js modules WebRTC Server

Signalling over ws and wss

Webrtc session

@altanai

http://raspberrypi:9000/stream/webrtc

VP8/VP9/Opus

HTTPREST

mongo

Live Streaming on WebRTC Peer 2 peer

Camera Feed

Live stream

Logs

Recorded videos

MCU or TURN

Page 29: Media Streams in IOT  via WebRTC

Web Control Dashboard

Temperature Heat Sat , prec , err checksum

Page 31: Media Streams in IOT  via WebRTC

Media codecs

● Licensed codecs like flash by

adobe , H264/H264/MPEG by

MPEGLA cannot be freely

used .

● Open source media stacks

(webrtc ) not supported

everywhere.

● Realtime transcoding is very

taxing .

Bottlenecks for Media streaming in IOT

Proprietary protocols and standards

● IMAP , ICMP , Parley , SOAP ,

GIOP , Javs RMI , IMAP , LDAP

and many more .

● Telcos use proprietary patented

communication protocol stacks

too

Supporting all mobile OS and web browsers

● Lot of time and resources are

spend on user interface design

● Support and rendering on multiple

end- user devices .

● NAT and Firewall issues

Page 32: Media Streams in IOT  via WebRTC

Any questions?

Page 33: Media Streams in IOT  via WebRTC

Acknowledgements and Credits

Presentation design Titles: Raleway , Body copy: Karla

Slide Template and Icons : SlidesCarnival

Images: Freepik, Wikipedia

Figures : marketsandmarkets.com ,

Many of the data used here is based on the market reports and self experience , with the fast pace of change it may be outdated very soon .

Page 34: Media Streams in IOT  via WebRTC

Thanks!

Madame Marie Curie (1867–1934)

You can find me at @altanai & [email protected]

Page 35: Media Streams in IOT  via WebRTC

Extras

Page 36: Media Streams in IOT  via WebRTC

Number of connected devices worldwide

Page 37: Media Streams in IOT  via WebRTC

www.google.com/trends