Upload
mojo-lingo
View
327
Download
0
Embed Size (px)
Citation preview
CAN YOU SPEAK MAGIC?
WHAT WEBRTC IS
•Javascript access to Camera and Mic
•High Quality Video & Audio Codecs
4
CAN YOU SPEAK MAGIC?
WHAT WEBRTC IS
•Javascript access to Camera and Mic
•High Quality Video & Audio Codecs
•Techniques for traversing NAT
4
CAN YOU SPEAK MAGIC?
WHAT WEBRTC IS
•Javascript access to Camera and Mic
•High Quality Video & Audio Codecs
•Techniques for traversing NAT
•Peer-to-Peer
4
CAN YOU SPEAK MAGIC?
WHAT WEBRTC IS
•Javascript access to Camera and Mic
•High Quality Video & Audio Codecs
•Techniques for traversing NAT
•Peer-to-Peer
•A Data Channel
4
CAN YOU SPEAK MAGIC?
WHAT WEBRTC IS
•Javascript access to Camera and Mic
•High Quality Video & Audio Codecs
•Techniques for traversing NAT
•Peer-to-Peer
•A Data Channel
•A Tool for Developers
4
CAN YOU SPEAK MAGIC?
WHAT WEBRTC IS NOT
•…a Polished, End-User-Ready Product
•…the same thing to every application
5
CAN YOU SPEAK MAGIC?
WHAT WEBRTC IS NOT
•…a Polished, End-User-Ready Product
•…the same thing to every application
•…required to interop…but may
5
CAN YOU SPEAK MAGIC?
WHAT WEBRTC IS NOT
•…a Polished, End-User-Ready Product
•…the same thing to every application
•…required to interop…but may
•…finished.
5
CAN YOU SPEAK MAGIC?
WHAT WEBRTC IS NOT
•…a Polished, End-User-Ready Product
•…the same thing to every application
•…required to interop…but may
•…finished.
5
But don’t sweat it
CAN YOU SPEAK MAGIC?
14
Signaling
STUN & TURN
SFU or MCU
NAT Traversal
Larger Multiparty Video Conferences
CAN YOU SPEAK MAGIC?
14
Signaling
Recording Conferencing PSTN Gateway
STUN & TURN
SFU or MCU
NAT Traversal
Larger Multiparty Video Conferences
Media Server
CAN YOU SPEAK MAGIC?
WEBRTC SIGNALING•Can be anything you like•Select based on application requirements
16
CAN YOU SPEAK MAGIC?
WEBRTC SIGNALING•Can be anything you like•Select based on application requirements•Integrate with existing comms or greenfield?
16
CAN YOU SPEAK MAGIC?
WEBRTC SIGNALING•Can be anything you like•Select based on application requirements•Integrate with existing comms or greenfield?•Federate? Or Not?
16
CAN YOU SPEAK MAGIC?
WEBRTC SIGNALING•Can be anything you like•Select based on application requirements•Integrate with existing comms or greenfield?•Federate? Or Not?•Anonymous, Social,or Legal Identities?
16
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
17
Hav
e Bob
call
me h
ere!
SDP:
v=0
o=al
ice 2
0518 0
IN IP
4 0.0
.0.0
s=-
t=0 0
m
=audio
54609 R
TP/SAVPF 1
09
Alice Bob
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
17
Hav
e Bob
call
me h
ere!
SDP:
v=0
o=al
ice 2
0518 0
IN IP
4 0.0
.0.0
s=-
t=0 0
m
=audio
54609 R
TP/SAVPF 1
09
Alice Bob
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
17
Hav
e Bob
call
me h
ere!
SDP:
v=0
o=al
ice 2
0518 0
IN IP
4 0.0
.0.0
s=-
t=0 0
m
=audio
54609 R
TP/SAVPF 1
09
Bob is at:
SDP:v=0 o=bob 19915 0 IN IP4 0.0.0.0
s=- t=0 0 m=audio 61001 RTP/SAVPF 109
Alice Bob
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
17
Hav
e Bob
call
me h
ere!
SDP:
v=0
o=al
ice 2
0518 0
IN IP
4 0.0
.0.0
s=-
t=0 0
m
=audio
54609 R
TP/SAVPF 1
09
Bob is at:
SDP:v=0 o=bob 19915 0 IN IP4 0.0.0.0
s=- t=0 0 m=audio 61001 RTP/SAVPF 109
Alice Bob
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
17
Hav
e Bob
call
me h
ere!
SDP:
v=0
o=al
ice 2
0518 0
IN IP
4 0.0
.0.0
s=-
t=0 0
m
=audio
54609 R
TP/SAVPF 1
09
Bob is at:
SDP:v=0 o=bob 19915 0 IN IP4 0.0.0.0
s=- t=0 0 m=audio 61001 RTP/SAVPF 109
Alice Bob
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
17
Hav
e Bob
call
me h
ere!
SDP:
v=0
o=al
ice 2
0518 0
IN IP
4 0.0
.0.0
s=-
t=0 0
m
=audio
54609 R
TP/SAVPF 1
09
Bob is at:
SDP:v=0 o=bob 19915 0 IN IP4 0.0.0.0
s=- t=0 0 m=audio 61001 RTP/SAVPF 109
Alice Bob
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
19
Alice Bob
Hav
e Bob
call
me h
ere!
SDP:
v=0
o=al
ice 2
0518 0
IN IP
4 0.0
.0.0
s=-
t=0 0
m
=audio
54609 R
TP/SAVPF 1
09
Bob is at:
SDP:v=0 o=bob 19915 0 IN IP4 0.0.0.0
s=- t=0 0 m=audio 61001 RTP/SAVPF 109
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
19
Alice Bob
SRTP
SRTP
Hav
e Bob
call
me h
ere!
SDP:
v=0
o=al
ice 2
0518 0
IN IP
4 0.0
.0.0
s=-
t=0 0
m
=audio
54609 R
TP/SAVPF 1
09
Bob is at:
SDP:v=0 o=bob 19915 0 IN IP4 0.0.0.0
s=- t=0 0 m=audio 61001 RTP/SAVPF 109
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
19
Alice Bob
SRTP
SRTP
Hav
e Bob
call
me h
ere!
SDP:
v=0
o=al
ice 2
0518 0
IN IP
4 0.0
.0.0
s=-
t=0 0
m
=audio
54609 R
TP/SAVPF 1
09
Bob is at:
SDP:v=0 o=bob 19915 0 IN IP4 0.0.0.0
s=- t=0 0 m=audio 61001 RTP/SAVPF 109
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
19
Alice Bob
SRTP
SRTP
XHav
e Bob
call
me h
ere!
SDP:
v=0
o=al
ice 2
0518 0
IN IP
4 0.0
.0.0
s=-
t=0 0
m
=audio
54609 R
TP/SAVPF 1
09
Bob is at:
SDP:v=0 o=bob 19915 0 IN IP4 0.0.0.0
s=- t=0 0 m=audio 61001 RTP/SAVPF 109
CAN YOU SPEAK MAGIC?
THE FIVE TENETS
•Adaptive
•Fluid
•Contextual
21
A Modern Voice Application should be…
CAN YOU SPEAK MAGIC?
THE FIVE TENETS
•Adaptive
•Fluid
•Contextual
•Trustworthy
21
A Modern Voice Application should be…
CAN YOU SPEAK MAGIC?
THE FIVE TENETS
•Adaptive
•Fluid
•Contextual
•Trustworthy
•Reference-able21
A Modern Voice Application should be…
CAN YOU SPEAK MAGIC?
•Start with Chat•Add audio•Invite more participants•Upgrade to video
BEING FLUID
25
CAN YOU SPEAK MAGIC?
•Start with Chat•Add audio•Invite more participants•Upgrade to video•Downgrade back to Chat
BEING FLUID
25
CAN YOU SPEAK MAGIC?
•Start with Chat•Add audio•Invite more participants•Upgrade to video•Downgrade back to Chat•Switch devices and continue
BEING FLUID
25
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
“Communicating isn’t going to be what you’re doing - it’s what you’ll be doing
while you’re doing something else”
- Geoff Hollingworth Ericsson Head of AT&T Foundry
27
CAN YOU SPEAK MAGIC?
28How many sales reps are still in homes?
How much have we sold so far this month?
How many callers are in the queue right now?
Add my manager to this call
When is the next available appointment?
BEING CONTEXTUAL
CAN YOU SPEAK MAGIC?
TRUSTWORTHY•Don't surprise the user!•User data stays property of user•Help users make smart choices where required (with sane defaults)
30
CAN YOU SPEAK MAGIC?
TRUSTWORTHY•Don't surprise the user!•User data stays property of user•Help users make smart choices where required (with sane defaults)•Asserted identity should beuser-centric and strong
30
CAN YOU SPEAK MAGIC?
REFERENCEABILITY•Make Interactions Shareable•Every conversation has a URL that:
32
CAN YOU SPEAK MAGIC?
REFERENCEABILITY•Make Interactions Shareable•Every conversation has a URL that:•Is permanent & unique
32
CAN YOU SPEAK MAGIC?
REFERENCEABILITY•Make Interactions Shareable•Every conversation has a URL that:•Is permanent & unique•Represents the latest state of the communication or request
32
CAN YOU SPEAK MAGIC?
REFERENCEABILITY•Make Interactions Shareable•Every conversation has a URL that:•Is permanent & unique•Represents the latest state of the communication or request•May contain content alternatives: recording + transcription + annotation
32
CAN YOU SPEAK MAGIC?
REFERENCEABILITY•Make Interactions Shareable•Every conversation has a URL that:•Is permanent & unique•Represents the latest state of the communication or request•May contain content alternatives: recording + transcription + annotation•Is searchable & downloadable
32
CAN YOU SPEAK MAGIC?
REFERENCEABILITY•Make Interactions Shareable•Every conversation has a URL that:•Is permanent & unique•Represents the latest state of the communication or request•May contain content alternatives: recording + transcription + annotation•Is searchable & downloadable•Can be shared (respecting privacy limits)
32
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
JOB INTERVIEW APP•Self Service•Candidate signs up, uploads résumé
36
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
JOB INTERVIEW APP•Self Service•Candidate signs up, uploads résumé•Easy timeslot scheduling
36
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
JOB INTERVIEW APP•Self Service•Candidate signs up, uploads résumé•Easy timeslot scheduling•No exchange of phone numbers or Skype names -works on any device
36
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
JOB INTERVIEW APP•Self Service•Candidate signs up, uploads résumé•Easy timeslot scheduling•No exchange of phone numbers or Skype names -works on any device
•Contextual Interviews
36
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
JOB INTERVIEW APP•Self Service•Candidate signs up, uploads résumé•Easy timeslot scheduling•No exchange of phone numbers or Skype names -works on any device
•Contextual Interviews•Text chat alongside video conversation
36
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
JOB INTERVIEW APP•Self Service•Candidate signs up, uploads résumé•Easy timeslot scheduling•No exchange of phone numbers or Skype names -works on any device
•Contextual Interviews•Text chat alongside video conversation•See resume next to candidate
36
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
JOB INTERVIEW APP•Self Service•Candidate signs up, uploads résumé•Easy timeslot scheduling•No exchange of phone numbers or Skype names -works on any device
•Contextual Interviews•Text chat alongside video conversation•See resume next to candidate•Track and save notes during interview
36
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
JOB INTERVIEW APP•Self Service•Candidate signs up, uploads résumé•Easy timeslot scheduling•No exchange of phone numbers or Skype names -works on any device
•Contextual Interviews•Text chat alongside video conversation•See resume next to candidate•Track and save notes during interview•Record and share interviewee responses
36
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
INCIDENT RESPONSE•Timely, Contextual Information•Adapt for mobile vs. desktop
39
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
INCIDENT RESPONSE•Timely, Contextual Information•Adapt for mobile vs. desktop•Group-based communication
39
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
INCIDENT RESPONSE•Timely, Contextual Information•Adapt for mobile vs. desktop•Group-based communication•Inherit from existing organization groups
39
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
INCIDENT RESPONSE•Timely, Contextual Information•Adapt for mobile vs. desktop•Group-based communication•Inherit from existing organization groups•Allow ad-hoc participants (guests)
39
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
INCIDENT RESPONSE•Timely, Contextual Information•Adapt for mobile vs. desktop•Group-based communication•Inherit from existing organization groups•Allow ad-hoc participants (guests)•Federate with external services
39
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
INCIDENT RESPONSE•Timely, Contextual Information•Adapt for mobile vs. desktop•Group-based communication•Inherit from existing organization groups•Allow ad-hoc participants (guests)•Federate with external services
•Incident recording/logging
39
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
INCIDENT RESPONSE•Timely, Contextual Information•Adapt for mobile vs. desktop•Group-based communication•Inherit from existing organization groups•Allow ad-hoc participants (guests)•Federate with external services
•Incident recording/logging•“Lessons learned” and process improvement
39
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
INCIDENT RESPONSE•Timely, Contextual Information•Adapt for mobile vs. desktop•Group-based communication•Inherit from existing organization groups•Allow ad-hoc participants (guests)•Federate with external services
•Incident recording/logging•“Lessons learned” and process improvement•Links from/to issue tracking systems
39
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
MEDICAL ADVICE/HISTORY•Secure Caller Authentication•Reuse primary auth via website
42
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
MEDICAL ADVICE/HISTORY•Secure Caller Authentication•Reuse primary auth via website•Verify with voice biometrics
42
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
MEDICAL ADVICE/HISTORY•Secure Caller Authentication•Reuse primary auth via website•Verify with voice biometrics•Cross-check against caller location
42
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
MEDICAL ADVICE/HISTORY•Secure Caller Authentication•Reuse primary auth via website•Verify with voice biometrics•Cross-check against caller location
•Automate Medical Claims
42
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
MEDICAL ADVICE/HISTORY•Secure Caller Authentication•Reuse primary auth via website•Verify with voice biometrics•Cross-check against caller location
•Automate Medical Claims•Call recording/transcription
42
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
MEDICAL ADVICE/HISTORY•Secure Caller Authentication•Reuse primary auth via website•Verify with voice biometrics•Cross-check against caller location
•Automate Medical Claims•Call recording/transcription•Medical advice given to patient automatically added to patient file
42
CAN YOU SPEAK MAGIC?CAN YOU SPEAK MAGIC?
MEDICAL ADVICE/HISTORY•Secure Caller Authentication•Reuse primary auth via website•Verify with voice biometrics•Cross-check against caller location
•Automate Medical Claims•Call recording/transcription•Medical advice given to patient automatically added to patient file•Easy Auditing/Service Quality Assurance
42
CAN YOU SPEAK MAGIC?
RESOURCES & QUESTIONS•WebRTC •http://webrtc.github.io/samples/ •http://www.webrtc.org/
•Voice in Ruby •https://talkingstick.io/ •http://www.adhearsion.com/
47
@bklang [email protected]
CAN YOU SPEAK MAGIC?
RESOURCES & QUESTIONS•WebRTC •http://webrtc.github.io/samples/ •http://www.webrtc.org/
•Voice in Ruby •https://talkingstick.io/ •http://www.adhearsion.com/
47
@bklang [email protected]
CAN YOU SPEAK MAGIC?
RESOURCES & QUESTIONS•WebRTC •http://webrtc.github.io/samples/ •http://www.webrtc.org/
•Voice in Ruby •https://talkingstick.io/ •http://www.adhearsion.com/
47
@bklang [email protected]