49
The GNOME Audio Story Arun Raghavan

The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

The GNOME Audio Story

Arun Raghavan

Page 2: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Who am I?

Page 3: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

twitter: @louiswu

irc: Ford_Prefect

Page 4: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

PulseAudio

GStreamer

Other misc.

Page 5: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

How hard can audio be?

Page 6: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

🔉 Read samples, play them out

🎤 Record samples, do stuff

Page 7: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Samples?

Page 8: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?
Page 9: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?
Page 10: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Start from the lowest layer

Page 11: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

ALSA

Page 12: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Advanced Linux Sound Architecture

Page 13: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Kernel infrastructure

Userspace library

Plugin system

Page 14: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

“Restricted” subset

Talk to the hardware

Page 15: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

PulseAudio

Page 16: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Sound server

Why do we need one?

Page 17: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Applications just wanna

play or capture

Page 18: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?
Page 19: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Mixing

Conversion

Volumes

Page 20: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Routing

Filters

Page 21: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Power

Hardware

Page 22: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Simple API

Async API

Page 23: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

libcanberra

Page 24: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Event sound library

Page 25: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Phone ring

Button press

New message

Page 26: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

GTK+ bindings

Easily attach an event to a widget

Page 27: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Sounds cached if possible

Page 28: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

GStreamer

Page 29: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Swiss-army mulitimedia knife

Page 30: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Encode/decode

Containers

Page 31: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Audio and video

Disk, network, …

Page 32: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Everything that Nirbheek

spoke about yesterday

Page 33: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

BUT WHAT DO I USE?

Page 34: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

ALSA

Page 35: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Practically never

Page 36: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

PulseAudio

Page 37: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Working with samples

Fine-grained control

Page 38: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

libcanberra

Page 39: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Event sounds

GSound in the future

'nuff said

Page 40: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

GStreamer

Page 41: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Encoded audio

Custom pipeline

Page 42: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

JACK

Page 43: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

What's that?

Pro-audio use cases

Page 44: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Future work

Page 45: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Container support

Filters and effects

Page 46: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

UI interactions

Low latency

Page 47: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Easier policy

Compressed audio

Page 48: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Questions?

Page 49: The GNOME Audio Story Arun Raghavan · 2015-05-20 · PulseAudio GStreamer Other misc. How hard can audio be? 🔉 Read samples, play them out 🎤 Record samples, do stuff. Samples?

Thank you!