26 January, 2005 CE Linux Forum Technical Conference 1

Audio Video GraphicsWorking Group Session

San Jose meetingPieter van de Meulen

WG chair

26 January, 2005 CE Linux Forum Technical Conference 2

AVG WG – todays objective:

Audio Video 2D 3DRenesas, Mitsubishi, Conexant

DirectFB

Philips (2) Samsung UH APIPhilips Multi-FB

…. OpenGL

….

….

26 January, 2005 CE Linux Forum Technical Conference 3

Recall: 25th/26th Presentations

• DirectFB - Dennis Oliver Kropp; Convergence– http://www.directfb.org/

• OpenGL ES, OpenVG and OpenMAX - Ed Plowman; ARM

– http://www.khronos.org/

• Graphics APIS for Linux - Matsubara, Hagiwara, Hisao Munakata; Renesas• Creating GTK+ based UI's for embedded devices - Markku Ursin, Movial

– http://www.gtk.org/

• Linux DVB - Michael Hunold; Convergence– http://www.linuxtv.org/

• UHAPI (AV streaming) tutorial - John Vugts; Philips/Samsung

– http://www.uhapi.org/

26 January, 2005 CE Linux Forum Technical Conference 4

Recall: Jan. 25th Demos• FB (Multi-framebuffer)

– Philips: PNX8550 running Linux; dual framebuffer and AV accel.

• DirectFB– Conexant: DVD processor running CELF Linux with DirectFB.– Mitsubishi: ARIB plane model emulated on DirectFB window system– Mitsubishi: MPEG4 Player (via GTK+) running on Renesas SH-4– Renesas: GTK+ and GUI without X11

• UHAPI (AV streaming):– Philips open source demo on PC

• DTV– Toshiba America/Europe: DTV reference solution and Home Gateway.

• 3D graphics–Renesas: demo by SI-Electronics on SH-4 and Power VR–Pioneer: OpenGL

26 January, 2005 CE Linux Forum Technical Conference 5

Linux APIs (2004/6 status) & CELF V1.0 focus

/dev/fb0/dev/videoKERNEL

vesafb

X11TinyX

Xv

GNOMEGTK+

Applications

USER

SPACE

HW

DirectFB

GNOMEGTK+

TruetypeLibmpeg3LibjpegLibpngZlib…

NanoX

NXlib

/dev/audio

OSS

ALSA

AC97

AC97

V4L[2]I2C

/dev/i2c

XF86_FBDEV

Host processor

/dev/ps2 /dev/tty0

USB drivers

Host processor / Board peripherals

Video In Video OutVideo In Video Out

SDL

Multi-platform: Unix, Windows, MacOS

GStreamer wxWindows

FLTK

X11 has its owngraphics drivers but can also use FB

CELF V1.0 focus

26 January, 2005 CE Linux Forum Technical Conference 6

GStreamer

Linux API focus with Media/GFX Hardware

KERNEL

vesafb

Applications

USER

SPACE

Host processor / Board peripherals

HW

AC97 USB driversI2C

Media/GFX

AC97

ALSA

/dev/audio

V4L

/dev/fb[2D]

GNOME

GTK+

/dev/ps2/dev/tty

DirectFB

DirectFB

/dev/atsc

UHAPI implementation

AV streaming application

UHAPI

Demo:SDL/V4LNative

/dev/video

26 January, 2005 CE Linux Forum Technical Conference 7

AVG WG project-listAudio Video A/D 2D 3D

Renesas, Mitsubishi, Conexant, Philips

DirectFB

Philips (2), Samsung

2nd phase: Renesas, Mits.UH API (A+D TV)

Philips (interim sol). Multi-FB

Renesas, Mits., IMG? OpenGL [ES]

Renesas, Mits., Toshiba Europe, LG

DTV - DVB - ARIB

None ALSA??

ETRI, Renesas GTK+

26 January, 2005 CE Linux Forum Technical Conference 8

Output: task list- LinuxDVB - add documentation, extensions to support analog, higher level API, Q1-2- Make OS implementation (incl. DVB V4?) of UHAPI PC available, Philips- DirectFB: Acceleration, consider API extensions,…- AVG/Khronos group: OpenGL ES relation to DirectFB- UHAPI team: detailed look at DVB & DirectFB

- T.b.d. Set timeline for studies & evaluations