17
Airflow Summit Advanced Apache Superset for Data Engineers

Airflow Summit

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Airflow Summit

Airflow SummitAdvanced Apache Superset for Data Engineers

Page 2: Airflow Summit

2

● A passion for building data tools!

● Started Apache Airflow at Airbnb in 2014

● Started Apache Superset at Airbnb in 2015

● Started Preset - The Apache Superset company in 2019

Page 3: Airflow Summit

3

Agenda!

● Superset Overview / Demo

● SQL Lab for data engineers

● Scheduling Queries

● Building a visualization plugin

● Building charts and dashboards dynamically

Page 4: Airflow Summit

4

Superset Overview / Demo!

Page 5: Airflow Summit

5

Enhancing Jinja Context

Page 6: Airflow Summit

6

Scheduling Queriesexperimental feature!

Page 7: Airflow Summit

7

Page 8: Airflow Summit

8

superset_config.pyhttp://superset.apache.org/installation.html#sql-lab

Page 9: Airflow Summit
Page 10: Airflow Summit

10

/savedqueryviewapi/api/read

Page 11: Airflow Summit

11

Visualization Plugins

Page 12: Airflow Summit

12

https://preset.io/blog/

Page 13: Airflow Summit

13

Superset Plugins as a data product development platform

● Build data products without writing much backend code

● Tap into Superset’s Data Access Layer (auth, perm, cache, audit)

● Rich controls at your fingertips

● Focus on the visualization / frontend

● Bring into a dashboard (surround with context / add interactions)

Page 14: Airflow Summit

14

Dynamic Chart/Dashboard Creation

Page 15: Airflow Summit

15

Swagger API @ /swaggerview/v1

Rest API!

Page 16: Airflow Summit

16

/superset/examples/birth_names.py

Using SQLAlchemy (improper)

Page 17: Airflow Summit

17

We’re hiring!