32
@petabridge Petabridge.com Making a Streaming ETL Pipeline with Akka.NET Andrew Skotzko Co-founder — Petabridge

Streaming ETL With Akka.NET

Embed Size (px)

Citation preview

Page 1: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Making a Streaming ETL

Pipeline with Akka.NET

Andrew SkotzkoCo-founder — Petabridge

Page 2: Streaming ETL With Akka.NET

@petabridge Petabridge.com

so why streaming?

Page 3: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Typical ETL

Page 4: Streaming ETL With Akka.NET

@petabridge Petabridge.com

so why streaming?

Page 5: Streaming ETL With Akka.NET
Page 6: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Page 7: Streaming ETL With Akka.NET

@petabridge Petabridge.com

WTF are you talking about?

Page 8: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Concurrency.

Time to make friends.

Page 9: Streaming ETL With Akka.NET

@petabridge Petabridge.com

How to Write Multithreaded Code

Page 10: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Shared State Programming Sucks

(Illustrated)

Page 11: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Is there a better way? THERE MUST BE!THERE.MUST.BE.A.BETTER.WAY!

Page 12: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Warning!

Mind Blowingly Different

Programming Style Ahead!

Page 13: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Page 14: Streaming ETL With Akka.NET

@petabridge Petabridge.com

The Actor Model

Page 15: Streaming ETL With Akka.NET

@petabridge Petabridge.com

What is Akka.NET?

Page 16: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Obligatory logos

Page 17: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Everything is an actor.

Page 18: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Page 19: Streaming ETL With Akka.NET

@petabridge Petabridge.com

3 Core Abilities

1. Send messages2. Create other actors3. Change behavior

Page 20: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Messages

Page 21: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Actors work by passing each other

messages

Page 22: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Actor addresses have location

transparency

Page 23: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Which means…

Page 24: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Page 25: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Page 26: Streaming ETL With Akka.NET

@petabridge Petabridge.com

ReactiveManifesto.org

Page 27: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Demo time!

Page 28: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Page 29: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Page 30: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Live* Demo

*fingers crossed

Page 31: Streaming ETL With Akka.NET

@petabridge Petabridge.com

http://LearnAkka.net

Page 32: Streaming ETL With Akka.NET

@petabridge Petabridge.com

Thank you!

[email protected]

http://learnakka.net

http://Petabridge.com