15
Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute of Technology [email protected] November 8, 2019 KTH ID2223 Scalable ML & DL

Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

Affordable Deep Learning on the Cloud

The Perks of Being a (KTH) Student

Sina SheikholeslamiDistributed Computing Group

KTH Royal Institute of Technology

[email protected] November 8, 2019 KTH ID2223 Scalable ML & DL

Page 2: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

This session is about how to get your hands on GPUs, without spending

money.

[email protected] November 8, 2019 - KTH ID2223 Scalable ML & DL 2

Page 3: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

Environments & Platforms● Hopsworks● Databricks Community Cloud● Google Colaboratory● Google Cloud Platform (GCP)● Amazon Web Services (AWS)● Microsoft Azure● FloydHub

[email protected] November 8, 2019 - KTH ID2223 Scalable ML & DL

Page 4: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

Hopsworks4

[email protected] November 8, 2019 - KTH ID2223 Scalable ML & DL

Page 5: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

5

Now… We Move to Hopsworks [email protected] November 8, 2019 - KTH ID2223 Scalable ML & DL

(Still shot from Rango (2011))

Page 6: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

Useful Links Related to Hopsworks● Hopsworks Python Helper Library: http://hops-py.logicalclocks.com/● Hopsworks Example Notebooks: https://github.com/logicalclocks/hops-examples/● Hopsworks Documentation: https://hopsworks.readthedocs.io/● Logical Clocks Whitepapers: https://www.logicalclocks.com/whitepapers● Logical Clocks’ Blog: https://www.logicalclocks.com/blog● Logical Clocks’ YouTube Channel - Lots of Content: https://bit.ly/2NqtM0H● Hopsworks Google Group: https://groups.google.com/forum/#!forum/hopshadoop● Hopsworks Gitter: https://gitter.im/hopshadoop/hopsworks

[email protected] November 8, 2019 - KTH ID2223 Scalable ML & DL

Page 7: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

As a KTH Student ...● You can use hops.site for free for quite some time● Use your KTH email to register an account

● Logical Clocks Cluster is free to use for KTH students for study purposes, so please use it wisely

● The Huawei Hackathon hosted by Logical Clocks starts today, so please don’t use hops.site today and during the weekend

[email protected] November 8, 2019 - KTH ID2223 Scalable ML & DL

Page 8: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

Databricks Community Cloud8

[email protected] November 8, 2019 - KTH ID2223 Scalable ML & DL

Page 9: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

It’s Free, So ...● Single cluster limited to 6GB and no worker nodes (and no GPU)● Basic notebook without collaboration● Limited to 3 max users● You can share your notebooks for public use (hence “community”)● Lots of example notebooks and tutorials● Register here: https://databricks.com/try-databricks

[email protected] November 8, 2019 - KTH ID2223 Scalable ML & DL

Page 10: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

But!

You can use your free AWS or Azure credits to runDatabricks on AWS or Azure Databricks

[email protected] November 8, 2019 - KTH ID2223 Scalable ML & DL

Page 11: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

Databricks Community Cloud Demo

[email protected] November 8, 2019 - KTH ID2223 Scalable ML & DL

Page 12: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

Other Free Options● Google Colaboratory

○ Tesla K80 GPU and Google TPU○ Check here: https://colab.research.google.com/

● FloydHub: Free Beginner Plan○ Limited Access to Tesla K80 and Tesla V100 for public projects○ Check here: https://www.floydhub.com/pricing

[email protected] November 8, 2019 - KTH ID2223 Scalable ML & DL

Page 13: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

You Get Free Credits for Signing Up On ...● Google Cloud Platform Free Tier: $300 Credits for 12 Months

○ And some other always-free options○ Start here: https://cloud.google.com/free/

● Microsoft Azure: $200 Credits + 12 Months○ And some other always-free options○ Start here: https://azure.microsoft.com/en-us/free/

● Amazon AWS: 12 Months of Free Tier○ Start here: https://aws.amazon.com/free/

[email protected] November 8, 2019 - KTH ID2223 Scalable ML & DL

Page 14: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

To Conclude:

As a KTH Student, you can do a lot of hands-on Deep Learning for free!

[email protected] November 8, 2019 - KTH ID2223 Scalable ML & DL 14

Page 15: Affordable Deep Learning on the Cloud · Affordable Deep Learning on the Cloud The Perks of Being a (KTH) Student Sina Sheikholeslami Distributed Computing Group KTH Royal Institute

Thank you and Happy Coding!(and Happy Friday)

[email protected] November 8, 2019 - KTH ID2223 Scalable ML & DL