Beyond ubiquitous computing

Beyond ubiquitous computing

Two hopeful ideas to drive us forward togetherGREGORY D. ABOWD [email protected]

SCS HALLOWEEN TGIF FR IDAY, OCTOBER 30 , 2015

Gregory D. Abowd, SCS Lecture 10 / 30 / 15Gregory D. Abowd, SCS Lecture 10 / 30 / 15

Goals

https://s-media-cache-ak0.pinimg.com/originals/6e/ba/fc/6ebafc6360dd08aad03c5d0c288adb9d.jpg


Goals

1. Motivate colleagues (faculty, staff, students) across campus to come together to address interesting research opportunities.



Goals


2. Feed your mind as well as your stomach.



Goals


2. Feed your mind as well as your stomach.

3. Thank some people who have helped shape and present my ideas



Outline

● A brief history of computing, 1936-2003○ 3 generations of technology, culminating with ubiquitous computing

● Beyond Weiser’s ubicomp, 2003-present○ A 4th generation has emerged ○ First hopeful idea: CampusLife

● 2020 vision○ Predicting a 5th generation of computing technology ○ Second hopeful idea: Computational Skin


A brief history of computing 1936 - 2003

67 years in 67 seconds (± 67 seconds)

New computing technologies create new perceptions of the human-computer relationship


First, there was Turing

Generation Vision began People-to-Device ratio Canonical technology Applications

1 Mid ‘30’s Many – 1 MainframeInitial: Scientific calculation

Follow-on: Data processing


Then, there was Kay


1 Mid 30’s Many – 1 MainframeInitial: Scientific calculation


2 Late 60’s 1 - 1 PCInitial: Spreadsheet

Follow-on: database mgt, document processing


Finally, there was Weiser

“The most profound technologies are those that disappear.”






3 Late 80’s 1 — ManyInchFootYard

Initial: Calendar/contact mgt; Human-human comms

Follow-on: location services, social media, app ecosystem, education, advertising



































Weir’s ubicomp was great, up to a point

“The most profound research topics are those that disappear.”

- Gregory D. AbowdUbicomp 2012


Beyond Weiser’s ubicomp 2003-present

The fourth generation of computing has already arrived and it offers an interesting empowerment


Generation 4: What is it?









4 ?? ?? ?? ??


Generation 4: A logical extension









4 Mid 00’s Many — Many ?? ??


Generation 4 Technologies The “cloud”


Generation 4 Technologies The “crowd”

The “cloud” The “crowd”


Generation 4 Technologies Internet of Things …



Generation 4 Technologies … + Wearables = …



Generation 4 Technologies The “shroud”



Generation 4: Canonical technology









4 Mid 00’s Many — ManyCloudCrowdShroud

??


Application: Personal navigation

http://blog.furnishedquarters.com/wp-content/uploads/2014/12/iStock_000042077894Large.jpg
































Generation 4: Application Theme



Collective Computing



Collective ComputingUsing the cloud to merge data from the shroud with intelligence from the crowd rapidly empowers the individual with specialized expertise

beyond her training.



Collective ComputingUsing the cloud to merge data from the shroud with intelligence from the crowd rapidly empowers the individual with specialized expertise

beyond her training.

The individual can harness on-demand expertise.


Generation 4Generation Vision began People-to-Device ratio Canonical technology Applications








4 Mid 00’s Many — ManyCloudCrowdShroud

Initial: Personal nav. & ent.

Follow-on: 2015-2025 examples of on-demand harnessing of expertise

http://bitsofpositivity.com/wp-content/uploads/2011/03/DChitwood_OnceYouChooseHope.png


First hopeful idea: CampusLife

https://upload.wikimedia.org/wikipedia/en/a/a3/CampusLife_sm.jpg


First hopeful idea: CampusLife

https://upload.wikimedia.org/wikipedia/en/a/a3/CampusLife_sm.jpg

How does the digital footprint of a campus community reflect or predict its wellness?


Why is this important?

http://tamsincasey.com/wp-content/uploads/2014/06/photodune-3580386-study-stress-m-2.jpg

● College life can be overwhelming for young adults just growing into independence.

● How can a campus community understand the sources of stress in such a way as to promote a balanced and healthy academic career, and avoid painful loss?


Inspiration: StudentLife

● 70 ugrads and grads in a 10-week course were given instrumented Android phones to collect evidence of their activities over a 10-week period.

● 2 Best Paper awards (2014 & 2015) resulted from public dataset analysis showing predictions of depression and academic performance.

http://studentlife.cs.dartmouth.edu/Andrew Campbell

Today, we can and will do more, particularly as we think about all 4th generation technologies.


Relevance to 4th generation

● There are new opportunities to understand the link between human activity and wellness outcomes○ Shroud: on- or near-body sensing as well as interaction with the environment ○ Crowd: social media activities; crowd-sourced peer mentoring ○ Cloud: data analytics over a whole community

● Empower the student to be her own counselor


Goal

By 2017, be able to commence an experiment of CampusLife to track the entire educational career for all entering first-year students.

The journey begins Thursday, November 5, 2015!

Please consider jumping aboard.

Andrew Campbell Dartmouth

Anind Dey CMU

Tanzeem Choudhury Cornell

Munmun De Choudhury Georgia Tech


2020 Vision

Towards a 5th generation of computing technology


What did Weiser write in 1991?

“The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it.”


What did Weiser write in 1991?

“The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it.”


Today


Today

Printed electronics


Today

Printed electronics


Today

Computing elements attached to already manufactured objects

Printed electronics


The fabrication processes for conventional materials (e.g., textile fibers, paper) are modified to embed computational capabilities.

Tomorrow

Yoel Fink, silicon nanowires embedded in textile fibers


Who could possibly do this?


We can!

Eric VogelMS&E

Michael FillerCHBE

Manos TentzerisECE

Tom ConteCS

Hadi EsmaeilzadehCS

Gregory AbowdIC


We can!

Eric VogelMS&E

Michael FillerCHBE

Manos TentzerisECE

Tom ConteCS

Lincoln LauhonNorthwestern

Joe ParadisoMIT

Daniel HerrUNC Greensboro

Hadi EsmaeilzadehCS

Gregory AbowdIC

http://footnotescounseling.com/wp-content/uploads/2014/03/Hope-logo1.jpg

http://footnotescounseling.com/wp-content/uploads/2014/03/Hope-logo1.jpg


Second hopeful idea: Computational Skin









4 Mid 00’s Many — Many Cloud/Crowd/Shroud

Initial: Personal nav. & ent.

Follow-on: 2015-2025 examples of on-demand harnessing of expertise

5 2020 ?? Computational skin ??


Computational Skin: What is it?

Advances in materials engineering and manufacturing will result in the surface of any object being able to perform basic computational

operations.

○ Store information ○ Compute logical operations ○ Communicate within and between surfaces through contact ○ Sense and actuate ○ Harvest their own power to perform the above




operations.





operations.





operations.



What is really new here?


What is really new here?Technical breakthroughs● Non-silicon based computational substrate manufactured at high

throughput● Inextricable/natural connection between the physical and digital● Power harvesting possible because of large surface area● Rethinking communication needs


What is really new here?Technical breakthroughs● Non-silicon based computational substrate manufactured at high

throughput● Inextricable/natural connection between the physical and digital● Power harvesting possible because of large surface area● Rethinking communication needs

Applications breakthroughs● We are at a critical transition point: A compelling system-level

application is needed to direct the development of the nanomaterials themselves, as well as inform the design of devices and circuits based on them.*

* J. Holdren and E. S. Lander, "Report to the President and Congress on the Fifth Assessment of the National Nanotechnology Initiative," President’s Council of Advisors on Science and Technology, www.nano.gov, 2014.


Application domains: The classroom


Application Domains: Asset tracking


Application Domains: Food safety


Application Domains: Voting


Image courtesy of Dingtian Zhang

Application Domains: Whole living spaces

The home

The car

The office

The campus


Where to start?


COSMOSCOmputational Skin for Multifunctional

Objects and Systems

“COSMOS envisions a transformative technological shift: a world where all physical objects and surfaces are covered with “computational skins” consisting of embedded, dense, high performance, seamlessly networked computational nodes which can process, store, and communicate sensor data and be powered via energy harvested from the environment. ”

Eric Michael Manos

Tom Hadi Gregory


Conclusions

● Thinking beyond Weiser’s ubicomp, there is a lot we can do to define the future of computing

● A 4th generation has emerged with new technologies and application themes○ Cloud/crowd/shroud and on-demand harnessing of expertise ○ First hopeful idea: CampusLife

● A 5th generation is around the corner○ Computational skin lets us completely rethink what the computer is and its relationship

to the physical world. ○ Second hopeful idea: COSMOS


Parting thoughts

These hopeful ideas provide lots of opportunities for all aspects of computing. ○ Success requires collaboration within and beyond computing ○ If I didn’t make that clear, then I failed in this talk, and I apologize.

“It is amazing what you can accomplish if you do not care who gets the credit.” - Harry S. Truman

http://blogs.managementconcepts.com/wp-content/uploads/2014/10/Sunrise.jpg

http://blogs.managementconcepts.com/wp-content/uploads/2014/10/Sunrise.jpg


Important follow up

Thursday, Nov. 5

CampusLife

noon-1 @ TSRB Banquet Hall GVU BB talk by Andrew Campbell

Munmun and Gregory will lead IPaT Thursday Think Tank

Contact Gregory or Munmun to get involved

3:30-5 @ Centergy, 6th Floor

Computational SkinSpring Semester 2016

Seminar series across CoC, ECE, Materials Science and ChemBio

Contact Eric, Michael, Manos or Gregory to get involved

Documents

Beyond ubiquitous computing