63
Collaborative Task Execution In Volunteer Clouds -- Michele Amoretti, PARMA -- Alberto Lluch Lafuente, IMT -- Stefano Sebastio, IMT 2nd General Meeting, Bologna, 18-20 Feb 2014

Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Embed Size (px)

DESCRIPTION

My talk at the 2nd General Meeting of the CINA project, Bologna, 18-20 Feb 2014. The increasing diffusion of cloud technologies offers new opportunities for distributed and collaborative computing. Volunteer clouds are a prominent example, where participants join and leave the platform and collaborate by sharing computational resources. The high complexity, dynamism and unpredictability of such scenarios call for decentralized self-* approaches. We present in this paper a framework for the design and evaluation of self-adaptive collaborative task execution strategies in volunteer clouds. As a byproduct, we propose a novel strategy based on the Ant Colony Optimization paradigm, that we validate through simulation-based statistical analysis over Google workload data.

Citation preview

Page 1: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Collaborative Task Execution

In Volunteer Clouds

-- Michele Amoretti, PARMA

-- Alberto Lluch Lafuente, IMT

-- Stefano Sebastio, IMT

2nd General Meeting, Bologna, 18-20 Feb 2014

Page 2: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Collaborative Task Execution in

Volunteer Clouds

-- Michele Amoreti, PARMA

-- Alberto Lluch Lafuente, IMT

-- Stefano Sebastio, IMT

Page 3: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Collaborative Task Execution in

Volunteer Clouds

-- Michele Amoreti, PARMA

-- Alberto Lluch Lafuente, IMT

-- Stefano Sebastio, IMT

Page 4: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Collaborative Task Execution in

Volunteer Clouds

-- Michele Amoreti, PARMA

-- Alberto Lluch Lafuente, IMT

-- Stefano Sebastio, IMT

How to choose

a sub-reviewer

How to choose

a sub-reviewer

Page 5: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)
Page 6: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

Page 7: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

X X X XX X X XX

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

Page 8: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

X X X XX X X XX

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

Page 9: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

X X X XX X X XX

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

Page 10: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

X X X XX X X XX

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

Page 11: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

X X X XX X X XX

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

Page 12: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

X X X XX X X XX

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

Page 13: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)
Page 14: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

choose reviewers

(almost) randomly

Page 15: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

SciFi Community

Page 16: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

SciFi Community1 Unstructured network

Page 17: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

SciFi Community1

2

Unstructured network

All members generate review tasks

Page 18: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

SciFi Community1

2

3

Unstructured network

All members generate review tasks

All members perform reviews

Page 19: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

SciFi Community1

2

3

4

Unstructured network

All members generate review tasks

All members perform reviews

Review requests may be forwarded

Page 20: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

SciFi Community1

2

3

4

5

Unstructured network

All members generate review tasks

All members perform reviews

Review requests may be forwarded

All members apply the same algorithm

Page 21: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

SciFi Reviewers

Page 22: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

1

SciFi Reviewers

No rescheduling, no priorities.

Page 23: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

1

2

SciFi Reviewers

No rescheduling, no priorities.

Accept request iff CoS met.

Page 24: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

1

2

3

SciFi Reviewers

No rescheduling, no priorities.

Accept request iff CoS met.

No delays.

Page 25: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

1

2

3

SciFi Reviewers

No rescheduling, no priorities.

Accept request iff CoS met.

No delays.

Reply/Forward requests immediately.4

Page 26: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

1

2

3

SciFi Reviewers

No rescheduling, no priorities.

Accept request iff CoS met.

No delays.

Reply/Forward requests immediately.

Disclose confidence on research topics.

4

5

Page 27: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

ALGORITHM 1:

RANDOM

Page 28: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Algorithm 1: Random

Each outgoing arc has the same probability of being chosen during request propagation.

Page 29: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Algorithm 1: Random

Each outgoing arc has the same probability of being chosen during request propagation.

Page 30: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Algorithm 1: Random

Each outgoing arc has the same probability of being chosen during request propagation.

Page 31: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Algorithm 1: Random

Page 32: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

ALGORITHM 2:

Greedy ORACLE

Page 33: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

The GreedyORACLE

The oracle provides the sub-reviewer who will finish earlier.

Page 34: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

The GreedyORACLE

The oracle provides the sub-reviewer who will finish earlier.

Page 35: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

The GreedyORACLE

The oracle provides the sub-reviewer who will finish earlier.

Page 36: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)
Page 37: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

ALGORITHM 3:

FEEDBACK BASED

Page 38: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Probabilistic routingArcs are labelled with rates to be used in probabilistic choices.

11

1

1

1+1 1

Page 39: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based rates

11

1

1

1+1 1

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

Page 40: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based rates

11

1

1

1+1 1

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2 Can you review?

Page 41: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based rates

11

1

1

1+1 1

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2 Can you review?

NO

Page 42: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based rates

1-11

1

1

1+1 1

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2 Can you review?

NO

Page 43: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based rates

1-11

1

1

1

1+1 1

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

Can you review?

Page 44: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based rates

1-11

1

1

1

1+1 1

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

Can you review?

Can youreview?

Page 45: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based rates

1-11

1

1

1

1+1 1

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

Can you review?

Can youreview?

YES

Page 46: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based rates

1-11

1

1

1

1+1 1+1

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

Can you review?

Can youreview?

YES

Page 47: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based rates

Page 48: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based rates

Page 49: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

ALGORITHM 4:

con+dence-based

Page 50: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based pheromones

FM: 3

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

SE: 1

FM: 4

SE: 5

Arcs labeled with one ratefor each research topic.

Page 51: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based pheromones

FM: 3

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

FM: 3SE: 1

SE: 1

FM: 3SE: 1

FM: 4

SE: 5

Arcs labeled with one ratefor each research topic.

Page 52: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based pheromones

FM: 3

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

FM: 3SE: 1

SE: 1

FM: 3SE: 1

FM: 0SE: 0

FM: 4

SE: 5

Arcs labeled with one ratefor each research topic.

Page 53: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based pheromones

FM: 3

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

FM: 3SE: 1

SE: 1

FM: 3SE: 1

FM: 0SE: 0

FM: 4

SE: 5 SE: 5

FM: 4

Arcs labeled with one ratefor each research topic.

Page 54: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Feedback-based pheromones

FM: 3

Paper XXXDue dd/mm/yyCoS:* FM > 3* SE > 2

FM: 3SE: 1

SE: 1

FM: 3SE: 1

FM: 0SE: 0

FM: 4SE: 5

FM: 4

SE: 5 SE: 5

FM: 4

Arcs labeled with one ratefor each research topic.

Page 55: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Confidence-based Rates

Page 56: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Confidence-based Rates

Page 57: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Confidence-based Rates

Page 58: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

choose reviewers

(almost) randomly

Page 59: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

1

What's next?

Study the impact of the structure of the overlay network

Page 60: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

1

2

What's next?

Study the impact of the structure of the overlay network

Study reputation-based strategies

Page 61: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

1

2

3

What's next?

Study the impact of the structure of the overlay network

Study reputation-based strategies

Application to routing of messages in predicate-based communication (cf. SCEL)

Page 62: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

Questions?

Page 63: Collaborative Task Execution In Volunteer Clouds (or how to choose a sub-reviewer)

References

“A Computational Field Framework for Collaborative Task Execution in Volunteer Clouds”, Stefano Sebastio, Michele Amoretti and Alberto Lluch-Lafuente, draft [PDF]

“Reputation-based Cooperation in the Clouds”, Alessandro Celestini, Alberto Lluch Lafuente, Philip Mayer, Stefano Sebastio, and Francesco Tiezzi, draft [PDF]

The science cloud platform. http://svn.pst.ifi.lmu.de/trac/scp/.

P. Mayer et al. The Autonomic Cloud: A Vision of Voluntary, Peer-2-Peer Cloud Computing, 3rd Workshop on Challenges for Achieving Self- Awareness in Autonomic Systems, 2013.

Work-in-progress partially reported in:

See also: