13
Evolution of OPNFV CI system: what already exists and what can be introduced Jun Li ([email protected]) San Francisco 09/11/2015

Evolution of OPNFV CI System: What already exists and what can be introduced

  • Upload
    opnfv

  • View
    511

  • Download
    1

Embed Size (px)

Citation preview

Page 1: Evolution of OPNFV CI System: What already exists and what can be introduced

Evolution of OPNFV CI system:

what already exists and what can be introduced

Jun Li ([email protected])

San Francisco 09/11/2015

Page 3: Evolution of OPNFV CI System: What already exists and what can be introduced

3

Jenkins, the CI engine

Jenkins runs tests and automates some parts of project operations

Jenkins focuses on building/testing software projects continuously and monitoring

executions of externally-run jobs

Jenkins supports plugins, which allows to be extended to meet specific requirements

The Jenkins jobs are defined by Jenkins Job builder(JJB) in human readable YAML format

Page 4: Evolution of OPNFV CI System: What already exists and what can be introduced

4

The number of patch commit and author is growing fast

With 10 labs(include LF lab), while no efficient job scheduler(some labs are not connected stable)

Do we need a log tool?

And more …

Some problems occur

Page 5: Evolution of OPNFV CI System: What already exists and what can be introduced

5

Which tools can be introduced?

Page 6: Evolution of OPNFV CI System: What already exists and what can be introduced

6

Zuul scheduler, the main component of Zuul, it receives

events related to proposed changes, triggers tests based on

those events, and reports back

Zuul merger, set temporary Git repositories and branches up

in order to ease the preparation of jobs environments.

Jenkins slave 1

Jenkins slave 2

Zuul (gating) and Gearman (job scheduling)

Page 7: Evolution of OPNFV CI System: What already exists and what can be introduced

7

Reference http://status.openstack.org/zuul/

Zuul pipeline(check, gate, post, etc)

Zuul solves,

1) Testing in parallel

2) Cross projects dependencies

One use case, Zuul used in OpenStack

Page 8: Evolution of OPNFV CI System: What already exists and what can be introduced

8

ElasticSearch ELK stack: gather/store/visualize syslogs

Page 9: Evolution of OPNFV CI System: What already exists and what can be introduced

9

how should be the evolution of the CI infra??

Page 10: Evolution of OPNFV CI System: What already exists and what can be introduced

10

Evolution of CI system

Github Mirror

Remote Git Repository

Gerrit

Developers

Pipy repository Ubuntu, Centos,

etc, mirrors

Repository of Steady version

openstack/opendaylight, etc

… …

Jenkin masters

Jenkin slaves & plugins for test

… Log servers & log searcher

Zuul Gearman

Gating, work scheduler

Scripts to get the mirrors & test depended packages for Build, use nodepool for image management.

Puppet/Hiera manages the servers

OPNFV Mirror

Page 11: Evolution of OPNFV CI System: What already exists and what can be introduced

11

Demo links

https://www.youtube.com/watch?v=fOYdsNdkCuw

Page 12: Evolution of OPNFV CI System: What already exists and what can be introduced

12

Any Questions ?

Page 13: Evolution of OPNFV CI System: What already exists and what can be introduced

Copyright©2015 Huawei Technologies Co., Ltd. All Rights Reserved.

The information in this document may contain predictive statements including, without limitation,

statements regarding the future financial and operating results, future product portfolio, new technology,

etc. There are a number of factors that could cause actual results and developments to differ materially

from those expressed or implied in the predictive statements. Therefore, such information is provided

for reference purpose only and constitutes neither an offer nor an acceptance. Huawei may change the

information at any time without notice.