Elder Matias

Canadian Light Source

Where is Saskatoon?

• University of Saskatchewan– Est. 1907; 20,000 students– Collages: Arts & Sciences; Agriculture; Engineering;

Dentistry; Medicine; Law; Pharmacy; Veterinary medicine ......

• Other research institutes similar to the CLS:– VIDO (Level 3 Bio-research facility)– Plasma Physics Laboratory STOR-M tokemak – Saskatchewan Research Council– Canadian Centre for Nuclear Innovation (CCNI)

Canadian Light Source, Inc.• The CLS facility is owned by the University of

Saskatchewan• Operated by Canadian Light Source Inc. (CLSI)• CLSI is a not-for-profit corporation owned by the university• Key attributes:

• Independent Board of Directors (appointed by the University)• Independent Procedures and Processes from the University• Licensed by the Canadian Nuclear Safety Commission (CNSC)• Different safety and labour regulations standards

Vision & Strategic Goals

Operating Budget

Accelerators on Campus• Decommissioned Accelerators

– 25 MeV Betatron (1947 – 1961)– EROS – Pulse Stretcher Ring (1984-1996)

• CLS Facility– Linac 130 -> 150 -> 300 MeV (1964 to present) – BR1 - Booster Ring (2.9 GeV - 2003)– SR1 – Storage Ring – MIPS Isotope 30 MeV Electron Linac (2012)

• Other Facilities on Campus – Cyclotron 24 MeV Proton Machine (2014)– STOR-M AC Tokamak – SLOWPOKE-II – 20 keW Reactor

Beamline Energy Range

Canadian Light Source

Timeline:2006 – First Publication2005 – First User2004 – First Beamline2003 – First Light2002 – BR11999 – Funding

CLS Org Structure

TS Division

Technical ServicesDivision

Engineering &TechnicalSystems

Control and Instrumentation Development

Information &Communication

Technology

TechnicalPool

PMO

- Control Systems- Data Acquisition - Electronics Lab- Instrumentation- Diagnostics

- Mechanical Design- Electrical Design- HVAC- Machine Shop

- Network- Phones- Office Software- Servers- Business Systems

- Electrical Techs- Mechanical Techs

Control and Instrumentation Development

CID Mission and Mandate

Develop, deploy and support the instrumentation, control and data acquisition technology needed to

help position CLS and it’s beamline as a global leader and recognised

centre of excellence.

Staffing Levels

• Manager: 1• Instrument Scientist/Engineer: 2 + ½ • Electronics Techs: 3• Control Lead 5• Bio-medical Imaging Specialist 1• System Analyst - Software Developer 5• System Admin 0 + (IT 1)• Web-systems 1 + (IT 1)• Control PLC and Drawings 1 +(AOD 2;ETS

3)• Fellow 1• Students 2Total: 22 + 7

Management Approach

• Matrix staffing approach• Project/Work Package breakdown• Graded Change Control • Control lead is primary interface

between beamline staff and the rest of the department

• If successful control leads feel embedded in both the department and beamline teams

| 16

Rational Unified ProcessC

onte

nt

Time

Inception Elaboration Construction Transition

Requirements Analysis Design Implementation Test

Unified Process

Core Workflows In Each Phase

- Establish Feasibility- Establish Business/Scientific Case- Capture Essential Requirements- Identify Critical Risks- Establish initial budget & schedule

Deliverables (as required):- Project Plan- Risk Assessment- Initial Requirements (10-20%)

Requirements: - Refine System ScopeAnalysis: - Establish what to buildDesign:- Create an ArchitectureImplementation- Build an architecture baseline- Build any prototypesTest- Test the architecture baseline- Test any prototypes

Deliverables (as required):- PID Drawings- Wiring Diagrams- Updated Requirements Document- System breakdown

Requirements: - Uncover missing requirementsAnalysis: - Finish the analyis Design:- Finish detailed designImplementation- Build and install the systemTest:- Test and ring-out the system

Deliverables (as required):- Running System

- Correct any defected- Provide support for commissioning - Prepare final documentation

Deliverables (as required):- Final documentation- Working system

CLSI System (Beamline) Engineering ProcessProposal Conceptual

DesignPreliminary

DesignDetailedDesign Build Commissioning

Human Factors

• Human factors basedon NREG-700

• Equipment vrs Task• Increased layers of

abstraction• Priority has been tailoring GUI

applications to specific tasks/beamlines, we now need to look at a common look and feel across the facility

We Changed the Question...

Dec 2009

May 2010

Jun 2010

Jul 2010

Sep 2010

Nov 2010

Dec 2010

Mar 2011

May 2011

Aug 2011

Sep 2011

Oct 2011

Dec 2011

0

20

40

60

80

100

Software User Friendliness (Good or Excellent Rating by Users)

Drop corresponds to new beamlines coming on and shift in interface.

Improving the Beam

• Storage ring dipolestability improved(30ppm -> 15 ppm)

• Power supply upgrades oninjection chain - nearly complete

• Upgraded orbit correction software in place and ready for commissioning

• Absolute power meter 1 % Accuracy and 50 nW Resolution (comp. with PTB)

Front End Electronics

• Contract in place for thefirst µTCA system

• Continuous scanning nowon VESPERS and SGM

• Evaluation underway on RTEMS and motion control platform migration

• Evaluation of pre-amps (2011/12)

User Oriented Software

• Continue to achieve highuser satisfaction rates

• We are moving forward on HXMA improvements

• Human factors review are ongoing• Many of the concepts embedded in

aquaman are based on the last years user meeting

Compute Canada

• Silo disk storage available• Work in ongoing• In collaboration with SharNet

the FOXMAS analysissoftware have been developed and made available within ScienceStudio

Aquaman The Story

• Superhero Mission: Transforming beamline software away from "Controlling Machines" to "Supporting Experiments“

• Spawned By: A creative design session of synchrotron users, beamline staff, and software developers in Summer 2010

• Seeks to Protect: The whole experimental process:  From planning and organizing old data, to running experiments on beamlines, to visualization, analysis, and making connections

• Sidekick: "Dataman", a take-home version that lets scientists compare, process, visualize, and export their data, using the same interface they see on the beamline

• Super Powers: Adapts to new beamlines and techniques in the blink of an eye.   Can run on almost any platform (Linux, Mac, Windows).   

• Secret Abilities: Agile development; fast and frequent user feedback; modular design; integrated documentation.

• Arch-Nemeses:  8AM mornings. TestBoy (his test suite).  Being confused with Aquaman, the lamest comic book character ever.

Developed by:– Mark Boots, David Chevrier, Darren Hunter

Strategic Goals 2013/17

• Improved Beam Stability  (BPMs)• Improved Beam Stability  (Thermal Stability in the Storage

Ring)• Storage Ring RF Transfer Line and Valve Box • Improved Machine Reliability• Common Data File Format • Calibration Service• Improve Control System Development Techniques• Replacement of Legacy Control Equipment• Increase the Performance of Data Acquisition Systems on

CLS Beamlines• Improved Human Factors of Control and Data Acquisition

Systems on Beamline

Requirements Management

PID Drawings

• Generally used in thepast.

• Relates field equipment tocontrol system inputs

• Quite effective.• Moving towards computerised

requirements management

See ICALEPS2009 TUP47

MKS

MKS Requirements .....

Prodex

Motion Control at CLS

• VME– Prodex OMS 58 and MaxV (the majority)

• Standalone– Prodex MaxNet– Schnider Electric - Mdrive – Newport XPS

• Special System– Bosh Controllers (IEC 61508 certifiable)

HXMA Experience

• We had a OMS 58 Card destroy a mono on one of our hard x-ray beamlines

• Problem was caused by a failed $2 IC that caused the FPGA to continue to pulse the motor

• We now do dual redundant limit switches where practice with the outer set interlocking driver power.

Layout

• Two breakoutboards

• Colour CodedCat 5 cabling

• Drivers locatednear the motors to reducenoise

• Complex but it works

SSI Version

• Traditional we have used absolute encoders only on the insertion devices

• We are now using SSI encodors broadly • Using a special MaxV option.• MTS R-Series?

The Challenges

• Beamline controls are very homogenous • More variability on data acquisition:

– Common elements:• EPICS at the device layer• Common sign-on and home directories (Centrify)

– Shared elements:• Most use our standard scanning engine• LOC interface for user built endstation

– Variable elements:• Actual experiment control

• Improved post-experiment data access

What is Science Studio?• Partnership with CLS, University of Western Ontario,

IBM Canada, IBM Research, and LNLS • Database for experiment information• Common object models & rest interface• Plug-in modules• Multi-laboratory capability• Includes:

– People (production)– Facility Info (production)– Training (production)– Data (Florescence and Diffraction)– Proposal (prototyped)– Schedule (prototyped)

Current High-level Data Model

endstation

beamline

CLS

Science Studio

• Applications are integrated through REST Interface

• Applications can either be data acquisition oriented or data analysis oriented

• They can also occur across multiple sites• Security implemented using CAS

Some Example Applications

XRD/XRF by CLS

SAXS Implemented by LNLS

Web VNC integration ofElectron microscopeUWO NanoFabBy UWO/CLSPeeakabook fitting software UWO

Training by CLS

Foxmas by UWO/SharcNet

Science StudioDatabase

Next Step....

• Integrate sufficient user office functionality to obtain more metadata

• Add additional upload capabilities from existing applications

• Add additional viewing capability• Integrate eduroam/access federation

Thank you for your time....

Funding Partners

Potential Restructured Model

endstation

SGM beamline

CLS

Options for DOI....

• Canada is a signatory to the OECD: “Declaration on Access to Research Data from Public Funding”

• We should expect their to become a condition on the award of any federal research funding.

• The European and DOE major facilities are moving toward the assignment of DOI numbers to data sets using a common system

• DOE is following down the same path (lead by Oak Ridge)• Generally practice is for the facility to be the publisher of

reference for data sets obtained by their users after the expiry of their embargo period.

• DataCite Canada (operated by NRC is the register)

• ScienceStudio requires minor modification to interface into the central register.

Canadian Access Federation• CLS has entered into an agreement with CANARIE on CAF• CAF – provides a mechanism for users to authenticate at CLS

using their home institutions credentials• CANARIE has agreements with their counterparts providing

international access• Currently three applications:

– Edurom access for users/visitors while at the CLS– Edurom access for CLS staff when traveling at member institutions

• Some ongoing work to integrate “CAS” layer in ScienceStudio with CAF servers at CLS. Significant potential to improve data transfer between CLS and Compute Canada facilities

HXMA Monocrometer

CAF Members (Aug 2012)

• British Columbia  • BC Campus     • British Columbia Institute of Technology     •   Camosun College   •   Emily Carr University of Art and Design   •   Great Northern Way Campus   •   Langara College   •   Okanagan College   •   Royal Roads University   •   Simon Fraser University     •   Thompson Rivers University   •   University of British Columbia     •   University of Victoria   •   Vancouver Community College • Alberta • Mount Royal University   •   University of Alberta     •   University of Calgary     •   University of Lethbridge     • Saskatchewan • SIAST• University of Saskatchewan     •   University of Regina   • Manitoba • University of Manitoba     •   Brandon University

•   Ontario • Brock University •   Carleton University   •   McMaster University •   OCAD University   •   Queen's University     •   Ryerson University   •   Sheridan College     •   University of Guelph     •   University of Ottawa   •   University of Toronto     •   University of Waterloo     •   University of Western Ontario     •   University of Windsor •   Wilfrid Laurier University   •   York University   • Québec• Concordia University   •   École de Technologie Supérieure   •   École Polytechnique de Montréal   •   HEC Montréal   •   McGill University     •   Université de Montréal   •   Université de Sherbrooke   •   Université du Québec à Montréal •   Université du Québec à Trois-Rivières   •   Université Laval

•  New Brunswick • University of New Brunswick   • Nova Scotia • Dalhousie University   • Saint Mary's University   • Newfoundland

and Labrador • Memorial University

Licensing Requirements (CNSC - Oct 22, 2010)

• Safety and Security Considerations– Use of third party certificate for SSL encryption (Thawte)– Integrated Video Feed of any area under remote control (OHS

requirement)– Single interface point between DMS and the beamline VLANs with

security.– Access is limited to specific experiment permit and only to members

of experiment– Remote user contact (phone number and e-mail must be available

within the system) – Remote access user training– Audit records of access times and experiment activities– Devices controllable limited to only those needed to perform the

experiment