Upload
uriah-holmes
View
36
Download
0
Tags:
Embed Size (px)
DESCRIPTION
ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner, Helge Brands, Rasmus Ischebeck. The Past Accelerator Data Acquisition Design Ideas The Present Available Tools Demo The Future Data Acquisition with Large Data Sets at 100 Hz. - PowerPoint PPT Presentation
Citation preview
© 2013 Paul Scherrer Institut
Slides available at http://people.web.psi.ch/ischebeck
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
ADAQAAn Accelerator Data Acquisition & Analysis FrameworkBolko Beutner, Helge Brands, Rasmus Ischebeck
>The Past
>Accelerator Data Acquisition
>Design Ideas
>The Present
>Available Tools
>Demo
>The Future
>Data Acquisition with Large Data Sets at 100 Hz
11
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
What Came Before…
(my personal collection of accelerator data acquisition)
>TESLA Test Facility at DESY, Hamburg
>Access to accelerator process variables from MATLAB, C++ (read/write)
>Easy to write data acquisition software, scan parameters, record variables…
>Data stored in .MAT, ASCII & ROOT files
>No common data format
>Experts required to set up scan, analyze data…
>SLAC LINAC at Stanford, California
>VAX-based control system
>Scan software to determine the dependency of a variable on a parameter
>On-line display & fits
>Writes MATLAB 4 files for further analysis
22
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
Design Goals
>Have a universal scan and data acquisition software
>Well-tested scan core
>Universal GUI to set up scan easily
>Specialized GUIs for easy access for regularly performed scans
>Error checking and treatment
>Common HDF5-based file format for easy access from any data analysis code
>Automatic generation of logbook entries
>Link to auxiliary information on accelerator configuration
>Synchronized data acquisition
33
Rasmus IschebeckRasmus Ischebeck
Data File Format
>Hierarchical format to store Instruments
>Based on HDF5
>Readable from Matlab, Root, Mathematica…
44www.nexusformat.or
g
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
Accelerator Data Acquisition
Many accelerator measurements consist of the following tasks:
>Control 0…N actuators
>Acquire 1…M measurements
>Analyze data
Important features
>On-line analysis
>Reasonable error handling
>Robust code for use by other persons than the programmer
55
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
ADAQA Layers
>ADAQA consists of several separate building blocks
>Applications, written by different programmers, make use of the same data acquisition code
>Instruments gather connected devices
>Logbook
>Common data storage format
>Online model*
>Device information server*
>Synchronized data acquisition
* ongoing work, not yet ready for prime time
66
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
ADAQA Layers
>Tree-like structure:
>Many devices (roots)
>One data acquisition core (trunk)
>Many applications (branches)
>Building blocks can be exchanged
77
Devices
DataAcquisitio
n
Applications
Wikipedia
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
Synchronized Data Acquisition
>All VME crates for diagnostics are equipped with an Event Receiver
>Connected with a star topology network to the Event Generator
>Supported for:
>BPMs, Bunching monitor, RF, …
>Ongoing work:
>Laser shutter, oscilloscopes, cameras
88Sven
Nordquist
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
• ScreenMonitorTool• General Purpose Scan Tools• Specialised Scan Tools
–Slice Emittance–Optics Matching–Slit Scan–…
• “Do it yourself! - Scan Tools
ADAQA Applications
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
• General purpose camera display andanalysis tool
• In every day use for different kinds of cameras and screen monitors
ScreenMonitorTool
Dione and Saturnhttp://www.ciclops.org
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
General Purpose Scan Tool
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
the future…
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
• Scans can be stored in Template files• The last scan is always stored as template
–“Repeat Last Scan…”-Button
• Data files are scan templates as well–All scans can be exactly repeated
• Templates can handed over to the scan tool at startup–example: extracted charge vs. gun phase scan
Scan Templates
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
Specialised Scan Tools
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
Specialised Scan Tools
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
Automatised logbook entries
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
• General and specialised scan tools are possible with ADAQA–a wide variety of tools is available
• Common data format• Templates
–data files are templates – for all tools
• Actions–e.g. automatic screen insertion or background subtraction
• Analysis functions
• Automatic logbook entries
Scan Tools Summary
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
knob{1} = LoadKnobDefinition('ManagementKnob'); % setup Knob and Instrumentknob{1}.SetpointValues = [1, 2.4, 3, 3.78, 92]; % scan setpoints
instrument{1} = LoadInstrumentDefinition('SwissFEL_Meeting_Demo');
Setup.Function = 'scan'; % define scan setupSetup.Repeat = 10; % “shots” per scan step
Info.Author = 'Beutner'; % human readable infoInfo.Title = 'SwissFEL Meeting Demo';Info.Purpose = 'this is a small scan tool for demo...';
[DAQFileName, Setup, knob, instrument, Info] = ... daq(Setup,knob,instrument,Info); % execute scan
% …insert your analysis code here…
Do it yourself! - Scan Tools
Image based measurements: today
IOC
AFS
EPICS Control+Data
cameraworkstation
Helge Brands
control room
Image based measurements: today
Problems:• available buffers on IOC are not used• „lost“ of measured data• high frequencies can‘t be reached• high CPU load on workstations
Helge Brands
IOC
AFS
EPICS Control+Data
cameraworkstation
control room
Image based measurements : future
DATA
Compute-Node
Results
Results+Data
IOC
AFS
EPICS Control+Preview
cameraworkstation
Helge Brands
control room
Why?
•less radiation•higher recording speed (10Hz/100Hz)•independent of the workstation (CPU and memory)•system is similar to SLS (Tomcat, in operation, 1* PCO Edge)
Helge Brands
Why?
•less radiation•higher recording speed (10Hz/100Hz)•independent of the workstation (CPU and memory)•system is similar to SLS (Tomcat, in operation, 1* PCO Edge)
BUT
Helge Brands
Technical values
example: ~30TB/week
more storage needed
Helge Brands
Specs
storagesize/speed
network(camera IOC)
IOClocal memory
compute nodes
WHLATest-Injector
558 GB/50MB/s
1Gb/s 16GB~3000 pic
1-2
SwissFEL (?)/(?) 10Gb/s (?) min. 5-10
Helge Brands
Current situation
•WHLA: each Camera-IOC has 1GB/s (enough for 10Hz) •3 PCO Edge in operation + 1 PCO Edge in preperation•upload to AFS max 50MB/s•software is ready for 100Hz•needed network speed 10GBit/s for 100 Hz•other GIGE cameras can be used too•additional compute nodes should be planned•storage policies are needed
Helge Brands
>Project started in 2008, always between 5 and 10 developers
>Written mostly in Matlab
>89093 lines of code (including code sourced from MathWorks Central and other external sources)
>Performed 22775 scans, resulting in 558 GB of data
>A joint project between the Controls, Beam Dynamics & Diagnostics Sections at PSI
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
ADAQA
3131
ADAQADiagnostic
sControl
sBeam
Dynamics
© 2013 Paul Scherrer Institut
Slides available at http://people.web.psi.ch/ischebeck
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
Outlook> We are looking forward to many new
applications for SwissFEL!
> Thank You to:
> all ADAQA programmers and users, in particular Eduard Prat, Marta Divall, Peter Peier, Marc Guetg, Gian Luca Orlandi, Bennie Smit & Thomas Schietinger
> support from Jan Chrin & Babak Kalantari
3232Sven Nordquist