The FNAL “LHC Physics Center” Preparing for CMS Physics at Fermilab

The FNAL “LHC Physics Center”

Preparing for CMS Physics at Fermilab

DOE Annual Program ReviewAvi Yagil

17 May 2006 LPC - DOE Annual Program Review Avi Yagil 2

A Talk within a Talk…

• Inside: A presentation by Sarah during the Annual US-CMS collaboration mtg (Apr 06, Nebraska)

• Wrapper: My comments, observations…

Will try to keep talk short… Please, guide it with your questions!


Brief History, Status

• Motivation - “why worry now?”

• Getting started - LPC

• First discussion:

– Why do we cluster?

– The “plan”

• Status (1 slide)


• Commissioning– Complex detectors, environment– Took CDF ~18 months (just for RunII startup!!)– Period to build credibility for future physics results

• Partially instrumented detector (?)– No pixels Very different tracking strategy and capabilities. Study now!– Tracking always slower to mature, big impact

• New Energy regime– Some (possibly exciting) physics is accessible with calorimetry only. Need

to work on it now.– Really exploration machine! No paradigm, “golden” channels…

• Must be ready and prepared for anything• Do not waste time (money) on #17

Why worry now? “Day-One”


• Darin Acosta (Florida)• Claudio Campagneri (UCSB)• John Conway (Rutgers)• Sridhara Dasu (Wisconsin)• Regina Demina (Rochester)• Greg Landsberg (Brown)• Christoph Paus (MIT)• Chris Tully (Princeton)• John Womersley (FNAL)

•

• Lothar Bauerdick (FNAL)• Bob Cousins (UCLA)• Dan Green (FNAL)• Sarah Eno (Maryland)• Avi Yagil (FNAL)

Since Added:• Max Chertok (Davis)• Cecilia Gerber (UIC)

LPC Founding Fathers & Mothers, Adv Brd

Recently: rotate 1/3, new chair members…A bit more from that 1st mtg:

First Discussion on Feb 12th 2004

Julia Thom (Cornell)Bob Hirosky (Virginia) Mo Swartz (JHU)


Why do we cluster?• Detector location• Operations: Shifts, Data validation, Maintenance

• Computing: Data reconstruction, Storage, Simulation• Critical mass for complex analyses• Experts (mainly tracking, calor, calib, sim...)• Presentations & Meetings• New students & post-docs education• Gossip and other “social” activities

In the end, our common goal is Physics output. Can “remote clustering” be successful?


Agreed on a “Plan”• Establish the LHC Physics Center (LPC), so that we

can:

– Build local low-level software expertise and infrastructure– Learn: what’s available (in CMS)? How good is it? What

should we concentrate on?– Enable University participation by leveraging initial lab effort– Invite and encourage sharing of CDF/D0 collaborations

efforts (specifically of post-docs and students)– Establish skeleton local algorithm groups– Participate in CMS activities as a community

==> Sent letter to Mike that started the whole thing.


Where are we now?• We managed to build a strong foundation:

– Most points from the “plan” we made where actually and surprisingly achieved in an amazing short period.

• Our working groups completed the study of the available • Some are major contributors to current developments (framework, tracking, Jet, Met, code

management,…)• Lab support has been and still is very strong• LPC is one of the best places (if not the best) in terms of low-level SW expertise in CMS

• Examples:- Six active working groups- Workshops, Schools, mtgs (a few highlights):

- Hosted CMS Physics week- J-term- Hosted CMS Tracker/SW joint workshop- Initiated and will host the first joint FNAL/CERN HCSS

- Recently: started analysis oriented Physics effort- Remote Operation Center (ROC)

Became (literally) a model for imitation by CERN and others

The FNAL “LHC Physics Center”

Sarah Eno, U. MarylandUS CMS Meeting

Apr. 7, 2006, Nebraska


LPC

• a critical mass (clustering) of young people who are actively working on software (reconstruction, particle identification, physics analysis) in a single location (11th floor of the high rise),

• a resource for University-based US CMS collaborators; a place to find expertise in their time zone, a place to visit with their software and analysis questions,

• a brick-and-mortar location for US-based physics analysis, with such physical infrastructure as large meeting rooms, video conferencing, large scale computing, and a “water cooler” for informal discussions of physics.

Located on the 11th floor of the FNAL high rise, the purpose of the LPC is to ensure the US gives the strongest possible assistance to international CMS in software preparations for Day 1 and to enable physics analysis from within the U.S.

Founded Feb 2004


2005• Moved into 11th floor in early 2005

• create of ROC

• planning of LHC@FNAL

• international CMS physics week

•3 sessions of CMS101/ 4 sessions of software tutorials

• J-Term

• 2 week summer school (run by Dan Green)

• over 50 summer visitors who stayed at least 2 continguous weeks

• Physics workshop

• LHC: the first one-two years mini workshop

• All US CMS Meeting

• Wine and cheese on LPC at FNAL

• new working groups (tau, cosmic challenge/roc, physics)


Facilities


Resources: 11th Floor• Meeting Rooms/Video Conferencing/Internet

• terminals/printers/office supplies

• secretarial and computer support

• Coffee machines/Water cooler

• Lockers for transient use

Transient space

Room for 60 transients from Universities plus 60 permanent residents

Meeting rooms

Remote operations center

Currently 25 University employees permanently on 11th floor.


ROC15th Sept. ‘05.

Kaori Maeshima, Alan Stone et al.


We’ve got data!

(working in conjunction with the FNAL CMS Tier1 team)


Web Informationhttp://www.uscms.org/LPC/LPC.htm


Web


Computer HelpPatrick Gartung

system administration of the Linux PC's at the LPC and the ROC

• all common login PC's and some university PC'suser support for

•Windows and Linux laptops at the LPC• accessing the UAF resources from the LPC and universities• the video conference rooms at the LPC• running CMS software•setting up the PC's and video conference equipment in the ROC•developing software configurations for new Linux desktop installations


Inform/Educate


All US CMS Meeting

• (almost) every Friday• well-attended both in person and via vrvs

Typical Agenda •News from Dan• News from Ian/Jon• Hardware News (Hadley/Maravin)• one topical talk

May 13 EDM report - Liz Sexton-Kennedy May 20 sLHC - Wesley SmithMay 27 e/gamma - Yuri GersteinJun 3 trigger - SridharaJun 10 jet/met - Rob HarrisJun 17 (cancel due to cms week?Jun 24 (cancel due to cms annual review?)Jul 1 The CMS Forward Pixel Project - John ConwayJul 8 Making contact with theorist - Steve MrennaJul 15 muon alignment - Marcus HohlmannJul 22 LPC muon group - Eric JamesJul 27 due to Dan's lecture seriesAug 5 Authorship list requirements - Dan GreenAug 12 Magnet studies - Rich SmithAug 19 Data bases for Cosmic Ray test - Lee LuekingAug 26 luminosity preparation - Dan MarlowSep 2 cosmic analysis in the U.S. - Yurii MaravinSep 9 cosmic workshopSep 16 ROC - KaoriSep 23 CMS week Sep 30 Simulation Certification Project - Daniel ElviraOct 7 physics workshopOct 14 (HCAL meeting at FNAL) MET - Richard CavanoughOct 21 Calorimetry Task Force - Jeremy MansOct 28 HCAL calibration - Shuichi KunoriNov 4 P420 Proposal - Mike AlbrowNov 11Nov 18 Tier 2's for me and you - Ken Bloom


CMS101 Agenda


Tutorials Agenda


International CMS “Physics” Workshop/USCMS Meeting


Article on Mini-Workshop


Summer School Agenda


Summer ‘05Over 50 University-based physicists visited the LPC for at least 2 weeks this summer.

11th floor X-over•Summer school•CMS 101•tutorials


Inauguration of LPC Physics Effort -Workshop @FNAL on Oct. 7, 2005

Goals Get to know (communications is the name of the game!)

each other who is doing what wrt Physics analysis what level of support already exists at the LPC (computing, software, algorithms, environment,…)

Find out where one can fit in Join one (or more) of the working groups Allow newcomers to learn from the experience of those already active in CMS analysis Help in shaping up our future – feedback, input Begin to enjoy the road to the “promised land”…

Great Success - ~60 Participants at WH1W + ~20 VC Connections


J-Term Intro to CMS at LPC

Attended by over 70 1st and 2nd year grad students!


People/Working Groups


More than just furniture…Run by Avi Yagil, Sarah Eno •offline/edm: Liz Sexton-Kennedy (FNAL), Hans Wenzel (FNAL)

• tracking: Kevin Burkett (FNAL), Steve Wagner (CO)

• e/gamma: Yuri Gershtein (FSU), Colin Jessup (Notre Dame)

• muon: Eric James (FNAL) , Michael Schmitt (Northwestern)

• jet/met: Rob Harris (FNAL), Marek Zielinski (Roch)

• Tau: Anna Goussiou (Notre Dame), Alexei Safonov (Texas A&M)

• simulation: Daniel Elvira (FNAL), Harry Cheung (FNAL)

• trigger: Greg Landsberg (Brown) , Kaori Maeshima (FNAL)

• Physics: Boaz Klima (FNAL)

Heidi

Hans

Daniel Yuri

Rob

Eric

MarekLiz

Boaz

Kevin

Kaori

Avi

Sarah

Steve

Michiel

Greg

Harry

Colin

Alexei

Anna


Thanks and Welcome!

Thanks!

Welcome!

Colin

Steve Michiel

Harry

Greg

Sasha

MartijnHeidi

Sridhara

Alexei Anna


Integration with CMS “CPT Project” for Computing, Software, Physics Reconstruction and Selection

Frequently on 11th floor or on LPC advisory council

EvF/DQME. Meschi

ReconstructionT. Boccali

Analysis ToolsL. Lista

SimulationM. Stavrianakou

Daniel Elvira

Calibr/alignmentO. Buchmuller

L. Malgeri

FrameworkL. Sexton

SoftwareL.Silvestris

A.Yagil

Integration Program

S. Belforte/I. Fisk

Facilities and Infrastructure

N. Sinanis

Operations ProgramL. Barone

Technical Program

P.Elmer/S.Lacaprara

ComputingL. Bauerdick

S. Belforte

Project ManagerP.Sphicas

Project OfficeV.Innocente

L.Taylor

Fast SimulationP. Janot

ECAL/e-C. Seez

Y. Sirois

TRACKER/b-I.TomalinF. Palla

HCAL/JetMETJ.RohlfC.Tully

MuonsN. NeumeisterU.Gasparini

PRSD.Acosta

A. DeRoeck

OnlineSelectionS. Dasu

C. Leonidopoulos

HiggsS. Nikitenko

SUSY & BSML. Pape

M. Spiropulu

Standard ModelJ. Mnich

Heavy IonsB. Wyslouch

Generator ToolsF. Moortgat

S. Slabospitsky

ORCA for PTDRW. Adam

SW Devel ToolsS. Argiro

GeometryM. Case


The LPC & Universities• a postdoc who is stationed at FNAL working on both CMS and a Tevatron experiment can have a desk on the 11th floor and be near people from both experiments.• a CMS postdoc can be stationed at FNAL and benefit from having many people close by to interact with• a postdoc stationed at your university can come for a month, to get up to speed on analysis basics and to form personal connections that will help his/her later work• students can come for the summer to interact with a wide variety of experts and learn the basics on the CMS environment• Faculty can come every other week to keep their connections with the experimental community .• Faculty can come for a day for help with a particularly knotty software or analysis problem

Participation in the groups will both help them do physics and allow them to serve the US and

International CMS


US University InvolvementSimulation: FNAL, FSU, Kansas State, Kansas, Louisiana Tech/Calumet, Maryland, Northwestern, Notre Dame, Rutgers, UIC, SUNY Buffalo, Nanjin, Ciemat, Tata, Puerto Rico, Mississippi, Colorado

Jet/Met: FNAL, Rochester, MD, Rutgers, Boston, Cal Tech, Florida, Rockefeller, Princeton, Texas Tech, Iowa, Mississippi, Minnesota, Santa Barbara, Northwestern

Muon: FNAL, Carnegie Mellon, Florida, Florida Tech, Purdue, Nebraska, Northwestern

e/gamma: FNAL, Northwestern, FSU, Minnesota, MD, Brown, Notre Dame, San Diego, Cal Tech, Cornell, Virginia, Kansas State

Tracking: FNAL, Colorado, Cornell, Nebraska, UC Davis, UCSB, UC Riverside, Kansas, Calumet

Trigger: Wisconsin, Florida, Northwestern, FNAL, Vanderbilt, Texas A&M, Brown, Maryland, LLNL, UIC

Offline/edm: FNAL, Cornell, CalTech

Physics: all


“11th” Floor25 “permanent” University employees on “11th” floor

Brown , Buffalo, CMU, Kansas State, MD, MN, Northeastern, Puerto Rico, Rochester, Rockefeller, Rutgers, Texas A&M, UC Davis , UIC, FSU


Plans for Coming Year•Commissioning of ROC / Cosmic slice test

• Expansion onto 10th floor

• Full house this summer

• CMS101/Tutorials in June and September

• LHC@FNAL

•Strengthening of working groups, especially the brand-new physics group

•Development of realistic “run plan” for early data taking

• Working with detector groups


LPC and MTCCMTCC = Magnet Test & Cosmic Challenge

– Start of test = Detector close, June 6, 2006– Goals: test and train magnet, integrate detectors.– Date has slipped. Summer visitors can now participate.– Data will be brought to FNAL for analysis.

• Some (e.g. HCAL brightening data) will be kept and archived at Fnal.)

– Also some real time monitoring will be done.– Specific plan for LPC analysis varies by group and is in

formulation• (ECAL, EMU, HCAL, Tracker, Trigger)

– Many periods without data taking, no shifts currently envisioned, brief daily meeting instead.


LPC and Test Beam

Test Beam planned for late summer. – ECAL, HCAL, …– Data will be brought to FNAL (as was done for

previous test beams)– ECAL and HCAL have LPC based analysis plans for

this data.– Shift(s) at ROC and real time data monitoring planned

• Shifts likely not 24/7 •Nick •Yurii


This Summer

(Brown, Carnegie Mellon, Colorado, Cornell, FIT, FSU, KS, MD, Mississippi, Northwestern, Ohio State, Puerto Rico, Rochester, Rockefeller, Rutgers, Buffalo, Texas A&M, Florida, UC Davis, UC Riverside, UIC, Virginia)


10th Floor

???


LHC@FNAL Location & Layout

Operations Center

(Phase 1) Office Space(Phase 2)

ConferenceRoom

(Phase 1)


LHC@FNAL Current Status

• LHC@FNAL layout endorsed by Fermilab Director• Conceptual Design Report completed and reviewed• Project Execution Plan written• Project Managers

– Elvin Harms (FNAL-AD) – construction– Erik Gottschalk (FNAL-PPD) – consoles

• Weekly meetings to prepare construction drawings• Presentation to US-CMS Collaboration (early April)• Presentation to LHC Accelerator Research Program

(LARP) at its collaboration meeting (late April)• Construction complete by end of FY06


Conclusions

Hope to see you on the 11th floor!


Impact of LPC• Although not formally commissioned until early

2005, LPC have already had a big impact on CMS:– Review of software framework led to overhaul of

CMS software from the bottoms up (new framework, event data model).

– One of the two tracking packages CMS uses, has been developed and is supported by the LPC tracking group.

– LPC Jet/Met group leads the implementation of Jet and Met reconstruction software in the new framework.

– ROC is setting an example for remote participation/access (CMS is planning the CCAR).

– To date, best place to pick up and get started on CMS.


Interaction terms - Key to success

• The three legs: – US-CMS S&C– FNAL CD/PPD– LPC

• There have been an early understanding of the potential benefits from coordination:

– Joint study groups (CDF/D0, CD experts, US-CMS colleagues)• Started with tracking --> code distribution, framework…

– Utilizing CD “consultancy time”, huge impact! (critical during early stage)– Consolidating US-CMS S&C efforts around few, well chosen projects

• Instead of “shipping individual effort across the Atlantic”• Maintain constant project effort level (see Liz’ talk) • Push overall effort level. Enable physicists contributions, broader participation.

– Tremendous cross-fertilization• Impact rather obvious


Summary

• 2005: concentration on the physics-enabling environment and reconstruction tools. Aspects ranging from muon identification to trigger tables to jet calibration.

• 2006: moving closer to physics analyses, via the path of understanding the detectors during the cosmic challenge and test beam. Starting to plan for commissioning, Day-1 Physics.

• 2007:

Documents

The FNAL “LHC Physics Center” Preparing for CMS Physics at Fermilab