34
Ruth Taylor Pacific Northwest National Laboratory LIGHTFAIR May 9-12, 2012 COMMERCIALLY AVAILABLE LED PRODUCT EVALUATION AND REPORTING PROGRAM Recent Findings from CALiPER Testing

Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

Program Name or Ancillary Text eere.energy.gov

Ruth Taylor Pacific Northwest National Laboratory

LIGHTFAIR May 9-12, 2012

COMMERCIALLY AVAILABLE LED PRODUCT EVALUATION AND REPORTING PROGRAM

Recent Findings from CALiPER Testing

Page 2: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 2 | Solid-State Lighting Program

DOE SSL Support Programs

Page 3: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 3 | Solid-State Lighting Program

CALiPER at a Glance

Why testing products is valuable: Capture market trends and gauge performance levels Identify important areas for improvement Manufacturer accountability Inspire consumer confidence

Scope of products: SSL General illumination White light Market available

Page 4: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 4 | Solid-State Lighting Program

CALiPER Process

Product Selection & Purchasing

Independent LM-79-08 Testing

Data Analysis

Report Publication

Page 5: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 5 | Solid-State Lighting Program

Step 1: Selection & Purchasing

I. Industry observations Conventions, trade shows, and conferences Trade publications, popular media Manufacturer marketing materials

II. LED Lighting Facts quality assurance concerns Do reported values reflect commercially available products?

III. CALiPER guidance committee

Manufacturers can’t request tests or submit products!

Page 6: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 6 | Solid-State Lighting Program

Step 1: Selection & Purchasing

Challenges in the early stages: Setting criteria—capture the market? ‘Vapor fixtures’—we just can’t get them Very long lead times We must be very careful that we receive what we ordered Products sometimes arrive damaged or broken

Page 7: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 7 | Solid-State Lighting Program

Step 2: SSL Luminaire Testing

Independent testing laboratories

Uses absolute photometry rather than relative photometry (IES LM-79-08) Must measure luminaire as a

complete system

Benchmark products for each application are also tested to LM-79

Integrating sphere and goniophotometer testing

Photo credit: Luminaire Testing Laboratory

Page 8: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 8 | Solid-State Lighting Program

Step 3: Data Analysis

Performance compared to conventional technologies

Performance relative to manufacturer data

Evaluation of equivalency claims

Comparison to LED Lighting Facts

Comparison to ENERGY STAR® (or other) criteria

Page 9: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 9 | Solid-State Lighting Program

Step 3: Data Analysis

Key questions to answer: Does the product perform as claimed?

Marketing literature (equivalency and performance claims) Specification sheets (at the time of the order) Product packaging

Does the product perform as expected? What are you replacing? What are you trying to accomplish? How does the SSL product compare to conventional alternatives?

Page 10: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 10 | Solid-State Lighting Program

Step 4: Report Publication

2006–2011 SUMMARY REPORTS

3 “Rounds” per year Range of products

Summary Reports

Detailed Reports

Special Reports

New for 2012! APPLICATION

REPORTS Continuous data More focused LED Lighting Facts QA

Page 11: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 11 | Solid-State Lighting Program

2006 Pilot phase 4 products (hard to

purchase)

2007 Rounds 1-3 Small replacement

lamps, desk lamps, undercabinet, small downlights

2008 Rounds 4-6 Downlight and T8 in

situ testing, replacement lamps

2009 Rounds 7-9 Streetlights, bollards,

downlights, 2x2 panels, 2x4 troffers, replacement lamps

2010 Rounds 10, 11 Parking garage, wallpack,

cove lights, replacement lamps, roadway, high-bay

2011 Rounds 12, 13 Downlights, track lights, A-

lamps, T8 replacements, cove lights, high-bays, wall packs, 2x2 troffers

Summary Reports

Comparative Analysis

Page 12: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 12 | Solid-State Lighting Program

This Year

Flood lights AR111,BR30,PAR38

Linear pendants Wall washers

Upcoming Testing

Released Downlight Retrofits (New Format!) Retail Replacement Lamps 2 (Special)

Next Year

High-output A-lamps Troffers (2x4s, 2x2s) T-8 Replacements Track Bollards

Page 13: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 13 | Solid-State Lighting Program

Detailed Reports

Login to CALiPER Page

Page 14: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 14 | Solid-State Lighting Program

Detailed Reports

Login to CALiPER Page

Page 15: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 15 | Solid-State Lighting Program

Detailed Reports

See Full Test Results!

Page 16: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 16 | Solid-State Lighting Program

Past and Future Efforts

Special Reports

Benchmark Reports PAR Lamp Benchmark Report* A Lamp Benchmark Report MR16 Benchmark Report Troffer Benchmark Report

Exploratory Studies Dimming Product and Testing Variability Long-term Testing Thermal Imaging Flicker Future: Flicker, Dimming, Power

Quality Tradeoffs Future: Office & Classroom Lighting

Page 17: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 17 | Solid-State Lighting Program

Performance to Date

0

20

40

60

80

100

120

2006

Mea

n Ef

ficac

y (lm

/W)

2007 2008 2009 2010 2011

CALiPER Test Results

[All Product Types]

Page 18: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 18 | Solid-State Lighting Program

High Level Observations

Overall improvements in light output, efficacy, light distribution, power factor, color quality

Manufacturer claims are improving (LED Lighting Facts label helps) but equivalency claims are still a problem

Suitability often depends on application Comparable products are now found in many lighting applications Poor performing products are also found

Careful comparisons based on accurate performance data is an absolute necessity

Be cognizant of “secondary” quality issues: glare, flicker, color tolerances, physical formats, reliability…

Page 19: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 19 | Solid-State Lighting Program

Recent Findings

Retail Replacement Lamp Study - #2 Retrofit Downlights Floods

Page 20: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 20 | Solid-State Lighting Program

Retail Replacement Lamps (Part 2!)

Special Reports

38 Total Products. 9 Different Retailers. 18 Different Manufacturers.

A19 G25 MR16 PAR20 PAR30

Page 21: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 21 | Solid-State Lighting Program

Retail Replacement Lamps (Part 2!)

0

100

200

300

400

500

600

700

800

900

1000

$0 $10 $20 $30 $40 $50 $60 $70 $80

Out

put (

lm)

Cost per Lamp

Retail Replacement Lamps 2 Retail Replacement Lamps 1 Incandescent Benchmarks Halogen Benchmarks CFL Benchmarks

1. Includes only products of the same types tested in RRL2.

RRL1: $139/klm1

RRL2: $63/klm (mean)

Special Reports

Page 22: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 22 | Solid-State Lighting Program

Bang for the Buck? Luminous Efficacy

22

0

10

20

30

40

50

60

70

80

90

100

$0 $10 $20 $30 $40 $50 $60 $70 $80

Lum

inou

s Ef

ficac

y (lm

/W)

Cost per Lamp

Retail Replacement Lamps 2 Retail Replacement Lamps 1 Incandescent Benchmarks Halogen Benchmarks CFL Benchmarks

RRL1: $0.69/lm/W1

RRL2: $0.49/lm/W (mean)

1. Includes only products of the same types tested in RRL2.

Page 23: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 23 | Solid-State Lighting Program

Retailers: Is Listed Performance Accurate?

23

Ret

aile

r

Lumen Output Expectations Efficacy Expectations

A

B

C

D

E

F

I

J

K

Note: Products listed for a retailer include any sold at the store that were tested as part of RRL2, regardless of purchase location.

Ret

aile

rs a

lso

test

ed in

RR

L1

Meets Below Above Criteria: ±10%

Page 24: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 24 | Solid-State Lighting Program

Manufacturers: Is Listed Performance Accurate?

24

Lumen Output Expectations Efficacy Expectations

Man

ufac

ture

r

1 2 3 4 5 6 8 9 10 11 12 13 14 15 16 17 18 19

Man

ufac

ture

rs

also

test

ed in

R

RL1

Meets Below Above Criteria: ±10%

Page 25: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 25 | Solid-State Lighting Program

Product Type: Is Listed Performance Accurate?

25

Lumen Output Expectations Efficacy Expectations

Pro

duct

Typ

e

A19

G25

MR/PAR16

R/PAR20

R/PAR30

Meets Below Above Criteria: ±10%

Page 26: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 26 | Solid-State Lighting Program

Comparison to First Study

Lumen output, efficacy, and color rendering all improved when evaluated on a cost per lamp basis. Increased prevalence of product labels

Significant increase in number of lamps with ENERGY STAR qualification (29% vs. 6%).

Significant increase in number of lamps listed by LED Lighting Facts (61% vs. 15%).

Better at meeting manufacturer data In RRL1, 56% of products met output claims, whereas in RRL2, 68%

met output claims (92% met or were above). In RRL1, 79% of products met color quality claims, whereas in RRL2

92% met color claims (both CRI and CCT). More for the money

55% reduction in cost per kilolumen ($63 versus $139) in just 15 months

38% reduction in cost/lumen/watt ($0.49 versus $0.79) in just 15 months

26

Page 27: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 27 | Solid-State Lighting Program

Summary Report 14 Retrofit Downlights

11-76 11-75 11-74 11-73 11-64 11-63

11-103 11-98 11-97 11-96 11-82

Page 28: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 28 | Solid-State Lighting Program

Summary Report 14 Retrofit Downlights

Page 29: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 29 | Solid-State Lighting Program

Summary Report 14 Retrofit Downlights

Page 30: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 30 | Solid-State Lighting Program

Summary Report 15 - Floods

11-99 11-78 11-77 11-71 11-70

12-06 12-01 11-105 11-101 11-100

Page 31: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 31 | Solid-State Lighting Program

Summary Report 15 - Floods

Page 32: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 32 | Solid-State Lighting Program

Summary Report 15 - Floods

Page 33: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 33 | Solid-State Lighting Program

Summary Report 15 - Floods

Page 34: Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds 10, 11 Parking garage, wallpack, cove lights, replacement lamps, roadway, high-

www.ssl.energy.gov 34 | Solid-State Lighting Program

Ruth Taylor Pacific Northwest National Laboratory

LIGHTFAIR May 9-12, 2012

Questions?

Ruth Taylor [email protected]