Recent Findings from CALiPER Testing · 2016-09-20 · 2x4 troffers, replacement lamps 2010 Rounds...

Program Name or Ancillary Text eere.energy.gov

Ruth Taylor Pacific Northwest National Laboratory

LIGHTFAIR May 9-12, 2012

COMMERCIALLY AVAILABLE LED PRODUCT EVALUATION AND REPORTING PROGRAM

Recent Findings from CALiPER Testing

www.ssl.energy.gov 2 | Solid-State Lighting Program

DOE SSL Support Programs

www.ssl.energy.gov 3 | Solid-State Lighting Program

CALiPER at a Glance

Why testing products is valuable: Capture market trends and gauge performance levels Identify important areas for improvement Manufacturer accountability Inspire consumer confidence

Scope of products: SSL General illumination White light Market available

www.ssl.energy.gov 4 | Solid-State Lighting Program

CALiPER Process

Product Selection & Purchasing

Independent LM-79-08 Testing

Data Analysis

Report Publication

www.ssl.energy.gov 5 | Solid-State Lighting Program

Step 1: Selection & Purchasing

I. Industry observations Conventions, trade shows, and conferences Trade publications, popular media Manufacturer marketing materials

II. LED Lighting Facts quality assurance concerns Do reported values reflect commercially available products?

III. CALiPER guidance committee

Manufacturers can’t request tests or submit products!

www.ssl.energy.gov 6 | Solid-State Lighting Program

Step 1: Selection & Purchasing

Challenges in the early stages: Setting criteria—capture the market? ‘Vapor fixtures’—we just can’t get them Very long lead times We must be very careful that we receive what we ordered Products sometimes arrive damaged or broken

www.ssl.energy.gov 7 | Solid-State Lighting Program

Step 2: SSL Luminaire Testing

Independent testing laboratories

Uses absolute photometry rather than relative photometry (IES LM-79-08) Must measure luminaire as a

complete system

Benchmark products for each application are also tested to LM-79

Integrating sphere and goniophotometer testing

Photo credit: Luminaire Testing Laboratory

www.ssl.energy.gov 8 | Solid-State Lighting Program

Step 3: Data Analysis

Performance compared to conventional technologies

Performance relative to manufacturer data

Evaluation of equivalency claims

Comparison to LED Lighting Facts

Comparison to ENERGY STAR® (or other) criteria

www.ssl.energy.gov 9 | Solid-State Lighting Program

Step 3: Data Analysis

Key questions to answer: Does the product perform as claimed?

Marketing literature (equivalency and performance claims) Specification sheets (at the time of the order) Product packaging

Does the product perform as expected? What are you replacing? What are you trying to accomplish? How does the SSL product compare to conventional alternatives?

www.ssl.energy.gov 10 | Solid-State Lighting Program

Step 4: Report Publication

2006–2011 SUMMARY REPORTS

3 “Rounds” per year Range of products

Summary Reports

Detailed Reports

Special Reports

New for 2012! APPLICATION

REPORTS Continuous data More focused LED Lighting Facts QA

www.ssl.energy.gov 11 | Solid-State Lighting Program

2006 Pilot phase 4 products (hard to

purchase)

2007 Rounds 1-3 Small replacement

lamps, desk lamps, undercabinet, small downlights

2008 Rounds 4-6 Downlight and T8 in

situ testing, replacement lamps

2009 Rounds 7-9 Streetlights, bollards,

downlights, 2x2 panels, 2x4 troffers, replacement lamps

2010 Rounds 10, 11 Parking garage, wallpack,

cove lights, replacement lamps, roadway, high-bay

2011 Rounds 12, 13 Downlights, track lights, A-

lamps, T8 replacements, cove lights, high-bays, wall packs, 2x2 troffers

Summary Reports

Comparative Analysis

www.ssl.energy.gov 12 | Solid-State Lighting Program

This Year

Flood lights AR111,BR30,PAR38

Linear pendants Wall washers

Upcoming Testing

Released Downlight Retrofits (New Format!) Retail Replacement Lamps 2 (Special)

Next Year

High-output A-lamps Troffers (2x4s, 2x2s) T-8 Replacements Track Bollards

www.ssl.energy.gov 13 | Solid-State Lighting Program

Detailed Reports

Login to CALiPER Page

www.ssl.energy.gov 14 | Solid-State Lighting Program

Detailed Reports

Login to CALiPER Page

www.ssl.energy.gov 15 | Solid-State Lighting Program

Detailed Reports

See Full Test Results!

www.ssl.energy.gov 16 | Solid-State Lighting Program

Past and Future Efforts

Special Reports

Benchmark Reports PAR Lamp Benchmark Report* A Lamp Benchmark Report MR16 Benchmark Report Troffer Benchmark Report

Exploratory Studies Dimming Product and Testing Variability Long-term Testing Thermal Imaging Flicker Future: Flicker, Dimming, Power

Quality Tradeoffs Future: Office & Classroom Lighting

www.ssl.energy.gov 17 | Solid-State Lighting Program

Performance to Date

0

20

40

60

80

100

120

2006

Mea

n Ef

ficac

y (lm

/W)

2007 2008 2009 2010 2011

CALiPER Test Results

[All Product Types]

www.ssl.energy.gov 18 | Solid-State Lighting Program

High Level Observations

Overall improvements in light output, efficacy, light distribution, power factor, color quality

Manufacturer claims are improving (LED Lighting Facts label helps) but equivalency claims are still a problem

Suitability often depends on application Comparable products are now found in many lighting applications Poor performing products are also found

Careful comparisons based on accurate performance data is an absolute necessity

Be cognizant of “secondary” quality issues: glare, flicker, color tolerances, physical formats, reliability…

www.ssl.energy.gov 19 | Solid-State Lighting Program

Recent Findings

Retail Replacement Lamp Study - #2 Retrofit Downlights Floods

www.ssl.energy.gov 20 | Solid-State Lighting Program

Retail Replacement Lamps (Part 2!)

Special Reports

38 Total Products. 9 Different Retailers. 18 Different Manufacturers.

A19 G25 MR16 PAR20 PAR30

www.ssl.energy.gov 21 | Solid-State Lighting Program

Retail Replacement Lamps (Part 2!)

0

100

200

300

400

500

600

700

800

900

1000

$0 $10 $20 $30 $40 $50 $60 $70 $80

Out

put (

lm)

Cost per Lamp

Retail Replacement Lamps 2 Retail Replacement Lamps 1 Incandescent Benchmarks Halogen Benchmarks CFL Benchmarks

1. Includes only products of the same types tested in RRL2.

RRL1: $139/klm1

RRL2: $63/klm (mean)

Special Reports

www.ssl.energy.gov 22 | Solid-State Lighting Program

Bang for the Buck? Luminous Efficacy

22

0

10

20

30

40

50

60

70

80

90

100

$0 $10 $20 $30 $40 $50 $60 $70 $80

Lum

inou

s Ef

ficac

y (lm

/W)

Cost per Lamp

Retail Replacement Lamps 2 Retail Replacement Lamps 1 Incandescent Benchmarks Halogen Benchmarks CFL Benchmarks

RRL1: $0.69/lm/W1

RRL2: $0.49/lm/W (mean)

1. Includes only products of the same types tested in RRL2.

www.ssl.energy.gov 23 | Solid-State Lighting Program

Retailers: Is Listed Performance Accurate?

23

Ret

aile

r

Lumen Output Expectations Efficacy Expectations

A

B

C

D

E

F

I

J

K

Note: Products listed for a retailer include any sold at the store that were tested as part of RRL2, regardless of purchase location.

Ret

aile

rs a

lso

test

ed in

RR

L1

Meets Below Above Criteria: ±10%

www.ssl.energy.gov 24 | Solid-State Lighting Program

Manufacturers: Is Listed Performance Accurate?

24

Lumen Output Expectations Efficacy Expectations

Man

ufac

ture

r

1 2 3 4 5 6 8 9 10 11 12 13 14 15 16 17 18 19

Man

ufac

ture

rs

also

test

ed in

R

RL1

Meets Below Above Criteria: ±10%

www.ssl.energy.gov 25 | Solid-State Lighting Program

Product Type: Is Listed Performance Accurate?

25

Lumen Output Expectations Efficacy Expectations

Pro

duct

Typ

e

A19

G25

MR/PAR16

R/PAR20

R/PAR30

Meets Below Above Criteria: ±10%

www.ssl.energy.gov 26 | Solid-State Lighting Program

Comparison to First Study

Lumen output, efficacy, and color rendering all improved when evaluated on a cost per lamp basis. Increased prevalence of product labels

Significant increase in number of lamps with ENERGY STAR qualification (29% vs. 6%).

Significant increase in number of lamps listed by LED Lighting Facts (61% vs. 15%).

Better at meeting manufacturer data In RRL1, 56% of products met output claims, whereas in RRL2, 68%

met output claims (92% met or were above). In RRL1, 79% of products met color quality claims, whereas in RRL2

92% met color claims (both CRI and CCT). More for the money

55% reduction in cost per kilolumen ($63 versus $139) in just 15 months

38% reduction in cost/lumen/watt ($0.49 versus $0.79) in just 15 months

26

www.ssl.energy.gov 27 | Solid-State Lighting Program

Summary Report 14 Retrofit Downlights

11-76 11-75 11-74 11-73 11-64 11-63

11-103 11-98 11-97 11-96 11-82

www.ssl.energy.gov 28 | Solid-State Lighting Program

Summary Report 14 Retrofit Downlights

www.ssl.energy.gov 29 | Solid-State Lighting Program

Summary Report 14 Retrofit Downlights

www.ssl.energy.gov 30 | Solid-State Lighting Program

Summary Report 15 - Floods

11-99 11-78 11-77 11-71 11-70

12-06 12-01 11-105 11-101 11-100

www.ssl.energy.gov 31 | Solid-State Lighting Program

Summary Report 15 - Floods

www.ssl.energy.gov 32 | Solid-State Lighting Program

Summary Report 15 - Floods

www.ssl.energy.gov 33 | Solid-State Lighting Program

Summary Report 15 - Floods

www.ssl.energy.gov 34 | Solid-State Lighting Program

Ruth Taylor Pacific Northwest National Laboratory

LIGHTFAIR May 9-12, 2012

Questions?

Ruth Taylor ruth.taylor@pnnl.gov