dennis bachelder - american petroleum...

Dennis Bachelder

Subject: AOAP eBallot: LSPI Test is Ready for the Precision Matrix Testing Attachments: LSPIUpdate 111815.pdf

AOAP eBallot - LSPI Test is Ready for the Precision Matrix Testing

The AOAP met on November 12, 2015 to review the Ford LSPI Test Development program. After the review the AOAP Voted to issue an eBallot that the “LSPI Test is Ready for the Precision Matrix Testing” using the API eBallot Website at http://mycommittees.api.org/lubricants/AOAP/default.aspx .

The motion is:

Motion Ballot the Ford LSPI matrix testing as Ready for Precision Matrix Testing, pending completion of Lubrizol prove out testing and the acceptance of the data by the task force.

• Ballot to be issued once complete data packet provided to API

• Ballot issued November 20 and close on December 4

• Minimum 2-week ballot Motion by: Ron Romano, Ford Seconded by:

Gail Evans, Lubrizol

The AOAP agreed by voice vote to send the Motion to eBallot. The LSPI Test Data Presentation supporting the motion is provided on the eBallot Website.

This eBallot will close on Friday, Dec. 4, 2015. Please respond by then.

Note that all Negative Votes must include comments as described in API 1509 Annex C paragraph C.2.2. (a. Specific paragraph, section, or part negative ballot pertains to. b. Specific substantive reason(s) for negative vote. c. Proposed wording or action to resolve negative vote.) Additionally all Abstains must be explained.

Should you have any questions, please contact API

Ford Low Speed Pre-ignition (LSPI) Update

LSPI Development TeamNovember 18, 2015

Low Speed Pre-Ignition Test Overview

• Test engine: 2012 Ford 2.0L, EcoBoost, 4-cylinder

178Kw@5500366N-m@3000

• Combustion analysis data acquisition system: AVL IndiSmart Gigabit 612

• Running conditions Low speed, < 1750 rpm High Load, >80% max

BMEP Test duration, 4 hours

AOAP Letter Ballot Request(Based on Task Force Approval)

The LSPI test is ready for the precision matrix once the stand and procedure updates identified during the lab visits and review of operational data have been completed and the reference oils are at TMC.

Task Force MotionThe LSPI test is ready for matrix once the stand and procedure updates identified during the lab visits and review of operational data have been completed and the reference oils are at TMC.

Comments: Lubrizol believes that the proposed methodology has technical merit in characterizing lubricant performance in association to the LSPI phenomena. However, prior to matrix start and to ensure precision of methodology can be effectively assessed at the conclusion of the GF-6 Precision Matrix, participating laboratories must address and correct ALL identified procedural inconsistencies following the FLSPI development team laboratory visits conducted on 8/11/15 (Lubrizol) and 10/11/15 (SwRI and IAR), procedural control and measurement practice concerns identified in the review of the operational parameters, and remaining items on the MOA checklist that are still in progress.

Voting

• The task force approved the motionMember VoteFord YesInfineum YesSwRI YesIntertek Yes

Lubrizol Yescontingent on items listed in comments

Afton YesChevron Oronite YesAshland YesOHT YesTEI WaiveTMC YesVP Racing Fuels WaiveToyota Yes

Yes 11Waive 2

Original LSPI Data

• Test consists of four 4 hour runs (175,000 cycles) averaged for final results• Individual test runs show good repeatability• Still good discrimination between high and low event oil• Still good repeatability and reproducibility.• Showing a slight severity difference between labs on the high event oil• Investigating engine build effects on severity• Task Force formed• New piston design for improve durability was mild so this dropped

0

5

10

15

20

25

30

35

40

0 2 4 6 8 10

# of

Eve

nts

High Event oilSWRI Stand 4

SWRI Stand 2

IAR Stand 60

IAR Stand 62

Individual Runs

SWRI Tests IAR Tests

0

0.5

1

1.5

2

2.5

3

3.5

0 1 2 3 4

# of

Eve

nts

Low Event oil

SWRI Stand 2

SWRI Stand 4

IAR Stand

Individual Runs

SWRI Tests IAR Test

Original LSPI Data (cont.)

• 0W-16event oil tested• Data falls between present high and low activity oils. Close to some of the high event oil data from IAR.

02468

1012141618

0 0.5 1 1.5 2 2.5

# of

Eve

nts

0W-16 oil

SWRI Stand 2

IAR Stand 60

Individual Runs

SWRI Test IAR Test

New LSPI Data Average of 4 Iterations

0

5

10

15

20

25

30

0 2 4 6 8

# Ev

ents

SWRI LSPI HEOLEO0W16

Eng 11 Eng 10Stand 4


0

5

10

15

20

25

30

0 2 4 6 8

# Ev

ent

IAR LSPI HEO

LEO

0W16

IAR 10 IAR 9 IAR 9 IAR 10Stand 60 Stand 62

0

5

10

15

20

25

30

0 0.5 1 1.5 2

# Ev

ents

Lubrizol HEO

LEO

Eng 1000Stand 336

Eng 1000Stand 336

New LSPI data w/Individual Iterations

0

5

10

15

20

25

30

0 2 4 6 8

# Ev

ent

SWRI LSPI HEO

LEO

0W16

Individual



0

5

10

15

20

25

30

0 2 4 6 8

# Ev

ent

IAR LSPI HEO

LEO

0W16

Individual

IAR 10 IAR 9 IAR 9 IAR 10Stand 60 Stand 62

0

5

10

15

20

25

30

0 0.5 1 1.5 2

# Ev

ents

Lubrizol

HEO

LEO

Individual

Eng 1000Stand 336

Eng 1000Stand 336

Operational Data Review• Development team has reviewed operational data from 36 complete LSPI

tests.• All control data was evaluated against initial upper and lower limit targets

assigned to each of the following control parameters prior to proveout testing• Target limits are being refined based on the final review of the operational

data.

Targeted Proveout Test Condition LimitsControlled Parameter Set Point UnitsSpeed 1750 +15 RPMLoad 269+2 NmCoolant Out Temperature 95+0.5 degCOil Gallery Temperature 95+0.5 degCAir Charge Temperature 43+0.5 degCInlet Air Temperature 30+0.5 degCFuel Temperature 30 degCBack Pressure 104 +/-2 kPaAInlet Air Pressure 0.05 +/-.02 kPaG

Operational Data Validity• The data from the proveout tests showed that each lab is able to

control within the targeted limits. Some tests were run outside of specific limits and those labs are tightening up their controls. Some target limits are being refined to better reflect actual capability, including:– Fuel temperature limits– Speed– Air Charge Temp– Coolant Out Temp– Oil Gallery Temp– Exhaust Backpressure

• Each lab has identified control improvements that will be made to provide better stability prior to the Precision Matrix

Lab Visits and Build Workshop• Lab Visits at SwRI and Intertek were conducted on

11/11/15. Notes from these visits will be posted to the TMC website along with the previously conducted Lubrizol Lab visit

• Stand differences that vary from the test specification were identified during the lab visits and are to be corrected prior to Precision Matrix. All notes from the lab visits are posted to the TMC website at:ftp://ftp.astmtmc.cmu.edu/docs/gas/lspi/minutes/

• An engine build workshop was held at SwRI on 11/12/15. The test specification is currently being updated to reflect improvements identified by the team during this workshop.

Future Improvements• Future improvements based on the proveout test data review, Lab Visits,

and Engine Build Workshop:– Review and refine proveout control limit targets prior to precision matrix– Add Coolant In Temp, Coolant Flow, Oil Filter Inlet Temp, Lambda to reported

data list– Coolant Pressure and Humidity Control and Measurement– Potential monitoring of blowby– Take oil samples between each iteration to test for fuel dilution and wear

metals– Incorporate additional engine cycle validity criteria to better screen for invalid

cycles and invalid iterations– For each iteration, record 175,000 engine cycles, but only use the first 170,000

valid engine cycles.

© INFINEUM INTERNATIONAL LIMITED 2015. All rights reserved.

PRELIMINARY FORD LSPI PROVE OUT MATRIX ANALYSIS

D. Boese

November 16, 2015

Performance you can rely on. © INFINEUM INTERNATIONAL LIMITED 2015. All rights reserved. 15

Summary

• Discrimination of HEO and LEO is strongly statistically significant.– Number of standard deviations separating oils is highest relative to current tests.

• Lab and Stand[Lab] are statistically significant.

• Engine[Lab] is borderline statistically significant.

• Engine age is borderline statistically significant.

• Carry over is not statistically significant.


Prove Out Matrix Design

Designed to provide estimates of the following effects:

• Oil (HEO vs LEO)

• Lab (IAR, SwRI and LZ)

• Stand[Lab]

• Engine[Lab]

• Carry over

Run

Engine Oil Engine Oil Engine Oil Engine Oil Engine Oil

1 1 HEO 2 LEO 3 HEO 4 LEO 5 HEO2 1 HEO 2 LEO 3 HEO 4 LEO 5 HEO3 1 LEO 2 HEO 3 LEO 4 HEO 5 LEO4 1 LEO 2 HEO 3 LEO 4 HEO 5 LEO5 2 LEO 1 HEO 4 LEO 3 HEO 6 LEO6 2 LEO 1 HEO 4 LEO 3 HEO 6 LEO7 2 HEO 1 LEO 4 HEO 3 LEO 6 HEO8 2 HEO 1 LEO 4 HEO 3 LEO 6 HEO

IAR SwRI LZStand A Stand B Stand A Stand B Stand A


Plot of Prove Out Matrix Data


Regression Analysis

• LSPI transformed to Sqrt(Average LSPI + 0.5)

• Sqrt(Average LSPI + 0.5) regressed on:– Oil

– Lab

– Stand[Lab]

– Engine[Lab]

– Previous Oil (Carry over)

– Run (Engine Age)


Regression Analysis (Continued)

• The Effect Test table states the follow factors are statistically significant:– Lab– Stand[Lab]– Oil– Run (or engine age) is border

• The following effects are borderline statistically significant:– Engine[Lab] (borderline statistically

significant)– Run (or engine age)

• Previous Oil (carryover effect) is not statistically significant.

• The LS Means for each factor level are tabulated.– IAR is mild relative to LZ and SwRI.– SwRI’s stands have the higher

difference.– IAR’s engines have the higher

difference.

Term df p-Value Lab LS Mean

Lab 1 0.042 IAR 6.42Stand[Lab] 2 0.023 LZ 7.91Engine [Lab] 2 0.052 SwRI 7.85

Oil 1 <.0001

Previous Oil 1 0.597 Stand[Lab] LS Mean

Run 1 0.073 [IAR]60 5.77

[IAR]62 7.11[LZ]1 7.91[SwRI]2 6.88[SwRI]4 8.87

Engine [Lab] LS Mean

[IAR]PI10 7.39[IAR]PI9 5.52[LZ]1 7.91[SwRI]10 8.18[SwRI]11 7.52

Oil Activity LS Mean

HEO 18.06LEO 1.40

Previous Oil LS Mean

HEO 7.53LEO 7.22

Effect Test


Precision Metrics

• RMSE = 0.2988 (transformed Sqrtunits), excluding Previous Oil and Run terms.

• Non-transformed standard deviations (includes lab, stand and engine variation):– LEO: s = 0.602

– HEO: s = 3.876

• Number of standard deviations separating oils (highest – lowest RO) for Ford LSPI and current tests are tabulated:– Ford LSPI has highest separation of RO

oils in terms of number of standard deviations.

Test Parameter High Oil Low Oil Number of s

Ford LSPI Sqrt(LSPI + 0.5) HEO LEO 9.8IIIG WPD 434 438 2.7IIIG Ln(PVis) 435 438 2.1

IIIG Ln(ACLW) 435 438 3.2

IVA ACW 1006-2 1007 1.2

VG AES 1007 940 5.6

VG RCS 1006-2 940 2.2VG AEV 1006 940 3.0VG APV 1007 940 4.4VG Ln(OSCR) 940 1006-2 3.9

VID FEI1 542 541 5.2

VID FEI2 1010 541 2.8


Permission is given for storage of one copy in electronic means for reference purposes. Further reproduction of any material is prohibited without prior written consent of Infineum International Limited. The information contained in this document is based upon data believed to be reliable at the time of going to press and relates only to the matters specifically mentioned in this document. Although Infineum has used reasonable skill and care in the preparation of this information, in the absence of any overriding obligations arisingunder a specific contract, no representation, warranty (express or implied), or guarantee is made as to the suitability, accuracy, reliability or completeness of the information; nothing in this document shall reduce the user’s responsibility to satisfy itself as to the suitability, accuracy, reliability, and completeness of such information for its particular use; there is no warranty against intellectual property infringement; and Infineum shall not be liable for any loss, damage or injury that may occur from the use of this information other than death or personal injury caused by its negligence. No statement shall be construed as an endorsement of any product or process. For greater certainty, before use of information contained in this document, particularly if the product is used for a purpose or under conditions which are abnormal or not reasonably foreseeable, this information must be reviewed with the supplier of such information.

Links to third party websites from this document are provided solely for your convenience. Infineum does not control and is not responsible for the content of those third party websites. If you decide to access any of those websites, you do so entirely at your own risk. Please also refer to our Privacy Policy.

© INFINEUM INTERNATIONAL LIMITED 2015. All rights reserved

"INFINEUM, PARATAC, SYNACTO, VISTONE and the interlocking ripple device are Trade Marks of Infineum International Limited

MOA Requirements� Each oil used to demonstrate discrimination has a minimum of two valid test results in the documented Test Matrix procedure. The Test Development Task Force must approve these results.

More than 2 tests at SWRI and IAR. 4 tests at LZ. Additional LZ tests in progress

� Each Matrix Lab has run at least two operationally valid tests (shakedown runs are eligible) using the Test Matrix procedure. Shakedown runs are full-length, operationally valid runs on oils such as potential candidate or research oils. The Test Development Task Force will determine if these test results are satisfactory.

More than 2 tests at SWRI and IAR. 4 tests at LZ. Additional LZ tests in progress

� The Test Development Task Force has visited each Matrix Lab and filed a report with the ASTM Test Monitoring Center regarding the Matrix Lab’s conformance to specifications that include, at a minimum, completed lab inspection checklists.

LZ, SWRI and IAR lab visits complete

� Matrix Lab readiness, as summarized by the lab inspection team reports, is deemed satisfactory by a majority of the members of the Test Development Task Force.

Lab inspection reports on the TMC website

�The current batch supply of critical test parts used in the Test Matrix is sufficient to use in post-Matrix Testing beyond one reference cycle.

Present supply will last to April 2016. Will bring new engines in on a reference test.

� A matrix ready report packet has been approved by the Task Force and implemented by all Matrix Labs. At least one successful data transmission to the ASTM TMC is required before matrix oils will be assigned.

Draft version of the report form has been created and updates are in progress. +

� The Task Force has approved and posted on the ASTM TMC website operational control parameter ‘for matrix use’ Quality Index U & L values so that End of Test (EOT) Quality Index values can be reported in the matrix approved test report packet. If Quality Index is not anticipated to be pursued by the Task Force, operational control ± limits are to be established for all control parameters. The intent is that control parameters are to be centered on the control target, and the average is to be within the ± limits if Quality Index is not pursued.

QI are not set. Will be set after the precision matrix. Control parameter limits are in the procedure.

� The Matrix Test oils are available at the Matrix Test Labs.

In process. LEO at TMC (TMC220). HEO and 0W-16 oil being blended. Estimated delivery in December.

The Task Force should define the validity criteria before the start of the Matrix.

Proveout operational data has been reviewed items requiring further refinement have been defined.

MOA Requirements

Test Readiness Checklist• Reference oils

– LEO is at TMC (TMC220), HEO and 0W-16 being blended• Test Procedure

– Draft procedure on the TMC website. Updates are in progress.– Engine build workshop Completed 11/12/15– SWRI and IAR labs visits completed 11/11/15

• Test Prove Out Data– SwRI and Intertek have each completed 16 tests, Lubrizol has completed 4

tests. Each lab has run at least two valid tests on the HEO and LEO oils.– Initial operation validity review of proveout tests held on 11/17/15. – Evaluation of the relation between test severity and operation/build data is in

progress.

Comments and next steps• Test still shows good repeatability, reproducibility

and discrimination with regard to the high and low event oils.

• Old data and new data repeated well• Update stand per the lab visits prior to precision

matrix. • The development team feels the test is ready for

precision matrix testing. Asking the task force to recommend to AOAP that the test is ready for matrix so an AOAP letter ballot can be distributed for resolution at the December 10 AOAP meeting.

Back up Data

Lab Visit Report• Notes on SwRI test stands #2 and #4• 1. Add oil gallery out TC on oil filter housing• 2. Update Post Intercooler tubing and sensor locations to match specification• 3. Move Intake Air TC and pressure ports to post filter.• 4. Where should we monitor fuel temp? – Tabled• a. Labs will try finding a way to mount Fuel TC as close to high pressure fuel pump without• adding too much weight to the pump’s intake port.• 5. Front Mounting uses Ford escort and OHT mounting.• 6. Change rear mount to marine (quick silver 6628) mounts.• a. Team needs to decide whether we are going to call out the rear mount part number or• just a performance standard (durometer value).• Notes on Intertek Stands 60 and 62.• 7. Add oil gallery out TC on oil filter housing, both 60 and 62• 8. Turbo outlet or Intercooler inlet pressure is not being measured, needs to be included.• 9. Exhaust back pressure probe on stand 60 needs to be moved to port nearer to exhaust• manifold.• 10. Exhaust probe/afr probes are not located as per Fig A2.8• 11. Ground wire for PCM does not go back to engine and have a #2 cable going back to battery as• per section 7.9(1)• 12. Move Intake Air TC and pressure ports to post filter.• 13. Fuel Temperature may need to be relocated, it is in the outlet of the heat exchanger• approximately 3 feet from fuel pump inlet.• 14. Stand 62 driveshaft angle is 2.6 degrees, should be 2 degrees• Notes on Lubrizol Stand 336. 8/11/15• 15. OHT coolant in and out adapters not installed.• 16. Exhaust probe/afr probes are not located as per Fig A2.8• 17. Turbo outlet or Intercooler inlet pressure is not being measured, needs to be included.• 18. MAP connection at throttle body needs to be added.• 19. Front Engine mount needs to match other labs and drive shaft angle will need to be adjusted to• 2 degrees.• 20. Factory vacuum connection harness/piping not utilized, turbo charger vacuum control and• sensors connected with tygon tubing.

Ford LSPI Prove Out Operational Data Plots

11-17-15Kevin O’Malley

The Lubrizol Corporation

28

Overview• 36 tests included

• 16 IAR (2 stands; 8 tests per stand; 2 engine builds per stand)• 16 SwRI (2 stands; 8 tests per stand; 2 engine builds per stand)• 4 LZ (1 stand; 1 engine build)

• 2 oils tested (low event oil and high event oil)• Each oil tested in duplicate within each stand-engine build

combination

• Operational parameters are plotted versus cumulative time• Cumulative time is a combination of time from valid iterations

A, B, C, and D; time at start of iteration A = 0hrs• Each RunID/Test # is plotted in a separate pane

29

39

ZOO

MED

IN

dennis bachelder - american petroleum...

Documents