summary report - ron smith and associates, inc. · comparison proficiency test page test #17301...

Headquarters Laboratory P.O. Box 670

Collinsville, MS 39325 Office (601) 626-1100

Fax (601) 626-1122

Florida Laboratory 201 Douglas Ave, Suite A

Dunedin, FL 34698

Office (727) 253-4991

Fax (727) 953-7849

Ron Smith & Associates, Inc.

Testing Division

Toll Free: 1-866-832-6772 │ www.RonSmithandAssociates.com

Email: [email protected]

Spring 2017 Footwear

Comparison Proficiency Test

Test #17301

Summary Report

of 13

Summary Report Spring 2017 Footwear Comparison Proficiency Test #17301

Issued: May 24, 2017

On February 20, 2017, Ron Smith and Associates, Inc. (RS&A) shipped the 2017 Spring Footwear Comparison Proficiency Test #17301. Participants were required to submit their responses no later than April 24, 2017 in order for them to be included in this summary report. A total of 22 tests were ordered and shipped, with all 22 participants returning their responses. The test was provided in both digital and hard copy format and included seven questioned impressions and four known footwear impressions. The results presented in this report reflect whether or not the participants’ submitted results agree or disagree with the assigned values garnered from pre-distribution testing and outlined in The Manufacturer’s Report (Appendix 1). The primary purpose of a Summary Report is to provide an overall documentation of all the submitted responses. It is RS&A’s intention to go a step further by providing more meaningful statistical results through analyzing the submitted responses in relation to the demographics obtained from each of the examiners participating in this proficiency test. All results and statistics for Test #17301 will be outlined through graphs and charts found in the remainder of this report. Prior to distribution of this test, all of the expected responses were determined to be either “Identification” or “Exclusion”; however, we are aware that some agencies allow for a conclusion of “Inconclusive” in their casework. In designing this Proficiency Test, there was no intention to force a participant to render a conclusion which goes beyond their considered opinion. To satisfy this option, participants were allowed to enter “Inconclusive” as a response. Due to the fact that a participant's “Inconclusive” response does not meet the assigned values, it will appear as an inconsistent response in the summary report and be incorporated as such in the statistical analysis. It will be up to each agency to decide if the participant's “Inconclusive” response qualifies as being acceptable under their policies and procedures. RS&A strives to maintain the confidentiality of all of its clients and participants. All results are obtained and published using randomly generated test codes. RS&A will not release the identity of any participant without the written consent of the participant and/or the agency involved. For any additional information, please contact Footwear Proficiency Testing Coordinator, at [email protected] or call toll free at 1-866-832-6772.

http://www.ronsmithandassociates.com/

mailto:[email protected]

mailto:[email protected]



Test #17301

Summary Report

of 13

Appendix 1

Test Manufacturer’s Information

Spring 2017 Footwear Comparison Proficiency Test #17301

The assigned values are:

Questioned Impressions Q#

Conclusion Known Shoe

K-#

Q-1 Identification K-4, Left Shoe

Q-2 Identification K-3, Right Shoe

Q-3 Exclusion

Q-4 Exclusion

Q-5 Exclusion



The test consisted of seven questioned impressions and four known footwear impressions in hard copy photograph and/or digital image formats. The assigned values were determined through the ground truth information and verified through unanimous agreement during pre-distribution testing.



Test #17301

Summary Report

of 13

Appendix 2

Appendix 3

*For further information, please read Manufacturer’s Additional Observations on the final page of this report.

99%

Consistent vs Inconsistent Responses Compared to Assigned Values

Consistent (153)

Inconsistent (1)

118

35

1 00

20

40

60

80

100

120

Accredited (17) Non-Accredited (5)

Consistent vs Inconsistent ResponsesBased on Accreditation

Consistent

Inconsistent

1%



Test #17301

Summary Report

of 13

Appendix 4

Appendix 5


0

153

0 10

20

40

60

80

100

120

140

160

Sworn (0) Civilian (22)

Consistent vs Inconsistent ResponsesBased on Sworn or Civilian Status

Consistent

Inconsistent

84

69

0 10

10

20

30

40

50

60

70

80

90

IAI Certified (12) Non-Certified (10)

Consistent vs Inconsistent ResponsesBased on IAI Certification Status

Consistent

Inconsistent



Test #17301

Summary Report

of 13

Appendix 6


55%

4%

14%

27%

Percentage of Participants Based on Primary Job Position

Latent Print Examiner (12)

Firearms/Toolmark Examiner (0)

Crime Scene Investigator (1)

Footwear Examiner (3)

Questioned Document Examiner (0)

Other (6)

42

0

20

7

0

84

0

0

1

0

0

0

0 10 20 30 40 50 60 70 80 90

Other (6)

Questioned Document Examiner (0)

Footwear Examiner (3)

Crime Scene Investigator (1)

Firearms/Toolmark Examiner (0)

Latent Print Examiner (12)

Consistent vs Inconsistent Responses Based on Primary Job Position

Consistent

Inconsistent



Test #17301

Summary Report

of 13

Appendix 7


68%

23%

9%

Percentage of Participants Based on Time Devoted to Footwear Casework

Less than 25% (15) 25%-50% (5)

51%-75% (0) 76%-100% (2)

14

0

35

104

0

0

0

1

0 20 40 60 80 100 120

75%-100% (2)

50%-75% (0)

25%-50% (5)

Less than 25% (15)

Consistent vs Inconsistent Responses Based on Time Devoted to Footwear Casework

Consistent

Inconsistent



Test #17301

Summary Report

of 13

Appendix 8


4%

50%

9%

14%

23%

Percentage of Participants Based on Hours of Footwear Training Completed

Less than 40 Hours (0) 40-80 Hours (1)

81-200 Hours (11) 210-400 Hours (2)

401-1000 Hours (3) 1001+ Hours (5)

35

21

14

76

7

0

0

0

0

1

0

0

0 10 20 30 40 50 60 70 80 90

1001+ Hours (5)

401-1000 Hours (3)

210-400 Hours (2)

81-200 Hours (11)

40-80 Hours (1)

Less than 40 Hours (0)

Consistent vs Inconsistent Responses Based on Hours of Footwear Training Completed

Consistent

Inconsistent



Test #17301

Summary Report

of 13

Appendix 9


9%4%

27%

55%

5%

Percentage of Participants Based on Years of Experience in Footwear

Examinations

Less than 1 Year (0) 1-3 Years (2)

4-6 Years (1) 7-10 Years (6)

11-20 Years (12) 21+ Years (1)

7

83

42

7

14

0

0

1

0

0

0

0

0 10 20 30 40 50 60 70 80 90

21+ Years (1)

11-20 Years (12)

7-10 Years (6)

4-6 Years (1)

1-3 Years (2)

Less than 1 Year (0)

Consistent vs Inconsistent Responses Based on Years of Experience in Footwear

Examinations

Consistent

Inconsistent



Test #17301

Summary Report

of 13

Appendix 10


18%

5%

36%

41%

Percentage of Participants Based on Highest Level of Education Completed

High School (4) Associate's Degree (1)

Bachelor's Degree (8) Master's Degree (9)

PhD (0)

0

63

56

7

27

0

0

0

0

1

0 10 20 30 40 50 60 70

PhD (0)

Master's Degree (9)

Bachelor's Degree (8)

Associate's Degree (1)

High School (4)

Consistent vs Inconsistent Responses Based on Highest Level of Education Completed

Consistent

Inconsistent



Test #17301

Summary Report

of 13

Appendix 11


111

1

42

00

20

40

60

80

100

120

Consistent Inconsistent

Consistent vs Inconsistent ResponsesBased on Review of Original Conclusions by

another Footwear Examiner Prior to Submission

Reviewed (16)

Not Reviewed (6)



Test #17301

Summary Report

of 13

Appendix 12

Participant Responses Listed by Test Code

Questioned Impression # Q-1 Q-2 Q-3 Q-4 Q-5 Q-6 Q-7

Assigned Values

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

Test

C

od

e

4301C17301 ID

K-4 ID

K-3 EXC EXC EXC

ID K-2

ID K-2

8154W17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

3866A17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

8906H17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

5121M17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

7142J17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

4714Q17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

4129V17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

3602E17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

8997N17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

3523J17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2



Test #17301

Summary Report

of 13

1149D17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

1035Q17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

3164M17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

154J17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

1102I17301

ID K-4

ID K-3

EXC EXC INC ID

K-2 ID

K-2

6718A17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

88G17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

4166E17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

7824F17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

6499M17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

6277Y17301

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2



Test #17301

Summary Report

of 13

Totals

Questioned Impression # Q-1 Q-2 Q-3 Q-4 Q-5 Q-6 Q-7

Assigned Values

ID K-4

ID K-3

EXC EXC EXC ID

K-2 ID

K-2

Consistent Responses 154 154 154 154 153 154 154

Inconsistent Responses 0 0 0 0 1 0 0

Percentage of Consistent Reponses

100% 100% 100% 100% 99% 100% 100%

Participant’s Additional Comments

Test Code Comments

4301C17301

Used Q-6 and Q-7 in comparison of Q-5 to K-2.

8906H17301

Q2 - Q5 were excluded due to excessive wear. The identifications were effected due to correspondence in outsole pattern and physical size as well as correspondent general wear and individualizing accidental characteristics.

1102I17301

Q5 - scene mark has movement in it, some features not recorded. Mark could have been left by K4 but with no footwear elimination prints from victims (bearing in mind there are 2 exclusions with the same sole pattern) I would have to say 'inconclusive'.

Manufacturer’s Additional Observations There were no additional observations.

Authorized by: Ron Smith, President For Further Information Contact: Footwear Proficiency Test Coordinator

summary report - ron smith and associates, inc. · comparison proficiency test page test #17301...

Documents