1 design, findings, and lessons learned: sample audit recounts in 2006 north carolina elections...

13
1 Design, Findings, and Lessons Learned: Sample Audit Recounts in 2006 North Carolina Elections William D. Kalsbeek Lei Zhang University of North Carolina, Survey Research Unit, Department of Biostatistics E-mail: [email protected]

Upload: chad-bishop

Post on 18-Jan-2016

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 1 Design, Findings, and Lessons Learned: Sample Audit Recounts in 2006 North Carolina Elections William D. Kalsbeek Lei Zhang University of North Carolina,

1

Design, Findings, and Lessons Learned: Sample Audit Recounts in

2006 North Carolina Elections

William D. KalsbeekLei Zhang

University of North Carolina, Survey Research Unit, Department of Biostatistics

E-mail: [email protected]

Page 2: 1 Design, Findings, and Lessons Learned: Sample Audit Recounts in 2006 North Carolina Elections William D. Kalsbeek Lei Zhang University of North Carolina,

2

Background

• The NC Board of Elections asked the UNC Survey Research Unit (SRU) to design and conduct an election recount audit for 2006 primary and general elections

• A 2006 bill passed by the NC Legislature now mandates that a “ hand-to-eye” recount be done for national/statewide offices in each election– Little mention of how the recount data are to be analyzed

• Recounts completed thus far:– May 2006 primary – State supreme court associate justice

seat (five candidates)– November 2006 general election – State supreme court

chief justice seat (two candidates)

Page 3: 1 Design, Findings, and Lessons Learned: Sample Audit Recounts in 2006 North Carolina Elections William D. Kalsbeek Lei Zhang University of North Carolina,

3

Sampling Precincts/Places

• Stratified random sample precincts/places – NC has 3,047 precincts/places overall– 100 counties as strata (sampling in each

county required by NC-BOE)– Total precinct/place sample sizes:

• n = 200 (6.6%) for May primary election – 2 per county

• n = 264 (8.7%) for November general election – 2 or more per county– More than 2 to the extent of May discrepancies)

Page 4: 1 Design, Findings, and Lessons Learned: Sample Audit Recounts in 2006 North Carolina Elections William D. Kalsbeek Lei Zhang University of North Carolina,

4

Recounting the Votes

• Selected precincts/places announced after each election

• Bi-partisan recount:– Generally followed hand-count procedures– Teams of 3-4 from each political party– Team members rotate duty as “tallier” and

“caller”

Page 5: 1 Design, Findings, and Lessons Learned: Sample Audit Recounts in 2006 North Carolina Elections William D. Kalsbeek Lei Zhang University of North Carolina,

5

Two Types of Vote Count Discrepancies in Precincts/Places

• Discrepancy in Candidate Count (DCC)– In vote count for each candidate on ballot– Discrepancy = [Election Count] – [Recount]

• Discrepancy in Total Count (DTC)– In total vote count for all candidates– Discrepancy = [Election Count] – [Recount]

Page 6: 1 Design, Findings, and Lessons Learned: Sample Audit Recounts in 2006 North Carolina Elections William D. Kalsbeek Lei Zhang University of North Carolina,

6

Discrepancies at Each Precinct/Place

ELECTION:

Candidate

E1 E2E3

E4 ___________ Total E Count

RECOUNT:

Candidate

R1 R2R3

R4 ___________ Total R Count

All DCC Discrepancies

DTC Discrepancy

Page 7: 1 Design, Findings, and Lessons Learned: Sample Audit Recounts in 2006 North Carolina Elections William D. Kalsbeek Lei Zhang University of North Carolina,

7TABLE 1Estimated % Distribution of DTCs Among All Precincts/Places

for Five Statewide Candidates in May 2006 PrimarySupreme Court Associate Justice (Wainwright Seat)

FINDINGS: •Total votes reported in the election = 519,615• Range of DTCs: -4 to +4 • Over-count vs. under-count: favors undercount somewhat• Discrepancies much less likely for iVotronic than M100

         

Value of DTC      

Type of Machine Used in Precinct/

Place  -4 -3 -2 -1 0 1 2 3 4

Precinct/Place

Sample Size 

All Machines Combined 0.2 1.2 0.8 10.5 82.6 2.4 1.0 1.0 0.3 195

M100 Machines Only 0.3 1.7 1.2 12.5 79.5 2.0 1.0 1.4 0.4 150

iVotronic Machines Only       5.2 90.5 3.3 1.0     48

Page 8: 1 Design, Findings, and Lessons Learned: Sample Audit Recounts in 2006 North Carolina Elections William D. Kalsbeek Lei Zhang University of North Carolina,

8TABLE 2Estimated % Distribution of All DCCs Among All Precincts/Places

for Five Statewide Candidates in May 2006 Primary Supreme Court Associate Justice (Wainwright Seat)

FINDINGS: •Total votes reported in the election = 519,615• Range of All DCCs: -2 (undercount) to +3 (overcount)• Overall over-count vs. under-count -- very slightly favoring undercount• Discrepancies equally rare for iVotronic and M100

 

Value of DCC      

Type of Machine Used in

Precinct/ Place  -4 -3 -2 -1 0 1 2 3 4

Precinct/ Place

Sample Size

All Machines Combined 0.18 3.04 95.00 1.68 0.02 0.04 195

M100 Machines Only 0.26 3.86 93.88 1.90 0.04 0.04 150

iVotronic Machines Only     1.04 97.90 1.06   48

Page 9: 1 Design, Findings, and Lessons Learned: Sample Audit Recounts in 2006 North Carolina Elections William D. Kalsbeek Lei Zhang University of North Carolina,

9TABLE 3Estimated % Distribution of DTCs Among All Precincts/Places for

Two Statewide Candidates in November General Election Election for State Supreme Court Chief Justice

FINDINGS: • Total reported votes = 1,707,326; 2 to 1 margin of victory = 569,366• Range of DTCs --- mostly -13 to +13 • Discrepancies of this type are more likely than in May primary • Over-count vs. under-count: slightly favors undercount• Discrepancies much less likely for iVotronic than M100

           

Value of

DTC            

Type of Machine Used in

Precinct/ Place -13 -9 -3 -2 -1 0 1 2 3 10 13 172

Precinct/ Place

Sample Size

All Machines Combined 0.15 0.03 1.30 4.39 10.89 80.16 1.48 0.15 1.06 0.22 0.04 0.13 264

M100 Machines Only 0.21 0.05 1.85 6.28 15.57 73.46 1.66 0.66 0.66 0.19 205

iVotronic Machines Only           96.29 0.93 0.43 1.72 0.64     67

Page 10: 1 Design, Findings, and Lessons Learned: Sample Audit Recounts in 2006 North Carolina Elections William D. Kalsbeek Lei Zhang University of North Carolina,

10TABLE 4Estimated % Distribution of All DCCs Among All Precincts/Places for

Two Statewide Candidates in November 2006 General Election Election for State Supreme Court Chief Justice

FINDINGS: •Total election votes = 1,707,326 ; 2 to 1 margin of victory = 569,366• Range of All DCCs: mostly -14 to +12; with outlier at +86 • Discrepancies of this type are more likely than in May primary • Overall over-count vs. under-count: slightly favors undercount• Discrepancies much less likely for iVotronic than M100

 Type of Machine

       

 

Value of

DCC

             

Precinct/

Used in Precinct/

Place -14 -8 -5 -3 -2 -1 0 1 2 3 5 6 7 12 86

Place Sample

Size 

All Machines Combined 0.02 0.08 0.08 0.48 2.77 7.44 84.88 3.35 0.33 0.30 0.02 0.02 0.02 0.11 0.13 264 

M100 Machines Only 0.03 0.11 0.11 0.69 3.81 10.64 79.46 4.56 0.36 0.03 0.03 0.03 0.19 205 

iVotronic Machines Only 0.32 97.83 0.47 0.22 0.32  67

Page 11: 1 Design, Findings, and Lessons Learned: Sample Audit Recounts in 2006 North Carolina Elections William D. Kalsbeek Lei Zhang University of North Carolina,

11

Summary of Key Findings• May primary and November general election:

DTCs and DCCs in precincts/places – Both + (indicating overcount) and - (indicating

undercount) – Slightly favoring – (undercount)

• Greater discrepancies in November general election than May primary – >3 time as many votes cast in November

• Greater discrepancies (in both directions) in precincts/places using M100 voting machines than in those using IVotronic machines

Page 12: 1 Design, Findings, and Lessons Learned: Sample Audit Recounts in 2006 North Carolina Elections William D. Kalsbeek Lei Zhang University of North Carolina,

12Lessons Learned in Conducting North Carolina Election Audits

• Sampling– Must be random– What do we need to learn from an audit? Sample

design must be responsive to this.– Drop county focus?– Sample more intensively where there has been disparity– Sample locations not announced until after the election

• Data gathering– Recounting should be “blinded” to election count– Think about other practical ways to make the recount a

better gold standard– Expect a few process “glitches”

Page 13: 1 Design, Findings, and Lessons Learned: Sample Audit Recounts in 2006 North Carolina Elections William D. Kalsbeek Lei Zhang University of North Carolina,

13

Thank You!

Questions/Comments: [email protected]