Transcript

cap.org

ProficiencyTesting Manual

Table of ContentTable of ContentssSurveys & Educational Anatomic Pathology Programs Manual

1 Order Confirmation, Specimen Handling, and Customer Service 3–7

n Confirmation 3 n RegulatoryReporting 3 n Binders/Glossaries 3 n AlertingtheMailroom 3 n CAPIdentificationNumber 4 n ReplacementSpecimens 4 n TestingInstructionsandCompletionTime 4 n ChangingResultsandCMSReportingInstructions 4 n Fax-BackResponsePrograms 5 n EvaluationReports 5 n Corrections 5 n CustomerSupport 5 n ProgramCertificates 6 n Letters 6 n LimitationsofProficiencyTesting 6 n HandleWithCaution 6 n LaboratoryAccidents 6 n LimitationsofProficiencyTestingLetter 7

2 General Comments 8–9

n CompletingtheResultForm 8 n Teleforms 8 n PreprintedMethodSummaryPage 8 n ExceptionCodes 8 n IdentificationMasterLists 9 n Method/InstrumentMasterLists 9 n Handwriting 9 n DecimalPointsandBoxPositions 9 n “LessThan”or“GreaterThan”Values 9

3 e-LAB SolutionsTM 10–11

n UsingOnlineFeatures 10 n Security 10 n OnlineDataSubmission 11 n InteractiveEvaluations 11 n OnlineReports 11 4 How to Interpret the Evaluation Report 12–14

n GeneralGuidelinesforEvaluation 12 n SelectionofaTargetValue 12 n CalculationofSummaryStatistics 12 n ComparativeStatistics 14

Interlaboratory Comparison Program Cycle

5 Continuing Education 15–17

n CMECategory1 15 n CEforCytotechnologists 15 n ContinuingEducation(CE)forNonphysicianLaboratoryPersonnel 16 n EXCEL®CEProgram 16

6 Discipline-Specific Reporting Information 18–19

n HowtoCompletetheResultForm 18

7 The Evaluation and Participant Summary Reports 20–22

n YourEvaluationReport 20 n ReviewingYourEvaluationReport 20 n TheParticipantSummary 21 n HowtoPerformaSelf-Evaluation 21

8 Laboratory Legislation and Centers for Medicare and Medicaid Services (CMS) Reporting 23–28

n ProvisionofResultstoCMSandStateAgencies 25 n UseofReasonCodesforNonevaluatedSpecimens 26 n CMSPerformanceSummaryData 27

Surveys & Educational Anatomic Pathology Programs Manual

1CAP 2 Subscriptions September–December:Yourlaboratoryplacesitsorder.

Your Laboratory 3CAP Order Processing September–December: Orderquantitiesarereserved.

Catalog Delivery September:Thecatalogissenttoyour laboratory.

4CAP 5 Kits Mailed Kitsareprepared andsentfromthe manufacturertoyour laboratory.

Surveys Mailing 6Your Laboratory Result Form Completedresultforms arereturnedviamail,fax,or onlinesubmissiontotheCAPwheredataaresummarized.

Order Confirmation September–December: Confirmationreportsaresenttoyourlaboratoryafteryourorderisprocessed.

7Scientific Resource Committee 8 Reports Mailed/

Available Online Reportsaresenttoormadeavailableonlineforyour laboratory,regulatory agency,and/orconsultants.

CAP 9Certificate Certificate of Participation AsaCAPSurveysand AnatomicPathology EducationalProgramsand EXCELsubscriber,your laboratoryisentitledtoreceive aCertificateofParticipation.Thecertificatewillbeissuedatthe beginningoftheprogramyear.

Evaluation Criteria Thescientificresource committeereviewsresultsandtheimpactofevaluationcriteria.

1OrderConfirmation, SpecimenHandling, andCustomerService

ConfirmationAfteryourorderisreceived,anorder confirmationreportissentthatcontainsthe followinginformation:

n Shippingaddress

n Billingaddress

n Telephoneandfaxnumber

n Listofproductsordered

n Listofagenciesand/orconsultantsto whomyouhaverequestedcopiesof yourevaluationreportbesent

Pleasereviewyourlaboratoryorderconfirmationreportcarefully.Ifyouhavechanges,returntheformwithintwoweeksofreceiptto:

CustomerDataManagement CollegeofAmericanPathologists 325WaukeganRoad Northfield,Illinois60093-2750 847-832-8168(fax)

Regulatory ReportingTheCAPwillautomaticallyforwardresultsforanalytesregulatedforproficiencytestingtotheCentersforMedicareandMedicaidServices(CMS)forlaboratoriesthathaveprovidedaCLIAidentificationnumber.

Torequestthatnoresultsbeforwardedortomakechangestoyourlaboratory’sanalyte selectionreportfortheinformationprovidedtoCMS,pleasecontacttheCustomerContact

Centerat800-323-4040option1oraccessyourreportonlineatcap.org.

Documentationwillberequestedandmaybefaxedto847-832-8168.Anexplanationof regulatoryreportingandcurrentlaboratory legislationisincludedinChapter8ofthismanual.

Binders/GlossariesPleaseseeyourcatalogforinstructionsonhowtoobtainthree-ringbindersforfilingresultsandreports.Surveysresultsareprintedonthree- hole-punchedsheetsforstorageinthebinders.

Ifyouareenrolledinhematologyand/orclinical microscopySurveyscontainingphotographsfor morphologicidentification,youwillbeabletoaccessanonlineglossaryoftermsforyour generaluse.Ifyouneedahardboundcopy,pleasecalltheCAPCustomerContactCenter.

Alerting the MailroomRefertotheshippingscheduleandadviseyour receivingdepartmentaccordingly.Ashippingscheduleisprovidedtoyourlaboratorywith theorderingcatalog,oryoucanobtaina customizedshippingcalendarthroughe-LAB Solutions™atcap.org.

Thereceivingdepartmentofyourhospitalorlaboratoryshouldbeadvisedhowtohandle theCAPkits.Insistonprompttransfertothe laboratory.(Kitsreceivedbythehospitalbut notdeliveredtothelaboratoryarenot eligibleforfreereplacement.)Unlessotherwisespecified,storethespecimensintherefrigerator.

CollegeofAmericanPathologists ProficiencyTestingManual 4

CAP Identification NumberEachparticipantreceivesaCAPidentificationnumberthatisprintedonallresultforms.Thisnumberwillalsoappearoneachevaluationreportreceivedbyyourlaboratory.ItishelpfultohavethisnumberavailablewhencontactingtheCollege.

Replacement Specimens Thekitscontainaresultformandspecimensfor analysis.Checkthecontentsofthekitagainsttheinstructions.EXCEL®participantsshouldverifythatallmoduleslistedonthemailingpageareincludedinthekit.Ifthekitisincompleteor containsbrokenorunlabeledspecimens, contacttheCollegewithinthenumberofdaysindicatedinthekitinstructionsfollowingtheactualshippingdateforafreereplacement.Additionalreplacementspecimensmaybepurchasedwithinthesametimeframe.Becauseproficiencytestingmaterialsmustbeprocuredinadvanceofshipment,onoccasion, additionalinventoryisavailableforanominalfee.TopurchasethesematerialscontacttheCustomerContactCenterat800-323-4040 option1.Allliteratureassociatedwiththis productincludingthesummarydatawouldbeprovided.This option does not replace routine proficiency testing.

Thesematerialsmaybeusedforbutnotlimitedto:

nCompetencyassessment

nInstrumenttroubleshooting

nTraining

nEducation

nResearch

Intheeventthatareplacementspecimenisrequired,retainyouroriginalresultformwhileawaitingthearrivalofthereplacement specimens.Thereplacementspecimenswill besentinthesamemannerasyouroriginal specimens.Whenyoureceivethe replacementspecimens,youwillbeallowed thesameamountoftimeforanalysisaswas allowedwiththeoriginalshipment.Youare ensuredanevaluation.

Occasionally,itmaynotbepossibleforthe manufacturertoreplaceyourspecimen(s)kit. Inthiscase,filltheexceptioncode33bubble ontheresultform.SpecimenProblemwill appearonyourevaluationreport,andyou willnotbepenalized.

Testing Instructions and Completion TimePertheFederal Register,proficiencytesting(PT)specimensmustbetestedwiththelaboratory’sregularworkload,usingroutinemethodsandtestingthePTspecimensthesamenumberoftimesitroutinelytestspatientspecimens.

WhenhandlingPTspecimens,laboratoriesmustnotcommunicateresultsnorshareorrefer specimensfortestsnotonthelaboratory’smenu.Ifreferralfortestingisroutinelyperformedforpatientspecimens,thepracticecannotbefollowedforPTspecimens.Referralisconsideredtobemovementofthespecimenfroma laboratorywithaCLIAidentificationnumbertoanotherlaboratorythathasadifferentCLIAidentificationnumber.LaboratoriesmustensurethatpersonneldonotshareresultsorreferPTspecimensforanyreflexortestingoutsidetheirCLIAidentificationnumber.

TheSurveysandEXCELprogramsareusedforcertificationofcertainlaboratories.Sincepromptnessisconsideredindeterminingcertification,wecannotacceptlateentries.Results are due by the date noted on the result form. Resultformsreceivedbeyondthedatenotedwillnotbeevaluated.Participantswill receiveanevaluationindicatingthattheresultswerereceivedpasttheevaluationcut-offdatealongwithaParticipantSummarythatcanbeusedforself-evaluation.

Changing Results and CMS Reporting Instructions n Changestosubmitteddatacannotbe madeaftertheduedatelistedonthe resultform.Reviewallentriesmadeon theresultformforaccuracypriorto submission.Forresultsapprovedonline, correctionsmustalsobedoneonline. Faxedormailedcorrectionswillnotbe accepted.

n Ifyouhaveregisteredyourlabonthe CAPwebsite,youmayuse“ResultForm Verification”toverifysubmittedresults.

n Foranytestingthatyoudonotroutinely performinyourlaboratory,leaveall reportingareasforthattestblank, includingmethodinformation.Please note, a penalty will not be applied for blank responses in the case of

OrderConfirmation,SpecimenHandling,andCustomerService

800-323-4040|847-832-7000Option1|cap.org 5

educational challenges, challenges not formally graded, or the proper use of exception codes. n Ifyoudonotperformspecifictestingina Surveysprogram,pleaserefertothekit instructionsandresultformforthe appropriateinstructions.

Foranyregulatedanalytesthatyourlaboratorydoesnotreportormayhavediscontinued,youmustnotifytheCAPinwriting.PleasefaxanychangesinwritingonyourCMSreportto 847-832-8168toavoidreceivingazeroscore onyournextPTevaluation.(Yourreporting preferencesareoutlinedontheCMSAnalytesReportingSelectionsdocument,whichis availableonlineatcap.orgontheAccreditationandLaboratoryImprovementtab.)Ifyouhaveanyquestions,pleasecalltheCustomerContactCenterat800-323-4040option1.

Fax-Back Response ProgramsTheCollegeoffersimmediate(fax-back) responsesforthesubmissionofthelaboratoryformsforthefollowingeducationalanatomicpathologyprograms:

nInterlaboratoryProgramsinCervicovaginal andNongynecologicCytopathology (PAP/NGC)

nFine-NeedleAspirationGlassSlideProgram

Individualresultformscanbesubmittedonline(preferredmethod)orfaxedtotheCAP.CME/CEformswillbeselfclaimedonlinethroughthe Educationtab.

Evaluation ReportsTheevaluationreportwillbepostedonlineandmailedapproximatelytwotofiveweeksaftertheshipdateofthekit.Thistimeisneededfor processingdata,establishingevaluationcriteria,andpreparingthesummaryreport.

CorrectionsOccasionally,incorrectentryofsubmitteddataoccurs.Ifthisisduetoyourtranscriptionerrororfailuretocompletetheresultformappropriately,yourentrycannotbere-evaluated.IftheerrorismadebytheCAP,pleasecontacttheCustomerContactCenterat800-323-4040option1for furtherassistance.

Customer Support

Customer Contact Center Hours

7:00 am–5:30 pm CT

ExtendedCustomerContactCenterhoursensure coverageforalltimezones.Call800-323-4040 option1tospeakwithaContactCenter representative.Forinternationalcustomers,pleasecall847-832-7000option1.

24-hour Messaging Service

TheCAP’s24-hourvoicemailsystemallowsyoutoleaveamessageafterhours.Aresponsewillbeprovidedthefollowingbusinessday.

24-hour Service Fax Hotline (800-289-1815)

Aswiththe24-hourvoicemailsystem,theServiceFaxHotlinemakesiteasyforyoutofaxrequestsanytime,dayornight.Responseisguaranteedbythenextbusinessday.

Contact the CAP via the Website

Youcansubmityourrequestorquestion convenientlyonlineviatheCAPWebpage.Logontocap.organdclickonthe“ContactUs”iconlocatedatthetopofthemainpage.

CAP Mail

TheCAPhasimplementedanemailnotificationservice,CAPMail,designedtokeepyouinformedofourreceiptofyourorderform(s)andresultforms.Foreachdocumenttype,theCAPwillnotifytheappropriateindividualsthatwehavereceivedyourinformation.

n Allresultformreceiptacknowledgment messagesincludearesultformreceipt.

n LinktotheCAPwebsitepagewhereyou canreviewdetailedinformationforeach kitonthenumberandspecificpages receivedandmethodofreceipt.

Totakeadvantageofthisservice,ensuretheCAPhastheappropriateemailaddressesforyourlaboratory.

n Fordocumentacknowledgment,include theappropriateemailaddressonthefirst pageofyourorderforminthesection titled,“PTShippingContact.”

Tochoosenottoparticipateinthisprogram, participantscancontacttheCAPCustomer ContactCenterat800-323-4040option1.

OrderConfirmation,SpecimenHandling,andCustomerService

CollegeofAmericanPathologists ProficiencyTestingManual 6

Contact the CAP via Email

GeneralinquiriesmayberoutedtotheCollegeatthefollowingemailaddress: [email protected].

Program CertificatesAfterthecompletionoftheprogramyear, participatinglaboratorieswillreceiveaprogramcertificatethatrecognizeseachinstitution’sparticipationintheCAPproficiencytestingprogramanditscommitmenttopatientcare.CertificatesaresignedbytheCAPpresidentandaresuitableforframing.

LettersAlllettersreceivedbytheCollegearereviewedand,ifappropriate,forwardedtoamedicaltechnologistorascientificresourcecommitteememberforresponse.Yourinputisencouragedandhasalwaysservedasavaluablevehicle forchangesandimprovementstothe interlaboratorycomparisonprograms.

TheCollegedoesnotrequirethatyousubmit documentationforallproficiencytesting deficiencies.However,itisrecommended thatsuchdocumentationberetainedinyour laboratory.TheCAPLaboratoryAccreditationProgramissuesaseparatereport,the “ProficiencyTestingExceptionSummary,”thataddressesproficienciesforCAP-accreditedlaboratories.Instructionsforresponsewillbeincludedwiththereport.

Limitations of Proficiency TestingDuetothemanufacturednatureofthe specimensandthelogisticsofshipping, proficiencytestingdoesnotalwayscorrelatewiththemannerinwhichfresh,clinical specimensarehandled.Aletteraddressingthesedifferencesisincludedonpage7for generalusebyyourlaboratory.

Handle With CautionProficiencytestingspecimensmustbehandledwithcaution.Eachshipmentincludesa biohazardwarningstatementexplainingproperhandling.

Laboratory AccidentsIncidentsofpersonnelexposuretoinfectiousspecimens,throughneedlesticks,contaminationofthemucousmembranesthroughsplashesoraerosolization,orcutsfromcontainers,shouldbereportedimmediatelytotheCAP.

24-hourhotline:800-443-3244

Pleasetrytohavethefollowinginformationavailable:

n CAPnumber

n Phonenumber

n Nameofinstitution/city/state

n Nameofpersonaffected,ifother thancaller

n Dateandtimeofincident

n Whereandhowaffected

n Surveyandspecimennumber

n Nameandtelephonenumberof laboratorydirector

Thisinformationwillberelayedtoapathologist memberoftheappropriateresource committeewhowillcontacttheparticipant’slaboratorydirectororhospitalemployeehealthservicesphysicianwithinstructionsconcerningprophylaxis.

OrderConfirmation,SpecimenHandling,andCustomerService

Limitations of Proficiency Testing Letter

TheCollegeofAmericanPathologists(CAP)Surveysprogramisthelargestexternalquality assessmentprogramintheworld.Assuch,itprovidesanunparalleledselectionofchallengesandoffersthelargestdatabaseinexistenceforinterlaboratorycomparison.TheCAPhas accumulatedsignificantexperienceinmanagingthistypeofprogramandisknowledgeable initsusesandlimitations.

PerformanceonCAPSurveysisnottobetakenasthesoleindicatorofalaboratory’sabilities. AproficiencytestingSurveyisbutoneofanumberofprogramsthatlaboratoriesshouldemploytoassess,manage,andimprovequality.InadditiontoSurveys,propermethodvalidation, qualitycontroltesting,periodiccalibrationandinstrumentmaintenance,employee competencytesting,andlaboratoryinspectionandaccreditationprovideimportanttools formeasuringlaboratoryperformanceandensuringquality.

TheSurveysprogram,althoughoutstanding,isnotaperfectmeasuringdevice.Anumber offactorslimitthistool’sabilitytomeasurelaboratoryaccuracy.Specificlimitationsinclude requisiteuseofmatrixmaterialsthatmayimpacttestsystemsdifferentlythanpatient specimens;theappropriatenessofgroupingresponsesaccordingtomethodology, instrumentation,andtestplatforms;varyingsizeofcomparisongroupswithattendant variabilityofstatisticalparameters;regulatedlimitationsinsamplingoflaboratories’testing systems;difficultiesinquantitationattheextremesofanalyteconcentration;andunsuitability ofcertainfederally-mandatedevaluationlimits.

Thus,acertainnumberofresponsesthataregradedasunacceptableinSurveyswillinfact beacceptable,andacertainnumberofresponsesgradedasacceptablewillinfactbe unacceptable.AlthoughunsuccessfulorunsatisfactorySurveysperformancemayreflect problemswithinalaboratory,itdoesnotconstituteproofofinadequateperformanceoran inabilitytomeetpatientneeds.

Sincerely,

R.BruceWilliams,MD,FCAP

Chair,CouncilonScientificAffairs

2 GeneralComments

Completing the Result FormTheresultformisapreparedformonwhichyourecordyourmethodsofanalysisandresultsoflaboratorytesting.ThecompletedresultformmustbereturnedonlineorbyfaxtotheCAPforevaluation.Prepareyourresultformcarefullyaccordingtotheinstructions.Double-checkyouranswersforaccuracyandcompleteness.

ItisimportanttophotocopyorprintacopyofthecompletedformsforyourrecordsbeforemailingorsubmittingthemonlinetotheCAP.

PerdirectivefromtheCentersofMedicare andMedicaidServices(CMS),changesto submitteddatacannotbemadeaftertheduedateprintedontheresultform.Reviewallinformationonthemethodsummarypageandallentriesmadeontheresultformforaccuracypriortosubmission.Onceyouhaveoptedin,youcanusethe“ResultFormDataEntryandReceiptVerification”optionontheCAPwebsite(undere-LABSolutions)toverifythesubmitteddata.

TeleformsTeleformsarescannableforms.Becausetheseformsarescanned,pleaserefertothekitinstructionsformoredetailedinstructionsoncompletingtheresultform.

Preprinted Method Summary PageThecomputersystemisdesignedtoenhanceresultreportingfromyourlaboratory.Once youhaveinitiallyprovidedamasterlistcode foramethod,instrument,and/orreagent,the computerwillmaintainthesecodes, endingyourneedtoreportthemthroughouttheyear.Pleasecheckeachmasterlisttoensurethecorrectcodesarelisted.Shouldyouneedtochangeacode,enteritinthe appropriateboxesontheresultform.

Exception CodesIfitisnecessaryforyoutoreportananalyticalproblemforanentiretestorindividual specimenswithinatest,leavetheresultareablankandfillthebubblefortheappropriate exceptioncode.Selecttheappropriate two-digitcodefromthoselistedandfillthe appropriatebubble.

Exception Code* Reason

11 Unabletoanalyze (documentationtobeprovided bylaboratory).

22 Resultisoutsidemethod/ instrumentreportablerange.

33 Specimendeterminedtobe unsatisfactoryaftercontacting theCAP.

*Itisthelaboratory’sresponsibilitytodocumentthe appropriateuseoftheseexceptioncodesshouldthisberequestedduringalaboratoryinspection.Pleasereferto thekitinstructionsformoreinformation.

800-323-4040|847-832-7000Option1|cap.org 9

Identification Master ListsMasterlistsofpossibleidentificationsare providedformicrobiology,bloodcell identification,urinesediment,clinical microscopy,andprovider-performed microscopy.Selectyouranswersfromthe appropriatemasterlistsprovided.Recordtheappropriatemasterlistcodeforyourchoiceontheresultform.

Forbloodcellidentification,urinesediment,clinicalmicroscopy,andprovider-performedmicroscopy,allpossibleidentificationsare includedonthemasterlists.Donotusethecode010,“Other,Specify.”Theuseofthis codewillbeevaluatedasanunacceptable response.

Method/Instrument Master ListsMethod/instrumentmasterlistsareprovidedinthekitinstructions.Choosetheappropriateinstrumentand/ormethodandprovidethisinformationontheresultform.

ItisimportantthatyounotifytheCAPandthe manufacturerifyourinstrumentormethodisnotlistedonamasterlist.Thismaybedonebylistingthisinformationinthe“UseofOther”sectionoftheresultform.YoumayalsocontacttheCAPdirectlywhilecompletingtheresultformtosee ifacodehasalreadybeenestablishedfor yourmethodand/orinstrumentbutwasnot availableintimeforprintingoftheresultform.

HandwritingTheresultformsaredesignedforquick,easy scanningbyourcomputers.Ifyoufaxyour results,theinformationonyourresultformmustbeclearlyreadable.

Decimal Points and Box PositionsThecomputerisprogrammedtoacceptonlythoseanswersconformingtotheboxesanddecimalpointsontheresultform.

Ifanumberisnotlargeenoughtofilltheboxes, insertzerointheremainingspaces.Resultsshouldberight-justified.Whensubmittingresultsonline,thiswillbedoneautomatically

Example: Correct Incorrect Glucose 73 mg/dL

Urea Nitrogen 12.8 mg N/dL

“Less Than” or “Greater Than” ValuesDonotattempttoadd“lessthan”or“greaterthan”tothevalueyousubmitunlessthisoptionisprovidedontheresultform.Whereprovisionismadetoreport“lessthan”or“greaterthan”results,youmustfillinthebubbleofthe appropriateboxtoindicateyourresponseisa“lessthan”or“greaterthan”value.Allotherresultswillbeconsidered“equalto”values.

Wherenooptiontoreport“greaterthan”or“lessthan”isgiven,referto“exceptioncodes”onpage8orinyourkitinstructions.

073. 73 .

013. 128.

GeneralComments

Using Online FeaturesPowerfulInternet-basedtoolsareavailabletogiveparticipatinglaboratoriesmanyexcitingchoices.Simpleinstructionsforuseofthesetoolsareprovided.Andasalways,CAP CustomerContactCenterrepresentativesstandreadytoofferassistance.

Inordertotakefulladvantageofthe functionalitiesavailableonline,userscan selectivelyenablelaboratoriesand personnelbyundertakingenrollment proceduresasoutlinedbelow:

Self Registration

ThisistheprocessofcreatinganaccountwiththeCollegeforonlineactivities.AllusersoftheadvancedfeaturesoftheCAPwebsitearerequiredtohaveapersonalWebaccountandbeloggedintobeabletousethesite.Thisprocessonlyneedstobedoneonceperuser;itallowstheusertoselectanIDthatcanbeeasilyrecalledandthatbelongstotheuser,regardlessoflaboratoryaffiliation.Bothmembersandnonmembersarerequiredtoberegistered,therebyallowingtheentirelaboratorycommunitytoparticipateonline.ThisregistrationisalsovalidforCME/CEonlinelearningactivities.

Logging In

OnceusershaveestablishedanaccountwiththeCollege,theywillbepromptedbythe systemtoentertheiruserIDandpassword.Thismustbedoneeverytimeusersvisitthesite,oruserscanchoosetohavethesystem remembertheirlogin.Bothmembersand nonmembersutilizethesamelogin functionality.

Opting In

Auser(thelaboratoryadministrator,by default)entersaCAP#andCollege- providedPIN#,therebyenablingthe laboratorytoaccessadvancedfeatures online.Thisprocessonlyneedstobedoneonceperlab;andonceaccomplished,thelabwillhaveaccesstoallofthefeatures currentlyaccessibleonlineaswellasthosethatwillbeofferedinthenearfuture.

SecurityThenatureoftheindividualizedaccounts forlaboratoryusersallowsforflexibilityindeterminingwhatlevelsofaccesseachusershouldhave.Becauseusersareindependententitiesfromthelaboratory,theuserscanbeassociatedwithmultiplelaboratoriesandtheirsecuritycanbeadministeredinadifferentmannerateachsite.Thisiscarriedoutby thedelegatedsecurityadministratoratthe laboratorywhoisresponsibleforoverseeingtheaccessandsiteprivilegesforeachuser associatedwiththatlab.Becauseofthechangingnatureoftheemployee-employerrelationshipinthelaboratory,thisfeature allowsthemostflexibilityfortheadministratortoadd,modify,and/orremoveusers’accessprivilegesastheadministratorseesfit.Thishastheoveralleffectofeliminatingtheneedto havetocalltheCustomerContactCenter tocarryoutsomeofthemoreroutine maintenanceofanaccount.Thedelegatedsecurityadministrator(s)canconferasmanyorasfewpermissionsastheyseefit,andtheadministrator(s)canconfigurepersonnel securitysothatitcloselymatchesindividuals’roleswithinthelaboratory.Thiswillenablethelabtoreplicatethesameworkflowmodelthatitemploysforpaper-basedsubmissionof results,therebyhelpingtoincreasetheintegrityandconfidenceinthedataenteredonline.

S O L U T I

O

N

S

.

. . .

. . . .

. . . . . . . . . . . . . . . . . .

-LAB TM3e-LABSolutions™

800-323-4040|847-832-7000Option1|cap.org 11

Online Data SubmissionOncethelabhasoptedinandsecurityforemployeeshasbeenadministered,oneofthefirstfeaturesalabcantakeadvantageofistheabilitytosubmititsdataresultsonline.AlabwillreceiveitsPTmaterialandpaperresultforms asusualandwilltesttheminitscustomary manner.Mostlaboratoriansmayprefertorecordtheirresultsonthepaperresultformforeaseoftranscriptiontotheonlinesystem.Theuserswilllogintothesite,navigatetotheirlabandkit,andtheywillbepresentedwithan AdobePDFversionofthesamepaperresultformtheyhaveinhand.Theformisdesignedtopreventerrantdatafrombeingsavedtotheform.Userswillbeabletoselectmethodandqualitativecodesfromdropdownlistsratherthanhavingtorefertoaseparatedocumentforthecode.Invalidcodesanddatawill preventtheuserfromsavingtheform.Userswillenterthedataintothevirtualformandsavethedataastheyfinish.ForSurveysinwhichmultiplelaboratoriansperformthetestingandresulting,theflexiblenatureofthedataentrysystemwillallowmultipleuserstologintothesystemat differenttimesandentertheirdata,soastominimizeanyinterruptiontotheirnormal laboratorywork.Dependingonthenormalworkflowwithinthelab,theadministratorhasachoicetodesignateanadditionalapproverroleforanotheruserwhosejobitistoverifythatalldatawasenteredasintendedandtosubmitthedata.Oncethisstepisfinished,thedataiscommittedtotheCollege’ssystemandisreadyfornormalprocessing.Theadvantagestothissystemlieinspeed,efficiency,andclarityoftheresultantdata.

Inadditiontothesebenefits,labswhocontinuetofaxtheirresultformsincanalsotake advantageoftheonlineentrysincethesystemwillbeabletopresentthedataasithasbeeninterpretedbycomputerizedscanning equipment.Userscanaccesstheirinterpreteddataandwillhavetheopportunitytocorrectanyscanningerrorsthatmayhaveoccurredduetothenatureoferrorsinherentinthese media.Givingtheparticipantstheopportunitytocorrectforthesescanningerrorsalso increasestheaccuracyoftheirdatawhich,ifallowedtopropagatethroughthesystem,couldhavenegativeconsequencesintheirperformanceinterpretation.

Interactive EvaluationsAssoonastheCollegereceivesastatisticallysignificantpopulationoftheresultsfromkitsmailedforeachSurveymailing,thedataareprocessedandgradedaccordingtostringentgovernmentalandcommitteecriteria.Thelabresultsandgradinginterpretationsaredisplayedinanindividualizedreportthatwillbeavailabletoallusersviapaperoronline.Thepaperreportthatlabsareusedtoseeinghasanupdatedgraphicalformat.Thenewformatalsoallowsformoredatatobedisplayedperpage,therebycuttingdownontheamountofpaperthatmustbestoredforfutureretrieval.Theonlineversionisavailableinastaticformatthatcanbe printedordownloadedandstoredlocally,therebynegatingtheneedtocreatea separatelibraryofevaluationsforfuture reference.Inaddition,theonlineevaluation willallowtheusertonavigatethroughtheevaluationandbrowsethedataanalytebyanalyte.Also,userswillbenefitbytheinclusionofdetailedimagesthatwillbehyperlinkedfromtheonlineevaluationreportonly.LaboratorymanagerswillfindausefultoolintheAllAnalyteScorecard,whichwillallowthemtofilterandcustomizethescorecarddatafortheir laboratoryasameansofidentifying deficienciesortrendsinperformance.

Online ReportsOtherancillaryreportsthataccompanytheevaluationreportwillbeavailableonline,aswell,forreviewandtodownloadforfuturereference.Thisincludesparticipantsummaryreports,finalcritiques,andannualsummaries,whichcontainusefuldataandeducationthatcanbereviewedandaccessedbyalluserswithappropriatesecurity.Thesedocumentsmaybedownloadedandstoredlocallyforfutureuse.Thiswillhelptoincreasethedisseminationoftheinformationcontainedinthesedocumentstomultiplepersonnel,especiallynowthattheinformationcontainedthereinisbeingusedincreasinglyforeducationalenhancements forwhichindividualscanobtaincontinuing medicaleducation/continuingeducation (CME/CE)credits.

e-LABSolutions

Thischapterincludesgeneralinformation regardingevaluations.Asectionexplaininghowtointerpretyourindividualevaluationwillbeincludedwitheachmailing.

General Guidelines for EvaluationOnFebruary28,1992,theSecretaryofHealthandHumanServicespublishedthefinalrulesimplementingtheClinicalLaboratory ImprovementAmendments(CLIA)of1988.TheseregulationsestablishedevaluationcriterialimitsformanyoftheanalytesincludedintheCAPSurveysprograms.Thetargetvaluesaredeterminedbythescientificresource committeesoftheCAP.Forthoseanalytes notincludedintheproficiencytestingportionofCLIA,thetargetvaluesandevaluationcriteriaaredeterminedsolelybythescientificresourcecommittees.

Selection of a Target ValueTominimizetheeffectofmethoddifferencesandtoallowcomparisonofallmethods, participants’resultsarecombinedinto comparablemethod/instrumentgroupscalledpeergroups.Itisimportantforparticipantstoprovidecompleteinformationregardingthemethodorinstrumentusedinordertobe combinedintheappropriatepeergroup.

Formostanalytes,thepeergroupmeanisdesignatedasthetargetvalueforevaluation.Thepeergroupmeanisthepreferredtargetifnosingletargetvalueexiststhatcanprovideanaccuracy-basedtargetthatistraceabletothe“truevalue”asdeterminedbyadefinitiveorreferencemethodanalysis.Thepeergroupmustconsistofgreaterthannineresultsafter

outlierexclusion,andthevariabilityofthepeergroupdatamustnotbetoogreat.

Ifpeergroupdataarenotavailableoraretoo variable,methodgroupstatisticsmaybeused.Themethodgroupmustalsoconsistofgreaterthannineresultsanddemonstrateacceptablevariabilitybeforeitisusedasthetargetgroup.

Ifpeerandmethodgroupstatisticsarenotavailable,acomparativemethodgroupmaybedesignatedasthetargetmean.The comparativemethodisnotthemethod recommendedbytheCollege.Howeveritisestablishedasahistoricallyreliablemethodandisusedforevaluatingresultsfrommethodsthathaveaninsufficientnumberofparticipantstogenerateaseparatepeergroupand/or methodgroupstatistics.Ifnocomparativemethodexistsfortheanalyte,resultswillnot beevaluated.

Forsomeanalytes,asingletargetvalueisusedinwhichconsistentresultsaredemonstratedacrossallpeergroups.

Calculation of Summary StatisticsPeer Group Results

Resultsaregroupedaccordingtothemethodusedforanalysisandscreenedforoutliers. Variousstatisticsarecalculatedfromthe remainingdatathatsummarizethepeergroup’sresponses.Thesesummarystatisticsincludethefollowing:

n themean(theaverageofthereported results);

n thestandarddeviation(ameasureof thevariabilityoftheparticipantresults, oftenabbreviatedasSD);

4 HowtoInterpretthe EvaluationReport

800-323-4040|847-832-7000Option1|cap.org 13

n thecoefficientofvariation(CV);

n themedian(themiddlevalueinan orderedlistofthenon-outlierresults);

n thelowvalue;

n thehighvalue;

nthefinalcountofreportedresultsthat werenotexcludedasoutliers.

Outlier Detection Technique

Outlierexclusionisnecessarybecausealargeseriesofresultsfrequentlywillincludesome aberrantvalues.Thesemayarisefrom instrumentmalfunction,technicalerrors, specimenmix-ups,misplaceddecimals, incorrectunitsofmeasure,ordataentryerrors. Ifanyresultsareexcluded,theoutlierprocess isrepeatedusingtheremainingvalues.Thesummarystatisticsthatappearonyourreportsdonotreflectresultsthatwereconsideredtobeoutliersduringeitheroutlierpass.

Quantitative Procedures/Rounding

Allquantitativeresponsesareevaluatedbaseduponarangeofacceptability.Thisrangeisdeterminedusingatargetvalueandalimit.Thelimitwillbeeitherafixedinterval(eg,±5mg/dl),apercentageofthemean(eg,±25%),anSD(eg,±3SD),oravariablerange(eg,±6mg/dL or10%,whicheverisgreater).TheParticipantSummaryincludedwithyourevaluationwilllistthecriteriausedtoevaluateyourperformance.Thefollowingsectionsprovidesspecific examplesofhowtocalculatetherangeof acceptabilitydependinguponthecriteriaused.

Fixed Range Example

Yourlaboratoryreportsasodiumresultof138mmol/L.Thepeergroupmeanis139.5mmol/L.Theevaluationlimitforsodiumis±4mmol/L.Theacceptablerangeisdeterminedbytheformula139.5mmol/L±4mmol/L,whichis135to144mmol/L.Therefore,yourreportedresultof138mmol/Liswithinthecalculatedacceptablerangeof135to144mmol/Lwhenusingbenefit-of-the-doubtrounding.

Percentage of the Mean Example

Yourlaboratoryreportsanalbuminresultof3.1 mg/dL.Thepeergroupmeanis3.39mg/dL.Theevaluationlimitforalbuminis±10%.Tenpercentof3.39mg/dLis0.34mg/dL.Theacceptablerangeisdeterminedbytheformula3.39mg/dL±0.34mg/dL,whichis3.0to3.8mg/dLwhen

usingbenefit-of-the-doubtrounding.Therefore,yourreportedresultof3.1mg/dLiswithinthecalculatedacceptablerangeof3.0to 3.8mg/dL.

Standard Deviation Example

YourlaboratoryreportsaTSHresultof 16.4µU/mL.Thepeergroupstatisticsareas follows:mean=15.7µU/mL,SD=1.5,and CV=9.6.TheevaluationlimitforTSHis±3SD. 3x1.5=4.5.Theacceptablerangeis determinedusingtheformula15.7µU/mL±4.5µU/mL,whichis11.2to20.2µU/mLwhenusingbenefit-of-the-doubtrounding.Therefore,yourresultof16.4µU/mLiswithintheacceptablerangeof11.2to20.2µU/mL.

Variable Range Example

Yourlaboratoryreportsatotalbilirubinresultof4.5mg/dL.Thepeergroupmeanis4.68mg/dL.Theevaluationlimitfortotalbilirubinis ±0.4mg/dLor20%,whicheverisgreater.Twentypercentof4.68is0.936.Sincethepercentagelimitof0.94isgreaterthantheintervallimitof0.4,thepercentagelimitisappliedtothetargetvalue.Theacceptablerangeisdetermined usingtheformula:4.68±0.936,whichis3.7to 5.7mg/dLwhenusingbenefit-of-the-doubtrounding.Therefore,yourresultof4.5mg/dL iswithintheacceptablerangeof3.7to 5.7mg/dL.

TheParticipantSummaryReportincludedwithyourevaluationreportwilllistthecriteriausedtoevaluateyourperformance.Todeterminetheacceptablerange,abenefit-of-thedoubtroundingprocedureisutilizedwhengrading.Theupperlimitofacceptabilityisobtainedbyroundinguptothenextreportableresult,whilethelowerlimitisdeterminedbytruncating.

Calculation of the Standard Deviation Index (SDI)

Thecomputer-printedevaluationreportlistsyourresultsandtheevaluationstatisticsforyourpeergroup.ItalsolistsyournormalizedresultsasanSDI.ThisvalueisobtainedbysubtractingthegroupmeanfromyourresultandthendividingbytheSD.

TheSDIisexpressedintermsofthenumberofSDsfromthemean,withanarithmeticsignindicatingthedirectionofthedifference.ThecalculationoftheSDInormalizesyourresultand,therefore,allowsforacomparisonofresultsfromspecimensofdifferentconcentrationsofananalyte.

HowtoInterprettheEvaluationReport

CollegeofAmericanPathologists ProficiencyTestingManual 14

Whenacomparativemethodhasbeen designatedforSurveysanalysis,asecondsetofstatisticsislistedontheprintoutcomparingyourresultswiththoseobtainedusingthecomparativemethod.ThefiguresshownarethemeanandSDforthecomparativemethodandyourresultasanSDIusingthesestatistics.Itispossibleforyourresulttobedefinedas“good”performanceinyourmethodgroupandyetproduceacomparativeSDIgreaterthantwo.ThiswilloccurifyourmethodhasalargeanalyticbiasoralargeSD.Itis possibletoreceiveacomparativeSDIlower thanthemethodgroupSDI,althoughthisrarelyoccurs.Inpractice,mostparticipantsreceive similarmethodgroupandcomparativeSDIs.

Comparative StatisticsQuantitative Procedures

Yourevaluationreportwilldisplayplotsofthe relativedistanceofyourreportedresultsasa percentageofallowabledeviationfromthe targetvalue.Thenumericdigitindicatesthe numberofresultsataplotlocation.Thealloweddeviationmaybecalculatedasfollows:

Ifyourresultisgreaterthanthetargetmean:

Ifyourresultislessthanthetargetmean:

Qualitative Procedures

Forqualitativeresponses,consensusagreementofrefereeorparticipatinglaboratoriesisusedfor evaluation.Generally,80%agreementisrequired.

HowtoInterprettheEvaluationReport

Percentage ofAcceptable Deviation=100 x

your result-target ______________________upper limit-target mean

Percentage ofAcceptable Deviation=100 x

your result-target ______________________target mean-lower limit

15

CME Category 1TheCollegeofAmericanPathologists(CAP)isaccreditedbytheAccreditationCouncilfor ContinuingMedicalEducation(ACCME)toprovidecontinuingmedicaleducationfor physicians.

TheCAPdesignatestheseeducationalactivitiesforamaximumofthestatednumberofAMA PRA Category 1 Credits™.Physiciansshouldonlyclaimcreditscommensuratewiththeextentoftheirparticipationintheactivity. TheAmericanMedicalAssociationhasdeterminedthatphysiciansnotlicensedintheUSwhoparticipateintheseCMEactivitiesareeligibleforAMA PRA Category 1 Credit™.

SeethecurrentSurveyscatalogforavailableCMEprograms.

CE for CytotechnologistsCytotechnologistsmayapplythecreditsfromtheFNAG,FNA,PAPCE1/PAPJE1/PAPKE1/PAPME1, PAPPTandNGCprogramstowardtherequirededucationalactivitiesfortheAmericanSocietyforCytopathology(ASC)ContinuingEducationCreditProgram.

Online Virtual Microscopy Education Programs

TheCAPoffersonlineeducationprogramsthatuseadvancedimagingtechnologytopresentimagesfromactualglassslidesforavarietyofsitesandspecimentypes.Thistechnology simulatesamicroscope,allowingyoutoscantheimageandusemultiplemagnificationstoviewthematerial.Fromtheimagesandclinicalinformationprovided,youselectadiagnosis,answerlearningassessmentquestions,andreceiveimmediatefeedbackonline.

SeethecurrentSurveyscatalogforavailableonlinevirtualmicroscopyeducationprograms.

5 ContinuingEducation

CollegeofAmericanPathologists ProficiencyTestingManual 16

Surveys CE ProgramsDiscipline Maximum CE CreditsChemistry

Coagulation

Hematology

Histology(HistoQIP)

Immunology

Microbiology

TherapeuticDrugMonitoring/Endocrinology

Toxicology

TransfusionMedicine

Continuing Education (CE) for Nonphysician Laboratory Personnel

The number of credits are specific to the program mailing.

Please go to cap.org and click on the Education tab for

up-to-date activity listings.

EXCEL CE ProgramFortheEXCELprogram,eachindividualmayreceivecontinuingeducation(CE)creditsforparticipatingintheeducationactivities. SelectedmailingsofEXCELwillincludean educationactivitydesignedtoprovide technicalandnontechnicalinformationto keepyourstaffontheleadingedgetoensurequalitypatientcare.Theeducationactivityconsistsofarelatedreadingfoundinthe ParticipantSummaryandlearningassessmentquestionsonlineatcap.org.

All laboratory professionals in your lab may now earn individual CE credits by completing the related education reading and online learning assessment questions on the CAP website.Uponcompletionoftheeducationactivity,youwillreceiveaCAPcontinuing educationcertificate.

DesignedbytheCAPPoint-of-CareTestingCommittee,eachactivitycombinestheuniqueperspectiveofthecommittee’spathologist,

clinician,andmedicaltechnologistmembers.Theeducationactivitiesaredesignedto challengeandeducatewhileprovidingtheconvenienceofearningfreeCEcreditsandfulfillinglicensureandeducationrequirementswithoutleavingyourlaboratory.Theeducationactivitiesarealsovaluabletoolsforin-housecontinuingeducationprograms.

Learning Cycle Information

Eacheducationactivityprovidesinformation oncommontechnicalandnontechnical issuesencounteredinalllaboratorysettings.Toreceivecontinuingeducationcredit,youmustcompletetheeducationreadingprovidedinyourParticipantSummaryandanswerthe onlinelearningassessmentquestions.Each educationactivitywillbeavailableforsixmonthsandmustbecompletedwithinthattimeframe.Continuingeducationcreditwillbeappliedtowardtheyearinwhichtheactivityiscompleted.Detailedinformationonhowto accesstheonlinecomponentswillbeincludedineachParticipantSummary.

ContinuingEducation

800-323-4040|847-832-7000Option1|cap.org 17

ContinuingEducation

Overall Learning Objective

Uponcompletionoftheseeducationactivities,thelearnerwillbeableto:

1. Listpreanalytic,analytic,and postanalyticvariablesthataffect patienttesting.

2. Identifyqualityimprovement opportunitieswithinhis/herown laboratorysetting.

3. Applyappropriatequalityassurance measurestoensureaccuratepatient results.

CE (Continuing Education)

Thisactivityisacceptabletomeetthe continuingeducationrequirementsfortheASCPBoardofRegistryCertification MaintenanceProgram.

Thisactivityisapprovedforcontinuing educationcreditinthestatesofCalifornia andFlorida.

How to Complete the Result FormToensurestatisticallyvaliddata,itisessentialthatparticipantsprovideallnecessarymethod,reagent,and/orinstrumentinformationasrequired.Pleaseremember,onceyouhaveprovidedaccurateinformation,ourcomputersystemwillretainthisinformation.

Verifythatthecorrectmethod,reagent,and/or instrumentcodeisnotedonthepreprintedmethodsummarypageincludedwithyour resultformorlistedontheonlineresultform. Ifacodeisnotnotedoryou’vechanged instruments,youmustenterthecorrectcode ontheresultform.

Hematology

Toreportyourbloodcellidentification,selectthebestidentificationcodefromthe HematologyBloodCellIdentificationMaster Listprovidedinthekitinstructions.Toassistyouwithbloodcellidentification,theHematology, ClinicalMicroscopy,andBodyFluidsGlossary isavailiableonlineatcap.org.

Ifresultsarereportedforbothbloodcell identificationandautodifferentials,thebloodcellidentificationwillbereportedtoCMS.

TheHematologyBloodCellIdentificationMasterListchoice,“Immaturecellorabnormalcell,wouldreferforidentification,”mustbereservedforcellsyourarelyencounterandareunabletospecificallyidentify.GradingofthisresponsewillfollowtheguidelinessetforthintheJuly26,1993,Federal RegisterNotice.

Coagulation

Forplasma-basedcoagulationtesting(PT,APTT, Fibrinogen),aninstrumentandreagentcodearerequiredforproperevaluation.Participantsenrolledinwholebloodproficiencytesting forPTneedonlyindicateaninstrument (ifrequested)andtheirresults.Forall prothrombintimemodules,reportingof InternationalNormalizedRatio(INR)resultsisoptional.Plasma-basedandwholebloodINRareevaluated.

Urinalysis

Thereisaseparateurinalysisandspecific gravitymethodmasterlistandinstrumentmasterlist.Toensureanaccuratepeergroupevaluationofyourresults,itiscriticaltoprovideaccuratemethodandinstrumentinformation.

Aspecificlistofreportingoptionsisprovided foreachurinalysisprocedure.Itisnotfeasible toprovidealistofreportingchoicesspecific foreverypossibledipstickbeingmarketedtolaboratories.Subsequently,theresultrangeslistedmaynotexactlycorrelatewiththerangesusedwithyourinstrument/dipstick.Inthesefewcases,choosetherangethatmostcloselymatchesyourintendedresult.Toensurean accuratepeergroupevaluationofyourresults,itiscriticaltoselectanappropriateresultthatthemethodallows.

Toreporturinesediment,clinicalmicroscopy,orprovider-performedmicroscopy,selectthebest identificationcodefromtheUrineSediment/ClinicalMicroscopyMasterListprovided.To assistwithidentification,theHematology, ClinicalMicroscopy,andBodyFluidsGlossary isavailableonlineatcap.org.

6 Discipline-SpecificReportingInformation

800-323-4040|847-832-7000Option1|cap.org 19

Urinalysis Dipstick Tests

Forqualitativeproceduresinurinalysis, evaluationisbasedonparticipantconsensus bymethodandinstrument.Foreachanalyte, aminimumoftwo,butnotmorethanfour,responseswillbegivenapassingscore.Analyteresultsgraded“good”performancemusthave80%participantconsensus.Eightypercent participantconsensuscanbedeterminedby groupingthemodewiththenextoneortwomostfrequentresponses.Thisgroupwillbe given“good”performance.“Acceptable” performancewillbegiventoadditional responsesuntilaminimumof90%ofparticipantresultsaregivenapassingscore.Inthecaseofanegativespecimen,negativeresponsesmustconstitute90%participantconsensus.Specimenswithresultsforoneormoremethodsdistributedoverbothnegativeandpositiveresponse(nonconsensus)willnotbeevaluated.Specimensforwhichthereisgreaterthan90%ofparticipantresponsesdistributedovermorethanfourresponseswillbegradedas nonconsensus.

Microbiology

Whereappropriate,aclinicaldiagnosis,age,andsourcearelistedtosimulateatrue clinicalsituationandtoallowlaboratory personneltoselectappropriatemediaor methodsforprocessingthesespecimens. However,asthepathogenicbacteriapresent inanyofthesesamplesmaybeisolatedfrommultiplesourcesofthebody,allparticipantsshouldattemptidentificationoftheorganismspresentinallthesespecimens.

PertheFederal Register,aSurveymustgradealaboratory’sabilitytodistinguishbetweenapathogenandacontaminant.Culture challengeswillbedesignatedintheinstructionstobehandledas“identifyprincipalpathogen”or“identifyallorganisms”challenges. Participantsmustreportinthismannerevenwhenthisdiffersfromtheirlaboratory’sroutinepractice.Forexample,aurinespecimen containsKlebsiella pneumoniaeand Staphylococcus epidermidis.Iftheinstructionsindicateto“Identifyallorganisms,”both organismsshouldbereported.Iftheinstructionsindicateto“identifyprincipalpathogen,”onlytheKlebsiella pneumoniaeshouldbereported.IftheStaphylococcus epidermidisisreported,itwouldbepenalized.

Specimenresultswillbeevaluatedif80%ormoreoftheparticipantlaboratoriesagreeontheidentificationofthetestorganism(s)to genusortogenusandspecies.Intheabsenceofparticipantconsensus,refereelaboratorieswillbeused.

TheCLIAregulationsstatethatalaboratorymustperformaminimumoffivespecimensineachtestingeventforthesubspecialtyofbacteriology.Thefivechallengescanincludeacombinationofthefollowingspecimens:

nbacterialantigendetection

nbacterialidentification(culture)

nGramstain

nantimicrobialsusceptibility

Pleasenotethatproceduresassayedwithwaivedmethodologieswillnotcounttowardthefive-challengeminimum.ThelaboratoryisresponsibleformaintainingthefivespecimenspertestingeventforitsremainingnonwaivedtestsinthesubspecialtywhenatestiswaivedbytheFDAmidyear.

Antimicrobial Susceptibility Testing

Participantswillbeaskedtoperform susceptibilitytestsusingtheantimicrobialagentsandtechniquesinroutineuseintheirindividuallaboratories.Thelaboratoriesshouldreportonlyantibioticsappropriatefortherapyofinfectionsatthesiteindicatedinthepatienthistory.SeecurrentClinicalandLaboratoryStandards Institute(CLSI)documentsM2,M7,M100,orotherappropriatedocumentsforguidance.

Interpretationresults(susceptible,intermediate,andresistant)willbepenalizedfor:

n Agentsthatarenotclinicallyappropriate forthesiteofinfection(meningitis, pneumonia,urinarytract,etc)

nUseofmethodsCLSIadvisesagainst

nUseofmethodsthatthemanufacturer recommendsagainstusing,duetopoor performance

Selectivereportingforthepresumedsiteofinfectionhelpsimproveclinicalrelevance,encouragesappropriatetherapy,andhelpstominimizeselectionofresistance.

Discipline-SpecificReportingInformation

7 TheEvaluationand ParticipantSummaryReports

Your Evaluation ReportShortlyafteryousubmityourproficiencytestingresultstotheCAP,anevaluationreport evaluatingyoursubmittedresultswillbe availableonlineormailedbacktoyou.Yourevaluationreportcanbeusedasaqualityassurancetooltoassesshowyouperformedcomparedtootherparticipants.Tobenefitfromthisreport,itisimportantthatyoureviewandunderstandtheinformationpresented.Hereisareviewoftheinformationcontainedonyourevaluationreport:

nDemographicInformation:Provides informationaboutyourlaboratory, includingthenameofyourinstitution, yourCAPIdentificationNumber,andany agenciesorconsultantsyouhave designatedtoreceivecopiesofyour evaluation.

n ResultArea:Containsallresultsreported foraparticularmailingandstatistical datausedforevaluationpurposes.A detaileddescriptionofevaluationdata specificforeachdisciplineispresentedin eachParticipantSummary.

nCMSPerformanceSummaryReport: Includesinformationoncurrentand cumulativeperformanceforregulated analytestobesenttoCMS.

Reviewing Your Evaluation ReportTotrulyrealizethebenefitofproficiencytesting,itisimportantthatyoutakethetimetocarefullyreviewyourevaluation.Youcangainvaluableinsightintoyourlaboratory’soverallprocessesbyfollowingtheseeasystepsinreviewingthisreport.

1. Reviewthedemographicinformationon theevaluationreport.Ifanyinformation isincorrectorhaschanged,contactthe CAPat800-323-4040option1.

2. Compareinformationonyour evaluationreportwithresultsonyour photocopyorprintedcopyoftheresult form.Ifanyofyourdatawasenteredby theCAPincorrectly,contactus immediately.Correctionsdueto dataentryerrorsmadebytheCAPmust berequestedwithinfourweeksafterthe firstevaluationwasmailed.

3. Lookforanyunacceptableresults. Common,easilycorrectedreasonsfor unacceptableresultsinclude:

nIncorrectorincompletemethod/ instrumentdata

nClericalerror

nDecimalpointplacement

nSpecimenhandlingerror

Remember,whateverthecause,CLIA statesthatallPTdeficienciesmustbe documentedandcorrectiveaction takentoresolvethedeficiency.

4. Althoughtheresultsmaynotbeformally evaluated,youcancompareyour resultswiththedataprovidedinthe ParticipantSummary.Youcanusethe “allmethodmean”ormedian,low,and highvaluestocompareyourresultsfora self-assessmentofyourperformance.

800-323-4040|847-832-7000Option1|cap.org 21

5. Forquantitativedata,justknowingthatyou are“withinlimits”doesnottellyouifyou areexperiencingaslowlydevelopingbias thatmayresultinfuturefailures.Thekeyto optimaluseofyourevaluationdataisto lookatthecolumnwherestandard deviationindexes(SDI)arereported.Ifyou noteanyofthefollowingtendencies,itmay beadvantageoustoexamineyour laboratoryprocessesfurther:

n TheaverageSDIismorethan+/-1.5: thismayindicateasignificantsystematic error.Reviewcalibrationdataand technique.Reviewexpirationdatesof calibratorsandreagents.

n OneofyourSDIsisgreaterthan+/-3 ortotalSDIisgreaterthan4(oneSDIis -2andoneis+2.5foratotalof4.5):this mayindicateasignificantrandomerror. Reviewyourproceduretodetermine whereanyunwantedimprecisionmay beoccurring.

6. Whentheevaluationreporthasa nonevaluationcodelisted,refertoyour ParticipantSummaryforvaluable information.

7. Verifythatallregulatedanalytesforwhich youreportedresultsareincludedonthe CMSPerformanceSummaryReport.

8. Makesurethelaboratorydirectorreviews andsignsallproficiencytestingevaluations.

The Participant Summary Inadditiontoyourevaluationreport,eachlaboratoryreceivesaParticipantSummaryforthatmailingthatlistsresultsfromallparticipantsforeachanalytegroupedbythemethodology.Thisreportprovidesvaluableinformationtotheparticipantintheformofcomparativedataandeducationactivities.

Program Update

ThissectionoftheParticipantSummarycontains informationaboutevaluationcriteriainusefor thatmailing.Italsohighlightsimportantmethod, manufacturer,andspecimeninformationthat pertainstothatmailing.

Quantitative Data

TheParticipantSummaryprovidesthestatisticaldataneededtoreviewyourproficiencytesting(PT)results.Thereportliststhemean,standarddeviation(SD),andcoefficientofvariation(CV)forpeergroupsconsistingof10ormore laboratories.

Qualitative Data

Qualitativedataevaluationisbasedon consensusofparticipantand/orreferee responses.TheParticipantSummaryliststhe participantresponsesalongwiththe percentagereportingthatresponse.Whereavailable,refereedataisalsoincluded.Thispracticeprovideshigher-quality,evaluatedchallengestoourparticipants.

How to Perform a Self-EvaluationAsmentionedpreviously,occasionallyaPTchallengecannotbeevaluatedforavarietyofreasons:

nLackofparticipantconsensus

n Insufficientdata(<10responsesfora givenmethod)

nPerceivedcompatibilityissues

InordertocomplywiththequalityassuranceaspectofproficiencytestingasoutlinedinCLIA,youmusthavesomemechanismtoevaluateyourproficiencytestingresults.Hereareafewexamplesofhowthedatapresentedinthe ParticipantSummarycanassistwiththistask.

Quantitative Results

Ifyouperformatestandtherearefewerthannineotherlaboratoriesreportingresultsforthattest,yourresultwillnotbeevaluated.Youcandeterminehowwellyouperformedcomparedtoallparticipantswhoreportedresultsbyusingthe“allinstrumentmethod”datapresentedintheParticipantSummary(ifprovided).For example,youperformhemoglobinanalysis usingtheCoulterS-plusIV.Therearean insufficientnumberofresultstoformapeergroup(<10);therefore,yourresultsarenotgrad-ed.NotethatintheParticipantSummarythere

TheEvaluationandParticipantSummaryReports

CollegeofAmericanPathologists ProficiencyTestingManual 22

isanall-instrumentmean,standarddeviation,andcoefficientofvariation,whichcanbeusedasareferencevalue.ByapplyingthepublishedCMSevaluationlimits(±7%)tothismean,youcandeterminehowwellyouperformedcomparedtothisreferencevalue.Forexample:

Your result: 13.8 g/dL

All Instrument Mean: 13.77 g/dL

Range of Acceptability: 12.8–14.8 g/dL

Inthisexample,yourresultwouldbeconsideredwithinrangewhencomparedtotheall-instrumentmean.Documentthisself-assessmentonyour evaluationreport.Whenyouperformthisself- assessment,anyunacceptableresultshouldbedocumentedandinvestigatedandcorrective actionshouldbetakenaswouldbedonefor formallyevaluatedresults.Thissametechniquecanbeusedwhenonlyamedian,low,andhighvaluearereportedforananalyte.

Qualitative Results

Ifaqualitativeresultisnotevaluatedduetolack ofrefereeorparticipantconsensus,youcanstill evaluatehowwellyourlaboratory’sresultagreedwiththecorrectresponsebyusingthedataintheParticipantSummary.Forexample,oneoftheGramstainchallengescouldnotbegradedduetolackofparticipantconsensus(77%reportedgram-negative,23%reportedgram-positive).TheParticipantSummaryindicatesthattheorganismwasPseudomonas aeruginosa,agram-negativerod/bacilli.Compareyourresultwiththecorrectresult.Investigateanddocumentanycorrectiveactiontaken.Reviewtheeducationalcritique accompanyingtheresultforhelpfulsuggestions onlaboratorytechnique.

TheEvaluationandParticipantSummaryReports

8 LaboratoryLegislationandCMSReporting

OnFebruary28,1992,theSecretaryofHealthandHumanServices(HHS)publishedthefinalrulesimplementingCLIA.TheCLIAregulationsreplacedtheMedicare,Medicaid,andCLIA’67standardswithasinglesetofrequirementsthatapplytoalmostalllaboratoriestestinghumanspecimens.Standardsforlaboratorypersonnel,qualitycontrol,andqualityassuranceare basedontestcomplexityandriskfactors.The regulationsalsoestablishapplicationproceduresandfeesforCLIAcertification,aswellas enforcementproceduresandsanctions applicablewhenlaboratoriesfailtomeet standards.

CLIAappliestoalllaboratories,physicianoffices,orotherentitiesperformingtestingonhumanspecimensforthepurposeofproviding informationforthediagnosis,prevention,ortreatmentofdiseaseorimpairmentofhumanbeings.Laboratoriesthatconducttestingforthepurposeofassessingthehealthofindividuals(eg,testingforinsurancepurposes)arealsosubjecttoCLIA.ThefollowinglistscertainlaboratoriesthatarenotsubjecttoCLIA:

n Laboratoriesconductingonlyforensic testing

n Researchlaboratoriesthatdonotreport patientresults

n Componentsorfunctionsoflaboratories certifiedbytheSubstanceAbuseand MentalHealthServicesAdministration

n Laboratorieslocatedinastateinwhich thelicensureprogramisapprovedby theCentersforMedicareandMedicare Services(CMS)asmeetingCLIA standards

n Internationallaboratoriesnotperforming testsonUnitedStatescitizens.

UnderCLIA,allclinicallaboratories,regardlessof location,size,ortype,mustmeetstandardsbasedonthecomplexityoftheteststhey perform.Threelevelsoftestingcomplexityaredefinedintheregulations:waived,provider- performedmicroscopy,andnonwaived. Laboratoriesperformingprovider-performed microscopyornonwaivedtestingmust meetrequirementsforproficiencytesting(PT),patienttestmanagement,qualitycontrol, qualityassurance,andpersonnel.Thesespecificrequirementsdonotapplytotestsinthewaivedcategory.

Theuniformproficiencytestingprogram regulationsmandatethatyourlaboratorymustenrollinaPTprogramapprovedbythe DepartmentofHealthandHumanServices,CMS’sparentregulatoryagency,foreachofthespecialtiesandsubspecialtiesforwhichitseekscertification.AllanalytesthatareregulatedforproficiencytestingappearinboldtypeintheSurveysandEducationalAnatomicPathologyProgramsorEXCELcatalogs.

YourlaboratorymustnotifyCMSoftheapproved program(s)inwhichyouparticipateand authorizethePTprogramtoreleasealldatatoCMS.Yourlaboratorymustparticipateinan approvedPTprogramforoneyearbefore designatingadifferentprogram.CMSmustbenotifiedbeforeyourlaboratorychangesPT programs.ForteststhatarenotsubjecttoPTintheseregulations,yourlaboratorymuststill establishtheaccuracyandreliabilityofitstestproceduresatleasttwiceayear.

CollegeofAmericanPathologists ProficiencyTestingManual 24

PTspecimensmustbetestedwiththeregularpatientworkloadbypersonnelwhoroutinelyperformtesting.Yourlaboratory’sroutinetestingmethodsmustbeused.Theindividualtestingthespecimensandthelaboratorydirectormustattesttotheroutineintegrationofspecimens usingaformprovidedbythePTprogram.Laboratoriesthatperformtestsonproficiencytestingsamplesmustnotengagein interlaboratorycommunicationspertainingtotheresultsofproficiencytestingsample(s)untilafterthedatebywhichthelaboratorymustreportproficiencytestingresultstotheprogramforthetestingeventinwhichthesamplesweresent.Laboratorieswithmultipletestingsitesor separatelocationsmustnotparticipatein communicationsordiscussionsconcerning proficiencytestingsampleresultsuntilafterthedatebywhichthelaboratorymustreport proficiencytestingresultstotheprogram.Yourlaboratorymustalsomaintainacopyofall records,includingtheformusedtorecordthePTresults(includingtheattestationsignatures),foraminimumoftwoyears.

YourlaboratorymustsuccessfullyparticipateinaPTprogramapprovedbyCMS.“Unsuc-cessfulproficiencytestingperformance”isa“conditionlevel”deficiencyandmayresultinlaboratorysanctionssuchassuspensionoftheCLIAcertificateandMedicarepaymentsforthespecialty,subspecialty,andanalyteinvolved.Failuretoachieveasatisfactoryoveralltestingeventperformancefortwoconsecutivetestingeventsortwooutofthreeconsecutivetestingeventsisconsideredunsuccessfulperformance.

Pleasenotethatproceduresassayedwithwaivedmethodologieswillnotcounttowardthefive-challengeminimum.

Failuretoattainanoveralltestingeventscoreofatleast80%isunsatisfactoryperformanceforanalytesinallspecialtiesandsubspecialtiesexceptABOgroup,D(Rh)typing,and compatibilitytestingforwhich100%isrequired.

FailuretoreturnPTresultsforatestingeventis unsatisfactoryperformanceandwillresultina scoreof“0.”Foranyunsatisfactorytestingeventforreasonsotherthanfailuretoparticipate,your laboratorymustundertakeappropriatetrainingandemploythetechnicalassistancenecessarytocorrecttheproblem.Allremedialactionmustbedocumentedandsuchdocumentationkeptfortwoyearsatyourlaboratoryforpossible referencebyinspectionandaccreditationteams.

Aspartoftheseregulations,criteriahavebeen establishedbywhichaPTprovider’sprogrammaybeevaluatedforapprovalbyHHS.TheCAPhasmadeeveryefforttoensurethattheSurveysprogramhasmettherequirementssetforthbytheFebruary28,1992,FinalRule.

Special Considerations for the Regulatory Requirements for the Specialty of Immunohematology

TheSpecialtyofImmunohematologycomprisesfoursubspecialitiesasfollows:

n ABO/Rh

n Unexpectedantibodydetection

n Compatibilitytesting

n Antibodyidentification

A100%scoreisrequiredtoachievesatisfactory performanceforABO/RhandCompatibilityTesting.

Forunexpectedantibodydetectionand antibodyidentification,an80%scoreisrequired.Theconsensuspercentagerequiredtoestablishagradedchallengeissetat95%participant or100%refereeconsensusforABO/Rhand compatibilitytestingand95%refereeor participantconsensusforunexpectedantibody orantibodyidentificationchallenges.

Special Consideration for the Regulatory Requirements for the Specialty of Microbiology

TheCLIAregulationsstatethatalaboratorymusttestaminimumoffivespecimensin eachtestingeventforthesubspecialtiesofbacteriology,mycobacteriology,mycology,parasitology,andvirology.Withineachofthesesubspecialties,varioustypesoftestingare required.

Forbacteriology,thefivechallengesmay includeacombinationofthefollowing specimens:

n Bacterialantigendetection

n Bacterialidentification

n Gramstain

n Antimicrobialsusceptibility

Chlamydia trachomatisresultsareaggregatedunderthesubspecialtyofbacteriology.

LaboratoryLegislationandCMSReporting

800-323-4040|847-832-7000Option1|cap.org 25

Formycobacteriology,thefivechallenges mayincludeacombinationofthefollowing specimens:

n Acid-faststain

n Mycobacterialidentification

n Antimycobacterialsusceptibility

Formycology,fiveidentificationsarerequired.

Forparasitology,fiveidentificationsarerequired andmayconsistoftestingbyfecalsuspension, Giemsa-stainedbloodsmear,antigen detection,and/orPVAslide.

Forvirology,thefivechallengesmayincludea combinationofthefollowingspecimens:

n Viralantigendetection

n Viralidentification(culture)

Important Note: In order to meet the regulatory requirements for microbiology subspecialties, carefully follow the kit instructions included with each Surveys mailing.

Regulatory Requirements for the Specialty of Cytology: Gynecologic Examinations

Forcytology,theexaminationconsistsoften slidesfromfourdiagnosticcategories,including Unsatisfactory,NegativeorBenign,LSILand HSILorcarcinoma.Tobesuccessfulin cytology,ascoreof90%mustbeachieved.Detailedinstructionswillbeprovidedwiththetestmaterials.

Provision of Results to CMS and State AgenciesToassistincomplyingwiththerequirementthatyourlaboratoryresultsbereleasedtoHHS,theCAPwilltransferdatatoCMSifyouhaveprovidedaCLIAidentificationnumber.Wewillforwardpaperorelectroniccopiesofyour resultstoyourstatedepartmentofhealth,actingonbehalfofCMS,ifyouauthorizeustodoso.Toauthorizereleaseofresultstostateagencies,indicateyourrequestontheorderconfirmationreportsentafteryourSurveysorderisprocessed,orsendalettertotheCAP.YourSurveysevaluationwillthenreflectthenameoftheagencytowhichtheinformationwasprovided.AnyquestionsregardingrequirementsforforwardingyourproficiencytestingresultsmaybeansweredviayourstatedepartmentofhealthoroneoftheCMSregionaloffices.

Consultwithyourstatedepartmentofhealth foradditionallawsorregulationsconcerninginspection,accreditation,andproficiency testingrequirementsthatmayaffectthe licensingofyourlaboratoryanditspersonnel.

CopiesoftheFebruary28,1992,CLIA regulationscanbeobtainedbycontactingtheGovernmentPrintingOfficebytelephoneat202-512-1800orbyfaxat202-512-2250andrequestingCFRTitle42Parts400-429and 430-End.Youmayalsoaccessdocuments onlineataccess.gpo.gov/su–docs/.

Ifyouhaveanyquestionsregardingthe automatictransferofresultstoCMSoryour performancesummaries,pleasecontacttheCollegeat800-323-4040option1.

LaboratoryLegislationandCMSReporting

CollegeofAmericanPathologists ProficiencyTestingManual 26

Use of Reason Codes for Nonevaluated SpecimensSomeindividualresultsarenotevaluatedforcertainlaboratoriesforavarietyofreasons.Areasoncodeexplainingthespecificcircumstancewillappearonindividualevaluationreports,alongwithabriefexplanationofwhatthatcodemeans.Belowisaledgerofpossiblereasoncodesthatcanbeassigned.

Reason Code Description or Explanation11 Unabletoanalyze(documentationtobeprovidedbylaboratory).

20 Noappropriatetarget/responsecouldnotbegraded.

21 Specimenproblem.

22 Resultisoutsidethemethod/instrumentreportablerange.

24 Incorrectresponseduetofailuretoprovideavalidresponsecode.

25 Inappropriateuseofantimicrobial.

26 Educationalchallenge.

27,31 Lackofparticipantorrefereeconsensus.

28 Responsequalifiedwitha“greaterthan”or“lessthan”sign;orunabletoquantitate.

29 Inappropriateresponse.

30 Scientificcommitteedecision.

33 SpecimendeterminedtobeunsatisfactoryaftercontactingtheCAP.

35 Testingnotperformedonthisspecimentype.

40 Resultsforthiskitwerenotrecieved.

41 Resultsforthiskitwererecievedpasttheduedate.

42 Nocreditassignedduetoabsenceofresponse.

43 Theorderforthiskitwascanceled;resultsnotevaluated.

44 Thisdrugisnotincludedinourtestmenu.Useofthiscodecountsasacorrectresponse.

46 Quantitationnotappropriate.

55 Exemptiongrantedduetoanaturaldisaster.

77 Improperuseofexceptioncodeforthismailing.

88 Labdoesnotperformtestsfromthissourceordoesnotperformthistestonpatients.

91 Therewereaninsufficientnumberofcontributingchallengesto establishacompositegrade.

92 Compositegradecouldnotbeestablishedduetotheuseofmultiplenongradedreasoncodesfortheindividualchallenges.

Itisthelaboratory’sresponsibilitytodocumenttheappropriateuseoftheseexceptioncodesshouldthisberequestedduringalaboratoryinspection.

LaboratoryLegislationandCMSReporting

800-323-4040|847-832-7000Option1|cap.org 27

CMS Performance Summary

2 35

8

6

7

1a.Kit ID:definesthecustomer’suniquekit numberforeachmailing.

1b.Kit Mailed:liststhedatetheSurveysmailing wasshipped.

1c.Original Evaluation:liststhedatethe evaluationreportwasoriginallygenerated.

2. Regulated Analyte: listsallregulatedtests includedinthespecialty/subspecialtyas definedbytheCLIAregulationsforthe modulesinwhichyouareenrolled.

3. Summary of Your Previous Responses:lists thetotalnumberofspecimensyouhave testedandthenumberofacceptable responsesforprevioustestingevents.

4. CAP Number and Kit:definestheCAP numberandkitsequence.

5. Test Event:identifiestheproductfulfillment groupandshipment.

6. Summary of Your Current Responses:liststhe totalnumberofspecimensyouhavetested andthenumberofacceptableresponses forthattestingevent.

CMS Performance Summary Data

LaboratoryLegislationandCMSReporting

Proficiency Testing Manual

www.cap.org 27

CMS Performance Summary

Subspecialty :31D0696246 ToxicologyProficiency Event

2008 3

Regulated Analyte Test Event Score %

Proficiency Event2009 1

Proficiency Event2009 2 Cumulative CLIA

'88 PerformanceInterpretation

Current EventPerformanceInterpretationTest Event Score % Test Event Score %

CMS Peformance Summary for Analytes Regulated Under the Clinical Laboratory Improvement Amendments of 1988

CLIA ID #:

Satisfactory100AL1-C 100AL1-B100AL1-AEthanol Successful/ / /555 5 5 5

100BL-C 100BL-ABlood Lead Successful/ /55 5 5

Satisfactory100Z-C 100Z-B100Z-ACarbamazepine Successful/ / /555 5 5 5

Satisfactory100Z-C 100Z-B100Z-ADigoxin Successful/ / /555 5 5 5

Satisfactory100Z-C 100Z-B100Z-AGentamicin Successful/ / /555 5 5 5

Satisfactory100Z-C 100Z-B60Z-ALithium Successful <1>/ / /555 3 5 5

Satisfactory100Z-C 100Z-B100Z-APhenobarbital Successful/ / /555 5 5 5

Satisfactory100Z-C 100Z-B100Z-APhenytoin Successful/ / /555 5 5 5

Satisfactory100Z-C 100Z-B100Z-APrimidone Successful/ / /555 5 5 5

100Z-C 0Z-AQuinidine Unsuccessful <3>/ /55 0 5*

Satisfactory100Z-C 100Z-B100Z-ATheophylline Successful/ / /555 5 5 5

Satisfactory100Z-C 100Z-B100Z-ATobramycin Successful/ / /555 5 5 5

Satisfactory100Z-C 100Z-B100Z-AValproic Acid Successful/ / /555 5 5 5

Toxicology 65/65 100 58/65 89 55/55 Satisfactory Successful

<1> Currently successful - At risk for the next mailing.<3> Currently unsuccessful.<*> Per your reporting preferences, this analyte is currently identified as being tested by your laboratory. A score of zero has been given due to the lack of response.

100

0002

The College of American Pathologists recommends that the result of this interlaboratory comparison not be used as a sole criterion for judging the performance of any individual clinical laboratory.

Page 6 of 6

CAP Number:Institution:

Attention:City / State:

Quest Diagnostics IncWilliam Tarr JR MDTeterboro NJ 07608-1070

1204101-01 Kit# 1 Kit ID: Kit Mailed:

Original Evaluation:

21876162

6/1/2009

7/10/2009

Z-B 2009 Therapeutic Drug MonitoringE V A L U A T I O N

ORIGINAL

CAP Number: 1234567-01 Kit# 1 Kit ID: 87654321 Institution: Community Hospital Kit Mailed: 6/1/0000 Attention: Lab Director Original Evaluation: 7/10/0000 City / State: Anytown, USA 12345

1a1b

1c

4

2 35

8

6

7

1a. Kit ID: defines the customer’s unique kit number for each mailing.

1b. Kit Mailed: lists the date the Surveys mailing was shipped.

1c. Original Evaluation: lists the date the evaluation report was originally generated.

2. Regulated Analyte: lists all regulated tests included in the specialty/subspecialty as defined by the CLIA regulations for the modules in which you are enrolled.

3. Summary of Your Previous Responses: lists the total number of specimens you have tested and the number of acceptable responses for previous testing events.

4. CAP Number and Kit: defines the CAP number and kit sequence.

5. Test Event: identifies the product fulfillment group and shipment.

6. Summary of Your Current Responses: lists the total number of specimens you have tested and the number of acceptable responses for that testing event.

CMS Performance Summary Data

Laboratory Legislation and CMS Reporting

CollegeofAmericanPathologists ProficiencyTestingManual 28

7. Current Event Performance Interpretation: indicateseithersatisfactory(≥80%)or unsatisfactory(<80%)performanceforeach analyteandtheoverallperformanceforthe specialty/subspecialty.ForABOgroup, D(Rho)type,andcompatibilitytesting,a scoreof100%isrequired.Whenresultshave notbeenreceivedfromyourlaboratoryfor ashipment,thisareawillbeblank.

Ascoremaynotappear(fieldisblank)duetothefollowingreasons:

n LabhasindicatedtotheCollegethat theregulatedanalyteshouldnotbe reportedtoagencies

n Challengeswerenotgraded,using reasoncodesthatarenotreportedon thescorecard

n Themethodreportedfortheanalyteis waivedbyCMS

n Noresultswerereported

8. Cumulative Performance Interpretation: indicatessuccessful(≥80%)orunsuccessful (<80%)performanceforeachanalyteand forthespecialty/subspecialty.ForABO group,D(Rho)type,andcompatibility testing,ascoreof100percentisrequired. A<1>symboldenotesthatyourperformance issuccessful;however,becauseyouhadless than80%onthepreviousmailing,youarestill atrisktobeunsuccessfulforthenextmailing. A<2>denotesyouarecurrentlysuccessfulbut atriskforthenexttwomailingsasyouwere unsatisfactoryforthismailing.Thesecodesare applicabletoboththeanalyteandthe overallspecialty/subspecialtyscores.A<3> denotescurrentlyunsuccessfulperformance. A<4>denotesthatscorecardperformanceis pendingafutureevaluationormaynotbe applicableduetodiscontinuedtestingorthe useofawaivedmethod.

LaboratoryLegislationandCMSReporting


Top Related