j m laidlaw uantitative research

29
Forward Designed and produced by the Education Development Unit NHS Education for Scotland Initial development sponsored by the Scottish Higher Education Funding Council Q Q Q QQ uantitative Research Authors E A Hesketh J M Laidlaw Instructional Design J M Laidlaw Desktop Publishing L E Bell M C Gunn Computing N K McManus

Upload: others

Post on 23-Dec-2021

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: J M Laidlaw uantitative Research

Forward

Designed and produced by theEducation Development UnitNHS Education for Scotland

Initial development sponsored by theScottish Higher Education Funding Council

QQQQQ uantitative Research

Authors

E A Hesketh

J M Laidlaw

Instructional Design

J M Laidlaw

Desktop Publishing

L E BellM C Gunn

Computing

N K McManus

Page 2: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units SSSSS nippets on quantitative research

Quantitative research tends to focus onmeasurement and proof. This researchadopts a ‘scientific approach’. It is basedon the premise that something ismeaningful only if it can be observed andcounted. Its key characteristics are numerical data thatpermits a range of statistical analysis. There are severalapproaches to quantitative research which includeexperimental, descriptive, correlational and causalcomparison. Inferential statistics are frequently used togeneralise what is found about the study sample to thepopulation as a whole.

Quantitative Research... Snippets: 1 of 2

Page 3: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

Quantitative Research... Snippets: 2 of 2

””

““

The Problem The Solution

All these different research methods –experimental, descriptive, correlationaland more – which do I choose?

I’m put off doing research – myknowledge of statistics isn’t that hot!

Research methodology is a big subjectarea. If your skills need refreshed fromyour undergraduate days, this unit willgive you an overview of quantitativeresearch and start you off in the rightdirection.

Quantitative research concentrates onthe collection and analysis of numericaldata. Statistics, although not an integralpart of a quantitative study, are usedto confirm or contradict theconclusions you draw from youranalysed data. Getting the choice ofstudy type right, then getting advicefrom a statistician at the planning stagewill help.

Page 4: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units IIIII ntroducing quantitative research

Research is often described as either quantitative or qualitative.Studies which involve the collection and analysis of numericaldata are known as quantitative research. Quantitative researchadopts the scientific method and focuses on controllingvariables, gathering measurable evidence and coming togeneralisable conclusions or providing new explanations.

A typical quantitative study will specify the number ofparticipants from a defined population and present data on, forexample, the number of events occurring or some biologicalvariable. It will include a statistical section which may showcause and effect relationships. Many research studies have anelement of both quantitative and qualitative data. Read the‘Qualitative research’ unit to find out when this approach is moreappropriate.

Quantitative Research... Core: 1 of 13

Page 5: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units QQQQQ uantitative research in action

The aspects listed below take you through the various steps of theresearch process.

Selecting and definingthe research question

Deciding on study type

Deciding datacollection tools

Selecting the sample

Sample size

Analysing, interpretingand validating findings

Quantitative Research... Core: 2 of 13

Click the appropriateoption if you wish tofind out more

Page 6: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

Quantitative Research... Core: 3 of 13

Read up on the subject to find out if yourquestion has already been answered. Jotdown the key concepts and concerns thenform these into a meaningful question.

Ask yourself:

Can I answer this through datacollection and analysis?

Will this contribute to knowledge inthe subject area?

Show this to colleagues, if their reactionis ‘Who cares’, then think again.

Selecting and definingthe research question

Deciding on study type

Deciding datacollection tools

Selecting the sample

Sample size

Analysing, interpretingand validating findings

??

Page 7: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

UnitsSome research problems suggest onetype of strategy rather than another. Forexample:

If you want to know the effect of a drug

or treatment

then a tightly controlled experimentalmethodology is appropriate.

If, however, you want to know whethersome disease or symptom is related toage, smoking or some other life style

factor

then a correlational approach isappropriate.

Four different strategies are now brieflydescribed. These are Experimental,Descriptive, Correlational and CausalComparison.

Experimental...

Selecting and definingthe research question

Deciding on study type

Deciding datacollection tools

Selecting the sample

Sample size

Analysing, interpretingand validating findings

Quantitative Research... Core: 4 of 13

Page 8: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

UnitsExperimental

In an experimental study an intervention is made under controlledconditions with the sole purpose of evaluating its effect. The goldstandard is the ‘Randomised Controlled Trial’ or RCT, mostcommonly used in clinical trials to assess whether a therapeuticintervention is effective.

A randomised selection of the population is split into the followingtwo groups:

and

Blinding, where the allocation of the intervention isconcealed, is often used. Valid outcome measures areidentified and assessed.

Descriptive...

Quantitative Research... Core: 5 of 13

one group being giventhe new treatment

or intervention

the other the controltreatment or no

intervention

Note...

Page 9: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

UnitsDescriptive

Descriptive research involvescollecting data to test a hypothesis. Itis commonly used in epidemiologicalstudies to look at the incidence ordistribution of disease, or assessingcurrent health problems and needs.Data is usually collected throughquestionnaires.

Correlation...

Quantitative Research... Core: 6 of 13

Page 10: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

Note...

Correlational

This method is used to discoverrelationships between two variables, eg isthere a link between birth weight and thedevelopment of disease over time?

The down side of this approach is that although links canbe made and insight gained into the strength of the link,direct cause and effect relationships cannot beconsidered proven.

Causal comparative research...

Quantitative Research... Core: 7 of 13

Page 11: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units Causal comparative research

If a cause and effect relationship is beinginvestigated, eg truancy and exam results; familyincome and health etc. the researcher canobserve the status quo without intervention. Theindependent variable (truancy, income) havingalready occurred, cannot be manipulated.

Quantitative Research... Core: 8 of 13

Page 12: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

Your chosen tool will be determined by theinformation you want to collect.

Typical data for a quantitative study maybe morbidity and mortality trends, hospitaladmissions or prescribing patterns.

Data sources will be:

! existing documents

! patient records

! surveys and questionnaires.

Questionnaire design is anart in itself. Use an existingdesign or take advice.

Selecting and definingthe research question

Deciding on study type

Deciding datacollection tools

Selecting the sample

Sample size

Analysing, interpretingand validating findings

Quantitative Research... Core: 9 of 13

Note...

Page 13: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

Define the population you are interestedin. The sample should be representativewith minimum bias. To learn more aboutcommonly used sampling procedures,cllck on the following:

Random

Non-random

Selecting and definingthe research question

Deciding on study type

Deciding datacollection tools

Selecting the sample

Sample size

Analysing, interpretingand validating findings

Quantitative Research... Core: 10 of 13

Page 14: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units Random

Simple : using published random number tables everyone in thepopulation has an equal chance of being selected.

Systematic: a sampling interval is calculated based on the populationsize and the required sample size. Then every nth subjectis selected.

Stratified: sub-groups which may influence the outcome of a study,eg sex, age, ethnicity, are identified and a random sampletaken.

Non-random

Purposive: subjects typical of the characteristics under investigationare chosen, eg patients from practices with a highincidence of a particular health problem.

Volunteers: there is a danger of creating a biased sample but may be anecessary option where legal or ethical issues arise, egdrug testing.

Quantitative Research... Core: 11 of 13

Page 15: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

Sample size is important, too big increasescosts, too small and you don’t havesufficient data to reach any meaningfulconclusions. Take advice from astatistician who will help you decide thenumbers required to give validity to yourresults.

Selecting and definingthe research question

Deciding on study type

Deciding datacollection tools

Selecting the sample

Sample size

Analysing, interpretingand validating findings

Quantitative Research... Core: 12 of 13

Page 16: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

Decide at the planning stage whatstatistical tests will be used and thus thestatistical database package best suitedto your needs. Look for patterns,correlation’s and cause and effectrelationships in the data.

Selecting and definingthe research question

Deciding on study type

Deciding datacollection tools

Selecting the sample

Sample size

Analysing, interpretingand validating findings

Quantitative Research... Core: 13 of 13

Page 17: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units EEEEE xamples in practice

Here are examples in practice of two of the approachescommonly used.

Correlational

Experimental

Quantitative Research... Examples: 1 of 3

Click the appropriateoption if you wish tofind out more

Page 18: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

Quantitative Research... Examples: 2 of 3

All entrants fromfour consecutive years

Academic performanceprior to admission recorded

Students annual Grade Point Average recordedGPA based on exam (with OSCE year 5) and written

coursework (years 1-5) and ward reports (year 6)

Affirmative action scheme forethnic minorities excluded

Data analysisSome of the correlations examined and findings:

! relationship between overall achievement marksin school leaving exams and performance inmedical school - but the level of correlationdecreased as students progressed through thecourse.

! the lack of correlation between overall marks inschool leaving exam and the OSCE results.

! no correlation between total school leavingmarks and clinical competence as measuredduring the ward clerkship.

Correlational

A study on the relationship betweenacademic requirements andsubsequent performance in medicalschool.

Taken from Collins JP, White GR &Kennedy JA (1995). Entry to medicalschool: an audit of traditionalselection requirements. MedicalEducation 29: 22-28.

Page 19: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

Quantitative Research... Examples: 3 of 3

Subjects excluded:!!!!! exclusion criteria, eg those with viral

illness, already had bed rest etc.!!!!! consent not given to join study.

Experimental

A Randomised Control Trial on BedRest for Acute Lower Back Pain

Taken from Wilkinson MJB (1995).Does 48 hrs bed rest influence theoutcome of acute low back pain?British Journal of General Practice45: 481-4. Control group

no day time restIntervention group48 hours bed rest

Subjects enter trial▼

Nine general practitioners selected for study.Patients present with acute low back pain.

7 and 28 day assessment:!!!!! change in straight leg raise and lumber flexion (7 days)!!!!! disability scores!!!!! days off work.

Data analysis:!!!!! differences between groups detected at 7 days etc.!!!!! both groups reached similar disability scores by 28

days etc!!!!! no advantage of 48 hours rest over no bed rest shown.

Page 20: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

If you can’t think of a research idea ask forsuggestions or advice from your line manager.They may have ideas that would be useful toyour unit/organisation.Alternatively look at previous research work.Many research articles suggest areas thatneed further work. Remember most research isabout building on the work of others.Let your idea mature for a little while and then

talk it through with a colleague. They may helpyou to see some of the pitfalls and assist youto hone in on your research question.Make sure you get approval from any relevant

Ethics Committee and that the data is storedaccording to the Data Protection Act.

PPPPP ractical tips

continued. . .

Quantitative Research... Practical Tips: 1 of 3

Page 21: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

Take advice on statistics, sampling etc at anearly stage of planning.Always pilot your data collection tools and tryto analyse the data. This gives you theopportunity to improve on their effectivenessor, if necessary, reduce the scope of what youhad planned to do.Questionnaires - Avoid ambiguous words likeregular, normal, recently – they mean somethingdifferent to every one and need to be defined egtwice a week, within the last two weeksCheck the consistency of answers in your

questionnaires through asking one or twoquestions again with different wording.

Quantitative Research... Practical Tips: 2 of 3

continued. . .

Page 22: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

Quantitative Research... Practical Tips: 3 of 3

Always use the largest sample possible withinyour budget.For research studies that cover a fairly longperiod of time, make allowances for drop out inyour plans. Minimise this drop out throughmaking minimum demands on your subjects,keeping them informed and reminding them ofthe important part they play in your study. Forquestionnaires be prepared to do up to threemailings to get a good response rate.

Page 23: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units OOOOO ther learning opportunities

There are many books and other resources on Quantitative Research.Here is a short resume of our suggestions.

Click the appropriatebutton if you wish tofind out more

Quantitative Research... Opportunities: 1 of 5

Books

Journals

Web

Page 24: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

Kumar R (1999) Research Methodology - A step by step guide forbeginner. Sage Publications, London

Blaxter L, Hughes C & Tight M (1996). How to research. OpenUniversity Press, Milton Keynes

Carter Y & Thomas C (eds) (1997). Research methods in primarycare. Radcliffe, Oxford

All these books take you through the research process fromdesigning your question to study design, analysis, interpretationand dissemination.

Quantitative Research... Opportunities: 2 of 5

Books

Journals

Web

Page 25: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

Oxman AD, Sackett DL & Guyatt GH (1993). Users’ guides to themedical literature 1 How to get started. JAMA 270 2093-2095

The first of a series of articles dealing with critical appraisal skills.

Greenhalgh T (1998). Randomised controlled trials. British Journalof General Practice 48 1448-1449

A short interesting account of the history of RCTs and anintroduction to the shorthand terms commonly used in suchresearch. The article also stresses the importance of truerandomisation without which the benefits of an intervention maybe overestimated.

Quantitative Research... Opportunities: 3 of 5

Books

Journals

Web

Page 26: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

The international database TimeLIT (Topics in Medical EducationLiterature) www.timelit.org gives free access to articles relatingto education in medicine, dentistry, nursing, patient health andthe professions allied to medicine.

Other useful websites for those interested in Medical Educationare that of the Association for the Study of Medical Educationwww.asme.org.uk and that of the Association for MedicalEducation in Europe www.amee.org

Quantititative Research... Opportunities: 4 of 5

Books

Study

Web

Page 27: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

You might now wish to look at the related unit on QualitativeResearch.

Qualitative ResearchClick the option totake you to a summaryof the unit

Qualitative Research... Opportunities: 5 of 5

Page 28: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units GGGGG roup activities

Get together with about five colleagues andhave a go at investigating whether BodyMass Index (BMI) is related to the amountof junk food you eat. You will require scalesand a stadiometer. Take measurements ofeach group member’s height and weight.Then assess the frequency of their junkfood intake per week, where for example a bagof crisps or one small portion of cake could be counted as oneunit of junk food. Analyse your data by calculating each subject’sBMI. Plot BMI against junk food frequency and discuss the spreadof results on the graph and/or perform a correlational analysisusing a statistical package such as SPSS. Afterwards considerwhat other variables/factors could/should have been taken intoaccount to improve the study design.

Page 29: J M Laidlaw uantitative Research

ForwardBack

Snippets

Core

Examples

Practical Tips

Opportunities

Activities

Don’t Forget

Home

Units

Make sure your research aims andquestions are clear from the outset.Then ask an expert or experiencedperson for advice to ensure the rightmethods, tools and statistics areemployed.