2:15 – 2:30. software for text analysis the ceq collects written comments under the headings...

12
CEQuery 2:15 – 2:30

Upload: brook-stokes

Post on 13-Jan-2016

219 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 2:15 – 2:30.  Software for text analysis  The CEQ collects written comments under the headings “Best aspects” and “Needs improvement” ◦ What were the

CEQuery

2:15 – 2:30

Page 2: 2:15 – 2:30.  Software for text analysis  The CEQ collects written comments under the headings “Best aspects” and “Needs improvement” ◦ What were the

What is CEQuery? Software for text analysis

The CEQ collects written comments under the headings “Best aspects” and “Needs improvement”◦ What were the best aspects of your course?◦ What aspects of your course were most in need of

improvement?

CEQuery classifies into 5 Domains and 26 Subdomains

Page 3: 2:15 – 2:30.  Software for text analysis  The CEQ collects written comments under the headings “Best aspects” and “Needs improvement” ◦ What were the

CEQuery enables the student’s qualitative comments to be linked with quantitative:◦ demographic and field of education variables◦ satisfaction scales and graduate outcomes

“Listen to the ‘voice’ of students & not just rely on quantitative measures”◦ Professor Geoff Scott

What is CEQuery?

Page 4: 2:15 – 2:30.  Software for text analysis  The CEQ collects written comments under the headings “Best aspects” and “Needs improvement” ◦ What were the

What is CEQuery? Domains:

◦ Assessment◦ Course Design◦ Outcomes◦ Staff◦ Support

Subdomain:◦ Assessment

Expectations Feedback Marking Relevance Standards

Page 5: 2:15 – 2:30.  Software for text analysis  The CEQ collects written comments under the headings “Best aspects” and “Needs improvement” ◦ What were the

Any good? CEQuery comments hit rate: 80%

◦ Of the remaining 20% not hit in CEQuery, half are not meaningful (cannot be coded)

Coding of comments to sub-domains by CEQuery checked by multiple raters◦ Accuracy approx 90%

Still being used by over 20 universities in Aust and a couple in NZ – even though it is very out of date

Page 6: 2:15 – 2:30.  Software for text analysis  The CEQ collects written comments under the headings “Best aspects” and “Needs improvement” ◦ What were the

Best Aspects - domains

Page 7: 2:15 – 2:30.  Software for text analysis  The CEQ collects written comments under the headings “Best aspects” and “Needs improvement” ◦ What were the

Best Aspects – sub-domains

Page 8: 2:15 – 2:30.  Software for text analysis  The CEQ collects written comments under the headings “Best aspects” and “Needs improvement” ◦ What were the

The comments

Page 9: 2:15 – 2:30.  Software for text analysis  The CEQ collects written comments under the headings “Best aspects” and “Needs improvement” ◦ What were the

BA / NI ratio

Page 10: 2:15 – 2:30.  Software for text analysis  The CEQ collects written comments under the headings “Best aspects” and “Needs improvement” ◦ What were the

Does not work on Windows Vista or Windows 7◦ Some functionality / interface very tired◦ Using outdated phrasing

Dictionary last updated in 2005◦ Search terms outdated?

text speak / chat messaging eg LOL, IMHO, FTW Emoticons eg:

The issues

Page 11: 2:15 – 2:30.  Software for text analysis  The CEQ collects written comments under the headings “Best aspects” and “Needs improvement” ◦ What were the

Contact GCA

Google:◦ Accessing the Student Voice

Professor Geoff Scott

Want to know more?

Page 12: 2:15 – 2:30.  Software for text analysis  The CEQ collects written comments under the headings “Best aspects” and “Needs improvement” ◦ What were the

To get around Vista/Win7 - set up an old PC using Windows XP with CEQuery and remote desktop (RDP) into it

You can use Access 2007 or 2010◦ Save as MDB (Access 2003 format)

Import your data SPSS etc◦ score your comments in CEQuery and import the

resulting Access file into SPSS

Tips for users