rm assessor discover the most widely used & innovative e ... · discover the most widely used...
TRANSCRIPT
Discover the most widely used & innovative e-marking platform in the world
RM ASSESSOR
rmresults.co.uk
Every year more than a million people
around the world get the marks they
deserve thanks to RM Results.
For over a decade we’ve been partnering
with the world’s leading awarding bodies
to deliver intuitive, secure and reliable
e-marking solutions.
That’s why our innovative e-marking
platform, RM Assessor, is the most widely
used in the world.
Hello, we’re RM Results, niceto meet you
*Marked with RM Assessor - The most widely used high stakes e-marking platform in the world
Every year more than a million people around the world get the marks they deserve thanks to RM Results
Every Result Matters™
Contents
Every Result Matters™
The Platform
Mark Anything Anywhere™
Quality Control
Real Time Support
Grade Awarding
Team Management
Comprehensive Reporting
Multi-Lingual, Multi-Platform
Integration
The Service
Transition
Implementation
Data Integration
Scanning
Hosting
Session Management
Training & Support
The Integration Options
RM Assessor as a Standalone Platform
RM Assessor as a Part of Your Process
Bespoke End-to-End E-Assessment
Get In Touch
6
7
8
9
10
11
12
13
15
16
17
18
19
20
21
23
24
25
27
4
The Platform
Every Result Matters™
RM Assessor sets the standard for innovative features, and is loved by markers and session managers alike.
The rich functionality of RM Assessor enables a clear and intuitive e-marking experience, delivered completely online.
Mark Anything Anywhere™
The Platform
Mark Anything
RM Assessor provides the flexibility to
‘human mark’ scanned scripts, converted
electronic files, rich multi-media (audio
visual), e-coursework portfolios and
e-content from computer based testing
systems. It also allows markers (sometimes
also referred to as examiners or evaluators)
to input marks where a physical paper or
submission cannot be scanned.
Multi Format Marking
RM Assessor can be used to mark both
long and short answer responses, and also
offers auto-marking of multiple choice
questions. The platform can accommodate
unstructured papers, and allows annotation
of both static and dynamic responses.
Feature Rich Marking
RM Assessor allows markers to mark
according to preference, allowing them
to switch between ‘mark by candidate’
and ‘mark by question.’ It also increases
efficiency with ‘zoning’ functionality,
enabling administrators to assign specific
questions or question groups to
the markers with the most relevant
topic expertise.
Questions can be annotated so that good/
weak candidate responses are highlighted,
helping to steer the final mark awarded.
RM Assessor also features a useful range of
marking tools such as a protractor
and rulers to e-mark scale-drawn charts
and diagrams.
Quality Control
The Platform
Standardisation
We understand that it’s essential to
standardise and approve all markers against
definitively marked responses before live
marking commences to keep marking
quality high.
Simulation
The simulation and practice marking
modes within RM Assessor allow
appropriate examiner preparation before
marking begins.
Marking Instructions
RM Assessor can give markers direct
access to marking instructions and
mark scheme while marking, keeping all
information needed for marking available
on one screen.
Issue Resolution
Should a script be miss-scanned or
an audio file be flawed in anyway, RM
Assessor’s exception raising capabilities can
be used to resolve issues quickly ensuring
that candidate responses do not get stuck
in the marking process.
Seeding
To ensure marking quality is maintained
throughout a session, seeding is used to
auto-check marking, providing on-going
feedback and temporarily suspending
examiners if necessary. Seeding is the
process of randomly introducing scripts or
items that have already been marked and
given an agreed score.
Seeds appear exactly the same as ‘real’
scripts in the examiner’s allocation, and
the system will compare the pre-allocated
score with the examiner’s score to check
marking quality. Using RM Assessor’s spot
checking functionality, team leaders can
also perform one-off spot checks at any
stage of the marking.
Multiple Marking
Where desired, responses can be
marked by more than one marker as
standard. Marks can be auto-compared
using acceptable tolerances to arrive at
an agreed final mark or flag a discrepancy
to ensure the highest marking quality at
all times
6 7rmresults.co.uk+44 (0) 8450 700 300
Real Time Support
The Platform
Grade Awarding
The Platform
Sharing Marks
Once definitive marks have been awarded,
RM Assessor exports all candidates’ marks
directly to awarding body systems quickly
and securely.
Results Collation & Rate Scripts
RM Assessor allows marks collation and
script rating to support grade boundary
decisions.
Internal Messaging
RM Assessor enables communication
between remote marking teams and their
team leaders and allows any examiner or
marking issues to be flagged and quickly
resolved in real-time from within the
e-marking tool.
Alerts & Exceptions
Within RM Assessor, team leaders and
markers are alerted to incoming messages
and exceptions. By being able to quickly
resolve marking queries with team leaders,
marking pace is maintained to target level.
Grading
RM Assessor allows auto-assign grades
(according to pre-defined grade
boundaries) to marked responses.
Online Help & Videos
RM Assessor offers markers online self-
help, covering key elements of the
platform’s functionality. RM Assessor also
comes complete with a library of dedicated
tutorial videos which can be accessed at
any time.
Familiarisation & Practice Modes
Before live marking begins, markers can
get familiar with the system using non-live
marking modes. They can use the platform
to mark dummy or actual responses
to make sure they are ready for the
standardisation phase.
8 9rmresults.co.uk+44 (0) 8450 700 300
Team Management
The Platform
Comprehensive Reporting
The Platform
Management Information
Administrators and business leaders are
able to use RM Assessor dashboards and
reports for high level business intelligence
and management use. Available reports
include scanning and marking progress
against plan and drill down reports to
component and examiner level to identify
underlying issues.
Marking Quality
RM Assessor offers a wide array of
reports and team leaders can view
examiner marking trends at both high
and detail level. Such reports can be run
at any time to track marking quality from
standardisation through to live marking.
Session Management
Using RM Assessor, administrators can
efficiently plan, track and manage markers,
exam components and item groups
through each exam session, ensuring that
all parts of the marking process
are trackable.
Marker Management
The platform enables team leaders to
manage and support markers completely
online. This means that team leaders
can view marking progress at any
time, communicate with markers and
resolve any their marking issues within
RM Assessor.
Script Scanning Management
Using RM Assessor, administrators can
manage the scanning and indexing of
scripts, manipulate scripts as required
and create and amend image zones for
mark by question or groups enabling easy
monitoring of progress.
Operational Progress
Operational dashboards and reports
enable team leaders to access
management information to identify
stuck markers or components that may
be causing groups of markers difficulties.
These real time reports enable team
leaders to help pro-actively, ensuring
marking stays on track.
Manage Marking Instructions
Marking leaders and their teams can use
RM Assessor to administer both marking
instructions and mark schemes to all
markers within the platform.
Resolve Exceptions
Team leaders and administrators can
quickly resolve escalated exceptions
while also monitoring and resolving any
common marking issues that may emerge.
Configure Awarding
Using RM Assessor, organisations
don’t need to change their awarding
schemes and processes. Awarding can be
configured entirely to meet the specific
scheme and requirements defined by any
awarding body.
10 11rmresults.co.uk+44 (0) 8450 700 300
Multi-lingual, Multi-platform
The Platform
Integration
The Platform
Single Sign On
RM Assessor can integrate directly with
other exam management systems. Markers
can sign in with a single username and
password for access to chosen internal
system and platforms required.
Integrated with Scanning / Indexing
Supplier Systems
The platform is directly integrated with
both RM managed and externally sourced
scanning and indexing supplier systems.
This synergy means that administrators can
use RM Assessor to monitor the progress
of scanning at any time.
Accessible Everywhere
RM Assessor is accessed over the Internet,
meaning that markers have secure 24
x7 access, creating a flexible working
environment for exam teams.
Globally Available
RM Assessor is offered as Software as a
Service (SaaS) or can be self-hosted
by either yourselves or partner – you
can pick the level of service that suits
your organisation.
Choice of Device and Platform
Because RM Assessor is accessed via an
internet browser, markers do not have to
install RM Assessor locally. The software
can be accessed on Mac OS X or any
Windows computer using a browser.
Integration Platform
RM Assessor features an Integration
Engine for two-way data interoperability
with third party e-authoring, e-testing,
analytics/business Intelligence and other
e-assessment systems.
Cloud Storage
RM Assessor can integrate with any cloud
based content management system or
secure public cloud (e.g. Microsoft Azure,
Amazon AWS) to provide e-responses
for marking.
Localised user interface
RM Assessor can be delivered in any
language and can accommodate
terminology specific to awarding
bodies/organisations, helping markers to
feel comfortable with the software
from the start.
Secure Access
Platform security features include; secure
password re-set, recovery and, where
required, single sign-on. This ensures that
the system is kept secure at all times, but
still has the flexibility needed for markers.
12 rmresults.co.uk+44 (0) 8450 700 300
The Service
Every Result Matters™
Choose from a wide range of standard services, or speak to our team of highly skilled service & solution architects and business analysts about custom services designed to support the specific requirements of your exam lifecycle.
Transition Services
Services
Pilots
The pilot stage delivers RM Assessor in
a full production environment, complete
and ready for a subset of your intended
audience to test it against your success
criteria. Pilots ensure that we understand
how RM Assessor will be used in
your specific environment, and
whether any changes need to be made
before the system is rolled out to your
marking community.
Proof of Concept
It’s essential that our products and services
meet real, identified needs. Conducting
a Proof of Concept project allows you
to assess RM Assessor against defined
success criteria before moving on to full
development of the pilot stage.
15rmresults.co.uk
Implementation
Services
Data Integration
Services
Business System Integration
So that you can easily populate
RM Assessor with the student and
examination data for your sessions,
we’ve developed a web service interface to
allow for easy, automated data exchange
between systems.
Accessible Everywhere
RM Assessor is accessed over the Internet,
meaning that markers have secure 24
x7 access, creating a flexible working
environment for exam teams.
Globally Available
RM Assessor is offered as Software as a
Service (SaaS) or can be self-hosted
by either yourselves or partner – you
can pick the level of service that suits
your organisation.
Choice of Device and Platform
Because RM Assessor is accessed via an
internet browser, markers do not have to
install RM Assessor locally. The software
can be accessed on Mac OS X or any
Windows computer using a browser.
Digital Assessment Integration
In addition to marking scanned scripts,
RM Assessor can also be used to mark the
output of electronically delivered exams.
Clients such as International Baccalaureate
are actively using RM Assessor to mark
electronic exams.
Localised user interface
RM Assessor can be delivered in any
language and can accommodate
terminology specific to awarding
bodies/organisations, helping markers to
feel comfortable with the software
from the start.
Secure Access
Platform security features include; secure
password re-set, recovery and, where
required, single sign-on. This ensures that
the system is kept secure at all times, but
still has the flexibility needed for markers.
16 17rmresults.co.uk+44 (0) 8450 700 300
Scanning
Services
Hosting
Services
On Premise Hosting
We have flexible hosting solutions to host
RM Assessor the way that works best for
you. All our hosting solutions deliver highly
resilient, highly available services with
security to ISO 27001 standards.
Availability Management
Our hosting maintenance and availability
management teams are dedicated to
providing the highest standards of uptime
and availability, achieving average uptime
in excess of 99.9%.
Scanning
With our partners we scan between 160
million to 180 million images each year.
We have well established best practice
procedures to ensure scanning
is consistent, secure, and timely to
ensure scripts are available to be
marked on schedule.
Indexing
RM Assessor provides both auto-indexing
and manual indexing to 100% accuracy. We
use feeds to deliver candidate information
to index against scanned scripts, or in the
case of manual indexing, we can manually
match scripts to candidates.
Data Capture
RM Results has well established best
practice procedures to ensure a
consistent, high quality image outcome
for all customers. Using both optical mark
reading and intelligent character reading,
RM Assessor is able to capture a wide
range of exam outputs.
Capacity Management
RM Assessor is designed to scale to
the needs of the organisation using it,
including some of the largest exam boards
in the world. Our proven track record
with capacity management means that
e-markers will not experience system
delays, even when the system is being used
at full capacity.
Security Management
The integrity of each and every high stakes
exam script is our top priority. With RM
Assessor, information security processes
are conducted according to ISO 27001
compliance requirements to ensure that all
exam answers stay confidential and secure.
Auto Marking
Auto marking is available within RM
Assessor for certain test types, such as
multiple choice.
Attendance Register Capture
RM Assessor’s Attendance Register Capture
functionality helps awarding bodies to
easily reconcile actual exam attendance
against forecast.
Script Storage
RM Results has dedicated, secure facilities
for script storage which comply to ISO
27001 standards.
Script Destruction
All scripts are stored for six months
before being destroyed via a routine,
secure process conducted by our
scanning partners.
18 19rmresults.co.uk+44 (0) 8450 700 300
Session Management
Services
Training & Support
Services
Helpdesk
Whether you are a marker or a member
of an awarding body administration team
you will need access to a highly effective
support service if you come across any
unexpected issues. We have a skilled
team of individuals providing timely issue
resolution as part of the RM Assessor
Helpdesk which is available up to 7 days a
week through examination sessions.
Release Management
We work with clients to ensure that the
latest release of RM Assessor is available to
them, regardless of their hosting model, at
all times.
Marker Training
RM Results provides comprehensive
system training for all markers, regardless
of e-marking or general computer
experience. We provide a variety of training
approaches including face to face and
online.
Marker Manager Training
RM Results provides managers and
team leaders with training specific to
their allocated tasks, ensuring they are
comfortable with the monitoring controls
available to them. Our high quality trainers
have direct hands on and operational
experience.
Session Planning
Our highly skilled exam lifecycle
support team provides comprehensive
session planning to ensure trouble free
examination sessions where risks are well
understood and mitigated.
Our team are experts in this field and have
established a set of industry leading best
practice planning procedures over the
years while we have worked with leading
awarding bodies.
Session Set-Up
RM Assessor features tried and tested
methodologies for managing session risk
and ensuring session readiness.
Once all session settings are selected,
student data can be moved into
RM Assessor and organisations can begin
their sessions.
Session Monitoring and Reporting
Having meaningful real time operational
data is the key to successful exam
operations management. You may want to
track, for example, the availability of digital
scripts for marking against the marking
targets for each exam subject.
Exam Administration Training
Exam administrators are trained to use the
RM Assessor administration module so
that they can quickly become proficient in
administering the examination session.
Support Training
With our unrivalled domain expertise for
e-marking of high stakes examinations,
we’re in a great position to train awarding
bodies who want to provide a level of
in-house support to RM Assessor users
themselves.
Service Management
Your service delivery manager will arrange
to meet with you on a regular basis as part
of a formal service management process.
These meetings are used to plan sessions,
discuss required product changes, and to
review both progress in live sessions and
reporting against SLAs in close session
periods.
Change Management
Our customers work in a dynamic
environment where changes are often
required either to improve or add marking
capability, or to respond to external
influences such as policy change.
We assign an account team to each client.
This team includes business analysts
RM Assessor makes available a
comprehensive set of operational reports
as standard and bespoke reporting can be
developed on request.
Quality Checks
As part of session management, we carry
out a comprehensive set of manual and
automated checks to flag any potential
problems with image quality very early and
to avoid delays in the marking process.
Exception Resolution
RM Assessor includes a comprehensive set
of support tools to allow administrators
to pro-actively identify ‘bad’ scripts and
resolve problems with images prior to
marking.
Session Close
To help ensure that all papers written are
present and will be marked, RM Assessor
helps administrators handle reconciliation
tasks and provides transparency into the
status of each and every script.
20 +44 (0) 8450 700 300
Integration Options
Every Result Matters™
From a standalone e-marking software licence right through to a fully integrated end-to-end e-assessment platform, RM Assessor is available in a variety of integration and deployment options to suit every organisation.
RM Assessor as a standalone e-marking platform
Integration Options
Supported Deployment
With the licence only model, RM Results
will provide technical support to your team
during deployment. We’ll provide you with
a point of contact for product change
requests, ongoing future developments
and support for any product issues which
require RM Results’ intervention.
Licence Only Model
RM Assessor is available as a standalone
e-marking platform that you are able
to host yourself. This can be beneficial
for those who prefer to control how the
system is deployed, where it’s hosted and
how it’s managed, and provide their own
support and helpdesk services.
Integrate With Your Systems
You can use the built-in interfaces to
pass data to and from your own scanning
provider and exam management systems.
RM Assessor also exports reports and exam
information via standard file formats for
use in other systems.
23rmresults.co.uk
RM Assessor as Part of Your Assessment Process
Integration Options
Bespoke integrated end-to-end e-assessment
Integration Options
Best of Breed Partners
At RM Results we are proud to say that we
are world leading experts when it comes to
high stakes e-marking. Through our
many years in education technology we
have built an established international
partner network of e-assessment providers
that we trust as market leaders in other
areas of e-assessment, such as authoring
and e-testing.
The Right Partner
We understand what it takes to provide
an end-to end e-assessment solution and
therefore we are in an excellent position
to seek out the correct partners for you
to provide an end-to-end solution. After
holding a series of requirements meetings
to fully understand your organisation’s
needs, we can then offer the best solutions
on the market
Integrated
RM Assessor can enable e-marking to be a
fully integrated part of your organisation’s
assessment process, while still being fully
managed, hosted and supported by the
experienced team at RM Results.
Range of Services
Alongside the RM Assessor platform, we
are able to provide hosting, scanning and
helpdesk facilities (along with many more
flexible options). We can also integrate
the entire e-marking process into
existing e-assessment or paper-based
examination models.
Tailor-Made
Each e-marking service that we provide is
100% bespoke so that we can ensure
that it operates effectively with your
systems and processes as part of your
overall assessment strategy.
Integration
We take care of the integration of systems
from different vendors by using our
powerful integration engine. This enables
e-assessment data to be automatically
transferred between systems without
manual data entry or potential loss of data.
We would also be delighted to talk to
you about how our integration services
could be used with your existing
e-assessment partners.
Joined Up E-Assessment
Our flexible approach means we
can offer the RM Assessor e-marking
service as part of a best of breed
e-assessment solution including authoring,
delivery, marking and analysis. Our
expertise across the entire exam lifecycle,
as well as our extensive network of
connections, our education heritage and
understanding of the relevant markets
globally are just a few of the reasons that
organisations choose us to implement
joined up e-assessment solutions.
Exam Lifecycle Support
You will be provided with full and on-going
support for all areas of the e-marking
process and you will have a service delivery
manager allocated who will be dedicated
to supporting you each exam session. They
will travel any distance for regular face-to-
face service level reviews.
Secure Data Transfer
We use industry standard approaches
to data exchange such as web services
and encrypted feeds to enable data to be
passed automatically to and from your
own internal or other 3rd party systems,
resulting in more efficient management of
marking and more accurate results for
your candidates.
Hosted and Managed
RM Assessor is provided as a complete
solution, hosted by RM Results in our
secure managed data centre facilities. We
take care of managing the system, ensuring
that it is available when you need it.
24 rmresults.co.uk+44 (0) 8450 700 300 25
Become a Partner
Interested in becoming a trusted RM Results operational partner? If you’re a leader in your
field we’re interested in hearing from you. Call us today on + 44 (0) 8450 700 300
If you are considering e-marking, contact our team today to discuss getting started with our tailored e-marking trials:
+ 44 (0) 8450 700 300
rmresults.co.uk
@RM_Results
Client Story
Every Result Matters™ Get In Touch
27rmresults.co.uk
“The Caribbean Examinations Council (CXC) wanted an e-marking solution
whose reliability would be the same or greater than that of the face to
face marking. After reviewing available of options RM was selected as
the provider. The first phase was to pilot the system on selected subjects
which were being parallel marked face to face.
RM assisted in creating the scope of the pilot and provided support
throughout. Through careful forward-planning, we were able to deploy
resources to a well-crafted experiment that provided solid statistical data
to advance the case for e-marking. Further, the engagement provided the
opportunity for CXC to develop a working relationship with the RM team
and competence using RM Assessor software for e-marking.
Following the successful pilot, CXC is now e-marking live across two
examinations using the RM Assessor: Caribbean Advanced Proficiency
Examination (CAPE) and the Caribbean Secondary Education Certificate
(CSEC). The support provided by the RM team was invaluable.”
– Glenroy Cumberbatch, Registrar, Caribbean Examinations Council
Every Result Matters™