internal quality assurance and accreditation: the case of seua · 2014. 1. 13. · 2 agenda 1.seua...

Internal Quality Assurance and Accreditation: the case of SEUA

ASIIN Annual Conference 2013 December 12-13, Stuttgart

By: Ruben Aghgashyan, [email protected] SEUA Vice-Rector

1

mailto:[email protected]

2

Agenda

1. SEUA (Polytechnic) at a glance Facts and Figures Internal Quality Management Structure

2. SEUA Internal QA System Academic Programmes e-System Evaluation and Ranking of Teaching Staff

3. Accreditation process at SEUA Conducting the Self-assessment Site-visits to SEUA Campuses

4. Summary Current state of the process Nearest targets

ASIIN Annual Conference - 2013, Stuttgart

State Engineering University of Armenia (Polytechnic)

ASIIN Annual Conference - 2013, Stuttgart 3

State Engineering University of Armenia is the legal successor of Yerevan Polytechnic Institute:

one of the leading engineering schools of the former Soviet Union


Mission Statement

to create and implement academic/research programs and services consonant with educational and technological needs of the national economy and society,

to prepare students for life, career, life-long learning and professional progress in line with changing economic environment and emerging global information society,

to create a supportive environment for the comprehensive personal and intellectual development

of each individual, generation of law-abiding and responsible citizens.


6

VICE-RECTOR

External Experts

Continuing Education

Centre

Academic

Planning

Division

QA Division

Regular Seminars

Academic Council RECTOR

Educational Reforms &DP Department

Academic Affairs

Department

QA Commission

of AC Regional Academic

Councils

Councils of Faculties

Local groups of

selfassessment

Organizational Structure of SEUA with its integrated QA system

QA Sub-commissions of

Faculty Councils

Regional QA

Commissions QA Commission of

Student Council


SEUA QA Web-based Online System

SEUA Quality Assurance Online e-System (QAeS) is

designed and created by a joint team of SEUA and

“Synergy International Systems Co.” based on the

methodical framework developed at SEUA.

It consists of two main applications:

Quality Assurance Web Portal

Quality Assurance e-System Tools


The structure of SEUA QA e-System


Methodical Framework Information Database of

Study Programmes

Online Platform of SEUA QAeS

Study Programme Processing

and Realization Control Tools

Teacher’s Activity Quality

Assessment Rating System

Content of Methodical Framework


Structure and management of QA

system

Policy and strategy of quality assurance

Development and restructuring of study

programmes

Programme monitoring and review

Quality assurance of teaching staff

Internal Information Management

Students assessment systems

External assessment, accreditation

Resource base of the programme

Participation of students

External Information Other documents

and materials

Information DB of study programme


Requisites and objectives of the programme

Structure, content and organization of the programme

Human resource base of the programme

Technical resource base and student support services

Assessment of the efficiency of the educational processes

Quality control and management of the programme

Information archive of the programme

QА е-System Tools and Analysis

www.synisys.com www.seua.am

Copyright © 2013 Synergy International Systems Inc. ALL RIGHTS

RESERVED

Development and quality assessment of study programmes.

Tracking and analysis of SEUA teaching staff.

Tracking and analysis of survey results gathered from

QАеS Portal.

Teacher assessment and automated rating generation.

Application Areas of QAeS Tools

Some characteristics of QAeS Tools


RESERVED

System users have personalized login credentials and

corresponding permissions granted individually to every user.

The main phases involved in the System for the SEUA

study programmes’ development and control are:

proposal submission and approval,

programme development and approval,

annual monitoring of programme,

periodical (cyclic) review of programme.

Responsible levels for QAeS Tools


RESERVED

For all mentioned processes of the SEUA study programmes, system has interactive revision workflows integrated with the participation of different levels of SEUA users:

Head of programme working group,

Head of Chair,

Dean of Faculty,

Head of Departments,

Academic Secretary,

Vice-rectors,

Rector

Some analytical characteristics of Tools


RESERVED

Analysis and reporting on the study programmes.

SEUA teaching staff data management and analysis.

Analytical reporting over the survey results imported from

QАеS Portal:

Assessment of teacher by students;

Course assessment by students;

Study programme assessment by graduates;

Assessment of employers’ satisfaction from SEUA graduates.


RESERVED

Submission of teacher’s self-

assessment form.

Automated calculation of teacher

rating based on:

Teacher’s self-assessment;

Students’ assessment of the

teacher.

Peer assessment of the teacher.

Teacher’s assessment organization

Management of Accreditation

process at SEUA


18

Action Plan of SEUA Institutional Self-assessment - 1

Actions Time

Taking part in the trainings organized by ANQA and NVAO within the frames of ARQATA Project workplan

March 2012, Aghveran

Preparation of pilot report of self assessment including the I, III and X Standards (within the frames of ARQATA Project)

May 2012, SEUA

Submission of Application to ANQA for starting institutional accreditation process according to the procedures set forth in the Accreditation Statute

May 2012, SEUA

Organization of local trainings by the SEUA QA Department for the members of SEUA Branch and Faculty QA Commisions

June 2012, SEUA

Forming the Working groups for preparation and provision of SEUA self-assessment processes (Rector’s Order)

September 25, 2012, SEUA

Discussion and approval of the action plan’s implementation time table to conduct the self-assessment processes

September-December, 2012


19

Action Plan of SEUA Institutional Self-assessment - 2

Actions Time

Periodic reports (presentations) to SEUA Rectorate on the current progress of the self-assessment process

September-December, 2012

Meetings of coordinating group working groups , provision of video conferences with the branch groups to harmonize the activities.

September-November, 2012

Completion of writing of the separate reports of Yerevan, Gyumri, Vanadzor and Kapan working groups made for all 10 QA Standards.

Deadline: Nov.10, 2012

Combining the separate reports in a one (integrated) file forming the SEUA Institutional Self-assessment Report


Internal dissemination of the Report to collect opinions, to revise the text (if needed), and to come over with the final version of the Report


Parallel translating the Report into English October – December, 2012

Sending both Armenian and English versions of Self-assessment Report to ANQA

Deadline: Dec.12, 2012


20

Management of Self-Assessment process

The self-assessment of the whole university or its separate unite, as a quite complicated, multi-factor and multi-phase process, needs the existence of a priory well developed and clear cut management system to guarantee success of the entire process.

The schemes used by SEUA to ensure the administrative management and the organization of information flows needed for conducting the self-assessment processes have been the following. ASIIN Annual Conference - 2013, Stuttgart

The Scheme of Administrative Management of SA Process


Formation of the goal and objectives of SA

Formation of the working groups

realizing SA

Phase of Self-Assessment

Preparation of the Unit

Forming the Portfolio of SA

Making up of SA Portfolio (gathering

materials)

Familiarization the Unit with the worked out SA

Formation of the plan of enhancement actions

Phase of External Audit

Phase of Summing up the results

Formation of Expert Panel Discussion of the

Expert Report project in the Unit Elaboration of the site-

visit formats Preparation of the Report

and Conclusions Study of the worked out SA Report

Organization of visits to subdivisions

Making up the separate parts

of Expert Report

Formation of the project (draft) of Expert

Report Formation of the

project of conclusions

Discussion of the Report

in AC Commission Discussion and approval

of the Report and Conclusions BY

Academic Council

Publishing the final results

of evaluation and the Enhancement Action Plan

Heads of Chairs and Divisions

Deans of Faculties Vice-Rectors

Head of Department of ER&DP Regional units of QA

Commission of Academic Council

Academic Council Rector

Wo

rkin

g grou

ps fo

rmed

accord

ing to

th

e SA Stan

dard

s’ com

po

nen

ts

Gro

up

of ev

aluato

rs (Exp

ert Pan

el mem

bers)

Stud

ent U

nion

/ Stud

ents

The Scheme of Information Flows of SA Processes


The object of evaluation

Head of ER&DP Department

Vice-Rector

Commission of Academic Council

Secretary of Experts group

Dean of Faculty Head of Chair

Student Union Experts group

Head of Academic Programs

Department

National Center for Quality Assurance (ANQA)

Working group compiling the portfolio

of SA

Head of Expert Panel

Academic Council Rector

Site-visits to SEUA Campuses


24

Within the term of (May 20 - June 8), 2013 the following site-visits have been realized to SEUA

SEUA Central Campus in Yerevan,

SEUA Regional Campus in Gyumri,

SEUA Regional Campus in Vanadzor,

SEUA Regional Campus in Kapan.

The list of realized site-visits


The List of Expert Panel Members

25

EDUARD

GHAZARYAN

(the panel Chair)

Director of Institute of Mathematics and High Technologies of the

Armenian-Russian (Slavonic) University, Dr. Professor

DAVID

WOODHOUSE Academic Accreditation Commission of United Arab Emirates

GRIGOR

ALAVERDYAN

The Head of the Chair of Theory of Wave Processes and Physics of

Yerevan State University, Associate Professor

EDUARD

DANOYAN

The Deputy Dean of the Faculty of Informatics and Applied

Mathematics of Yerevan State University, Associate Professor

LAURA

SIMONYAN

A 4th Year Student of the Faculty of Romano German Philology of

Yerevan State University


26

The meetings taken place in Yerevan -1

Within the visit programme meetings with the following groups have been realized:

University Rector (the start meeting),

representatives of the working groups caring out the parts of the self-assessment report Vice-rectors,

Deans of Faculties,

representatives of Chair Heads,

representatives of employers,

heads and representatives of separate units, ASIIN Annual Conference - 2013, Stuttgart

27

The meetings taken place in Yerevan - 2

representatives of different groups of students,

representatives of teaching staff,

representatives of Student Union,

heads and members of scientific collaboration

units and research laboratories,

staff of QA responsible department.

A series of visits to the educational and research Centers and Laboratories took place as well.


The current state of SEUA institutional accreditation process

28

A draft of the expert panel Report based on the

SEUA institutional self-assessment report, the

results of the site-visits, and the individual

reports of expert panel members worked out for

all of the accreditation criteria, has been sent to

SEUA consideration and discussion.


Summary


Summary: SEUA Internal QA today

30

In last 3-4 years all the main components of SEUA internal QA System have been created including:

Organizational structure and responsible units,

Methodical guides and procedures for QA of study programmes,

Web-based on line system uniting: information data base of regulatory/ methodical support documents, and QA tool set for study programmes.


Summary: starting accreditations

31

Two parallel accreditation processes have been initiated :

Institutional accreditation by ANQA ,

Programme accreditation for Software Engineering and Information Security BE and ME programmes by ASIIN and ANQA (within the Tempus “PICQA” Project).


Summary: nearest QA targets

32

To complete competency based reorganization of all SEUA study programmes with integrated QA mechanisms.

To prepare the teaching staff and administration of SEUA to quality assessment and management of restructured programmes.

To test and apply the developed SEUA Web-based QA online system in SEUA QA processes.

To prepare new study programmes to national / international accreditations.


33

THANK YOU FOR ATTENTION


Components of Teacher Assessment

Rating System


Self-assessment based on actual information

Academic, Research, Methodical, and Social activity components

Pear Review Reviews done by colleagues, Reviews of Head of Chair

Assessment by Students

Professional and Personal characteristics

35

Number of students & admission

123.700 students (Total), among them

- 114.600 – Bachelor

- 9.100 – Master

- 17.800 – In the free of charge system

- 22.700 – In non-state universities

There are about 7000 foreign students studying in Armenian HEIs from 41 countries, mostly of Asia, as well as of other four continents.

According to the Law on Education and the Law on Higher and Post-graduate Education admission and selection is carried out by introducing unified secondary school final examinations, which are held at “knowledge assessment centers” set up to replace the former centralized admission examinations system.



Yerevan – the capital city for all Armenians

36

http://www.google.bg/imgres?imgurl=http://www.armeniapedia.org/images/thumb/0/0e/Yerevan-swan-lake-blvd-IMG_3677.JPG/400px-Yerevan-swan-lake-blvd-IMG_3677.JPG&imgrefurl=http://www.armeniapedia.org/index.php?title=Yerevan&h=300&w=400&sz=26&tbnid=rS8BJsv-Q_QlAM:&tbnh=93&tbnw=124&prev=/images?q=yerevan+photos&hl=bg&usg=__n8RCyGYhDbh3qUGtGQtrwU8qcmQ=&ei=UM7WS6T3FeikOLjHtPwG&sa=X&oi=image_result&resnum=3&ct=image&ved=0CAoQ9QEwAg


http://www.google.bg/imgres?imgurl=http://www.ecml.at/html/armenian/images/yerevan_opera.jpg&imgrefurl=http://www.ecml.at/html/armenian/html/sightseeing.html&h=253&w=310&sz=22&tbnid=rf9wkLZwtBLeDM:&tbnh=95&tbnw=117&prev=/images?q=yerevan+photos&hl=bg&usg=__lCJb0jsJpLY8I6rt6h39F3w6bT8=&ei=UM7WS6T3FeikOLjHtPwG&sa=X&oi=image_result&resnum=5&ct=image&ved=0CA4Q9QEwBA


The beauty of night

Yerevan

37

Yerevan – the capital city for all Armenians





Armenia - a unique open museum

38




Objectives of SEUA QАеS Portal

Sharing information about quality assurance

system, quality control of study programs and QA

processes in SEUA.

Addressing potential students’ and customers’

needs in finding information about particular study

program and its details.

Administrative access provides easy content

management, as well as survey management tools.


RESERVED

Assessment of teacher by students;

Course assessment by students;

Study programme assessment by graduates;

Assessment of employers’ satisfaction from

SEUA graduates.

Surveys imported from QAeS Portal

Facts and Figures - 3

At present over 10 thousand students following 4 degree

programs, more than100 foreign students studying in

English and Armenian language groups.

In addition, over 800 learners at the SEUA central and

regional affiliated high schools.

The academic staff of the University exceeds 800, most

of them with Scientific Degrees.

With its developed research system and infrastructure

the University is nationally recognized as the leading

center in technical sciences and technologies.


0

1

2

3

4

5

6

7

8

9

10 1

2

3

4

5

6

7

8

9

10

11

12

13

14 Specialty:

Information

Security

Software

Engineering

0

1

2

3

4

5

6

7

8

9

10 1

2

3

4

5

6

7

8

9

10

1. Graduates' theoretical knowledge corresponds to the job requirements

2. Graduates demonstrate practical skills

3. Graduates are able to identify, formulate and solve engineering

problems 4. Graduates are capable of solving

management problems 5. Graduates have enough knowledge

of computer technology and applied programmes

6. Graduates have enough foreign languages skills in the professional

field 7. Graduates have necessary record

keeping skills in Armenian 8. Alumni prove to have a creative

approach in their professional activities

9. Graduates have satisfactory business skills

10. Graduates have skills in cooperation with colleagues and teamwork

45

Formation the Working Groups in Accordance with the Standards

Group I II. MANAGEMENT AND ADMINISTRATION

Group II IV. STUDENTS

Group III V. ACADEMIC AND TEACHING SUPPORT STAFF

Group IV VI. RESEARCH AND DEVELOPMENT

Group V VII. INFRASTRUCTURE AND RECOURSES

Group VI VIII. SOCIAL RESPONSIBILITY

Group VII IX. EXTERNAL RELATIONS, INTERNATIONALIZATION

The groups were coordinated by the University Rector and Vice-rectors responsible for the appropriate fields.

The SEUA QA Division was ensuring and coordinating the cooperation between all concerned sides and working groups.


Higher Education System of Armenia (Facts & Figures)


47

National Qualification Framework of RA

Is confirmed by the RA Government in 2011

Elementary Education

Basic Education

Craftsman

Secondary Education

Specialist

Bachelor

Master

Researcher (Scientific Degree- Candidate of Science)


48

Organization of HE Degree Programmes

The main education programmes of higher professional education are conducted through various types of teaching: full-time, part-time or external education.

The academic year, as a rule, starts on September 1st and is comprised of 2 semesters with 20 and 22 weeks of duration respectively.

3 cycle preparation of specialists is implemented within the framework of Higher Education of Armenia:

- Bachelor’s degree programme: 4 years duration, 240 ECTS

- Master’s degree programme: 2 years duration, 120 ECTS

- Researcher’s (PhD) programme: 3 years duration, 180 ECTS


49

Institutions functioning in RA

26 State Universities, of which 16 with their 14 branches belong to

the system of the Ministry of Education and Science (MES);

4 HEIs founded by interstate agreements and state participation,

and funded by the MES; 2 HEIs in the system of the Ministry of

Defense; one higher education institution in the system of each of the

following Ministry/Bodies: Police, Ministry of Emergency Situations,

Mother See of Holy Etchimiadzin.

40 Private Universities, among them: 31 Accredited Universities

83% of state universities and 76% of non-state universities are

located in Yerevan, others in 8 provinces (Marzes) of the RA


Accreditation of Armenian HEIs: main principles and characteristics


Main objectives and regulations - 1

In the Republic of Armenia the external quality

assurance system is realized through institutional

and academic programme accreditations of HEIs

Accreditation as a tool for the certification of the quality

of a HEI’s activities and offered academic programmes

Is realized by means of academic audit of HEIs

aimed at the assessment of efficiency and adequacy

of internal quality assurance processes


Main objectives and regulations - 2

The primary provider of accreditations is the National

Center for Professional Education Quality Assurance

(ANQA), established in 2008 by RA Government.

Institutional accreditation is a periodically repeated

mandatory process for all HEIs functioning on the

territory of the Republic of Armenia

The “Statute on Accreditation of Tertiary Level

Institutions and Academic Programmes in the Republic

of Armenia” is approved by RA Government Decree

No 978-N on June 30, 2011


53

I phase

• Self-assessment conducted by the educational institution

II phase

• Site-visit carried out by an independent external expert panel

III phase

• Production of the final report and decision making by ANQA Accreditation Committee

Accreditation Phases

Accreditation, both institutional and academic programme, is carried out in the following three consecutive phases


Facts and Figures - 1

Yerevan Polytechnic Institute (YPI) was founded in 1933 having only 2 departments and 107 students.

In 1980-1985 reached its peak with about 25000 students and more than 66 majors, becoming the largest higher education institution in Armenia.

On November 29, 1991, the Yerevan Polytechnic Institute was reorganized and renamed State Engineering University of Armenia (SEUA).

In 2005, by the Resolution of the RA Government the traditional name “Polytechnic” was returned to the University as an acronym.


Facts and Figure - 2

The Central Campus of the University is located in Yerevan and the Branch Campuses - in Gyumri, Vanadzor and Kapan.

4 study programs of vocational and higher education conferring the qualification degrees of Junior Specialist, Bachelor, Master and Researcher (PhD).

The University also offers extended education courses by means of a network of continuing education structures.

The University has affiliated high schools in Yerevan and Regional Campuses, aimed at recruiting future gifted students from schools.



RESERVED

SEUA Quality

Assessment

e-System Portal

The Home Page of SEUA QАеS Portal

Each section in the

portal provides

information on the

specific topic.


RESERVED

Any particular topic in the portal can be shared in the

social networks or via email.

QАеS Portal: sharing possibilities


RESERVED

QАеS Portal: Study Programme search

Portal is equipped with a study program searching

functionality.


RESERVED

QАеS Portal: study programme format


RESERVED

QАеS Portal: a bridge to the Tools

Portal acts as a

bridge to the QАеS

Tools application.

Portal is developed

in Armenian and

English languages.

Entrance to Study Programme Tools


RESERVED

Some document forms used in Tools


RESERVED


RESERVED

Possible presentation forms of reviews

internal quality assurance and accreditation: the case of seua · 2014. 1. 13. · 2 agenda 1.seua...

Documents