obe student learning time (slt) & assessment

Bengkel Kerja Penambahbaikan Kurikulum Standard Kolej Vokasional (KSKV) Berdasarkan Keperluan MQA

di Quality Hotel City Centre

pada 21 April 2015

Student Learning Time (SLT) & Assessment

OUTLINE

1. OBE Secara Am

2. Beban Jam Pembelajaran Pelajar (SLT)

3. Penaksiran Kursus

RUJUKAN UTAMA

Kerangka Kelayakan Malaysia (KKM/ MQF)

Kod Amalan Akreditasi (COPPA) MQA

Standard & standard program MQA yang berkaitan

Garis Panduan Penulisan Program Akademik KPM

Garis Panduan Amalan Baik MQA

Prosedur ISO Rekabentuk dan Pembangunan Program Akademik Baharu

Seksyen 3 : Permohonan untuk Akreditasi Sementara (PA) dan Akreditasi Penuh (FA)

VERSI MQA-01 YANG DIKEMASKINI

9 Bidang Penilaian

TAMBAHAN

MQA-02

COPPA

Bahagian C - Standard Program:

Area 1- Misi, Visi, Matlamat Pendidikan dan Hasil Pembelajaran

Area 2 - Rekabentuk Kurikulum dan Penyampaian

Area 3 - Penilaian Pelajar

Area 4 - Pemilihan Pelajar dan Perkhidmatan Sokongan

Area 5- Staf Akademik

Area 6- Sumber-Sumber Pendidikan

Area 7- Pemantauan dan Semakan Program

Area 8- Kepimpinan, Governans dan Pentadbiran

Area 9- Penambahbaikan Kualiti Berterusan

Qualifications Cognitive Psychomotor Affective

Diploma C3 P3 A2

Bachelor C4 P4 A3

Master/PhD C5 P5 A4

Suggested dominant Bloom taxonomy levels for various qualifications:

OBE Secara Am

Atribut yang pelajar perolehi selepas 3 - 5 tahun bergraduan

Atribut yang pelajar perolehi sebaik tamat program

Atribut yang pelajar perolehi sebaik tamat kursus

Objektif Pendidikan Program Programme Educational Objectives

(PEO)

Hasil Pembelajaran Program Programme Learning Outcomes

(PLO)

Hasil Pembelajaran Kursus Course Learning Outcomes

(CLO)

STAK

EHO

LDER

SPR

OR

GR

AM

E ED

UC

ATIO

NA

L O

BJEC

TIVES

Management support and commitment

PEO-1

Regulatory /Professional

Bodies

RELATIONSHIPS BETWEEN CLO, PLO, PEO and COMPLIANCE TO THE STAKEHOLDERS

KPT/ MQA IHL requirements Industries

Students…

….. etc

PEO-2 PEO-3 PEO-4 PEO-5 ….. etc

PLO-1 PLO-2 PLO-3 PLO-4 PLO-5 ….. etc

PRO

GR

AM

ME

LEAR

NIN

G

OU

TCO

MES

CourseCLO-1

CO

UR

SE LEA

RN

ING

O

UTC

OM

ES

Course CLO-3

CourseCLO-4

CourseCLO-5

Course CLO-2

CQI

Analysi s

CQI

Analysi s

Analysi s

CQI

Assessment

PEO PLO CLO

Assessment

Assessment

OBE: Closing the Loop

Stake- holders

Our PEOs are to produce graduates who are:

1. VCS (Knowledge & Practical Skill)2. VCS (Soft Skill)3. VCS (Soft Skill)4. VCS (Soft Skill)n. VCS

PEO, PLO and CLO Development

PROGRAMME LEARNING OUTCOME (PLO)

Upon graduation, the students will be able to:1. VCS (Knowledge)2. VCS (Practical Skill)3. VCS (Soft Skill - CS)4. VCS (Soft Skill - CTPS)5. VCS (Soft Skill - TS) 6. VCS (Soft Skill - LLL & IM)7. VCS (Soft Skill - ES)8. VCS (Soft Skill - M&PE)9. VCS (Soft Skill - LS)n. VCS

PEO, PLO and CLO Development

LEARNING OUTCOMES: EXAMPLELEARNING OUTCOMES: EXAMPLE

a) verb b) condition c) standard

• calculate the beam deflection at the centre to within one decimal point. (C3)

Cognitive Domain (Thinking, Knowledge)

Psychomotor Domain (Doing, Skills)

Affective Domain (Feeling, Attitudes)

DEFINITION OF CREDIT

Based on MQF (2011), one credit is equivalent to 40 hours of notional student learning time.

Notional learning hours is the time required for an 'average learner' to achieve the learning outcomes through all learning activities including attending formal teaching sessions, laboratories work, group work involvement, self reflection on prior knowledge and experience, preparation prior to formal learning sessions, personal programme planning, private study and revision, and assessment of learning, among others.

STUDENT LEARNING TIME (SLT) (EAC, 2012)

STUDENT LEARNING TIME (SLT)

Credit hour Types of delivery Meeting hours/ week

1

1

1

1

Lecture 1

Tutorial 2

Practical 2

Practical (skill-based, co-curricular) 3

= Jumlah jam penaksiran formal

= Jam syarahan

STUDENT LEARNING TIME (SLT)

CONSTRUCTIVE ALIGNMENT

(adapted from Biggs 1999)

Intended Learning

Outcomes

Assessment methods (designed to assess learning

outcomes)

Learning and teaching activities (Designed to meet learning outcomes)

All learning outcomes are:Specific, Measurable, Achievable, Realistic, Time Frame and Observable (S M A R T O)

"Programme must demonstrate that the graduates have achieved the required outcomes. Adopting Continual Quality Improvement (CQI) within the programme to ensure outcomes attainment."

CONSTRUCTIVE ALIGNMENT

CONTINUAL QUALITY IMPROVEMENT (CQI)

QUALITY

TIME

Continual Improvement

Planning

Assessment

Implementation

Monitoring

Data collection (evidence) of student learning is used to identify student strengths and weaknesses for the purpose of making decisions on how to improve the program/ teaching/ learning processes.

Assessment and evaluation processes provide critical information to faculty (lecturers) and administrators on the effectiveness of the design, delivery, and direction of an educational program, thus leading to CQI.

Improvements based on feedback from evaluations will close the system loop and the process will continue year after year.

*CQI marks obtained for the CLO MUST NOT be included in the overall grade.

CONTINUAL QUALITY IMPROVEMENT (CQI)

CLO INDICATOR/ ASSESSMENT METHODS

CLOs Indicators/ Assessment Methods CLO1 (C)

CLO2 (P)

CLO3 (A)

1 Assignment

2 Laboratory/ field work

3 Laboratory/ field report

4 Quiz

5 Test

6 Project (e.g. SCL)

7 Final Examination

Course Table of Specifications (TOS/ JSU/ JPU)

Method of Assessment

Cognitive Affective Psychomotor

C1 C2 C3 C4 C5 C6 A1 A2 A3 A4 A5 P1 P2 P3 P4 P5 P6 P7

Quizzes and Tests

√ √ √ √

Final Examination

√ √ √

Project/ Product

√ √ √ √ √ √ √ √ √

Assignments √ √ √ √ √ √ √ √Presentation √ √ √ √ √Total 2 3 4 3 1 2 3 2 1 2 3 1 1 1

Dominant Depth & Breath

60%

C3

60% 60%

P3 A2C1 – C6 P1 – P7 A1 – A5

TABLE OF SPECIFICATIONS (TOS)

Method of Assessment

Cognitive (%) Total (%)C1 C2 C3 C4 C5 C6

Quiz 1 (5%) 1 2 2 5

Quiz 2 (5%) 1 1 3 5

Test 1 (10%) 2 3 4 1 10

Test 2 (10%) 1 2 4 2 1 10

Final Exam(50%) 3 5 27 7 6 2 50

Total (80%) 8 13 40 10 7 2 80

Total (100%) 10 16.25 50 12.5 8.75 2.5 100

Example: A course with Cognitive Learning Outcome of C3

Distribution of Cognitive Assessment

1016.25

50

12.58.75

2.5

0

10

20

30

40

50

60

C1 C2 C3 C4 C5 C5Cognitive Level

Dis

trib

utio

n of

Mar

ks (%

)

Distribution of Cognitive Assessment

0

10

20

30

40

50

60

C1 C2 C3 C4 C5 C5Cognitive Level

Dis

trib

utio

n of

Mar

ks (%

) Shows breadth and depth (cognitive) of the course !!

TABLE OF SPECIFICATIONS (TOS)Example of a TOS of final examination (intended outcome - cognitive domain C4)

TABLE OF SPECIFICATIONS (TOS)

510

20

52

94

0

10

20

30

40

50

60

C1 C2 C3 C4 C5 C6

Cognitive level

Ma

rks

dis

trib

uti

on

CLO Cognitive: C4Normal Distribution

Truncated Distribution

510

20

52

94

0

10

20

30

40

50

60

C1 C2 C3 C4 C5 C6

Cognitive level

Ma

rks

dis

trib

uti

on

14

29

CLO Cognitive: C4

Example of a TOS of final examination (intended outcome - cognitive domain C4)

OR

As long as the dominant assessment (i.e. SLT) is at the intended level

CLOs Key Performance Indicator (KPI)

CLOs Performance Analysis

Example KPI: Grade C (50 marks) and above

CLOs Achievement

0

20

40

60

80

100

CLO 1 CLO 2 CLO 3

% students with marks 50 and

above

CLOs Marks Distribution

Example: Bachelor of Civil Engineering with Honours

Cognitive 85.0 %

Psychomotor 7.5%

Affective 7.5%

CLOs Marks DistributionExample: Bachelor of Civil Engineering Technology with Honours

Jam/minggu Taburan Markah Penaksiran Catatan

Kuliah Tutorial Amali C P A

3 0 0 65% 20% 15%

2 0 0atau

2 2 0

1 2 0 60% 25% 15%

1 0 3

50% 35% 15%

2 0 3

1 0 6

1 0 2

1 0 4

0 0 9 PSM 1

0 0 15 PSM 2

0 0 335% 50% 15%

Lab/Skill/ Practical0 0 6

CLOs Marks Distribution

Faculty of Civil and Environmental Engineering

CLO /Domain % MarksCoursework &

Final ExamLaboratory Project

Cognitive 85

Assignment - 5%

Quiz - 5%

2 Tests - 20%

Project - 5%

Final Exam - 50%

Lab 1 - 35%

Lab 2 - 35%

Open Ended - 15%

Project - 85%

Psychomotor 7.5 Project - 7.5%Lab 1/

Lab 2/ Open Ended - 7.5%

Project - 7.5%

Affective 7.5 Project - 7.5%Lab 1/

Lab 2/ Open Ended - 7.5%

Project - 7.5%

Σ 100

CLOs Analysis Template

Mapping assessment to CLOs for a course with coursework and final exam

CQI ACTIVITIES TO IMPROVE CLOs

Programmes are expected to make sure that continual quality improvement (CQI) is evident (EAC, 2012).

Quality Assurance Records (EAC, 2012): Provide minutes and records of action and improvement of meetings of the programme teaching team, Industry Advisory Committee, and staff-student consultation forums.

Tutorials/Extra lectures

Assignments

Discussion/Open discussion

Survey

PLO INDICATOR/ ASSESSMENT METHODSPLOs Indicators/ Assessment Methods PLO

1PLO

2PLO

3PLO

4PLO

5PLO

6PLO

7PLO

8PLO

9

1 Entrance survey (e.g. My3S)

2 Entrance exam

3 Exit exam

4 Exit interview

5 Exit survey

6 Course-embedded assessment (CLO)

7 Capstone course/ project

8 Final oral presentation

9 Portfolio

10 Peer & self evaluations

11 External examiner assessment

OUTCOME-BASED ASSESSMENT TOOLS

Example: Tools and KPI for PLOs assessment Programme: Bachelor of Civil Engineering of Honours

For BEng Electrical (Hons)

Exit survey & Industrial training survey KPI: PLO Achievement ≥ 60%

CLO-PLO assessment KPI: 50% of the cohort obtained ≥ 55%

1. Review learning design to reduce classroom instruction and include more innovative teaching approaches such as PBL and cooperative learning.

2. Modifying existing laboratory implementation from several experiments to one large-scale experiment in certain courses to achieve a predetermined goal where the students are required to design and conduct their own experiments.

CQI ACTIVITIES/ SYSTEMS

PEO INDICATOR/ ASSESSMENT METHODS

PEOs Indicators/ Assessment Methods PEO1 PEO2 PEO3 PEO4

1 Employer survey

2 Alumni survey

3 Alumni interviews

4 Stakeholder survey

5 Industrial advisor committee (IAC) assessment

6 Job offers

7 Starting salaries

8 Admission to graduate programme

9 Admission to professional qualification

CQI ACTIVITIES/ SYSTEMS

• Organising faculty workshop and awareness seminar on OBE

• Establishing OBE-curriculum review committees at faculty and departmental levels

• Faculty meeting to present and discuss the principles and implementation of OBE

• Getting feedback and views from employers, alumni, parents, faculty members, and students on proposed/ achievement of PEO and PO

• Review existing curricula and courses to take into account of PEO, PO and CO and feedback from the various constituencies

• Implementing suitable assessment and evaluation tools to measure the achievement of the PEO, PO and CO.

• Facilitating workshop on OBE Awareness & Sharing of Experience organised by professional bodies/ MQA for member of Faculty

Please ensure evidences (on everything!) are readily available during accreditation exercise.

CONCLUSION

BEST OF LUCK!!