Seminar 2 (Course File):

CS-NU ABET Accreditation Report

Presented By: Anwar Ali Ahmad Taleb College of Computer Science and Information Systems Department of Computer Science (CS-NU) Najran University September 2011

Seminar 2: Course Assessment Procedure Documentation

Course File 1. Course Syllabus 3. Books and Handouts 2. Assessment Methods 3. Sample of Students graded works

4. Course Assessment Procedure

Analyze and discuss the data to assess the course achievements

Students Performance
Collect data

Students Surveys

5. Course Assessment Report

Suggested Improvement

Approved Improvement

The departmental steering committees

Seminar 2: Course Assessment Procedure

Course Learning Outcomes
Students Surveys
Implement Course Improvement

Course

Approved Improvement

Collect students data

Students performance in assessment methods

The departmental steering committees

Look and analyze the data: 1. Performance by CLO 2. Student opinion by CLO

Recommend Course Improvement (Content, etc.)

70% of students happy

Is 70% of students at 70% or above for each CLO?

Yes Yes

NO NO Legends in Students minds!!

Is the average value at 2.75/4 or above in each question?

Course Satisfied
Yes

NO

Recommend Improvement to build higher student confidence

Seminar 2: Course Assessment Procedure Documentation

1. Assessing a course Assessing means assessing its Course Learning Outcomes.

Course Assessment

Assessing Course Learning Outcomes

Students Performance

Students Surveys
Students Survey Steps 1. 2. Designed by the instructor and approved by the departmental steering committee. Each question should be well defined to measure a specific course learning outcome

Design a Course Student Survey

Students Answers

Prepare Students

1. 2. 3.

Survey Report

Shows mapping between questions and CLOs Shows the average value for each course learning outcome out of 4. Above 2.75 means CLO is achieved

Seminar 1: Students Survey Documentation

Student Survey Documentation
Criteria Strongly Agree(4/4) Question 1 Question 2 Agree(3/4) Neutral(2/4) Disagree(1/4)

1. Course Student
Survey 2. Answers from students

Question 3

Question 4

Course Code: Instructor: Total Number of Students: Criteria Linkages to CLOs Question 1 CLO_1 Question 2 CLO_2 Question 3 CLO_3 SA(4)

Course Name: Semester:

Student Evaluation A(3) N(2) D(1) NA(0) Average

3. Students
Survey Report

Question 4 CLO_4 Number of Responses:

Seminar 2: Sample Students Survey Report

1. Assume that in CSC113 has 7 learning outcomes and 8 enrolled students. 2. A student survey (7 questions) is prepared and distributed to students. 3. Collect students answers and prepare the following report:
Course Code: CSC113 Instructor: SAM Matiurrahman Total Number of Students: 8 Criteria Linkages to Student Evaluation Course Name: Programming Language-2 Semester: First semester, 1431/1432H

Number of Students Average = (3 * 4 + 3*3+ 2*2+ 0 * 1) / 8 = 3.12

CLOs
Question 1 Question 2 Question 3 Question 4 Question 5 Question 6 Question 7 CLO_1 CLO_2 CLO_3

SA(4)
3 3 3 2 4 4 0

A(3)
3 2 3 1 2 3 3

N(2)
2 2 1 4 0 0 3

D(1)
0 1 1 1 2 1 2

NA(0)

Average
3.12 2.88 3

CLO_4
CLO_5 CLO_6

2.5
3 3.25

CLO_7

2.13

Average = (2 * 4 + 1*3+ 4*2+ 1 * 1) / 8 = 2.5

Number of Responses: 8

Seminar 2: Student Performance Report (Direct method)

1. General Information

Student Performance Report

2. Assessment Methods Tables 3. Students Marks Sheet 4.Students Grades by Learning Outcomes

Course Code Course Title Section

Number of Students

Instructor Semester Academic Year

Learning outcome CLO_1 CLO_2 CLO_3 CLO_4 CLO_5

Weight

Seminar 2: Student Performance Report Contd

1. Sample General Information in the student performance report
Course Code CSC113 Programming Course Title Language-2 Section 1 Number of Students: 8 Instructor Semester Academic Year SAM Matiurrahman First semester 1431/1432H

CLO_1 CLO_2 CLO_3 CLO_4 CLO_5 CLO_6 CLO_7

Learning outcome Describe the basic principles and major benefits of OOP Recognize Java syntax and semantics Analyze problems in object oriented fashion Use of Java standard classes Identify and correct errors in small programs Evaluate the output of small programs Design, implement, compile and run a program to solve simple real-world problems

Weight
5 20 10 10 10 15 30

Seminar 2: Student Performance Report Contd

2. Assessment Methods Table

Learning Outcomes 1 (CLO_1)

Learning Outcomes 2 (CLO_2) Learning Outcomes 3 (CLO_3)

Direct Assessments
Assignments Quizzes Major Exam ... ... ...

DESIGN: To obtain evidence of students learning outcomes achievements

Evaluating: T/F, Multiple Choice, fill-in-the-blank, rubrics, etc.

Seminar 2: Student Performance Report Contd

2. Assessment Methods Table Contd
Assessment method name and its weight out of the total score (100).
Quiz 1 (3) Q1 Q2 Q3 1 1 1 2 1 Quiz 2 (3) Q1 Q2 CLO_1 CLO_2 CLO_3 CLO_4 CLO_5 CLO_6 CLO_7

Linkages between questions and CLOs, with their weights

Mid-Term 1 (12) Q1 Q2 Q3 Q4 Q5 Q6 1 1 1 2 3 4 Lab Evaluation (10) Lab1 Lab2 Lab3 CLO_1 CLO_2 CLO_3 CLO_4 CLO_5 CLO_6 CLO_7 3 5 Mid-Term 2 (12) Q1 Q2 Q3 Q4 2 2

CLO_1 CLO_2 CLO_3 CLO_4 CLO_5 CLO_6 CLO_7

Assignment 1 (5) Q1 Q2 Q3 CLO_1 CLO_2 CLO_3 CLO_4 CLO_5 CLO_6 CLO_7 2 1 2

Assignment 2 (5) Q1 Q2

3 4 3

2 3

10

Seminar 2: Student Performance Report Contd

2. Assessment Methods Table Contd
Course Project (10) C1 C2 C3 C4 C5 1 2 1 2 Final Exam (40) Q3 Q4 Q5

CLO_1 CLO_2 CLO_3 CLO_4 CLO_5 CLO_6 CLO_7

CLO_1 CLO_2 CLO_3 CLO_4 CLO_5 CLO_6 CLO_7

Q1 2

Q2
12

Q6

5 5 5 11

The assessment methods in CSC113 are: 2 quizzes, 2 assignments, 2 exams, 3 lab tests, a course project, and a final exam.
Quiz 1 MidTerm 1 CLO_1(5) CLO_3(10) Q1 (1) Q3(1) Q1(1) Q2(2) Mid Term 2

The weight of CLO_1 is 5. The weight of CLO_3 is 10.

Course Project C1(1) C3(1) Q2(1) Assignme Final nt 1 Exam Q1(2) Q3(5)

11

Seminar 2: Student Performance Report Contd

3. Students Marks Sheet Contains the grades of each student in every question/
Student ID S1 S2 S3 S4 S5 S6 S7 S8 Quiz 1 (3) Q1 1 0 0 1 1 0 0 1 Q2 0 1 0 1 1 0 1 1 Q3 1 1 1 0 0 1 0 0 Quiz 2 (3) Q1 1 2 1 2 1 1 1 2 Q2 1 0 0 1 0 1 0 1 Student ID S1 S2 S3 S4 S5 S6 S7 S8 Mid-Term 1 (12) Q1 Q2 Q3 Q4 1 1 0 1 0 1 0 1 0 1 0 1 0 1 0 1 1 0 1 1 1 1 1 1 1 1 1 2 2 2 1 1 Q5 2 2 2 3 2 3 2 2 Q6 3 1 1 4 3 3 3 3 Q1 2 2 1 2 2 2 1 2 Mid-Term 2 (12) Q2 2 2 2 2 2 2 1 2 Q3 2 2 1 3 2 3 2 3 Q4 4 3 2 4 4 4 3 2

12

Seminar 2: Student Performance Report Contd

3. Students Marks Sheet Cont`d
Student ID
S1 S2 S3 S4 S5 S6 S7 S8 Student ID S1 S2 S3 S4 S5 S6 S7 S8

Assignment 1 (5)
Q1 1 2 1 2 1 1 2 0 Q2 1 1 1 1 1 0 1 1 Q3 1 1 0 2 2 0 1 1

Assignment 2 (5)
Q1 2 2 0 2 2 1 2 0 Q2 1 2 2 3 1 1 2 1 Student ID

Student ID S1 S2 S3 S4 S5 S6 S7 S8

Lab Evaluation (10) Lab1 Lab2 Lab3 2 3 2 1 1 2 0 1 3 3 4 3 2 3 1 2 4 1 0 2 3 0 0 1

Course Project (10) C1 C2 C3 C4 C5 1 1 1 1 2 1 2 1 0 2 0 0 1 0 2 1 2 1 2 4 1 2 1 2 2 0 1 2 1 3 1 1 1 2 4 0 0 1 1 3

Final Exam (40) Q1 Q2 5 Q3 2 Q4 3 Q5 4 Q6 9 2

S1

S2
S3 S4 S5 S6 S7 S8

0
1 2 2 2 2 0

5
5 10 8 8 10 6

1
5 5 4 4 5 2

0
2 5 5 3 5 5

0
2 5 4 5 5 2

5
4 9 11 8 9 11

13

Seminar 2: Student Performance Report Contd

4. Students Grades by Learning Outcomes

Shows the students' marks by learning outcome and the achievement percentage of students for each learning outcome.
Student Number Outcome Weight S1 S2 S3 S4 S5 S6 S7 S8 S9 S10 Achievement Grades (70% * outcome weight) Student Achieved Student Not Achieved CLO_1 CLO_2 CLO_3 CLO_4 CLO_5 CLO_6 CLO_7

A student achieves a CLO if his grades in the questions associated with that CLO is > 70% of its weight.

14

Seminar 2: Student Performance Report Contd

4.Quiz 1 Students Grades by Learning Outcomes Contd Mid-Term 1 Mid Course Assignment
General Information:

Final Exam Q1(2/2)

Term 2

Project

CLO_1(5) Code: CSC113 Course Name: Programming Language-2 C1(1/1) 1 Q1 (1/1) Q1(1/1) Course Section: CLO_3(10)
Instructor: SAM Matiurrahman Academic Year: 1431/1432H

Q3(1/1)

Q2(2/2)

Semester: First semester

Number of Students: 8

C3(1/1)

Q2(1/1)

Q3(2/5)

Student Number Outcome Weight S1 S2 S3 S4 S5 S6 S7 S8 Achievement Grades (70% * outcome weight) Student Achieved

CLO_1 CLO_2 CLO_3 CLO_4 CLO_5 CLO_6 CLO_7

5

5
2 1 5 4 3 3 2 3.5

20 9 13 7 18 14 13 15 10 14

10

7
6 10 9 8 9 8 6 7

10 6 4 2 10 8 5 5 5 7

10 7 3 3 10 9 7 8 7 7

15 11 5 6 15 11 15 11 7 10.5

30 21 15 14 27 22 21 24 21 21

15

3 37.5% Student Not Achieved 5 62.5%

4 50% 4 50%

6 75% 2 25%

2 25% 6 75%

6 75% 2 25%

5 62.5% 3 37.5%

6 75% 2 25%

Seminar 2: Course Assessment Report

1. Summarize the collected data from students surveys and students performance.
General Information:
Course Code: CSC113 Course Name: Programming Language-2 Instructor: SAM Matiurrahman Academic Year: 1431/1432H Section: 1 Semester: First semester Number of Students: 8

Course Learning Outcomes

Students' Surveys
Not Achieved Achieved

Students Performance
Not Achieved Achieved

CLO_1 CLO_2 CLO_3

CLO_4
CLO_5 CLO_6 CLO_7

16

Seminar 2: Course Assessment Report Contd

2. The course instructor has to write his comments on improvements of CLOs according to the students' surveys Report and the students' Performance Report in the course. Course Learning Outcomes

Students' Surveys

Student Performance

CLO_1
CLO_2 CLO_3 CLO_4

Recommendations to improve CLO_1

Recommendations to improve CLO_2

Recommendations to improve CLO_4 Recommendations to improve CLO_4 (Try to build higher student confidence in the next course offering)

CLO_5 CLO_6 Recommendations to improve CLO_6 (Recommend course improvements in content, delivery, etc.) Recommendations to improve CLO_7

17

CLO_7

ABET a-k CS program outcomes

The program must enable students to attain, by the time of graduation: )a) An ability to apply knowledge of computing and mathematics appropriate to the discipline )b) An ability to analyze a problem, and identify and define the computing requirements appropriate to its solution (c) An ability to design, implement, and evaluate a computer-based system, process, component, or program to meet desired needs (d) An ability to function effectively on teams to accomplish a common goal

(e) An understanding of professional, ethical, legal, security and social issues and responsibilities
(f) An ability to communicate effectively with a range of audiences (g) An ability to analyze the local and global impact of computing on individuals, organizations and society (h) Recognition of the need for and an ability to engage in continuing professional development

(i) An ability to use current techniques, skills, and tools necessary for computing practice.
)j) An ability to apply mathematical foundations, algorithmic principles, and computer science theory in the modeling and design of computer-based systems in a way that demonstrates comprehension of the tradeoffs involved in design choices. [CS] )k) An ability to apply design and development principles in the construction of software systems of varying complexity. [CS]

Thank You