SENATE
GUIDE
ASSESSMENT OF
TAUGHT COURSES:
DESIGN AND
FEEDBACK
p. 1
Contents
Contents ...............................................................................................................................................2
1
2.2
13
13
13
15
15
10
11
2.6
Timetabling of assessments
Part-time Courses
2.5
6
6
7
7
2.3
2.4
Assessment Validity
Making assessment M-level
Assessment as learning
Developing an assessment strategy
16
16
17
17
3.3
3.4
Model answers
Marking schemes
University Qualitative Descriptors
Rubrics
18
18
18
19
20
20
21
21
21
21
22
22
p. 2
p. 3
Introduction to Assessment
1.1
Overview
The purpose of this document is to offer advice and guidance to academic staff and to act as a
source of ideas for developing new approaches to assessment. It is not intended to be
prescriptive.
Before using this Guide, staff are advised to familiarise themselves with policies and procedures
in the following Senate Handbooks:
Senate currently does not prescribe particular methods of assessment, nor any specific balance
of assessment types for a particular award. Senate emphasises a key principle that
assessments should correspond directly to the stated intended learning outcomes. Course
teams are encouraged, however, to have a clear assessment strategy for the award as a whole,
taking into account all of the modular and other assessments contributing to the final award.
This Guide contains useful information to help staff reflect on the design of the assessments of
their taught courses, and how such design can help facilitate providing feedback to students on
their performance and academic standards.
As context, it is worth remembering that the primary purposes of assessment are:
to ensure and demonstrate that the quality and standard(s) associated with the
intended learning outcomes of the institutions courses are met (by means of
summative assessment in particular);
to provide a mark or grade which helps provide an absolute and/or relative indicator of
achievement (for example for prospective employers);
to help students evaluate their own progress in the development of knowledge,
understanding abilities or skills (through the provision of definitive marks and grades
and/or a constructive commentary on their work).
The UK Quality Code for Higher Education1 sets out two general expectations relating to
assessment:
1) Higher education providers ensure that students have appropriate opportunities to show
they have achieved the intended learning outcomes for the award of a qualification or
credit.
2) Higher education providers ensure the assessment of students is robust, va lid and
reliable, and that the award of qualifications and credit are based on achievement of the
intended learning outcomes.
This Guide is intended to help those responsible for taught course assessments meet these
expectations.
p. 4
1.2
Definitions
Diagnostic assessment
Formative assessment
and are
Summative assessment
A list of assessment types and variations with associated advantages and disadvantages is
given in Appendix 1.
p. 5
2.1.1
Assessment Validity
An assessment is valid if it tests successfully the learning the examiners want it to test. Thus,
validity relies upon aligning the assessment method to well-constructed intended learning
outcomes (ILOs). Advice on writing ILOs is given in Appendix 2.
A well-constructed ILO should inherently indicate an appropriate mode of assessment. For
example, if the ILO refers to critical analysis of an issue, an assessment based on some form
of essay might be indicated; a written examination is unlikely to be a suitable form of
assessment for this type of ILO, especially if its questions encourage answers based on
recollection of facts, rather than answers based on critical analysis.
More generally:
written assessments are unlikely to be valid choices for assessment of practical skills;
time-constrained examinations are unlikely to demonstrate in-depth critical analysis
(often a key qualifier for Masters-level provision).
Appendix 3 outlines the Universitys position on the interpretation of the national level 7
(Masters-level) descriptors, as defined by the Quality Assurance Agency (QAA) in its Quality
Code. This describes qualities of a masters graduate, and includes language such as critical
evaluation, originality in the application of knowledge, and evaluation of methodologies. It would
therefore be expected that level 7 (Masters-level) assessment will be designed to test such
skills, knowledge and understanding, through their authentic use in novel situations.
Examples of innovative assessment at M-level can be found in a compendium of examples
generated through the Assimilate project at:
https://sites.google.com/a/teams.leedsmet.ac.uk/assimilate-2012/dissemination/compendium
p. 6
2.1.3
Assessment as learning
Many authors have noted how student learning is influenced by how they will, or how they think
they will be assessed. This is readily demonstrated how many times do students ask Will this
be on the exam??
This can be utilised as a source of motivation for students by sharing with them the intended
learning outcomes, of a course or module, relating these to the assessment strategy for the
course, and clearly communicating the criteria for success (see information on rubrics in section
3.2).
A good strategy is Introduce, Practice, Assess students should not be assessed on anything
that has not been clearly introduced to them, and they should have had the opportunity to
practice and receive feedback through a formative assessment on their performance in
relation to skills and attributes required for a final summative assessment. Formative
assessments may be structured or provided by you as part of the course, or outlined as
suggestions for self-directed or group learning.
2.1.4
All course teams are encouraged to outline their overall strategy for the assessment of the
course as a whole. It is important to design a varied and balanced set of assessments, and
should be considered as an integral part of the overall course design.
Variety in assessment can encourage development of a well-rounded individual by directing
their learning into the development of a range of skills necessary to complete those
assessments. By contrast, an assessment strategy based heavily on a single mode of
assessment may hinder development and indirectly bias the course towards a particular
learning style (e.g. relying wholly on traditional written methods such as essays and
examinations is likely only to develop skills in writing essays and recalling information).
p. 7
Where more than one piece of assessment is used, Course Teams should consider whether
the assessments are independent or elements of a multi-part assessment. The impact on
failure is different as outlined below:
Independent assessments
3 separate assessments, outlined in the
course specification as:
Multi-part assessment
3 assessments, but outlined in the course
specification as:
A
B
C
assignment
assignment
assignment
assignment
25%
25%
50%
A
25%
25%
50%
25
mar
ks
25
11/25
6/25
Example 1:
marks obtained
100%
3
50
Example 1:
45%
25%
55%
marks obtained
27/50
marks obtained
marks obtained
45%
25%
42%
11/25
6/25
21/50
Appropriate for:
group work projects where the product of
the group work results in a mark equally
applied to all group members and there is
also an individual assessment to test
individual learning from the event (such as
a viva or individual presentation) so that an
individual mark can be attributed
when one assessment measures subject
knowledge and a practical exercise
measures application.
2) What skills should we be assessing?
These will include both subject-specific and transferable skills such as written and oral
communication skills. An assessment strategy should aim to allow students to demonstrate
their written and oral skills in different ways and contexts, and consideration should be paid
to both teaching methodologies and assessment of more practical skills such as use of
specific equipment or computer software, and how these can be assessed practically if
possible. If hands-on assessment of practical skills is not feasible, consider use of reporting
methods such as posters, oral presentations, or a report in the style of a journal paper.
Version 1.1 August 2015
p. 8
p. 9
7) How can we clearly communicate the requirements of an assessment and its marking
criteria to students from the outset?
It is considered good practice to provide students with as much information as possible
about how an assessment will be marked when it is set. In addition to a mark breakdown for
specific sections, or aspects such as presentation, this should include an indication of the
quality of work required to generate a given mark (See section 3).
Other considerations to take into account when developing an assessment strategy can be
found at:
https://www.heacademy.ac.uk/sites/default/files/A_Marked_Improvement.pdf
More Higher Education Academys Assessment Resources can be accessed via
https://www.heacademy.ac.uk/search/site/Assessment?f[0]=im_field_theme:2767
8) What is an appropriate re-assessment strategy?
Where students fail an assessment (i.e, they do not achieve the minimum mark for the work),
course teams are asked to consider whether the permitted re-assessment should be either:
a new piece of work (of the same type as the original assessment); or
an opportunity to revise and represent the original piece of work.
2.2
2.2.1
Timetabling of assessments
Within the taught course, assessment deadlines should be carefully coordinated to avoid
clashes, or bunching of deadlines. Particular care should be made where elements of your
course are shared with or borrowed from other courses. Students should also be given time to
act on the feedback from one assessment before being required to submit the next, to avoid
making repeated errors such as presentational or referencing requirements.
A programme will typically consist of ILOs which are translated into specific outcomes for
components of the taught course or the research project. Students are generally expected to be
more self-directed in their learning during research projects than during the taught components
that often precede the research project, so it is worthwhile considering whether aspects of the
taught course and its assessment can be used to develop skills required for individual or group
research projects. This may help to alleviate the pressure on assessment overall within the
course.
p. 10
2.2.2
Part-time Courses
For part-time students, the same assessment criteria will generally apply as for their full-time
colleagues, but extra support or assistance may be required, especially if an element of group
work is required to be carried out outside normal contact time.
For students on courses specifically designed to be part-time, which may be compressed into a
shorter week with longer days, it may be useful to ensure there is contact time specifically
designated to discussing needs of the assignment so there is time for students to reflect and
gain advice if required before they leave the site.
Senate permits full-time and part-time submission dates for the same assessment to be no
more than 10 working days apart (to provide time for marking for all assessments so that
feedback is not returned to some students prior to the submission of the work of others). Where
this is not practicable, submissions dates of more than 10 working days apart can be set,
providing that different assessments be issued for full-time and part-time students.
2.3
Integrating Assessments
In order to reduce assessment points and make for a more coherent learning experience, it may
be possible to develop an integrating assessment. An integrating assessment is often more
representative of real-life in that it requires students to draw upon knowledge and skills gained
from multiple parts of a programme.
p. 11
ii)
2.4
Group Assessments
The ability to work effectively in groups is a highly desirable skill which has translated into ILOs
in most of our courses. There are a number of benefits and problems associated with group
work and its assessment, mostly associated with wha t constitutes a fair way to assess and mark
the process. This section draws heavily on a review by Graham Gibbs 1 which draws together a
range of published literature on the issue.
http://www.brookes.ac.uk/aske/Groupwork%20Assessment/
p. 12
2.4.1
Group work has the potential to engage students, increase the complexity of the tasks and
challenges they can work on, and allow them to gain experience of collaborative working. From
an institutional perspective, this may also reduce the number of resources required for an
exercise, and offer the possibility of greatly reduced marking loads.
2.4.2
If groups are too large, individual motivation and effort can be less than if students had worked
alone. Students often lack the group management skills required for larger numbers, and the
possibility of free-loading increases. Four to six in a group is recommended. 2
Mixed ability groups are also recommended. A group mark may often be predicted by the ability
of the highest achieving member, and it is accepted that low achieving students have the most
to gain. If students are allowed to self-select groups, the impact will usually be that high ability
students will end up together to the detriment of the lower ability groups. The fairest option is
therefore seen to be to ensure mixed ability groups with a marking scheme that enables those
giving the greatest contribution to be recognised.
Culturally heterogeneous groups can gain lower marks on short tasks, presumably because a
homogenous group will get to work more quickly. However, the longer the task, the less this
has an effect, which is reported to disappear completely at 4 months.
2.4.3
http://www.brookes.ac.uk/aske/Groupwork%20Assessment/
p. 13
2.5
Oral Assessment
Oral assessment includes any assessment, wholly or in part, by word of mouth. Similar to the
ability to work in a group, the ability to communicate effectively by this route is a desirable skill
and one required by many of our courses. This section draws heavily upon a guide produced
by Leeds Metropolitan University (Gordon Joughin, 2010)3. Examples of oral assessment may
include:
http://www.brookes.ac.uk/aske/Groupwork%20Assessment/
p. 14
2.5.1
it helps assess inter and intra-personal skills, problem solving skills, and offers insight into
the students cognitive processes;
it allows probing of the depth and extent of students knowledge;
some students may be able to express themselves better orally rather than in writing;
it offers opportunity for clarification if questions (or answers) are unclear;
it guarantees that the work is the students own.
2.5.2
p. 15
2.6
2.6.1
General Strategy
A strategy for individual research project assessment may focus upon the outputs (typically a
thesis/dissertation, plus additional elements which may take the form of a poster or oral
presentation), but may also look to award marks for personal effort in the process (application
and initiative or effort and application). Weightings between these aspects and the sections
within them may vary, but it would be expected that effort-related marks would be a minor
component due to difficulties in reliably assessing such a quality.
An example of different weightings within the thesis might be:
Component
Introduction and Literature Review
Aims and Objectives
Materials and Methods
Results
Discussion
Conclusions / Suggestions for further work
Presentation and writing style
Weighting (%)
20
10
15
15
20
10
10
An alternative scheme is to outline structure, style, research approach, analysis and discussion.
Whatever the strategy, it should be clear to students what the expectations are for each
component, communicated via the student handbook, with reminders of the marking criteria at
appropriate points before and during the research project. When deciding on a strategy, course
teams and/or examiners are advised to consider carefully the balance between marking loads,
transparency and the risks of marks being challenged.
2.6.2
In The Lecturers Toolkit Phil Race4 notes the following challenges which arise as a result of
project work:
Race, P. (1998) An education and training toolkit for the new millennium. Innovations in Education
and Teaching International. 35 (3) p262
p. 16
unlikely), journal guidelines can be employed to help convey clear expectations to students (and
markers) about style, presentation and content. Examples from the journal selected can act as
exemplars, although care would need to be taken with weaker students and projects to ensure
that they do not see the end product as unachievable.
It may also be argued that paper/research article format has additional advantages:
they are generally considerably shorter in word count than a thesis or dissertation;
with the exception of those students going on to a PhD, graduates are more likely to make
use of paper-writing skills than the skills used in writing a long thesis.
2.6.3
Oral presentations
An oral presentation of the outcomes of the individual research project with an outline of project
rationale and methods used is often part of the assessment structure. Please refer back to
Section 2.5 on considerations for oral assessment.
2.6.4. Poster presentations
Poster presentations are often used at conferences and exhibitions to disseminate research
findings, so use skills many of our students will employ after graduation, and therefore are a
good to include in an assessment strategy. The poster production can be complimented with a
poster round where authors are asked to give an oral overview of their work and/or respond to
questions. Used at a presentation day or other event, such displays can generate a buzz and
interest in others work. Exemplars from previous years or posters generated by more
experienced researchers are often readily available for students and markers to view. However,
some students may be unfamiliar with this format, and in a similar manner to oral assessments
(see Section 2.5) there should be careful consideration of the marking criteria and how these
can be clearly communicated to students.
p. 17
3.1
Overview
The University is committed to developing high-quality and articulate graduates, who leave
Cranfield with a positive view of the student learning experience, and the engagement they had
with staff and other students. Critical to this impression is the quality of the feedback provided
by staff on their learning and examination performance.
It is accepted good practice and a QAA expectation that we provide appropriate and timely
feedback to students on assessed work in a way that promotes learning and facilitates
improvement. The QAA also notes the importance of timing; feedback has most benefit when
provided during the learning process, enabling students to reflect on their performance, and
where necessary make changes that can influence further marks.
Course teams should ensure that all student-focused course documentation is clear on:
3.2
For all assessments, either some sort of marking scheme and/or model answer should be
defined before the assessment is taken by students. While the integrity of the assessment
process should not be compromised, the purpose of the assessment is not to trick the student
into giving the wrong answer. There is much information that could and should be shared with
students, to aid them in their learning and to give them the best possible chance of being able to
attain all the marks that may be awarded.
3.2.1
Model answers
Model answers are useful where there is a definitive right answer, for example for examination
questions which involve a calculation, and for which there is only one possible outcome. Model
answers for previous assessments can be a useful guide to students.
3.2.2
Marking schemes
These show a point by point allocation of where and how marks can be achieved. Typical
categories which may be given specific mark weightings may include content, discussion,
quality of materials referenced and presentation. Again, marking schemes (with specific
answers) for previous assessments can be a useful guide to students.
3.2.3
The Qualitative Descriptors document, shown in Appendix 4, attempts to describe the quality of
work which would attract a given mark range, for example good work defined at 60-69% with
statements about how the work has met and exceeded learning outcomes, and demonstrates
good knowledge and understanding of the subject and subfields. The disadvantage of this
document is that is still open to interpretation where qualities which are good, very good or
excellent are difficult to define in such a generic document. These descriptors are also included
in the Senate Handbook on Assessment Rules (Taught Courses).
p. 18
3.2.4
Rubrics
Content
(40 marks)
Argument
(40 marks)
Fluency of
writing
(10 marks)
Presentation
(10 marks)
Fail
(0-49%)
Pass/
Satisfactory
(50-59%)
Good
(60-69%)
Excellent
(70-100%)
Demonstrates
inadequate
knowledge of the
subject
Absence of critique
of
the
subject
matter
A poorly structured
and communicated
piece of work
Demonstrates
sufficient
knowledge
to
address ILOs
Some critique of
the subject matter
Demonstration of
knowledge meets
all and exceeds
some ILOs
Good capacity for
critical evaluation
Demonstration of
knowledge
exceeds
many
ILOs
High capacity for
critical evaluation
Simple
structure
with
adequate
communication
skills
Most spelling and
grammar
is
correct;
other
presentational
aspects generally
correctly applied
Well-structured
work with good
communication
skills
Minor errors
Well-structured
work with excellent
communication
skills
No mistakes in
spelling
or
grammar;
references
correctly
and
consistently cited;
appropriate use of
titles and subtitles;
creative use of
figures and tables
to complement the
text
and
are
correctly labelled
and referred to.
A large number of
spelling, grammar
errors; references
incorrectly cited;
Poor or no use of
titles,
subtitles,
figures,
tables.
Lack of legends
and labelling.
Think about the pass category first what must the student do to be worthy of a pass
mark?
Think about excellent category what would the perfect assignment look like? It should
theoretically be possible to get 100%!
Fill in other categories to fit with above, using language that will not give the answer, but
describes what is expected.
Develop with colleagues to help ensure they are clear and subjectivity is reduced
Keep to one side of A4, but try to give as much information as you can in this space
p. 19
Give to students when the assignment is set to aid their understanding of what is required
Use in marking to highlight the category that the work falls into
If set up in Turnitin (Grademark), settings can also be used to generate a mark for you
3.3
3.4
3.4.1
It is stating the obvious, but long written assignments will require a lot of marking time, yet this is
one of the most common reasons why staff feel overloaded with marking or may miss feedback
deadlines. If the ability to produce long written reports is important to the aims of the course,
then consider avoiding such assignments at the beginning of a course where rapid feedback will
be of particular value to students.
3.4.2
As already indicated in Section 3.2.4, marking rubrics can offer a lot of information to students
about expectations, and help markers by giving a rapid vehicle for feedback. The relevant
section of a rubric can be highlighted quickly to provide an instant statement to the student
about the quality of their work, and this can be seen in context of the requirements for the work
to have gained a higher mark.
Hattie, J. & Timperley, H. (2007) The Power of Feedback. Review of Educational Research, 77 (1)
pp81-112.
Version 1.1 August 2015
GUIDE TO ASSESSMENT OF TAUGHT COURSES
p. 20
3.4.3
Statement banks
Many staff will find themselves writing or typing the same statements to students again and
again when assessing work. Statement banks can be generated in word processing packages
or spreadsheets, grouping statements of a similar nature, and either copying and pasting on to a
mark sheet or using a coding system to alert students to the relevant statement. See also the
next section on electronic marking.
3.4.4
Electronic marking
While it is possible to add comments to word-processed documents and pdf files, greater
efficiencies are to be gained using packages such as Grademark in Turnitin. This has the
advantage of providing a plagiarism detection tool with the ability to set up rubrics specific to the
assignment, and statement banks specific to the marker. Settings can be used to decide when
marks and comments can be viewed by students, and students can access the submitted file
with all its comments without the need to send anything to them.
Grademark also offers the marker the opportunity to record a short audio file, which some
markers may find useful, since most people speak quicker than they write or type.
A disadvantage to be aware of is that if blind second marking is required, additional copies of
the submission need to be made.
3.4.5
Feedback should be given in sufficient detail for a student to understand why they have been
given a numerical mark and provide them with information on how they can improve their
performance in the future. Statements should make reference to the intended learning
outcomes of the assignment. It is recommended that feedback has positive elements, and
relates first to the strengths of the work, and what the student should continue to do in the
future. It is recommended that attention is then turned to weaknesses and suggestions for
improvement.
It is important that comments should be made about the piece of work, rather than relating to
attributes or characteristics of the individual student.
3.4.6
Timeliness of feedback
It has already been noted in section 3.1 that feedback should be provided as soon as
practicable and no later than 20 working days after the submission deadline. For some
assessment types, such as oral presentations, assessment rubrics and comments may be
completed and given to the student immediately, and or supplemented with a written record
later. For longer, more complex assignments, other mechanisms may be considered to offer
some feedback to students when it is likely that individual written comments will take a
significant period of time to prepare (section 3.4.8). Course teams should bear this in mind
when reviewing the assessment strategy for the course, to ensure that they are not burdening
themselves with unrealistic timescale targets.
p. 21
3.4.7
If individual written feedback cannot be provided rapidly, some of the following may be
considered, especially when an exam or other assessment deadline falls before full feedback
can be given:
Oral feedback: to communicate the outcome and main feedback points for an oral
presentation, debate, or poster presentation. Oral feedback may also act as a useful
supplement to clarify written feedback, especially for students with learning difficulties or
English as an additional language.
Group feedback: may be appropriate for group work, but also to communicate commonly
encountered strengths and weaknesses on individual assignments in a setting which will
allow students to ask questions and seek clarification where necessary. This can be done in
specific sessions, by making use of web-conferencing tools, or as an introductory session to
a later module, if time allows.
Summaries: are another way of sharing common strengths and weaknesses identified on
assignments, and could be shared via a group e-mail or VLE post.
Preliminary sample marking for shared feedback: for larger classes, with a long written
assignment, rapid feedback can be generated by marking a sample and sharing some
strengths and weaknesses identified without indicating to students whose assignments have
been marked. When the feedback is received (either as a summary or in a group session)
soon after the submission deadline, students can consider the comments against the
standard of their submitted work, and can also use the feedback to improve their next
assignment.
3.4.8
The QAAs Quality Code for Higher Education (Chapter B6) 6 suggests that sound practice in
developing assessment literacy includes engagement in dialogue between staff and students to
share an understanding of making academic judgements.
Use of examples and/or self and peer assessment activities may be particularly appropriate in
the context of formative assessment and enable students to experience the complex nature of
professional judgment, where standards and expectations are derived from their course
descriptions. An NUS consultation on feedback recommended that feedback from peers, and
self-assessment can play a powerful role in learning by encouraging reassessment of personal
beliefs and interpretations.7
Peer and self-assessment exercises require production of clear marking criteria (as noted in
Section 3.2). These can be used with problem solving exercises in class, to help students
prepare drafts for summative assessment. This supports student learning without increasing
staff marking loads.
http://www.qaa.ac.uk/Publications/InformationAndGuidance/Documents/B6.pdf
http://www.nus.org.uk/en/advice/course-reps/feedback-what-you-can-expect-/
p. 22
4.1
Implications of Failure
Many of our students may not have experienced failure before, so it is useful to consider that
different emotional responses may occur to bad marks, or those which are perceived by the
student to be bad. For some students, a mark considered good by us may impact on studies
in their home country, the ability to progress to particular careers or further studies, or may
simply be perceived as a poor performance for which they may lose face to family or sponsors.
In the first instance it is good practice to help the student identify how they can reach the
desired outcome on subsequent assignments, but will also be useful to be aware of (and use):
4.2
The Senate Handbook on Academic Misconduct8 should serve as the main point of reference
for definitions and procedures. The main problems encountered are:
plagiarism: attempting to use another persons work as ones own or failing to use correct
referencing;
cheating: including copying or theft of another students work, collusion, falsification of
results or using a third party to complete an assignment.
Strategies to help students avoid misconduct include setting appropriate expectations and
alerting students to information regarding academic misconduct at the start of the course,
providing guidance on good assessment practice including referencing from the outset and
providing reminders when assignments are set.
4.3
the components of each course (modules, projects and assessments) collectively address
the course level ILOs in a logical progression;
the assessment of a course includes variation (to promote development and assessment of
a variety of skills), and includes methods which lend themselves to rapid feedback where
appropriate (for example the first summative assessment may have had several feedback
sessions after short formative assessments so that there are opportunities for students to
improve their work, or presentations made in advance of a long written piece may ensure
that students understand new concepts before applying them in their assessments);
https://intranet.cranfield.ac.uk/AcademicServices/Pages/AddressingStudentBehaviour.aspx
p. 23
hand-in dates, feedback dates and any other examination dates are carefully planned
through the year to ensure feedback is received in time to have an impact on the next
assignment, and hand-in dates (or exam dates) are not too close together.
Staff should be encouraged to enter submission dates and feedback dates into their work
calendars and block out sufficient time to do marking and feedback.
p. 24
Appendices
Appendix 1: Assessment types with advantages and disadvantages
(taken from Phil Race (2006) The Lecturers Toolkit: A practical guide to assessment, teaching and learning, Taylor and Francis; Oxford Brookes University
Selecting Methods of Assessment at http://www.brookes.ac.uk/services/ocsld/resources/methods.html; HEA Different forms of assessment at
http://www.heacademy.ac.uk/resources/detail/subjects/swap/different-forms-assessment)
*Design and marking tips are also available in The Lecturers Toolkit
Assessment
type
S = summative
F = formative
Formal written
examinations*
(S)
Demonstrate
knowledge
Advantages
Disadvantages
Time efficient
Cost-effective
Less plagiarism
Equality of opportunity within a timeframe
Essay*(S)
Develop arguments;
evaluate;
assess;
judge; communicate
effectively in writing
p. 25
Assessment
type
S = summative
F = formative
Integrating
Assessments
(S)
Advantages
Assimilate information
from different parts of
a
course;
demonstrating
a
range of M-level skills
Open Book or
Open
Note
Exams*(S)
Structured
Exams or class
tests such as
Multiple Choice*
(S or F)
Reviews
and
Annotated
Bibliographies*
(S)
Reports (S)
Disadvantages
Retrieve appropriate
information
Demonstrate
knowledge
Critical evaluation
Perform procedures;
evaluate;
assess;
judge; communicate
effectively in writing;
skills
relevant
to
many jobs
p. 26
Assessment
type
S = summative
F = formative
Debate (S or F)
Advantages
Communicate
verbally; develop and
defend and argument;
Generating a body of
work with a common
theme
Oral
exam Communicating
(viva)* (S)
verbally; responding
to questions
Oral
Communicating
presentation*(S
verbally; using visual
or F)
aids
Portfolio* (S)
Practical
work*(S or F)
Experimental
design (S or F)
Describe
the
requirements
/
process
of
an
experiment
Proposal or bid Describe
the
(S or F)
requirements of a
project in terms of
time,
cost
and
resources
Disadvantages
p. 27
Assessment
type
S = summative
F = formative
Project
work*
(S)
Written analysis
of cases (WAC)
(S)
Research paper
(S)
Poster
presentation* (S
or F)
Advantages
Communicate
writing
Communicating
concepts visually
in
Disadvantages
Can be integrative
Can identify the best students
Authentic (real life)) assessment
Opportunity to demonstrate
critical thinking,
application of theoretical knowledge,
integration of complex systems,
decision-making
evaluation
synthesis
For many, research paper writing skills will be
useful after graduation
A nice change from standard written
assessments!
A skill of use to those continuing in academia
/ research
Can include peer learning / assessment
p. 28
Subjectivity
may
creep
into
assessment
(presentation versus content)
Students may not perform well while being observed
Cant be anonymous, so may involve bias
Intended learning outcomes (ILOs) should provide course designers, teachers and students with
a clear and shared statement of the scope and level of learning which a diligent student is
expected to have acquired by the end of the module or course. The design of the course, the
teaching activities, and the assessment should all be aligned so that the ILOs are transparently
and effectively achieved. At award level, the ILOs are articulated in the tables provided in the
course specification, and provide a broad perspective on the expected capabilities of a graduate
of the course. At module level, the ILOs should be detailed in a module descriptor and relate
more specifically to the intended syllabus of that module.
Effective ILOs should therefore be expressed in terms of what a student will be able to do as a
result of the course, module, lesson, or whatever. Assessment should test that capability
accurately, and formative assessment should be aimed specifically at helping the student to
develop it.
ILOs should be expressed using active verbs, and be presented in a specific context and
define the nature of the object, to show learning that can be measured at the appropriate level.
Framing ILOs in this way will help to ensure transparency for both teachers and students.
Example:
By the end of this course a diligent student should be able to
Analyse experimental data from a clinical trial
Verb
object
context
Verbs should be carefully selected to represent the type of activity which would be expected of
graduates of the course, indicate the level of learning required (see Blooms Taxonomy of
Educational Objectives below), and assessable. Verbs such as understand and appreciate
are considered a poor choice for ILOs as they are difficult to measure and assess directly.
p. 29
Active verbs
Knowledge
define
repeat
record
list
recall
name
relate
underline
Comprehension
translate
restate
discuss
describe
recognise
explain
express
identify
locate
report
review
tell
Application
interpret
apply
employ
use
demonstrate
dramatise
practice
illustrate
operate
schedule
sketch
Analysis
distinguish
analyse
differentiate
experiment
test
compare
contrast
criticise
diagram
inspect
debate
question
relate
solve
examine
categorise
appraise
calculate
Synthesis
compose
plan
propose
design
formulate
arrange
assemble
collect
construct
create
set up
organise
manage
prepare
Evaluation
judge
appraise
evaluate
rate
revise
assess
estimate
p. 30
a systematic understanding of knowledge, and a critical awareness of current problems and/or new
insights, much of which is at, or informed by, the forefront of their academic discipline, field of study or
area of professional practice;
a comprehensive understanding of techniques applicable to their own research or advanced
scholarship;
originality in the application of knowledge, together with a practical understanding of how established
techniques of research and enquiry are used to create and interpret knowledge in the discipline;
conceptual understanding that enables the student:
deal with complex issues both systematically and creatively, make sound judgements in the absence
of complete data, and communicate their conclusions clearly to specialist and non-specialist
audiences;
demonstrate self-direction and originality in tackling and solving problems, and act autonomously in
planning and implementing tasks at a professional or equivalent level;
continue to advance their knowledge and understanding, and to develop new skills to a high level;
and holders will have the qualities and transferable skills necessary for employment requiring:
p. 31
MTech
MSc
MDes
MBA
PgDip
PgCert
Masters graduates should expect to have a full and comprehensive knowledge of their
subject area (rather than just key aspects);
10
Courses developed for the MOD are an exception to this, with registration periods of Masters: 5 years, PgDip 4
years and PgCert 3 years.
p. 32
Masters graduates should have a critical awareness of current issues and new
developments (rather than just being aware of them);
A significant proportion of the teaching material should be at the forefront of the discipline
(rather than just one or two examples to illustrate current trends);
Masters graduates should be able to discern and select appropriate techniques to apply to
a given problem (rather than just being able to apply one that has been highlighted to them),
and be fully aware of the limitations of the variety of research techniques available to them;
Masters graduates should have a practical understanding of how established research
techniques can be applied to create knowledge or advance understanding;
Masters graduates should therefore be contributing to the body of knowledge in the field
through original research or new insights and/or application of existing knowledge (rather
than just reviewing and summarising existing knowledge);
Masters graduates should be able to identify and evaluate critically current research and
advanced scholarship (rather than just describe and comment on articles and items
presented to them);
Masters graduates should be able to make confidently sound judgements in the absence of
complete data (rather than just be aware of the limitations and ambiguity of knowledge).
Masters graduates should be able to manage and expand their learning, without continuous
supervision (rather than just apply and consolidate);
Masters graduates should be able to reflect upon the scope of research projects and
identify by themselves new avenues to explore (rather than just undertake a defined
project);
Masters graduates should be able to communicate their conclusions, including their
assumptions and methodologies, to both specialist and non-specialist audiences (rather
than just communicating the outcomes of any research);
Masters graduates should have advanced skills in furthering their own personal
development, and be able to identify their own strengths and weaknesses to a sophisticated
level (rather than just be able to continue to develop skills as appropriate);
Masters graduates should be able to make clear decisions in complex and unpredictable
situations (rather than just in situations where there are elements of complexity or
unpredictability).
All courses will be expected to demonstrate that the provision of teaching and standards of
student learning are clearly above honours level provision.
p. 33
70% - 79%
Very Good
60% - 69%
Good
50% - 59%
Satisfactory
40% - 49%
Poor
0% - 39%
Very Poor
Criteria / Descriptor
(N.B. not all may apply for each piece of work or type of assessment)
Demonstrating a comprehensive knowledge and understanding of the subject and subfields.
All stated intended learning outcomes exceeded.
High capacity for critical evaluation.
Novel application of the subject matter to a specific context.
Requiring a student to have:
Undertaken extensive further reading.
Produced a well-structured piece of work.
Demonstrated excellent communication skills.
Exercised a high level of original thought.
Demonstrating an extensive knowledge and understanding of the subject and subfields.
Many stated intended learning outcomes exceeded.
Very good capacity for critical evaluation.
Effective application of the subject matter to a specific context.
Requiring a student to have:
Undertaken substantial further reading.
Produced a well-structured piece of work.
Demonstrated very good communication skills.
Exercised a significant level of original thought.
Demonstrating a good knowledge and understanding of the subject and subfields.
All stated intended learning outcomes met, with some exceeded.
Good capacity for critical evaluation.
Competent application of the subject matter to a specific context.
Requiring a student to have:
Undertaken some further reading.
Produced a well-structured piece of work.
Demonstrated good communication skills.
Demonstrating a satisfactory knowledge and understanding of the subject and subfields.
All stated intended learning outcomes met.
Standard critique of the subject matter.
Adequate application of the subject matter to a specific context.
Requiring a student to have:
Undertaken adequate further reading.
Produced an adequately-structured piece of work.
Demonstrated basic but satisfactory communication skills.
Demonstrating an inadequate knowledge and understanding of the subject and subfields.
Most stated intended learning outcomes met.
Lacking critique of the subject matter.
Limited application of the subject matter to a specific context.
Requiring a student to have:
Undertaken some relevant reading.
Produced a piece of work with a simple structure.
Demonstrated marginal communication skills
Demonstrating a lack of knowledge and understanding of the subject and subfields.
Many stated intended learning outcomes not met.
Absence of critique of the subject matter.
Lacking application of the subject matter to a specific context.
Requiring a student to have:
Undertaken inadequate reading.
Produced a poorly-structured piece of work.
Demonstrated poor communication skills.
p. 34
Owner
Department
Implementation date
Approval by and date
Version number and date of last review
Next review by
Academic Registrar
Education Services
1 August 2015
Academic Registrar July 2015
Version 1.1, August 2015
July 2016
p. 35