Undergraduate Teaching 2023-24

Guidelines for Examiners and Assessors: key points for all Parts

Guidelines for Examiners and Assessors: key points for all Parts

Not logged in. More information may be available... Login via Raven / direct.

General points

  1. Examiners and Assessors are required to adhere to the timetable and detailed instructions provided by the Chair of Examiners.
  2. Examiners must follow all aspects of the agreed policies on security.
  3. Form and conduct notices that detail any changes to the examinations from the previous year are published annually in the Cambridge University Reporter.
  4. External Examiners have an important role to play in our examinations. In particular, Examiners should pay due attention to comments made on their draft papers by the External Examiner.
  5. The General Data Protection Regulation (GDPR) 2018 requires that any data retained must be communicated to students on request.  The Faculty Board Office retains marks books and the students will receive transcripts giving a breakdown of their marks. Examination scripts are not normally released, but any written comments made by the Examiners (excluding ticks and minor notational marks) would need to be transcribed and made available.  Examiners must therefore adhere to the script marking guidelines given below so that data can easily be made available to students who make a request under the GDPR.
  6. All Examiners, Assessors and those involved in the administration of exams are expected to treat all aspects of the exam process, which are not included in publically available material, as confidential.  This includes details of all discussions between the Examiners, Checkers, Examinations Secretaries and the examinations support team.

Purpose of Tripos exams

  1. The purpose of the Tripos exams is to determine the extent to which candidates have achieved the aims and objectives of the lecture courses.  Exams should test students on whether they:

(a) have understood the basic principles with which they have been confronted, and their limitations;

(b) have developed skills in applying basic principles to the solution of straightforward problems, and;

(c) have developed a deeper understanding, allowing them to tackle problems that are, for them, novel.

Setting the paper for all Parts

  1. In setting the paper, Examiners should attempt to cover most of the course syllabus and no major topic should be completely omitted.  Questions should be of uniform difficulty.  Setters should study the papers and Examiners’ reports from previous years and note which questions proved satisfactory and which did not. No major changes should be made to the structure or style of papers without consulting the Chair of Examiners: it may be necessary to issue a sample paper. The best indication of the work that has been covered is obtained from the course hand-outs and examples papers.  Lecturers should always be consulted and shown the questions on their part of the course.
  2. Examiners have a tendency to set questions which are too difficult.  When a lecturer, checker, or External Examiner warns that a draft question is too difficult, history shows that he or she is almost always correct.  It is important for Examiners to act on such comments. 

Structuring the questions

  1. Exams should be structured so that very able students will distinguish themselves above the rest and less gifted, but conscientious, students will achieve a safe II.2 level mark.
  2. Questions with only one substantial point are unsatisfactory because candidates either get very high or very low marks.  Questions should whenever possible be ‘scaffolded’, i.e. structured as a series of closely linked steps. 
  3. If a question requires the derivation of a key equation en route, candidates should be specifically asked to derive it as an intermediate result.  Not all is then lost in later parts of the question if they have been unable to perform the derivation correctly.  Lengthy or difficulty algebraic manipulation should be avoided.
  4. Symbols used in questions should be clearly defined except where the definitions are systematically provided in examination data books or data sheets.
  5. It is most important that Examiners always keep in mind the time available for answering a question.  They should also remember that questions are often greatly improved by including a diagram.
  6. Essay type questions are rarely answered really well or really badly.  Engineering students may avoid essay questions because they know there is little chance of gaining high marks. If a question simply asks

‘Discuss the design parameters for a high-speed switching bipolar transistor’,

then mediocre answers can be expected.  A better way of structuring the question would be:

‘For a bipolar transistor:

(a) Explain the concept of minority carrier stored charge in the base.

(b) Outline the effect of current crowding at the base, indicating why it is deleterious and how these deleterious effects are combated.

(c) Explain what causes breakdown in the collector of a transistor and why an increase in the breakdown voltage increases the transit time for the relevant charge carriers.

Hence, discuss criteria for the design of a high-speed switching bipolar transistor.’

This type of structure will help students to provide appropriate answers, ensuring some uniformity and making for easier comparisons and better marking.  The important points expected in the answer should be identified, and form the substance of the crib.  Some open-endedness towards the end of an essay question is desirable, however, so that better candidates can display their knowledge.

Please see the Part-specific guidelines.

Checking the draft papers

  1. Checkers have a most important job.  They ensure that questions are valid, clearly expressed and of the correct level of difficulty.  The checker must write solutions for every question independently of the setter: simply accepting an Examiner's explanation without a clear understanding is unacceptable.  After checking, a detailed and easily readable crib comprising the model solutions and marking scheme is prepared by the Examiner in consultation with the checker.
  2. At this stage, the examination paper and crib should be, in the view of the setter and checker, ready for market in every respect.  This includes not only the length, difficulty, content, and style of each question, but also the presentation details such as layout (including diagrams), sentence structure, grammar, and punctuation.  If these aspects are covered conscientiously by the setter and checker at an early stage it saves everyone a very large amount of time and work later on.  It is not acceptable for semi-complete draft papers to proceed to the reading meeting.

Script marking guidelines

  1. All aspects of the marking process must be fully auditable and defensible in case of an appeal. 
  2. Examiners should adhere to the marking scheme indicated on the exam paper and crib.  The exam paper will show the approximate number of marks for each part of a question in the right margin, the mark to be level with the end of the paragraph(s) to which it refers.
  3. Scripts should be marked in red ink using the following guidelines:

i. mark to whole numbers (do not use half marks);

ii. tick or score through every page to indicate that the page has been seen;

iii. put sub-marks in the right-hand margin - these must correlate with the breakdown on the paper;

iv. circle the total mark for each question at either the start or the end of the question;

v. record the marks on the script cover sheet;

vi. keep the scripts in the correct order.

vii. no comments whatsoever should be made on the scripts.  Under no circumstances should an Examiner write any comments about a candidate’s performance.

  1. Calibrate the marking to comply with the required mark distribution. If, after about 20 scripts, it appears that adjustments will be required to produce a mark distribution in line with that required for that particular Part of the Tripos, the marking scheme can be revised slightly and the scripts remarked.  If major adjustments are required, the Chair should be consulted.
  2. When marking a large number of scripts, standards may shift slightly.  It is therefore best not to mark whole scripts at a time as some candidates may get a raw deal.  After doing the calibration described above, divide the scripts into piles, then mark Q1 right through starting with pile 1, then Q2 right through starting with pile 2, and so on.
  3. Silly arithmetical and algebraical mistakes should not normally be penalized heavily.  It is very troublesome when an early minor error gets carried through a solution: the Examiner then has no choice but to follow the whole solution in detail to check the correctness of the later work.  Questions should be structured to avoid this waste of time.
  4. Transfer the raw marks for each question to the excel markbook provided.  NB. where a candidate answers more than the required number of questions the Examiner should mark all the questions answered and then exclude from the marks recorded the question(s) scoring the lowest mark(s).  
  5. Scaling of the marks may be required by some Triposes.  In such cases, the Chair will issue instructions as to how to proceed.

 

Useful links

Last updated on 09/07/2021 14:07