Marking Lab Reports

55 downloads 19004 Views 275KB Size Report
Numerous courses at Ryerson include lab reports as a method of assessing student work. ... If you would like to construct your own rubric, some examples follow: ... 0-10 One or more sub-sections (e.g. participants, design, apparatus or ...
Marking Lab Reports Numerous courses at Ryerson include lab reports as a method of assessing student work. Marking these labs can often seem like an overwhelming task. The LTO has compiled these best practices to assist Ryerson instructors in developing an efficient and fair method of grading lab reports. Depending on the faculty, lab reports can come in a variety of formats, however there are certain tips for marking that apply to them all. Most importantly, be “clear about the assignment expectations (using checklists or assignment descriptions) and provide consistency for how the work is graded (using some form of grading sheet like a rubric)” (Black, Gach, & Kotzian, 1996) The following suggestions should help make the grading of lab reports easier: 













Determine the criteria for grading. If criteria have been provided by the supervising instructor, read them carefully ahead of time, clarifying any uncertainties before beginning the marking process. If criteria haven‟t been provided, prepare a detailed set to follow as you grade. When developing your criteria, decide how heavily you will weigh content versus form. “Content refers to the substance of the report: data, results, interpretations, conclusions. Form refers to how the substance is presented: organization of material, graphs and tables, clarity of writing, and grammatical correctness of sentences.” As you mark, annotate your criteria, “this helps you become more efficient as you encounter the same mistakes repeatedly,” providing a “record of how you handled the same error previously.” Make sure students understand the criteria. Provide the class with a copy of the criteria that clearly indicates what an “A” lab or “B” lab, etc., will require. This document should also state any policies on late reports or make up work. “Check with the Supervising Instructor of the course to see if there is a standard late policy for the sections. If there isn't, choose one that fits with your philosophy and apply it consistently throughout the term.” This document will “serve as a useful reference tool should a student have a question about a grade received” and reduce possible misunderstandings. When grading lab reports, read through several before beginning to mark. “This allows you to form a baseline impression for the class before grading individual reports. It also helps to form a checklist of criteria that you can refer to when grading, to ensure consistency in your marks, and to give students a specific understanding of what you are looking for in that report.” Give points for critical thinking and analysis. “Students who do not get the desired results from an experiment, but make a thoughtful analysis of why or of what should have occurred,” should not be penalized. “Evidence of good interpretation or analysis involves identification of patterns or contradictions and a specific, plausible, and well-supported explanation for these results.” Return labs promptly with useful feedback. Leave “comments on lab reports and return them with sufficient time for students to learn from the comments before turning in their next report. When providing feedback, consider describing difficulties that you experienced when

Prepared by Michelle Schwartz, Research Associate, for the Teaching Assistant/Graduate Assistant Program, Learning & Teaching Office, http://www.ryerson.ca/lt/taga/index.html

1



reading the report or using questions to stimulate student reflection. For example a comment such as „Could there be another explanation for why your value is higher than expected?‟ is more productive than a statement such as „Not complete.‟ Don’t overwhelm the students with criticism. “Too many comments on a page can be daunting. Instead, pinpoint a few key issues for each report.”

Adapted from “Fast and Equitable Grading,” Centre for Teaching Excellence, University of Waterloo, and “Best Practices for Grading Laboratory Reports,” Center for Research on Teaching and Learning, University of Michigan.

Rubrics A good rubric will make marking easier, faster, and more consistent. Rubrics should be based on the criteria developed by you or your Supervising Instructor. Sample fillable Excel spreadsheets for numerous marking schemes have been created and made available for free download by LabWrite at North Carolina State University: http://labwrite.ncsu.edu/instructors/excelsheets.htm If you would like to construct your own rubric, some examples follow:

Excerpt of scoring guide for lab report in Biology Introduction (15 marks total) Background information (5 marks) 0 No background info 1 Background info only from lab manual 2-3 Background info from manual and textbook, superficial explanations of fluid mosaic model or other relevant background 4 Background info includes good explanations of fluid mosaic model or other relevant background. 5 Background info includes good explanation of fluid mosaic model with one extra piece of info on the effect of heat/cold on membranes, information from their journal article, or info on beets, betacyanin or tonoplasts (or exceptional explanation of other relevant background with extra info) Purpose, objectives clearly stated (3 marks) Ex. „We are trying to measure temperature-induced damage to beet membranes by quantifying the betacyanin that leaks from the beet disks.‟ Full marks given even if the objectives are spread out over a few sentences Organism studied is stated (1 mark) „Beets or Beta vulgaris’ Hypothesis is clearly stated (3 marks) Hypothesis should include what happens in high, low, and intermediate temperatures OR which temperatures will cause the most and the least damage (as long as they include all three „ranges‟). Prepared by Michelle Schwartz, Research Associate, for the Teaching Assistant/Graduate Assistant Program, Learning & Teaching Office, http://www.ryerson.ca/lt/taga/index.html

2

Deduct marks if hypothesis is lacking

Relevance of study is indicated (3 marks) 0 No attempt to include relevance 1 Weak relevance, not well explained (trying to determine what temperature beets „like‟, eg.) 2 Weak relevance, but it is well explained, or good relevance but not well explained 3 Good or great relevance, well explained (important for food storage and transport, food processing, agriculturally important related crop- in sugar beets, temperature damage to membranes may limit growth range, easier purification as a source of betacyanin for dyes/vitamins, easier purification of sugar from beets, etc.)

From: http://www.gradstudies.ualberta.ca/profdev/EffectiveGradingAssessBiologyPritchard.pdf

Sample Marking Scheme for Research Skills Lab Reports Title (2 marks) 0 1 2

No title, or too vague. e.g. "Lab report", "Free Recall", etc. Too long, or does not identify the independent and/or dependent variables. Contains superfluous phrases, such as "An investigation into.." or "An experiment on..." Identifies the independent and/or dependent variables, not too vague or too long, encapsulates the purpose of the report well.

Abstract (12 marks) 0-5 5-6 7 8-12

No abstract at all, or an inappropriate abstract (e.g. far too long or fails completely to adequately and accurately summarize the study). The material is mostly relevant, but has been set out in a confused or disorganized way. Written correctly, but has missed out something, e.g. the implications of the results. Clear and succinct (150 words at most) summary of the aims, methods, results and conclusions of the study. Includes all the necessary information, and is well written.

Introduction (20 marks) 0 0-10 10-11 12-14

15-20

Section missing completely. Very short and skimpy, with no attempt to include any references to relevant theoretical and empirical work. Has included everything that was in the relevant handout, but elements are missing e.g. no justification for the study, no extra reading, poor structure, no hypotheses. Has included everything that was in the relevant handout, and some evidence of extra reading, but the structure isn't very clear and appears disjointed. OR it is well written, but shows no evidence of any extra reading. Clearly written, well structured, with evidence of relevant extra reading, flows well. Identifies the main aims, and ends with a clear outline of the study's hypotheses. Also has something novel in it, compared to the handouts that were supplied, and includes the rationale for performing the study.

Method (20 marks) 0-10

One or more sub-sections (e.g. participants, design, apparatus or procedure) are missing, confused, or parts are included under the wrong sub-section.

Prepared by Michelle Schwartz, Research Associate, for the Teaching Assistant/Graduate Assistant Program, Learning & Teaching Office, http://www.ryerson.ca/lt/taga/index.html

3

10-11 12-14 15-20

Somewhat confused and bits are missing within subsections. Parts have been included under the wrong headings. Good structure, but some relevant information has been omitted. Contains all of the relevant information about the methods used; clearly and systematically described in such a way that a naive reader could replicate the study from this description. Correctly describes the formal design of the study, including an accurate specification of the independent variable(s) and dependent variable(s) used.

Results (20 marks) 0-10 10-11

12-14

15-20

Has graphs or tables, but without any accompanying written explanation. OR has some writing, but no tables or graphs. Does not appear to have understood the results. No graphs, or graphs are in the wrong place (e.g. in an appendix). Only skimpy or inaccurate explanations supplied. Ha included irrelevant graphs, or has included the raw data in the results section. Standard deviations or standard errors missing from tables or graphs, figures/tables labeled incorrectly. Does show some understanding, and has presented the information in a logical format. Logical and clear presentation of relevant descriptive and inferential statistical results. Clear, well-labeled figures and tables, with a clear accompanying written description of what they show, in the context of the study.

Discussion (20 marks) 0-10 10-11 12-14 15-20

Skimpy (e.g. one paragraph) with no attempt to relate results to relevant theoretical and empirical research. Poor structure, things in the wrong order, shows little understanding of what the study was about, what the results mean, or how they relate to previous work. Poor structure, but contains the essential elements. OR the structure is good, but elements are missing. Clear summary of main results, followed by a successful attempt to relate the findings to relevant previous theoretical and empirical research. Intelligent evaluation of the strengths, weaknesses and limitations of the study that was performed, and sensible suggestions for possible improvements and extensions to it. Well organized and clearly written.

References (6 marks) Maximum marks will be awarded if the references in the text and in the reference list conform in all respects to the formatting conventions laid out in the 5th edition of the American Psychological Association's Publication Manual. References in the text should consist of author(s) surnames (no initials) and date only; references in the reference list should be full references, in alphabetical order. References in text and reference list should match i.e. there should be no missing references.

APPENDICES (no marks): All appendices should be included: copies of handouts, SPSS printout or other evidence of work where appropriate, etc.

From: http://www.sussex.ac.uk/Users/grahamh/RM1web/RM1%20report%20marking%20scheme%20 2008.pdf Prepared by Michelle Schwartz, Research Associate, for the Teaching Assistant/Graduate Assistant Program, Learning & Teaching Office, http://www.ryerson.ca/lt/taga/index.html

4