Go to the Reports tab at the top of the screen. Find the Filter to Exam drop-down in the upper left. The default is PACKRAT®, but you can select from the list of exams your program has given. Click the arrow to the left of the Graduation Year to view the classes that graduate that year and their Composite Report, which compiles all the scores into a single spreadsheet. Click the class row to show the versions of the exam that class has taken and the Performance Report comparing the cohort’s performance on that form to the national average. If you are looking for an older report, you may need to scroll to the second page. The row count is based on the number of rows visible if all classes are maximized.
Here is an explanation of those reports and what is included:
- The Composite Score Report is an Excel file you can download that lists students alphabetically in Column A, the form the students took in Column B, the exam date in Column C, and whether the score was released to the student in Column D. For End of RotationTM exams, the format for the remaining columns differs based on when the exams were delivered.
- If the exam was administered before July 2018, the raw score of number of items correct will be displayed in Column E. The next group of columns consists of the students’ percentage of correct answers, arranged by content and task area. This will also be true of all PACKRAT exams.
- If the exam was administered during or after July 2018, you will see the scale score, from 300 to 500, displayed in Column E, and the students’ scale scores for each content and task area.
You can find the key to these columns in the second worksheet. End of Rotation™ exams in psychiatry may include an additional set of tabs. The blueprint was updated in 2016 to be compliant with DSM–5 criteria and terminology.
- The Performance Report is a PDF document that shows cohort-level averages by exam form. Every pre-July 2018 End of Rotation exam has two forms, except family medicine, which now has three forms. After July 2018, all forms are combined into a single report, since the scores are equated and have a single set of comparative statistics. If you want to know the national average and standard deviation for a particular form, open the performance report for that form. At the top of this report, you will see both the national data and the cohort data. National statistics include performance on both forms, both in the content categories (Arrow A) and in the overall average (Arrow B).
PACKRAT Performance Reports also divide the test takers by their progression through the program. If the exam event was for first-year students, the data for your cohort will appear in Year One, and Year Two will be blank. You will have national comparative statistics for both years.
Student Score Reports are available in a few places. The primary location is in the Students tab behind the Exams link. You can also view them in the Exam Event boxes within the Exam Scheduling tab. More information on student score reports can be found here.
Please note: We do not disclose to students on their reports which from they took. This is a security measure so that they do not compare answers and reconstruct forms.
For more information on national data, please visit PAEA's Assessment webpage.