POSITION OBJECTIVE

The Assessment Administration Manager is responsible for the assessment administration of the medical education curriculum, and ongoing and continuous quality improvement for the student assessment system. This person is responsible for the overall implementation and administration of the examinations for each of the seven Blocks in the Foundations of Medicine and Health and the clinical curriculum. This individual will work closely with the Associate Dean for Assessment and CQI and the Associate Director of Assessment, course directors and faculty in the development and implementation of the formative and summative assessments. The assessment manager will work closely with the National Board of Medical Examiners in providing support in constructing, administering, and reporting the Cumulative Achievement Examination and Comprehensive Basic Science Examination.

ESSENTIAL FUNCTIONS

1. Work collaboratively with the course directors, Academic Computing and Administrative Computing to prepare, administer, and improve formative and summative student assessments in the University Program (UP) School of Medicine. Oversee the student electronic assessment system. Monitor the students’ assignment submissions; work with information technology to correct technical issues that may arise from faculty and students regarding formative and summative assessments, following the criteria of the WR2 curriculum. (20%)
2. Manage the current program for formative and summative student assessment to ensure consistency with the principles of the WR2 Curriculum and engage in continuous quality improvement. (10%)
3. Consult and assist faculty in effective writing of multiple-choice and essay question assessments; review and edit test questions, interact with eAssessment programmers, and make recommendations regarding testing issues/problems. (10%)
4. Work with curriculum leadership to annually develop the examination schedule for medical students and the examination submission schedule and deadlines for faculty. Negotiate with faculty to set deadlines. (5%)
5. Collaborate with faculty of various disciplines to choose and write assessment questions. Review questions and provide editorial suggestions and offer advice for consistency across courses.  Statistically analyze scores following summative essay exams for review by course directors to assist in determining cut points for pass versus failure.  Provide recommendations for improvement to course directors.  Oversee timely completion and accurate reporting of grades in all course components in Year 1 and 2 curriculum to meet the LCME accreditation standard. (10%)
6. Track student exam scores throughout the Foundations of Medicine and Health Curriculum.  Meet with society deans, as appropriate, to discuss issues and provide recommendations for helping students and improve the testing environment. Monitor the remediation process and report student status to society deans and associate director of student assessment. (10%)
7. Organize and oversee the recruitment of proctors.  Provide necessary training to prepare proctors for administer summative assessments.  Troubleshoot problems during exams.  Provide feedback to proctors to foster improvement. (5%)
8. Organize and oversee the post-exam reviews.  Ensure that the reviews are conducted under secure conditions.  Work to improve the instructions and procedures for ensuring the security of the exam reviews that occur following the release of results.  Oversee individual student’s post exam reviews, when needed, to ensure that they occur under secure conditions.  (5%)
9. Comply with all FERPA regulations.  Ensure students’ exam results are released only to those with appropriate access and permissions receive access to them.  Participate in FERPA updates and comply with University and School guidelines ensuring compliance. (5%)
10. Provide support to the Scholarship in Teaching Awards program.  Maintain records of external peer reviewers; correspond regarding recruiting, assigning applications, sending follow-up reminders, and sending acknowledgements and “thank you” acknowledgements when the cycle of reviews is completed. (5%)

NONESSENTIAL FUNCTIONS

1. Plan and facilitate a mandatory session for all first year students about the technical issues involved with taking examinations in the WR2 curriculum.  Create and present PowerPoint presentation and handouts, instruct students on the policies and procedures and study tips for the curriculum.  Collaborate with information technology to solve any technological issues at each workshop. (4%)
2. Create and run Assessment Administration Student Surveys on a regular basis. Analyze results and discuss with course directors, curriculum leaders and director of academic computing.  Make recommendations for improvements or changes based on student feedback. (4%)
3. Manage Student Assessment Committee; manage meeting times, agendas, and minutes to ensure that critical assessment issues are addressed. (4%)
4. Perform other duties as assigned. Help with additional department activities, as needed.  (3%)

CONTACTS

Department: Continuous contact with the Associate Director of Student Assessment, Director of Student Assessment and Evaluations, course directors (Block Leaders), faculty, and Administrative Computing. Frequent contact with Associate Dean of Curriculum, Executive Director of Curricular Affairs, Course Managers, and the Society Deans.  Occasional contact with SOM Registrar’s Office.

University: Occasional contact with ITS. Contact with ESS Office to accommodate students with accommodations and disabilities.

External: Frequent contact with the National Board of Medical Examiners (NBME).  Infrequent contact with other universities.

Students: Continuous contact with medical students

SUPERVISORY RESPONSIBILITY

No direct supervisory responsibility.

QUALIFICATIONS

Experience: At least 3 years of experience in an academic setting.

Education/Licensing: Bachelor’s degree in education, sciences, health care, or related field; Master’s degree preferred. 

REQUIRED SKILLS  

1. Knowledge and understanding of medical school curriculum is preferred.
2. Excellent oral and written communication skills and interpersonal skills; must demonstrate the ability to effectively and professionally communicate and work with various individuals from a broad spectrum of disciplines, technical and educational backgrounds within the department, school and university, and with individuals outside the university.
3. Strong organization skills; ability to multi-task, prioritize and meet deadlines.  Must demonstrate attention to detail and accuracy, time management skills, and follow-through.  
4. Excellent customer service skills; ability to maintain effective working relationships and address the potential and current needs of faculty and students. 
5. Ability to work effectively independently and collaboratively within a team.  
6. Ability to work with sensitive information and maintain confidentiality.  
7. Effective problem-solving skills; must demonstrate excellent analytical skills, sound judgment and good decision-making. 
8. Must demonstrate flexibility and ability to work under pressure; must be able and willing to (work in a fast-paced, changing environment, and conform to shifting priorities, demands and timeline. 
9. Willingness and ability to rely on and follow instructions and pre-established guidelines to perform the functions of the job.
10. Familiarity with policies and procedures on student assessment. 
11. Proficiency in Microsoft Office and data analysis programs such as SPSS.
12. Must demonstrate willingness to learn processes and computer programs as needed.
13. Ability to act independently and perform responsibilities with a minimum of supervision.
14. Professionalism and character necessary to succeed in a demanding work environment. Good judgment and common sense. Able to maintain the highest degree of sensitivity, discretion, and personal integrity in all matters, especially when dealing with highly confidential materials.

WORKING CONDITIONS

General office working environment.  May be asked to work fluctuating schedule.