Program Outcome Assessment Professional III - Manager, Exams (College of Medicine-Phoenix)
COM Phoenix Academic AffairsDepartment Website Link:
Greater Phoenix AreaAddress:
Phoenix, AZ USAPosition Highlights:
The Office of Assessment and Evaluation supports institutional effectiveness through consultation with faculty, staff, and community partnerships on the development of instruments and experimental designs informed by standard principles of measurement, assessment, and evaluation, including classroom tests, faculty and staff evaluation formats, and academic program development and evaluation.
The Examinations unit within the Office of Assessment and Evaluation, is responsible for test construction activities, curriculum mapping, administration of examinations for undergraduate medical curriculum and pipeline programs, data analysis and institutional outcomes reporting.
Under general supervision, this position will ensure testing resources and resource deadlines are met and will liaise with faculty and staff in order to perform essential duties. The functions of the position also entail regular student interaction, room scheduling, and planning resources for regularly scheduled exams, special accommodations, and other assessment-related needs. This position interfaces with all other departments, including basic science and clinical faculty, registrar, clerkships staff, other OAE staff, instructional technology, Information Technology staff, student development, admissions, and pre-clerkship curriculum staff.
This position requires occasional Sunday work to proctor exams.
The University of Arizona College of Medicine – Phoenixanchors the 28-acre Phoenix Biomedical Campus in the heart of the Valley of theSun. The College inspires and trains individuals to become exemplaryphysicians, scientists and leaders who are life-long learners and inquisitivescholars. We embrace professionalism, innovation and collaboration to optimizehealth and health care for all. The Phoenix Biomedical Campus embodies theUniversity’s priorities of engagement, partnership, innovation, and synergy inits world-class academic and research initiatives, with clinical facilitiesthroughout Greater Phoenix. The campus also houses the UA Colleges of PublicHealth, Pharmacy, and Nursing, as well as Northern Arizona University’s Collegeof Health and Human Services, the Translational Genomics Research Institute(TGen) and the International Genomics Consortium.
Outstanding UAbenefits include health, dental, and vision insurance plans; life insurance anddisability programs; paid vacation, sick leave, and holidays; UA/ASU/NAUtuition reduction for the employee and qualified family members; stateretirement plan; access to UA recreation and cultural activities; and more!
Duties & Responsibilities:
Asa cost-saving measure related to the impact of COVID-19, Furlough andFurlough-Based Salary Programs have been approved by the Arizona Board ofRegents. All new hires subject to the programs will be notified in accordancewith adopted Furlough and Furlough-Based Salary Programs guidelines and will berequired to comply with all measures. To learn more about the programs andwhether this position is affected, please visithr.arizona.edu/FY-2020-2021-Furlough-Program.
- Supervise all exam proctoring and serve as the main administrator of medical examinations for years 1-4, ensuring adequate proctors, venues, IT requirements and special student accommodating.
- Serve as Chief Proctor of Examinations, train and supervise proctoring staff, act as back up proctor as needed.
- Troubleshoot exam venue maintenance problems if they occur.
- Monitor budgets for exam vendor contracts, testing equipment and supplies.
- Manage and coordinate administrative exam support services; testing facilities, technology resource planning, test security, scores distribution, student record management, and other office support services.
- Manage procurement of all NBME diagnostic and shelf examinations.
- Liaise with ExamSoft vendor to provide client feedback and lobby for platform enhancements to support the COM needs.
- Develop and oversee all financial aspects of ExamSoft and NBME exam animations and other resources necessary to carry out assessment strategies across Years 1-4.
- Design and implement expanded assessment opportunities within ExamSoft such as short answer, essay, and reflective writing while liaising with course directors to map to their course needs in the assessment domain.
- Design and implement, along with course directors, end of Year 1 NBME diagnostic examination; explore and make recommendations to ADCA&PE and CC about additional use of NBME examination items such as additional diagnostic examinations and potential uses of such items I. Regular block examinations as a means for assessment integration.
- Design and implement expanded student-specific ExamSoft reports for student development and student use to improve performance across entire curricular spectrum; to include all block, course, and clerkship uses of ExamSoft assessment strategies used for years 1-4.
- Manage grade data sharing to ensure course directors and student affairs have just-in-time data of student performance metrics.
- Monitors and resources the post-Exam Review sessions
- Conducts data mining and provides longitudinal curriculum exam data performance measures; surveils and presents data on medical knowledge per curricular block and per academic year; provides data to Office of Assessment and Evaluation.
- Lead all exam review team meetings, ensuring that all examination items are mapped and tagged per best practices, including Blooms level, session learning objectives, CCT tags, discipline tags, and author tags
- Liaise with the CC, providing in depth data analyses on all examinations including cohort data of mean scores, Blooms levels, discrimination indices, and other psychometric data streams; make recommendations to course directors and CC concerning best examination item writing to ensure optimal student assessment and performance outcomes
- Liaise with other members of OAE, Student Affairs, and resident biostatisticians to provide ongoing prognosticating rubrics to track student success and struggles to ensure optimal student performance a rose years 1-4; to include prognosticators for Step exam success as well as influences, if any, of behavioral competencies in such success/struggles.
- Review current processes and recommend policy or procedural changes to improve high-stakes exam operations.
- Provides technical and resource assistance to Block Exam Review Team subcommittees, which includes editing, proofing and tagging of exam questions.
- Actively participate in appropriate committees such as AES, CC, CCS, and BCTS as lead resources for ExamSoft and NBME assessment strategies.
- liaise with NBME and inform COM leadership of any changes in Step, diagnostic, and shelf examination initiatives.
- Work closely with other Office of Assessment & Evaluation employees to learn One45 and general assessment & evaluation procedures.
- Responsible for the recruitment, training and supervising activities for testing and exams.
- Cross train other employees in the office of Assessment & Evaluation on the use of ExamSoft.
- Responsible for implementation of workflow procedures.
- Responsible for orientating and conducting training of new staff.
- Resolves issues relating to staff escalations.
- Works with staff to maintain and meet deadlines.
- Maintains work schedules of team.
- Communicates discrepancies and issues with senior management.
- All other duties as assigned.
- Minimum of 5 years of relevant work experience is typically required.
- Bachelor's degree or equivalent advanced learning attained through professional level experience required.
- Knowledge of processes to conduct needs assessments.
- Skill in designing materials and presentations to meet needs assessed.
- Ability to implement training, session reviews, and follow-up procedures.
- Knowledge of processes for dissemination of results through presentations, reports, and publications.
- Skill in both verbal and written communication. *Skill in establishing and maintaining effective working relationships and establishing and facilitating work teams.
- Ability to develop proposals for external funding of projects.
- Skill in planning, budgeting, implementing and evaluating projects.FLSA:
ExemptFull Time/Part Time:
Full TimeNumber of Hours Worked per Week:
Instructional and Assessment ServicesBenefits Eligible:
Yes - Full BenefitsRate of Pay:
$47,048 - $65,344 Annually, Depending on ExperienceCompensation Type:
salary at 1.0 full-time equivalency (FTE)Grade:
8Career Stream and Level:
Program Outcome AssessmentJob Function:
Instruct & Assessment ServicesType of criminal background check required::
Name-based criminal background check (non-security sensitive)Number of Vacancies:
1Target Hire Date:
1/24/2021Expected End Date:
Contact Information for Candidates:
College of Medicine-Phoenix, Office of Human Resources
11/17/2020Open Until Filled:
YesDocuments Needed to Apply:
Resume and Cover LetterSpecial Instructions to Applicant:
Application: The online application should be completed in its entirety. Blank or missed information may be considered an incomplete submission.
Letter of Interest: Should clearly indicate how your skills and professional employment experience meet the Minimum and the Preferred qualifications (if applicable).
The University of Arizona has currently adopted a remote working environment in accordance with guidelines recommended by the CDC. Until further notice, interviews for this position will be conducted remotely.Diversity Statement:
At the University of Arizona, we value our inclusive climate because we know that diversity in experiences and perspectives is vital to advancing innovation, critical thinking, solving complex problems, and creating an inclusive academic community. As an Hispanic-serving institution, we translate these values into action by seeking individuals who have experience and expertise working with diverse students, colleagues, and constituencies. Because we seek a workforce with a wide range of perspectives and experiences, we provide equal employment opportunities to applicants and employees without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity, or genetic information. As an Employer of National Service, we also welcome alumni of AmeriCorps, Peace Corps, and other national service programs and others who will help us advance our Inclusive Excellence initiative aimed at creating a university that values student, staff and faculty engagement in addressing issues of diversity and inclusiveness.