Albany, NY
May 11, 2017
Institution Type
Four-Year Institution
7 Columbia Circle, Albany, NY 12203

Closing Date: June 10, 2017

Do you want to use your Psychometric skills to help non-traditional students earn their college degree in a mission driven organization? Excelsior College, a regionally accredited, virtual, private, nonprofit institution of higher learning is looking for a Psychometrician with a strong background in measurement and good communication skills to join our test development team at the Center for Educational Measurement!


The Psychometrician will be a member of the Psychometric group within the Center for Educational Measurement (CEM) at Excelsior College, and will work with one other Psychometrician, Data Analyst, Director of Psychometric Services, and staff from the Test Administration, Test Development, Information Technology, and Editorial groups within the CEM. The person will help implement the objectives and procedures for the psychometric analysis and evaluation of Excelsior College's international program of examinations. These examinations are taken by students to gain credit for prior learning at colleges and universities in the U.S. and at international locations.

The Psychometrician will assist in planning and coordinating the daily activities and responsibilities of the Psychometric group. The Psychometrician will conduct various aspects of statistical and psychometric programming, analysis, and interpretation. This work will involve both classical and item response theory (IRT) methods of evaluating test items, building equivalent test forms, and standard setting. The Psychometrician will be able to prioritize various projects and ensure that all work is accurately completed within defined time frames. On a daily basis, this position will deal with secure, highly confidential information.

This full-time position is based in Albany NY and occasional travel may be required.

This full-time position is based in Albany NY and occasional travel may be required.


  • Conduct classical item analysis and IRT calibrations to support test development activities for multiple choice, extended response, mixed format (multiple choice & extended response), and examinations featuring alternate item types
  • Conduct generalizability theory analysis
  • Conduct standard setting and rater training for various exams
  • Collaborate with staff from the AU test development group to construct parallel test forms
  • Automate processes and keep automated processes current for ongoing psychometric activities
  • Support the development of psychometrically sound assessments for on-line courses
  • Conduct studies required to address issues of examination and item exposure, reports of testing irregularities, differential item functioning, speediness, equating, scaling, sub-score reporting and decision consistency and accuracy
  • Write statistical computer programs (using SPSS or other programming languages) for the purpose of cleaning data files and conducting statistical and psychometric analyses
  • Carry out research in measurement theory and practice to improve Excelsior
    College examination program and contribute to the measurement profession


  • MA or MS degree in measurement, or related field, with strong relevant experience and/or training in large scale standardized assessment required
  • PhD in measurement or related field preferred
  • Coursework and/or practical training in measurement is required
  • Knowledge of computerized adaptive testing (CAT) is desirable
  • Demonstrated knowledge and/or experience in equating, standard setting, IRT
    calibration, scaling, classification consistency analysis
  • High degree of accuracy and excellent attention to detail
  • Ability to write, debug, and run statistical computer programs
  • Demonstrated proficiency in the utilization of database, spreadsheet, and word processing applications
  • Ability to work both independently and cooperatively in a team environment
  • Demonstrated excellent written, oral, and interpersonal communication skills
  • Demonstrated professional commitment to responsibly secure and maintain confidential information

Application Information

If you have problems with online submission, please call 518-464-8532. Thank you.

Note: Screening for this position will start immediately and will remain open thirty days from date of posting.

Excelsior College offers competitive compensation and a generous benefits package that includes paid time off, retirement, and excellent health insurance. Interested candidates should submit a letter of application, resume, salary history, and the names of three professional references. Please submit requested information at


Similar jobs

Similar jobs