Baltimore, Baltimore City County
Jun 24, 2014

The psychometrician implements psychometric procedures for educational testing programs, and must be competent in the methods of assessment to include assessment design and development. The psychometrician is a member of the Office of Assessment and Evaluation (OAE), which provides learning assessments, program evaluations, student outcomes, and research support to all educational programs of the Johns Hopkins University School of Medicine. The position will interact and collaborate with a variety of faculty, staff, and students from a wide range of fields.


Conducts item and test analysis, equating, standard setting, score reporting, analysis, reliability and validity studies and other psychometric activities. • Conducts routine psychometric services to support faculty and staff. • Collaborates with subject matter experts to improve current assessments • Plans, coordinates, and performs statistical analysis for basic and/or complex assessment or program evaluation assignments. • Accountable for basic and complex statistical design and analysis decisions such as variance estimations (weighting), sample design, statistical modeling, and psychometrics. • Provides interpretation of results to diverse audiences. • Works with faculty on research studies and provides psychometric guidance • Participates in the design, development and maintenance of assessments • Provides support for an assessment management system and institutional database • Other duties as assigned.


To apply, please visit, create and save your application, then click “Find your new job”: requisition #61881.  Johns Hopkins University is an equal opportunity/affirmative action employer committed to recruiting, supporting, and fostering a diverse community of outstanding faculty, staff, and students.  All applicants who share this goal are encouraged to apply.

Masters in Psychometrics, Evaluation, Assessment, Education Measurement, Psychological Measurement, or a related field with an emphasis on psychometrics. At least twp (2) years of experience in test design and development, analysis including experience with assessment management systems.

Experience in test theory (IRT and Classical) • Advanced training in psychometric research including item response theory, scaling and equating methods. • Advanced knowledge of measurement topics generalizability theory, Bayesian methodology, and various standard setting methodologies is desirable. • Experience writing syntax/code for data manipulation and statistical analyses using SAS or SPSS or R • Familiarity with medical education, curriculum development, or assessment standards associated with LCME, ACGME and other accrediting agencies helpful. • Ability to work positively and collaborate effectively with a wide range of individuals, including students, faculty, and staff. • Excellent oral and written communication skills.


PhD preferred.