Pyschometrician and Assessment Specialist
Position Number: 00104250
Primary Function of Organization Unit: The College of Education at North Carolina State University is a voice of innovation for learning across the lifespan, preparing professionals who educate and lead. Our inquiry and practice reflect integrity, a commitment to social justice, and the value of diversity in a global community. The vision of the College of Education is to lead the way in North Carolina to increase success in education and narrow achievement gaps. Consistent with NC State's land grant mission, we transform lives by emphasizing real world experiences through original research opportunities, comprehensive extension, and engagement activities and external partnerships. The College enrolls more than 1,500 undergraduate and graduate students. Our 122 faculty members together with our Friday Institute for Educational Innovation currently have more than $57 million in active research and development grants. The Department of Science, Technology, Engineering, and Mathematics Education emphasizes exemplary teaching, scholarship, and service in the context of a university education. With a primary emphasis on improving schools and society, the Department prepares quality educators for middle, secondary, and post-secondary school science, technology, engineering, mathematics, graphic communications, and informal settings. In addition, the Department offers a Graphic Communication Concentration (non-teaching) and several minors, including Technology Education and Graphic Communications. The Department also has programs preparing professionals for leadership at the master's and doctoral levels. The Scaling Up Digital Design Studies unit refines and continues to develop a diagnostic learning system which includes diagnostic items to provide teachers psychometrically valid information on student progress and growth and conducts research on the effects on student and teacher learning and on the validation of the assessment system.
Essential Job Duties: Time Limited Position - Contingent upon Grant Funding The Psychometrician/Assessment Specialist will have experience with digital assessment systems and will collaborate with the PI the Learning Scientists, to design a modeling approach to classroom, rather than, high stakes assessments, measuring students' mathematics learning over time along learning trajectories. The psychometrician will apply and develop leading-edge measurement techniques to support diagnostic and differentiated assessment within the context of personalized learning. S/He will design, modify or implement in collaboration with the software engineer, the underlying system that will collect and report data. Duties and responsibilities include * Collaborate with domain experts and learning sciences in developing/applying measurement models for learning trajectories * Collaborate with outreach coordinator to develop annual data collection plans * Use software packages to assemble test forms according to blueprints and test specifications and design a test assembly system * Review and calibrate tasks * Implement a system to support comparison of student reports, over time and across students (and teacher's results) * Conduct simulation studies to evaluate competing measurement models * Produce weekly test usage reports * Conduct validation studies * Collaborate with engineers/architects on design, modification and implementation of data system * Write and deliver research reports and presentations that describe theoretical, technical, and empirical approaches and results
Minimum Education/Experience: * Master's degree in psychometrics or related field * 3+ years of applied knowledge of psychometrics including: classical test theory, structural equation modeling, mixed-effects modeling, and item response theory or PhD. in educational measurement, quantitative psychology, or psychometrics * College level knowledge of mathematics
Department Required Skills: * Proficient in cleaning and preparing large, complex data sets for analyses * Advanced knowledge of SAS, R or Python for data processing, formatting, and report generation * Intermediate knowledge of R and the ability to learn new packages * Prior experience using IRT software such as Winsteps, IRTPRO, FlexMirt and/or IRT packages in R * Proficient with technologies such as Microsoft Office, bibliographic system, use of data systems, use of tablet technology * Good teamwork and communications skills
Preferred Experience, Skills, Training/Education: * Ph.D. in educational measurement, quantitative psychology, or psychometrics and 1-3 years applied experience or ABD (all but dissertation) * K-12 teaching experience in math or science * Excellent programming skills in assessment technology * Above average knowledge of web technologies
Necessary Licenses and Certifications: N/A
AA/EOE: NC State University is an equal opportunity and affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, national origin, religion, sex, gender identity, age, sexual orientation, genetic information, status as an individual with a disability, or status as a protected veteran.
Individuals with disabilities requiring disability-related accommodations in the application and interview process, please call 919-515-3148. Final candidates are subject to criminal & sex offender background checks. Some vacancies also require credit or motor vehicle checks. If highest degree is from an institution outside of the U.S., final candidates are required to have their degree verified at "www.wes.org":http//wes.org. Degree must be obtained prior to start date.
NC State University participates in E-Verify. Federal law requires all employers to verify the identity and employment eligibility of all persons hired to work in the United States.