Psychometrician II

Job Description

Our Psychometrics team is responsible for the development and maintenance of assessments – both computerized adaptive tests (CAT) and curriculum-based measures (CBM) – ensuring that they meet and adhere to the prevailing industry standards for educational testing. As a member of this team, you will collaborate with your teammates, product managers, content teams, engineering, external stakeholders and contractors, and others, utilizing your full range of psychometric knowledge and skills to bring world class assessments to a large K-12 state assessment program.

In this role as a Psychometrician II, you will:

• Manage projects through product implementation and evaluation
• Represent the department to senior management, both internal and external, and technical advisory committees
• Exercise judgement of analysis, methodology, and techniques to accomplish goals
• Apply knowledge of psychometrics and statistics to the design, development, and evaluation of tests and other educational products
• Plan advanced research studies, including item calibration, test norming, and validity studies
• Analyze item responses, score distributions, reliability and validity research data as part of test development process
• Design and implement psychometric studies to support new products or new product development
• Coordinate with Product Management, Engineering, Content Development, and other internal groups to deliver new products
• Investigate and diagnose complex anomalies, issues, and customer concerns related to scores
• Present to and document work for both internal and external stakeholders, using the appropriate communication for the audience

For this role as a Psychometrician II, you must have:

• Doctoral degree (Ph. D.) in education, measurement, statistics, evaluation, or relevant field and minimum 4 years of experience in related field, or equivalent combination of education and experience
• Knowledge of CAT design, IRT, and statistical methods, and proficiency with statistical software packages (e.g., SAS, R, Python).
• An understanding of test content alignment to state standards.
• Demonstrated ability to define problems, collect data, establish facts, and draw valid conclusions
• Demonstrated ability to respond to common inquiries or complaints from customers, regulatory agencies, or members of the business community
• Project management skills, with emphasis on technical design and implementation of educational tests
• Experience in developing proposal responses for state