Psychometrician/Measurement Statistician

Excelsior College, a recognized world leader in distance higher education, makes college degrees accessible to working adults with highly flexible and affordable degree programs. If you are looking for an environment that values diversity, encourages innovation, promotes academic rigor, and is responsive to the needs of adult learners, we want to hear from you. Excelsior College received the recognition as the Best Place to Work/Top Workplace in the Capital Region from Albany Times Union and Albany Business Review. This is a full-time position with benefits.

Summary

The College is currently seeking candidates for the position of Psychometrician/Measurement Statistician. The Psychometrician/Measurement Statistician is a member of the Psychometric group within the Center for Educational Measurement (CEM) at Excelsior College, and works with the Measurement Statistician, Data Analyst, Director of Psychometric Services, and staff from the Test Administration, Test Development, Information Technology, and Editorial groups within the CEM. This person helps implement the objectives and procedures for the psychometric analysis and evaluation of the College's international program of examinations. These examinations are taken by students to gain credit for prior learning at colleges and universities in the U.S. and at international locations.

The Psychometrician/Measurement Statistician assists in planning and coordinating the daily activities and responsibilities of the Psychometric group and conducts various aspects of statistical and psychometric programming, analysis, and interpretation. This work involves both classical and item response theory (IRT) methods of evaluating test items, building comparable test forms, and standard setting. The Psychometrician/Measurement Statistician prioritizes various projects and ensure that all work is accurately completed within defined time frames. On a daily basis, this position will deal with secure, highly confidential information.

Responsibilities

The Psychometrician/Measurement Statistician is responsible for a wide range of statistical and psychometric activities related to test construction, validity, reliability, standard setting, equating, analysis, and scoring for a battery of over 50 examinations. Responsibilities include, but are not limited to the following:

  • Conduct classical item analysis and IRT calibrations to support test development activities for multiple choice, extended response, mixed format (multiple choice and extended response), and examinations featuring alternate item types.
  • Conduct standard setting and rater training for various exams.
  • Collaborate with staff from the Assessment Unit (AU) test development group to construct parallel test forms.
  • Automate processes and keep automated processes current for ongoing psychometric activities.
  • Assist in the publication of an annual technical manual documenting psychometric characteristics of all AU assessments offered.
  • Support the development of psychometrically sound assessments for online courses.
  • Conduct studies required to address issues of examination and item exposure, reports of testing irregularities, differential item functioning, speediness, equating, scaling, subscore reporting, and decision consistency and accuracy.
  • Write statistical computer programs (using SPSS® or other programming languages) for the purpose of cleaning data files and conducting statistical and psychometric analyses.
  • Conduct testing on both internal and external systems used for exam administration, and student scoring and grading.
  • Create, modify, and maintain databases for item banking.
  • Carry out research in measurement theory and practice to improve the Excelsior College testing program and contribute to the measurement profession.
  • Some travel may be required.

Qualifications

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.

  • Demonstrate a high level of knowledge and proficiency in statistical and psychometric theory, analysis, and interpretation.
  • Display a high degree of accuracy and excellent attention to detail.
  • Demonstrate excellent decision making and organization skills, and productive time management.
  • Provide quality assistance to staff.
  • Demonstrate professional commitment to responsibly secure and maintain confidential information.
  • Write, debug, and run statistical computer programs.
  • Demonstrate proficiency in the utilization of database, spreadsheet, and word processing applications.
  • Effectively work both independently and cooperatively in a team environment.
  • Demonstrate excellent written, oral, and interpersonal communication skills.
  • Work flexible hours as needed.

Education and/or Experience

  • The minimum requirements for the position of Psychometrician/Measurement Statistician are an MA or MS degree in measurement or related field from a regionally accredited institution with strong relevant experience and/or training in large scale standardized assessment.
  • A PhD in measurement or related field is preferred.
  • Coursework and/or practical training in measurement is required.
  • Knowledge of computerized adaptive testing (CAT) is desirable.
  • The ideal candidate will have the ability to use technology to automate repetitive tasks and processes.
  • Hands on experience programming in Visual Basic® , C#, Java® or some other computer language is highly desirable.

Application Information

Please Note: There is a known issue with the online submission and Internet Explorer 11. The online submission will work with another browser or if you put Internet Explorer into Compatibility View before clicking on the online link.

To do this, click on Tools then place a checkmark next to Compatibility View. If the Tools menu is not showing, click the Alt key on your keyboard to display the menu.

If you have problems with online submission, please call 518-464-8532. Thank you.

Excelsior College offers competitive compensation and a generous benefits package that includes paid time off, retirement, and excellent health insurance. Interested candidates should submit a letter of application, resume, salary history, and the names of three professional references. Please submit requested information at www.excelsior.edu/ecresumesubmission, or by mail:

Excelsior College
Human Resources Office
Psychometrician/Measurement Statistician Search
7 Columbia Circle
Albany, New York 12203-5159

AA/EOE/ADA

We are an affirmative action, equal opportunity employer that strives to enhance our ability to develop a diverse faculty and staff and to increase our potential to serve a diverse student population.