Quantitative Test Manager

The Center for Applied Linguistics (CAL) is located in Washington DC. This is a hybrid position, and the employee may choose to work in their preferred combination of in person at the office in a hoteling capacity, or remotely. However, this position prefers candidates local to CAL’s offices so qualified candidates are preferred to reside locally to Washington DC. CAL does not compensate or reimburse candidates for relocation expenses.

POSITION SUMMARY:

Quantitative Team Manager works closely with members of the Psychometrics and Quantitative Research team (PQR) to support and lead a broad range of complex, high-stakes large-scale research activities related to Psychometric and quantitative research projects in language testing and applied linguistics projects. The Quantitative Team Manager supervisees the Quantitative analysts on the PQR team who work with researchers and Psychometricians in analyzing data and generating reports for WIDA ACCESS, a large scale, high stakes K-12 assessment of English language proficiency.

ESSENTIAL DUTIES

• Manage and lead project teams in the preparation of data for analysis and reporting, including acting as the liaison with the client on data delivery, preparing data file layouts, collecting, entering, scoring, transforming, receiving, validating, cleaning, merging, restructuring of data while taking appropriate steps to ensure quality.
• Supervise PQR analysts.
• Manage and maintain team calendar and internal project timelines for the PQR team.
• Organize and manage the weekly PQR meeting and CAL-WIDA Psychometric meeting.
• Serve as PQR data specialist. Duties include serving as primary data point of contact with clients, managing master datasets and/or databases ensuring master datasets are created, saved and stored appropriately, and identifying, drafting, and updating procedures for producing and analyzing datasets.
• Lead the technical work as relates to the WIDA ACCESS Annual Technical Reports. Duties include orienting team members to processes and procedures for producing tables, managing staff assignments, documenting ATR QC, and supporting senior PQR staff as the client liaison.
• With the support of the Senior Director of Psychometrics and Quantitative Research, draft and revise quantitative analysis procedures.
• Conduct data analysis using statistical software such as SPSS, R and Winsteps.

EDUCATION AND EXPERIENCE

Required

• Master’s degree from an accredited college or university, in Educational or Psychological Research, Applied Linguistics, Language Assessment, Educational or Psychological Assessment, or a related field, with at least six (6) years of relevant experience as technical lead or/and team management.
• Experience with advanced data processing and statistical analyses, research methodologies, and high-stakes large-scale assessments.
• Minimum of five years of extensive experience in programming using statistical software such as SPSS, R, Winsteps, Stata, and SAS.
• Experience working with MS Excel, in a professional position or extended research project.
• Extensive experience working with large quantitative data sets.
• Extensive experience with following quality control procedures and documenting workflow.
• Experience with educational assessment, especially language assessment and/or online adaptive assessment.
• Demonstrated experience supervising junior level staff/data analysts.
• Demonstrated experience in managing project tasks and timelines.

KNOWLEDGE, SKILLS & ABILITIES

•  Proficient in programming using SPSS, R and IRT software such as Winsteps.
• Expertise in using advanced features of MS Excel.
• Expertise with Microsoft Office software, desktop publishing, and MS Project.
• Ability to work independently as well as cooperatively in a fast-paced team environment.
• Excellent organization, planning, and time management skills.
• Excellent oral and interpersonal communication.
• Background and interest in assessment.

PHYSICAL DEMANDS

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. While performing the duties of this job, the employee is regularly required to effectively communicate. The employee may be required to sit or stand in a stationary position 50% of the time. This position constantly operates a computer and other office productivity equipment. CAL adheres to ADA compliance and guidelines as a common practice.

ADDITIONAL INFORMATION

This job description summarizes the main duties of the job. It neither prescribes nor restricts the exact tasks that may be assigned to carry out these duties. This document should not be construed in any way to represent a contract of employment. Management reserves the right to review and revise this document at any time.

AFFIRMATIVE ACTION/EQUAL OPPORTUNITY EMPLOYMENT STATEMENT

The Center for Applied Linguistics (CAL) provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity, disability, or genetics. In addition to federal law requirements, CAL complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.

CAL expressly prohibits any form of workplace harassment based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. Improper interference with the ability of CAL employees to perform their job duties may result in discipline up to and including discharge.