ETS’s Research & Development division is seeking a highly qualified candidate to serve as a Senior Director of the NLP Research Laboratory, one of three inaugural ETS research laboratories. The individual will lead the execution of a long-term, strategic research agenda focused on enhancing existing and developing new capabilities to enable adaptivity and personalization, targeted feedback, automated scoring engines, voice biometrics and security analytics as well as solutions for flexible assessment administration and remote proctoring.
As a core member of the ETS Research Laboratory leadership team, the Senior Director NLP Labs will be responsible for setting a clear and impactful research agenda and developing, in close partnership with cross-functional business partners, roadmaps for emerging AI capabilities and the engines that power those capabilities. The individual will also be responsible for cultivating a culture of consumer-centric strategy in the laboratory.
The Senior Director will lead a talented team of scientists and associates with expertise in AI, deep learning, machine learning, and automated scoring engines, as well as product owners and developers. To fulfill the research and development agenda of the NLP Lab, the Senior Director will be expected to work closely with the leads of two other laboratories as well as cross-functional units throughout the organization.
The Senior Director is expected to have a well-established reputation as a thought leader, a team leader, and as an accomplished scientist in the field of AI and/or machine learning. This individual will report to the General Manager who oversees three research laboratories, the Foundry, and an Enabling Technologies team.
The collaborating laboratories are: Personalized Learning & Assessment and Language Learning, Teaching, and Assessment. Other teams under the General Manager include Enabling Technologies (a team of research engineers that supports the three labs) and the Foundry (an internal incubator).
BASIC FUNCTIONS AND RESPONSIBILITIES
Provide vision and strategic direction in support of ETS’s immediate and long-term objectives around the development of capabilities to enable adaptivity and personalization, targeted feedback, automated scoring engines, voice biometrics and security analytics as well as solutions for flexible assessment administration and remote proctoring.
Oversee the development and implementation of a strategic AI multi-year research and development agenda that supports and advances existing products and services, and new product development efforts and initiatives. The agenda is expected to identify customer challenges and address their needs as well as address measurement-, learning- and policy-related issues, challenges, and needs for domestic and international populations.
Cultivate close partnerships with cross-functional units throughout ETS including the research institutes, new product development, information technology, strategy, business development, marketing, and the strategic business units to identify opportunities for commercialization of capabilities, support go-to-market strategies, and align on continued research and optimization of core capabilities, products, and services.
Provide leadership in the design and implementation of complex research projects involving the coordination of interrelated tasks performed by cross-functional teams of scientists, associates, and experts from other areas within ETS (e.g., psychometricians, statisticians, test developers, information technology specialists), and monitor all research activities and projects for the lab.
Act as a thought leader internal and external to ETS sharing new ideas through various communication outlets including formal and informal publications, conference presentations, and other speaking engagements; maintain active engagement with and leadership in relevant professional organizations.
Serve as a primary liaison between ETS and external groups such as policy and/or advisory boards, technical advisory committees, government agencies and foundations; establish and maintain close collaborative relationships with recognized leaders in the field of learning science, personalized learning and assessment, and educational technology.
Establish and support a research climate and culture that expects high-quality scholarship, fosters and encourages collaboration among scientists and associates both within the AIWE lab and across other labs and research institutes and demonstrates a commitment to increasing diversity and representation.
Mentor and develop a team focused on addressing a wide range of educational measurement issues. Provide guidance in all stages of conducting research including formulation of research questions, framing of successful grant proposals, design of research projects, developing problem statements, identifying target user groups, engaging with users, analysis of data, and publication.
Develop scientists and associates in various stages of their careers. Guide their work priorities and assignments; provide counsel and career advice; provide opportunities for all staff to growth and development and to take appropriate initiative; provide construct feedback to all lab staff.
Direct and administer fiscal, operational, personnel and policy implementation activities. This includes, for example: recruiting and selecting scientists and associates; conducting performance reviews and evaluations; reviewing and approving proposal and project budgets, and approving expenditures against budgets; developing, monitoring, and revising center budgets; and monitoring and approving research and consulting expenditures.
Experience and Skills
A doctoral degree in Computer Science, Educational Research or Measurement, Cognitive or Learning Science, or a closely related field is required. Strong background in educational measurement is also required. A masters degree with relevant experience would also be considered.
Twelve years of experience leading research and development efforts in the area of AI and evidence of independent scholarly research. Demonstrated experience managing teams is also required.
Passionate about educational opportunities and equity in education
Experience in the research and development of assessment and learning solutions in various educational contexts (PK, K-12, HED, Language Learning, Professional training) is preferred
Application of agile development, user centered design and experience with user centered research
Experience with, or interest in educational technology
Clear track record of establishing relevant and impactful research priorities and agendas
Strong evidence regarding strategic thinking and problem solving
Established ability to interact successfully with colleagues in the field on substantive issues, and to communicate clearly and effectively with a range of other stakeholders
Experience in successfully managing and meeting budgets and relevant financial metrics Strong administrative skills, including the ability to prioritize needs and resources
Handle multiple tasks, and to establish and meet deadlines
Broad political and technical understanding of current education and assessment trends
Proven skills and abilities in building, leading, and facilitating research teams
Demonstrated ability to support the professional and scientific growth and development both of experienced and less experienced colleagues