The Associate Manager, AI-Enabled Audit & Grading Effectiveness is responsible for leading a team of Grading Effectiveness Specialists to ensure consistent, high-quality grading practices across the grading team. This role owns audit strategy, execution oversight, and performance outcomes related to grading quality and academic integrity.
The Associate Manager drives continuous improvement by leveraging data insights, strengthening cross-functional alignment, and leading the design, implementation, and continuous optimization of an AI-first grading audit infrastructure, including prompt engineering, agent workflows, structured data ingestion, and human-in-the-loop validation models. This position plays a critical leadership role in maintaining academic excellence through human-led, AI-enabled efficiency, and data informed decision making.
Essential Duties & Responsibilities:
Audit Strategy & Oversight:
- Define and own the grading audit framework, standards, and performance thresholds.
- Integrate AI-driven pre-audit triage and anomaly detection into sampling and audit strategy.
- Establish audit cadence, sampling strategy, and reliability benchmarks.
- Oversee audit execution and ensure consistency, objectivity, and measurable quality improvement.
AI-First Audit Design & Governance:
- Architect and scale AI-powered audit workflows using generative AI platforms (e.g., ChatGPT), including prompt engineering, agent configuration, and structured rubric ingestion.
- Design and refine prompt libraries, evaluation schemas, and escalation logic to ensure reliability and grading consistency.
- Establish human-in-the-loop review standards, calibration loops, and drift detection thresholds.
- Monitor AI performance metrics (precision, consistency, bias, hallucination rates) and iterate on prompts and workflows to improve reliability and throughput.
- Partner with technical teams where needed, while retaining ownership of operational AI design and quality standards.
Team Leadership Performance:
- Manage and develop a team of Grading Effectiveness Specialists.
- Set clear output, reliability, and impact expectations.
- Coach team members to strengthen analytical capability and audit effectiveness.
Communication & Collaboration
- Translate audit data into actionable insights, systemic opportunities and strategic recommendations.
- Collaborate cross-functionally to drive improvement initiatives.
Reporting & Stakeholder Alignment:
- Oversee quality dashboards and executive reporting.
- Align grading quality initiatives across Academic, Operations, and Product teams.
- Ensure accurate documentation and confidentiality of audit findings.
Job Skills:
- Strategic audit framework design and operational oversight
- People leadership and performance management
- Advanced data analysis and trend interpretation
- Hands-on experience designing operational workflows using generative AI tools (e.g., ChatGPT), including prompt engineering, structured data ingestion, and agent configuration.
- Experience building human-in-the-loop validation systems and AI output evaluation frameworks.
- Ability to assess AI reliability, bias, drift, and consistency in production workflows.
- Strong executive communication and stakeholder management skills
- Ability to translate complex analytics into actionable business insights
- Process design and scalable system thinking
- Strong attention to detail and organizational excellence
Work Experience:
- Minimum 4 years of combined experience across audit/quality operations and applied AI workflow design required.
- Demonstrated hands-on experience applying generative AI tools (e.g., ChatGPT or similar platforms) to design or enhance operational workflows, including prompt engineering, structured evaluation frameworks, and human-in-the-loop validation processes preferred.
- Experience designing or scaling quality control or audit systems required; experience integrating AI into those systems strongly preferred.
- Data analytics experience required, including performance measurement and trend analysis.
- Experience in academic grading or education environments preferred.
- 2+ years of leadership or people management experience preferred.
Education:
Other:
- Must be able to travel occasionally should a business need arise. For most roles travel would not be common. Travel may involve plane, car or metro. In accordance with ADA policies, reasonable accommodations regarding travel limitations can be provided. Travel will be more common for roles such as Account Executives (25 - 50%), senior leaders (10 – 20%) or Capella Core Faculty (5 – 10%).
- Ability to work onsite in Corporate or Campus location (in a typical office environment) may be required based on role. If so, this would include being mobile within the office, including movement from floor-to-floor using elevators or stairs.
- If offsite or hybrid role, must have access to work in setting which enables meeting all requirements of the role (including privacy, reliable internet access, phone, ability to video conference, etc.) at a remote location.
- Faculty and Federal Work Study roles require access to work in setting which enables meeting all requirements of the role (including computer, privacy, reliable internet access, phone, ability to video conference, etc.) at a remote location.
- This role may require lifting, however reasonable accommodations will be provided in accordance with our ADA policies.
- Must be able to meet critical thinking and problem solving aspects aligned to job duties, as well as effectively communicating with co-workers.
- Must be able to work more than 40 hours per week when business needs warrant. Accommodations related to schedule may be considered.
- Able to access information using a computer.
- Other essential functions and marginal job functions are subject to modification.
Applicants must be authorized to work in the United States. Visa sponsorship is not available for this position.
$67,700-84,600 is the expected starting salary for this position. This offer is based on current budgetary guidelines and the additional factors outlined below.
SEI offers a comprehensive package of benefits to employees scheduled 30 hours or more per week. In addition to medical, dental, vision, life and disability plans, SEI employees may take advantage of well-being incentives, parental leave, paid time off, certain paid holidays, tax saving accounts (FSA, HSA), 401(k) retirement benefit, Employee Stock Purchase Plan, tuition assistance as well as entertainment and retail discounts. Non-exempt employees are eligible for overtime pay, if applicable.
Careers - Our Benefits, Strategic Education, Inc
SEI is an equal opportunity employer committed to fostering an inclusive and collaborative culture where individuals can grow their careers and contribute fully. We strive to attract talent with broad experiences, skills and perspectives. We welcome applications from all. While it is not typical for an individual to be hired at or near the top end of the pay range at SEI, we offer a competitive salary. The actual base pay offered to the successful candidate may vary depending on multiple factors including, but not limited to, job-related knowledge/skills, experience, business needs, geographical location, and internal pay equity. Our Talent Acquisition Team is ready to discuss your interest in joining SEI. The expected salary range for this position is below.
$67,700.00 - $101,500.00 - Salary
If you require reasonable accommodations to complete our application process, please contact our Human Resources Department at Careers@strategiced.com.