AWS
Scaling Quality from 47% to 96% Across a 350+ Person AI Program
Context
At Amazon Web Services, I supported global AI evaluation programs where quality consistency across large distributed teams was a key challenge.
Problem
Quality feedback was inconsistent, unclear, and difficult to apply, resulting in low alignment (~47%) and inefficiencies across teams.
What I Did
Key Skills:
Audit frameworks, onboarding, documentation, data analysis, stakeholder alignment
Context
At Amazon Web Services, I supported global AI evaluation programs where quality consistency across large distributed teams was a key challenge.
Problem
Quality feedback was inconsistent, unclear, and difficult to apply, resulting in low alignment (~47%) and inefficiencies across teams.
What I Did
- Designed and implemented a full QA audit system
- Created standardized rubrics and feedback frameworks
- Wrote onboarding and guidance materials for QA workflows
- Delivered 1:1 coaching to Task Leads and Quality Leads
- Built reporting systems using Python and Excel
- Increased feedback quality from 47% to 96%
- Improved cross-team calibration and consistency
- Enabled scalable onboarding for global teams
Key Skills:
Audit frameworks, onboarding, documentation, data analysis, stakeholder alignment
QA + Content + Systems Thinking (Contract work)Shorter one. Focus on:
- QA for multilingual systems
- Content + structure
- Adaptability across platforms