Description
We are seeking an experienced Training Lead to oversee and guide a team of skilled Speech Experts (SMEs) in enhancing the quality of our AI training datasets, with a strong focus on speech aesthetics. The Training Lead will be responsible for setting the vision, driving excellence, and ensuring consistency across all speech annotation activities. This leadership role requires a deep understanding of speech, audio engineering, and annotation best practices, as well as the ability to mentor and manage a team of subject matter experts.
What You'll Do
Team Leadership & Management:
Lead, mentor, and develop a team of Speech Experts, fostering a culture of quality, collaboration, and continuous improvement.
Set clear goals and expectations for annotation quality and team performance.
Organize regular calibration sessions and feedback loops to ensure alignment and consistency.
Domain Expertise Oversight:
Work closely with Program Managers and Product Partners to implement the “vision” for novel speech annotation tasks
Provide strategic direction on speech aesthetics and annotation standards.
Collaborate with cross-functional teams and other SMEs to ensure best practices are followed.
Guideline Development & Maintenance:
Oversee the creation, editing, and maintenance of high-quality annotation guidelines tailored to speech aesthetics.
Ensure guidelines are up-to-date, clear, and actionable for both internal teams and external vendors.
Quality Assurance Leadership:
Design and implement robust QA processes for speech annotation, including SFT (Supervised Fine Tuning) and RLHF (Reinforcement Learning from Human Feedback) tasks.
Review and grade annotation outputs, identify areas for improvement, and provide actionable feedback to both team members and vendors
Audit outputs from the team to flag discrepancies and provide ample calibration information
Lead calibration sessions to align teammates on audit discrepancies and error trends
Data Annotation Oversight:
Supervise direct annotation efforts for key tasks, ensuring the highest standards of quality and reliability.
Guide the team in writing SFT responses and judging output quality for RLHF.
Expert Evaluation:
Lead the assessment of speech samples for subtle differences in emotion, audio quality, intention, and adherence to task requirements.
Ensure the team provides reliable, high-fidelity signals for automated evaluation (autoeval) and reward model (RM) training.
Stakeholder Communication:
Serve as the primary point of contact for internal teams and external partners regarding speech annotation quality and processes.
Communicate complex ideas and guidance effectively to diverse audiences.
What Would Make You a Great Fit
Leadership Experience: Proven track record of leading and developing high-performing teams in speech, audio engineering, or related fields.
Discriminative Skills: Professionally "posttrained" ear, able to reliably discriminate between extremely subtle differences in speech.
Technical & Domain Knowledge: Deep expertise in speech aesthetics, audio fidelity, emotional nuance, and conversational dynamics.
Equipment: Owns and is familiar with above-average listening equipment
Sony MDR 7506
Sennheiser HD600
Beyerdynamic DT 770 Pro
Sony MDR-7506
DT 770 Pro
Background:
Perfect fits for this role include:
Speech therapists
Voice actors
Audio engineerings
Great fits for this role include:
Mastering engineers
Music producers
Therapists
Radio announcers, talk show hosts, comedians
Anyone extremely “in tune” with conversation and “reading the room”
Prior Annotation Experience: Previous experience at other AI Labs, especially in a leadership position, is extremely useful / helpful here
Communication & Analytical Skills: Exceptional written and verbal communication skills; strong analytical abilities to identify trends and drive improvements.
Collaboration & Adaptability: Demonstrated ability to work collaboratively across teams and adapt to new technologies and processes in a fast-paced environment.
Pursuant to the California Fair Chance Act, Los Angeles County Fair Chance Ordinance for Employers, Los Angeles Fair Chance Initiative for Hiring Ordinance, and San Francisco Fair Chance Ordinance, qualified applicants will be considered for assignment with arrest and conviction records. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness, meet client expectations, standards, and accompanying requirements, and safeguard business operations and company reputation.
At Meta, we are constantly iterating, solving problems, and working together to connect people all over the world. That’s why it’s important that our workforce reflects the diversity of the people we serve. Hiring people with different backgrounds and points of view helps us make better decisions, build better products, and create better experiences for everyone.
We give people the power to build community and bring the world closer together. Our products empower more than 3 billion people around the world to share ideas, offer support, and make a difference.
