Description
As a subject-matter expert (SME) in Linguistics you will contribute your expertise by:
Quality Assurance: Evaluate and grade the quality of annotations produced by vendors for SFT (Supervised Fine Tuning) and RLHF (Reinforcement Learning from Human Feedback) annotations. Identify areas of improvement and provide feedback to optimize the quality of annotations.
Guideline Development: Create, edit, and maintain high-quality annotation guidelines tailored to your area of expertise. Ensure that these guidelines are up-to-date, clear, and concise to enable vendors to deliver accurate annotations.
Domain Expertise: Offer guidance and mentorship within your domain to bridge any gaps in understanding and support the development of more accurate AI models.
Data Annotation: Directly annotate data for key tasks when necessary, including writing SFT responses and judging output quality for RLHF.
Our domain SMEs are our most advanced job level in annotations and QA. Most are PhD-level experts with a history of teaching experience at the university level. For this role, we specifically are looking for a Linguistics PhD candidate who has teaching experience at the university level combined with previous experience training AI Models. They are expected to bring the utmost quality and knowledge to tasks within their specified domains.
Requirements:
Education: Linguistics PhD, or PhD in a related field
Experience: A minimum of 3 years professional experience in domain. Experience teaching advanced concepts (e.g., TAing advanced courses), demonstrating ability to distill and relay complex problems in logical, step-by-step thinking preferred; a minimum of 1 year experience at another position that involved working with training datasets to train AI Models.
Deep Knowledge: Demonstrated deep understanding and expertise in the designated domain.
Communication Skills: Strong written and verbal communication skills to effectively convey complex ideas and guidance to internal teams and external vendors.
Analytical Skills: Exceptional analytical abilities to identify trends, evaluate annotation quality, and provide actionable feedback.
Collaboration: Proven ability to work collaboratively with cross-functional teams and external partners to achieve shared goals.
Adaptability: Flexibility and willingness to learn and adapt to new technologies and processes in a rapidly evolving environment.
