Anthropology Quality Assurance Lead

Job Summary

The Anthropology Quality Assurance Lead oversees, audits, and optimizes the end-to-end data quality pipeline for anthropology-focused AI training operations. Core daily tasks include spot-checking complex AI-generated cultural comparisons and ethnographic summaries, delivering granular written feedback to annotators, managing team alignment across secure communication channels, building comprehensive linguistic and cultural style guides, executing bias/ethnocentrism audits, and running calibration sessions for remote subject matter experts.

Required Advanced Academic Foundation

• Degree Checklist: Bachelor’s, Master’s, or PhD degree in Anthropology, Cultural Anthropology, Archaeology, Biological Anthropology, Linguistic Anthropology, Sociology, Area Studies, Museum Studies, or a closely matching social science discipline.

Required Core Professional Experience

• Domain Tenure: 3+ years of progressive professional experience rooted in anthropological research, teaching, field archaeology, ethnography, museum/heritage management, academic writing, or structured cultural analysis workflows.
• Linguistic Command: Exceptional, near-native command of the English language, featuring the ability to draft highly articulate, structured technical assessments, style rubrics, and detailed written feedback for remote teams.

Required Subject Matter Expertise

• Theoretical Fluency: Deep, intuitive grasp of fundamental anthropological frameworks, including cultural relativism, participant observation methods, kinship structures, ritual systems, language/culture interactions, material culture analysis, human evolution, and contemporary representation ethics.
• Analytical Diagnostic Skills: Demonstrated ability to evaluate dense qualitative content against strict rubrics and rapidly isolate complex flaws such as cultural stereotyping, ethnocentrism, unsupported generalizations, outdated terminology, methodological gaps, or ethically problematic framing.

Preferred Technical & Leadership Competencies

• Team Supervision: Direct prior history leading, mentoring, or supporting remote teams of researchers, educators, academic reviewers, fieldworkers, or data annotation QAs (highly preferred).
• Systems Agility: High comfort level operating inside fast-moving, asynchronous remote tech stacks utilizing Discord, Google Workspace (Sheets, Docs, Trackers), custom dashboards, and agile project management tracking platforms.
• AI Operations Familiarity: Direct exposure to AI training mechanisms, data annotation suites, LLM evaluation metrics, social science quality control pipelines, or rubric-based blind reviews (a strong plus).

Key Responsibilities

1. High-Density Anthropology Review & LLM Auditing (35%)

• Audit AI Outputs: Systematically evaluate AI-generated anthropology explanations, complex ethnographic summaries, cross-cultural comparisons, archaeological discussions, and deep human evolution arguments for factual precision and structural reasoning.
• Enforce Methodological Rigor: Ensure all reviewed training data demonstrates appropriate contextualization, alignment with established scientific paradigms, and proper deployment of technical domain terminology.
• Flag Bias and Ethnocentrism: Act as the ultimate compliance gatekeeper to catch and eliminate ethnocentric biases, hidden cultural stereotypes, western-centric assumptions, and outdated colonialist perspectives.
• Verify Ethical Awareness: Review complex text items involving indigenous studies, repatriation, and museum ethics to guarantee the data strictly reflects modern international ethical standards.

2. Remote SME Performance Monitoring & Feedback Infrastructure (25%)

• Run Ongoing Spot-Checks: Execute ongoing, metric-driven spot-checks across active data batches to evaluate trainer and secondary QA performance variations.
• Deliver Granular Documentation: Provide precise, clear, and actionable written feedback through direct communication lines to correct individual annotator misunderstandings.
• Manage Escalation Tracks: Isolate recurring quality failures, trace them back to specific structural guidelines, and rapidly escalate critical data issues to project directors.
• Drive Contributor Activation: Monitor active team contribution trackers, run personalized outreach to underperforming or inactive experts, and optimize overall network availability.

3. Asynchronous Team Training, Alignment & Communication (20%)

• Coordinate Discord Operations: Maintain real-time alignment across digital team channels, keeping trainers and QAs updated on changing project parameters, target metrics, and review rules.
• Resolve Concept Disputes: Act as the primary technical reference point to clear up team confusion regarding complex cultural contexts, kinship matrices, or evolving rubric interpretations.
• Lead Onboarding Programs: Schedule, build, and host interactive onboarding sessions and technical training calls to smooth the entry path for incoming subject matter experts.
• Drive Quality Calibration: Run structural calibration tests and comparative review reviews to guarantee all active team members apply project rubrics with identical consistency.

4. Process Engineering & Documentation Architecture (20%)

• Author Technical Style Guides: Design, structure, and maintain foundational project documentation, including localized style guides, comprehensive FAQs, and exemplary data profiles.
• Construct Evaluation Rubrics: Build edge-case testing materials and target dataset controls ("honeypots") to proactively test and score team evaluation accuracy.
• Propose Workflow Iterations: Pinpoint recurring operational bottlenecks or qualitative gaps within the data lifecycle, presenting structured workflow updates to scale QA output.
• Maintain Compliance Readiness: Ensure all processed data sheets, active trackers, and metadata frameworks remain clean, organized, and ready for immediate deployment to client model labs.

Core Competencies & Skills

• Methodological Deconstruction: The unique ability to take fluid, non-deterministic language model prompts and break them down into objective, measurable components using social science guidelines.
• Radical Attention to Detail: An uncompromising eye for structural flaws, micro-biases, formatting errors, and subtle deviations from guidelines across thousands of sentences.
• Asynchronous Leadership: Exceptional capability to motivate, align, and direct highly educated, geographically scattered academic professionals without requiring face-to-face oversight.
• Intellectual Agility: The capacity to pivot rapidly between highly diverse anthropological subfields—from deep biological evolution to contemporary museum ethics—without losing analytical velocity.

Skills Required:

• Social / Science / Project / Management / Development