Yo IT Consulting
Architecture & Design QA Lead
Posted
3 weeks ago
Experience
3+ Years
Salary
$75 - $90 /hour
Deadline
Closed
Job Summary
The Architecture & Design Quality Assurance Lead oversees quality consistency, spatial logic modeling, documentation engineering, and remote expert trainer performance across all built-environment AI projects. Core responsibilities include auditing AI-generated design concepts, managing distributed trainer pipelines via Discord, writing clear style guides and calibration tasks, and flagging safety or code violations.
Qualification
Educational Level & Professional Pedigree
- Required Foundation: A formal Bachelor’s, Master’s, or equivalent professional degree in Architecture, Interior Design, Urban Design, Landscape Architecture, Environmental Design, Industrial Design, or Urban Planning.
Experience
Candidates must demonstrate a strong balance of practical built-environment execution, spatial critique proficiency, and technical team leadership:
Built-Environment Core Domain Expertise
- Professional Tenure: Minimum of 3+ years of verified professional experience operating within architecture, urban design, space planning, design research, construction documentation compilation, or architectural academic instruction.
- Spatial System Fluency: A deep, structural understanding of core design principles, spatial organization, pedestrian circulation dynamics, scale and proportion metrics, materiality values, accessibility standards (e.g., ADA), sustainability frameworks, construction logic, and building systems.
- Rubric Evaluation Capacity: Proven ability to evaluate detailed design explanations against rigorous rubrics, confidently isolating defects such as non-functional floor plans, weak structural rationales, accessibility gaps, code-insensitive suggestions, or unsafe engineering assumptions.
- Technical Design Tool Literacy: Familiarity with the operational frameworks of industry-standard design tooling or methodologies—such as AutoCAD, Revit, Rhino, SketchUp, Adobe Creative Suite, BIM systems, precedent analysis models, or rendering environments—is highly preferred.
Remote Team Operations & Quality Management
- Team Governance: Demonstrated experience leading, managing, or mentoring remote teams of designers, peer reviewers, content annotators, or visual quality control specialists is strongly preferred.
- Asynchronous Tool Proficiency: Complete comfort working inside fast-moving, distributed ecosystems utilizing Discord, Google Workspace (Docs, Sheets, Trackers), interactive dashboards, and agile project management tracking architectures.
- Documentation Rigor: Outstanding organizational capability with a history of maintaining structured internal assets such as style guides, localized FAQs, calibration tasks, calibration honeypots, and onboarding manuals.
- AI Training Exposure: Prior experience working within AI data training environments, prompt tuning data curation, data annotation, LLM evaluation, or rubric-based peer review systems is considered a major operational advantage.
Key Responsibilities
1. Advanced Architectural Review & Quality Monitoring (35%)
- Audit Spatial AI Data: Evaluate AI-generated spatial layouts, design reasoning statements, material specifications, and structural concepts for accuracy and real-world viability.
- Spot-Check Technical Content: Run regular spot-checks across built-environment datasets to identify logic errors, formatting defects, and deviations from project guidelines.
- Perform Risk Reviews: Actively flag unsafe, inaccessible, code-insensitive, or structurally unrealistic recommendations generated by the model or annotators.
- Deliver Precise Feedback: Provide clear, structured written feedback through direct communication channels to resolve individual errors and elevate overall team performance.
2. Distributed Team Leadership & Activation Management (25%)
- Govern Communication Hubs: Lead dedicated project communication spaces on Discord, updating trainers and QA specialists on new guidelines, client calibration pivots, and architectural review metrics.
- Resolve Technical Queries: Act as the primary point of contact for complex questions regarding spatial logic, material properties, construction feasibility, and rubric interpretation.
- Manage Network Activation: Monitor contractor activity logs, proactively re-engaging inactive or inconsistent contributors via direct outreach to maintain steady data production.
- Onboard Global Experts: Schedule and run onboarding calls and training webinars to align incoming remote architects and designers with project-specific workflows and rubrics.
3. Documentation Engineering & Process Calibration (25%)
- Create Governance Assets: Author and maintain crucial project documentation, including master style guides, technical FAQs, performance trackers, and visual quality examples.
- Build Calibration Modules: Design specialized benchmarking tasks and intentional baseline challenges ("honeypots") to test and align reviewer accuracy across the network.
- Standardize Quality Metrics: Audit grading behavior across different reviewers to ensure guidelines are applied uniformly as the underlying AI model scales.
4. Process Optimization & Client Strategy (15%)
- Identify Quality Gaps: Analyze recurring data failures and model hallucinations, turning those insights into structured workflow adjustments.
- Scale QA Infrastructure: Propose and test scalable QA mechanics to simplify data validation for increasingly complex, multi-modal architectural datasets.
- Provide Strategic Alignment: Ensure all processed datasets meet the quality standards and context-aware expectations of elite AI foundation labs.
Expected Outputs & Deliverables
- Up-to-date, legally and structurally defensible project style guides, technical FAQs, and alignment documentation.
- Structured calibration modules, benchmark challenges, and onboarding assets for remote annotators.
- Descriptive data audit summaries, error-tracking matrices, and risk assessment logs highlighting spatial reasoning or code safety issues.
- Weekly network performance reports tracking contributor accuracy, response times, and active deployment volumes.
Skills Required:
- Architecture / Urban / Planning
Quick Actions
Share Vacancy