Semesteria Logo
Crossing Hurdles

AI Quality Analyst

Crossing Hurdles

Posted

last week

Remote

Remote

USD 2K

Mid Level

Contract

Match

Skills

Experience

Industry

Sema

Sema Summary

As an AI Quality Analyst at Crossing Hurdles, you will evaluate outputs from large language models and autonomous agent systems, applying defined rubrics and quality standards. The role involves reviewing workflows, providing actionable feedback, and documenting findings for stakeholders. Strong experience in AI evaluation and quality assessment is required. This position is contract-based, allows for flexible hours, and is fully remote.

About Company

Crossing Hurdles is a staffing and recruiting company specializing in customized solutions to connect organizations with top-tier talent. They focus on understanding client needs and aligning candidates with organizational culture.

Core Requirements

  • Experience in AI evaluation
  • Proficiency in quality assessment
  • Strong attention to detail
  • Excellent English communication
  • Ability to work independently

Responsibilities

  • Evaluate outputs from AI models
  • Review multi-step agent workflows
  • Apply benchmarking criteria
  • Provide structured feedback
  • Participate in calibration sessions
  • Document findings clearly
  • Adapt to evolving guidelines

Must Have skills

LLM evaluationQuality assuranceAnalytical thinkingDecision makingCommunication

Nice To Have Skills

UX researchBenchmarking frameworksAttention to detailRemote work skillsCollaborative skills

Job Keywords

AI AnalystQuality AssessmentRemote WorkLanguage ModelsAnalytical Roles

Similar Jobs