Talent.com
Subject Matter Expert (Agentic Complex Engineering and Evaluation) - REMOTE

Subject Matter Expert (Agentic Complex Engineering and Evaluation) - REMOTE

Innodata Knowledge Services, Inc.Philippines
23 days ago
Job description

Subject Matter Expert (Agentic Complex Engineering and Evaluation) - REMOTE

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Innodata Knowledge Services, Inc.

Innodata Knowledge Services, Inc., a data‑engineering company delivering AI solutions to global clients, is currently hiring a full‑time Subject Matter Expert (Agentic Complex Engineering and Evaluation).

Key Responsibilities

  • Create complex prompts in your subject domain according to detailed instructions and guidance.
  • Design and implement evaluation rubrics on complex prompts of your creation.
  • Provide evaluations and judgments of model responses, based on your domain knowledge.
  • Commit to consistent throughput and improvements over the course of the project.

Technical & Required Skills

  • Strong prompt writing and prompt engineering skills, ideally previous experience in projects involving prompt engineering and writing.
  • Knowledge and experience in writing prompt scoring rubrics.
  • Strong domain knowledge in one of the following fields :
  • Humanities (i.e. History, Literature, Art, Journalism, Philosophy)

  • Business (i.e. Economics, Finance, Accounting, Management)
  • Eccentric (i.e. Games, Chess, Culinary Art)
  • A collaborative mindset with the ability to solve complex technical challenges, follow guidelines and work independently as needed.
  • Exceptional attention to detail and a commitment to delivering high‑quality, reliable AI solutions.
  • Passion and curiosity in LLM improvement and data annotations.
  • Qualifications

  • Master’s degree or higher in STEM, Humanities, Business or a related field.
  • Experience with data annotation, especially prompt writing or LLM responses evaluation.
  • Fluency in English at an academic level and above, with the ability to read, write, and communicate complex ideas clearly and precisely.
  • #J-18808-Ljbffr

    Create a job alert for this search

    Subject Matter Expert • Philippines

    Related jobs
    • Promoted
    Subject Matter Expert - AI / LLM Projects

    Subject Matter Expert - AI / LLM Projects

    Innodata Knowledge Services, Inc.Philippines
    Subject Matter Expert – AI / LLM Projects.Apply for the Subject Matter Expert – AI / LLM Projects role at Innodata Knowledge Services, Inc. Creates complex prompts in your subject domain according to de...Show moreLast updated: 26 days ago
    • Promoted
    • New!
    Subject Matter Expert

    Subject Matter Expert

    Ryze Superfoods LLCPhilippines
    Subject Matter Expert page is loaded## Subject Matter Expertremote type : Remotelocations : Remote- Philippinestime type : Full timeposted on : Posted Todayjob requisition id : R- • •About RYZE...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Remote Senior PM : Stakeholder Adoption & Alignment

    Remote Senior PM : Stakeholder Adoption & Alignment

    Recruitnest ConsultingPhilippines
    A consulting firm in the Philippines is looking for a Senior Product Manager to strengthen stakeholder relationships and drive product adoption. The ideal candidate will have over 5 years of product...Show moreLast updated: 10 hours ago
    • Promoted
    Technical Training Director

    Technical Training Director

    Flightjobs / DVV MediaPhilippines (PH)
    Rishworth Aviation are looking for .A competitive and well-rounded remuneration package will be offered to successful candidates for this position. Sets the overall vision, strategy, and roadmap for...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Engineer-Electrical & I / C Design

    Senior Engineer-Electrical & I / C Design

    Energy Development CorporationPhilippines
    Senior Engineer-Electrical & I / C Design page is loaded## Senior Engineer-Electrical & I / C Designlocations : EDC Rockwell Business Center Tower 3time type : Full timeposted on : Posted 17 Days Ag...Show moreLast updated: 10 hours ago
    • Promoted
    PhD Data Partner - Biology - Asia | Fully Remote

    PhD Data Partner - Biology - Asia | Fully Remote

    TELUS Digital AI Data SolutionsPhilippines
    PhD Data Partner - Biology - Asia | Fully Remote.Freelance role requiring domain knowledge to design advanced, domain-specific questions and solutions. Create challenging problem sets that test deep...Show moreLast updated: 22 days ago
    • Promoted
    Senior Project Development Engineer

    Senior Project Development Engineer

    PacificimpactdevelopmentPhilippines
    Pacific Impact is a leading renewable energy developer, investor and operations company committed to sustainability and environmental stewardship. Our projects focus on developing renewable energy s...Show moreLast updated: 30+ days ago
    Chinese (Hong Kong) Linguistic Projects (Remote)

    Chinese (Hong Kong) Linguistic Projects (Remote)

    Sigma GroupPhilippines, PH
    Quick Apply
    Help shape the future of ethical AI.AI – Shaping the Future of Artificial Intelligence.Sigma is a leading global technology company specializing in data collection and annotation for Artificial Int...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Technical Project Manager

    Technical Project Manager

    ShaeWellnessPhilippines
    We are a global AI-powered technology and services group operating multiple brands across health, wellbeing, and performance. We're AI-first, outcome-obsessed, automation-heavy, and scale through ti...Show moreLast updated: 10 hours ago
    • Promoted
    Senior Civil Engineer

    Senior Civil Engineer

    Personnel Board of Jefferson CountyVictoria, Oriental Mindoro, Philippines
    Personnel Board of Jefferson County.Continue with Google Continue with Google.Be among the first 25 applicants.Personnel Board of Jefferson County. Senior Civil Engineers working within the Merit Sy...Show moreLast updated: 30+ days ago
    • Promoted
    Collector / Credit Investigator - Roxas, Mindoro

    Collector / Credit Investigator - Roxas, Mindoro

    SLFCroxas, Oriental Mindoro, Philippines
    Age Limit : Up to 33 years old .High school graduate or equivalent.Some college or relevant courses in finance / accounting is a plus but not required. At least 1 year of experience in collections or c...Show moreLast updated: 3 days ago
    • Promoted
    Preventive Maintenance Engineer- 1 yr Experience- Mindoro

    Preventive Maintenance Engineer- 1 yr Experience- Mindoro

    DEMPSEYMindoro, Oriental Mindoro, Philippines
    Graduate of BS Electronics / Electrical Engineering or Electronics / Electrical Technology .With at least 1 year work experience in preventive maintenance of auxiliary systems.Familiar with configurati...Show moreLast updated: 3 days ago
    • Promoted
    Technical Portfolio Lead

    Technical Portfolio Lead

    Energy Development CorporationPhilippines
    Technical Portfolio Lead page is loaded## Technical Portfolio Leadlocations : EDC Rockwell Business Center Tower 3time type : Full timeposted on : Posted 30+ Days Agojob requisition id : JR ## ...Show moreLast updated: 21 days ago
    • Promoted
    AI Tech Strategy Manager

    AI Tech Strategy Manager

    ShaeWellnessPhilippines
    We are a dynamic, AI-first global organization driving innovation across health, wellbeing, education, and tech.We build fast, scalable, and outcome-oriented ecosystems powered by AI and driven by ...Show moreLast updated: 30+ days ago
    • Promoted
    Certification & Assessment Proctor

    Certification & Assessment Proctor

    MediumPhilippines
    Certification & Assessment Proctor.Wing’s training and evaluation programs.This role ensures a fair, consistent, and secure testing environment — upholding the integrity of assessments that determi...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Project Manager

    Technical Project Manager

    DXC TechnologyPhilippines
    At DXC Technology, we prioritize in-person collaboration and encourage employees to work from a DXC office when appropriate. We also recognize that flexibility is important and understand that work ...Show moreLast updated: 30+ days ago