Subject Matter Expert (Agentic Complex Engineering and Evaluation) - REMOTE
Get AI-powered advice on this job and more exclusive features.
Direct message the job poster from Innodata Knowledge Services, Inc.
Innodata Knowledge Services, Inc., a data‑engineering company delivering AI solutions to global clients, is currently hiring a full‑time Subject Matter Expert (Agentic Complex Engineering and Evaluation).
Key Responsibilities
- Create complex prompts in your subject domain according to detailed instructions and guidance.
- Design and implement evaluation rubrics on complex prompts of your creation.
- Provide evaluations and judgments of model responses, based on your domain knowledge.
- Commit to consistent throughput and improvements over the course of the project.
Technical & Required Skills
Strong prompt writing and prompt engineering skills, ideally previous experience in projects involving prompt engineering and writing.Knowledge and experience in writing prompt scoring rubrics.Strong domain knowledge in one of the following fields :Humanities (i.e. History, Literature, Art, Journalism, Philosophy)
Business (i.e. Economics, Finance, Accounting, Management)Eccentric (i.e. Games, Chess, Culinary Art)A collaborative mindset with the ability to solve complex technical challenges, follow guidelines and work independently as needed.Exceptional attention to detail and a commitment to delivering high‑quality, reliable AI solutions.Passion and curiosity in LLM improvement and data annotations.Qualifications
Master’s degree or higher in STEM, Humanities, Business or a related field.Experience with data annotation, especially prompt writing or LLM responses evaluation.Fluency in English at an academic level and above, with the ability to read, write, and communicate complex ideas clearly and precisely.#J-18808-Ljbffr