Responsibilities

• Analyze AI conversations to identify opportunities for improving response quality and enhancing user experience.
• Design, implement, and evaluate effective prompt engineering strategies.
• Optimize retrieval-augmented generation (RAG) pipelines and enhance retrieval quality.
• Evaluate various large language models (LLMs) and recommend the most effective models for specific use cases, with a potential focus on training personalized models.
• Define and monitor AI quality metrics, including accuracy, relevance, latency, and user satisfaction.
• Design and execute experiments to validate improvements in AI systems.
• Analyze user feedback and interaction data to continuously enhance AI behavior.
• Collaborate with AI Engineers to deploy validated improvements into production environments.
• Maintain comprehensive evaluation frameworks, benchmarks, and documentation.
• Stay updated on the latest advancements in generative AI and machine learning.

Requirements

• Master’s degree or Ph.D. in Computer Science, Data Science, or a related field.
• Proven experience as an AI Scientist or similar role with a focus on conversational AI.
• Strong knowledge of machine learning algorithms, natural language processing, and AI model evaluation.
• Experience with prompt engineering and RAG methodologies.
• Familiarity with various LLMs and their applications.
• Excellent analytical skills and ability to derive insights from complex data.
• Strong programming skills in Python or similar languages.
• Ability to work collaboratively in a fast-paced, dynamic environment.
• Strong communication skills to effectively convey technical concepts to non-technical stakeholders.

Benefits

• Competitive salary and performance-based bonuses.
• Comprehensive health benefits, including medical, dental, and vision coverage.
• Flexible work hours and the opportunity to work remotely.
• Professional development opportunities, including workshops and conferences.
• A collaborative and innovative work environment that fosters creativity.
• Access to the latest tools and technologies to support your work.
• Generous vacation and paid time off policies.