Description

You will develop tools and techniques to scale and accelerate AI risk assessment and measurement across BCG and its clients.

Responsibilities

• Collaborate with product teams to influence quality and risk measurement and mitigation in AI/GenAI products.
• Research new and emerging threats and measurement/evaluation approaches to keep methods current.
• Train and mentor technical practitioners on GenAI measurement and evaluation approaches.
• Execute risk assessment and measurement on AI/GenAI products within small technical teams.
• Maintain awareness of emerging frameworks, standards, and technical approaches through professional engagement.

Required Skills

• 3+ years of professional data science or quantitative research experience.
• Experience designing and analyzing experiments using advanced statistical methods.
• Strong conceptual understanding of ML and AI paradigms (e.g., deep learning, tree-based models).
• Proficiency in Python and the open-source data science ecosystem (e.g., pandas, scikit-learn, statsmodels).
• Hands-on experience with Generative AI, including prompt engineering and API interaction (e.g., OpenAI, HuggingFace).
• Experience with Git for version control.
• Ability to explain complex data science concepts to non-technical stakeholders.
• Familiarity with statistical modeling, including hierarchical linear models.

Preferred Skills

• Familiarity with software engineering practices such as unit testing or CI/CD.
• Experience with cloud platforms like AWS, Azure, or GCP.
• Knowledge of AI risk management frameworks (e.g., NIST AI RMF).

Key Skills

Education

Any Gradute