Responsibilities‍

• Formulate data-driven approaches to evaluate and improve AI agent performance, leveraging diverse algorithms and data sources.   

• Apply state-of-the-art LLM and machine learning techniques to analyze and optimize agent behavior  

• Use data exploration to uncover patterns in agent interactions, identify new opportunities or issues, and assess data limitations within our problem space.   

• Engage with product teams and collaborate with other data scientists, engineers, designers, and product managers to translate findings into clear, actionable insights that shape product features and improve our Copilot Studio platform.   

‍

‍

‍Qualifications‍

• Education & Experience:
  • PhD in Data Science, Mathematics, Statistics, Econometrics, Physics, Operations Research, Computer Science, or related field OR  
  • MSc in Data Science, Mathematics, Statistics, Econometrics, Physics, Operations Research, Computer Science, or related field AND 1+ year(s) data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) or consulting experience OR  
  • BSc in Data Science, Mathematics, Statistics, Econometrics, Physics, Operations Research, Computer Science, or related field AND 2+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) OR equivalent experience

• Programming Skills: Proficiency in one or more programming/scripting languages for working with data, such as Python, C++, or C#. 
• Machine Learning Experience: Experience in applying machine learning to large-scale data sets. Solid understanding of ML algorithms and evaluation techniques 
• Analytical Mindset: Strong data analysis and problem-solving skills. Ability to use data to draw insights and make decisions, experiment design, and interpret model performance metrics. 

‍

‍

Other Requirements 

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check:  

This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.   

‍

‍

Preferred/Additional Qualifications

• Excellent teamwork and communication skills. Comfortable working in a fast-paced, interdisciplinary environment and presenting complex findings in a clear, impactful way. 
• Experience with building ML and LLM products, focusing on NLP and conversational AI.
• Passion for learning and stay informed with State of the Art progress

‍