Are you excited about distilling user behavior on a complex internet scale product to make it better? Bing Search & Copilot are Microsoft's premier AI consumer products, dedicated to helping every human worldwide to find what they want and our decisions are driven by data and metrics. The Bing Metrics team is central to this mission, owning and managing all aspects of metrics and data pipelines, from telemetry collection to the creation of meaningful metrics for A/B testing, offline quality analysis informing key shipping decisions and providing forward-looking analysis for opportunities. Our data products are utilized daily by thousands of internal customers to identify and improve search quality worldwide. Information search as an industry is entering an exciting time with AI being integrated and disrupting the paradigms that have been standard for decades which challenges decades-old assumptions of how to measure user success and the types of metrics and telemetry to collect for it.We are seeking a passionate Product Manager II to lead and drive the roadmap for the fundamental data collection mechanisms that distill what user's satisfaction and success entails. You will also have opportunities to build Key metrics with this data that will be used by all Bing engineers to inform their product direction and ship decisions. This role offers the opportunity to collaborate with multiple teams across Bing, significantly influencing search engine relevance and search result quality, ultimately having a direct impact on our customers.Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.QualificationsRequired Qualifications:- Bachelor's Degree AND experience in product/service/project/program management or software development- OR equivalent experience.- Background in product management of internal data systems within the tech industry.- Expertise in working with Big data systems, metrics, data analysis and using insights to drive product improvements.- Experience managing cross-team collaboration projects across multiple stakeholders.Additional or Preferred Qualifications:- Familiarity with crowdsourcing label collection solutions & applying LLMs for data labeling.- Experience of managing cross-team collaborations projects across the organization.- Knowledge of SQL, Python, LLM prompting techniques.Responsibilities- Defining and implementing search quality metrics.- Analyzing user activity & labeled data for quality metrics and deriving actionable insights.- Driving continuous improvements in Bing Search.- Collaborating with cross-functional teams to address quality and relevance issues within Bing.Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work:- Industry leading healthcare- Educational resources- Discounts on products and services- Savings and investments- Maternity and paternity leave- Generous time away- Giving programs- Opportunities to network and connectMicrosoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.#J-18808-Ljbffr