Senior Data & ML Observability Analyst
WHOOP
Software Engineering, IT, Data Science
Boston, MA, USA
Posted on Mar 5, 2025
At WHOOP, we are on a mission to unlock human performance and healthspan. Our platform empowers members to make data-driven decisions that improve health, recovery, and performance by offering unparalleled insights into their unique physiology.
Data is the foundation of WHOOP's innovation, and our Machine Learning (ML) platform is the connective tissue that enables data to power real-time insights, personalized algorithms, and breakthrough science. As a Senior Data & ML Observability Analyst, you will lead initiatives that ensure our physiological models and data pipelines are transparent, resilient, and impactful. Your work will support mission-critical ML products, ensure stakeholder confidence through robust monitoring, and champion innovation in observability tooling.
RESPONSIBILITIES:
- Build Observability Frameworks: Design, implement, and maintain scalable observability solutions to track the health and performance of offline and real-time ML models.
- Monitor Data & ML Quality: Develop dashboards and alerts to track data quality, distributional shifts, and model drift. Partner with teams to investigate anomalies and recommend solutions.
- Cross-Functional Collaboration: Work closely with data scientists, ML engineers, product managers, and software teams to define observability requirements, translate use cases, and ensure seamless integration.
- Support Algorithm Deployments: Guide new algorithm rollouts with monitoring strategies that validate performance across WHOOP diverse member base.
- AI-Driven Innovation: Leverage modern AI tools (e.g., Copilot, Cursor, ChatGPT) to automate observability workflows, optimize monitoring pipelines, and uncover new insights.
- Mentorship Opportunity: Serve as a mentor to other analysts as the team grows, offering guidance and leadership in best practices and career development.
- Continuous Improvement: Stay current on emerging technologies, observability trends, and industry best practices to enhance WHOOP's data and ML infrastructure.
QUALIFICATIONS:
- Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field.
- 4+ years of experience in data analytics, data engineering, or ML operations, with a focus on data quality & model performance observability.
- Strong SQL & DBT skills; experience with Snowflake is highly preferred.
- Proficiency dealing with large data sets via programming languages like Python.
- Experience with data visualization platforms such as Sigma, HEX, or equivalent.
- Proven experience on providing actionable insights for different stakeholders based on a variety of data sets.
- Familiarity with ML lifecycles, performance monitoring, and basic modeling concepts.
- Experience working with physiological or time-series data is a strong plus.
- Strong interpersonal and communication skills; comfortable translating technical observations into business value.
- Keen attention to detail, structured problem-solving approach, and an iterative mindset.
- Experience mentoring or coaching junior team members.
- Understanding of MLOps best practices including CI/CD pipelines for model deployment and validation.
This role is based in the WHOOP office located in Boston, MA. The successful candidate must be prepared to relocate if necessary to work out of the Boston, MA office.
Interested in the role, but don’t meet every qualification? We encourage you to still apply! At WHOOP, we believe there is much more to a candidate than what is written on paper, and we value character as much as experience. As we continue to build a diverse and inclusive environment, we encourage anyone who is interested in this role to apply.
WHOOP is an Equal Opportunity Employer and participates in E-verify to determine employment eligibility. It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.