Block

Senior Machine Learning Engineer, Applied AI Quality

Bay Area, CA, United States of America · Senior

Sponsorship not specified$229k-$343kDetected 2 days ago

Machine LearningLLMsA/B TestingLeadershipCommunication

About the role

At Block, we believe product quality is foundational to great user experiences, and AI is transforming how we measure, understand, and improve that quality at scale.
In this role, you'll operate across ambiguous, high-impact problem spaces and shape how quality is measured and operationalized across the organization.
Define long-term approaches for evaluation, measurement, and quality intelligence across complex product surfaces.

You'll drive the architecture and strategy behind systems that evaluate product behavior, surface emerging issues, generate actionable insights, and enable teams across Block to make higher-confidence product decisions.
Drive the development of scalable systems that use LLMs, agents, and behavioral signals to evaluate quality, detect regressions, and generate product insights.
Mentor and level up engineers across the organization through technical leadership, design reviews, and systems thinking.
Want to learn more about what we're doing to build a workplace that is fair and square?
empowering you to do the best work of your career while building the life you want.
Block, Inc. (NYSE: XYZ) builds technology to increase access to the global economy.
Afterpay is transforming the way customers manage their spending over time.
Together, we're helping build a financial system that is open to everyone.

Deep experience designing and shipping large-scale AI/ML systems in production environments.
Strong expertise with LLMs, agents, evaluation systems, retrieval architectures, and modern AI infrastructure.
Strong systems thinking and architectural judgment, with the ability to balance experimentation, scalability, and operational rigor.
Experience defining technical strategy and influencing roadmaps beyond your immediate team.

Check out our other benefits at Block.
Remote work, medical insurance, flexible time off, retirement savings plans, and modern family planning are just some of our offering.

We're working to build a more inclusive economy where our customers have equal access to opportunity, and we strive to live by these same values in building our workplace.

Block is an equal opportunity employer evaluating all employees and job applicants without regard to identity or any legally protected class.

This listing is sourced directly from Block's careers page and normalized into a canonical job model.