M3
Senior Quality Engineer, Data & AI Platform
Lawrenceville, Georgia, United States · Senior · Contract
Sponsorship not specifiedDetected 4 days ago
PythonSQLDatabricksAzureCI/CDDevOpsOpenAPIMachine LearningdbtData EngineeringLLMsAgileFinancial AnalysisAccountingPlaywrightPostmanManual TestingAPI TestingCommunicationCollaborationFinancial Reporting
About the role
- M3 ( www.m3as.com ) is a leading provider of hospitality-specific software solutions, delivering cloud-based tools for hotel accounting, financial reporting, labor management, payroll, and business intelligence.
- Description Summary: The Senior Quality Engineer - Data & AI sits at the intersection of data engineering, machine learning product delivery, and quality assurance.
- Unlike traditional QE roles focused on deterministic software, this position requires quality thinking applied to systems that produce probabilistic outputs - where "passing" is defined by accuracy thresholds, not binary correctness.
Responsibilities
- Design and execute test strategies for AI/ML-enabled features; define acceptance thresholds (precision, recall, F1) in partnership with Engineering and Product.
- Validate AI-generated outputs - mappings, anomaly flags, LLM summaries - against domain-grounded acceptance criteria; build regression suites to detect concept drift, label drift, and feature degradation.
- Evaluate LLM outputs for accuracy, hallucination, and format compliance; build prompt regression test suites to catch behavior changes when model versions or system prompts are updated.
- Write data validation logic in Python or SQL against tables across Bronze, Silver, and Gold layers; design and automate data contract tests covering schema, null rates, referential integrity, and row counts.
- Implement automated validation checkpoints in Databricks pipelines; apply statistical testing methods to pipeline output validation.
Nice to have
- Minimum of 5 years of experience in software testing or quality engineering, with at least 2 years focused on data-intensive or AI/ML-enabled products.
- 3+ years of hands-on experience with Microsoft SQL Server for data validation and testing
- experience using Azure DevOps for test management and release coordination.
- 2+ years of API testing experience (Postman, Swagger, or SoapUI)
- experience writing and executing test cases for ETL processes and data warehouse environments.
- Hands-on experience with Databricks, Delta Lake, or equivalent Lakehouse platforms and Python for data validation strongly preferred.
- Experience validating ML model outputs and familiarity with LLM evaluation, prompt regression testing, or generative AI quality workflows preferred.
- Familiarity with dbt, Great Expectations, MLflow, or equivalent pipeline-level assertion and experiment tracking tools preferred.
Skills
- Adhere to secure testing practices and compliance requirements associated with the assigned Technical Security Level.
- Other duties as assigned.
Benefits
- The Senior Quality Engineer - Data & AI sits at the intersection of data engineering, machine learning product delivery, and quality assurance.
Company info
- This role is responsible for validating AI-powered and data-driven features across M3's hospitality accounting platform, with primary ownership of quality for the Data & AI team's active products.
- The right candidate understands how AI products fail differently and is motivated to build the testing practice that prevents those failures from reaching customers.
This listing is sourced directly from M3's careers page and normalized into a canonical job model.