Peter Millar

Lead Principal Data Engineer

Research Triangle Park, NC · Principal

Sponsorship not specifiedDetected 15 days ago

PythonGitSQLAzureCI/CDSparkData EngineeringData ScienceLLMsRAGAgentic AIVendor ManagementTest AutomationLeadership

About the role

It's fun to work in a company where people truly BELIEVE in what they're doing!
We're committed to bringing passion and customer focus to the business.
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Own the end-to-end architecture of the Microsoft Fabric environment, including Lakehouse and Warehouse design, the medallion (bronze/silver/gold) pattern, and Direct Lake semantic datasets.
Design and govern OneLake as the single, organization-wide data lake, managing domains, shortcuts, data mirroring, and Delta Lake/Parquet storage standards.
Own data ingestion and transformation at scale using Fabric Data Factory pipelines, Dataflows Gen2, and Spark notebooks.

Implement security and governance controls, row/column-level security and PII handling, required for AI at scale.
Microsoft Fabric - deep, hands-on experience with Lakehouse, Warehouse, Data Factory pipelines, Dataflows Gen2, Spark notebooks, and Direct Lake.
Azure AI. experience integrating Azure AI services / Azure OpenAI into data and retrieval pipelines.
Microsoft Foundry (Azure AI Foundry) - working knowledge of the model catalog and RAG/agent grounding for GenAI workloads (applicable to this role).

Expert SQL and Python
strong Spark (PySpark) experience.
Experience managing or directing outsourced/consulting engineering teams.
Exposure to Microsoft Purview, data governance, and security/compliance frameworks.
Bachelor's in Computer Science, Engineering, or related field
Master's or relevant Microsoft certifications (e.g., Fabric Analytics Engineer, Azure Data Engineer Associate) a plus.

This listing is sourced directly from Peter Millar's careers page and normalized into a canonical job model.