Pyramid Consulting Inc.
Data Engineer (AI & LLM Expertise)
Plano, Texas, USA · Contract
Sponsorship not specifiedDetected 25 days ago
PythonGitSQLSnowflakeVector DatabasesAWSGCPAzureCloud PlatformsTerraformCI/CDMachine LearningdbtData EngineeringLLMsMLOpspytestProblem Solving
About the role
- Immediate need for a talented Data Engineer (AI & LLM Expertise).
- This is a 06-12+months contract opportunity with long-term potential and is located in Plano, TX / San Antonio, TX (Onsite).
- Please review the job description below and contact me ASAP if you are interested.
Responsibilities
- Maintain and enhance dbt models across staging (DL2) and mart (DL3) layers.
- Support Control-M scheduling changes and DBT deployments.
- Write and maintain SQL models following SQLFluff lint standards (ruff, mypy for Python).
- Manage source freshness and data quality test failures.
- Develop and maintain robust Python code for ETL processes, with an understanding of how data is processed by LLMs.
- Document AI/ML data pipelines, including explanations of tokenization strategies and data transformations relevant to LLM processing.
Requirements
- Must have skills: Data Engineer", "Snowflake SQL, "DBT", "Git", "Github Copilot", "AI.
- Experience with vector databases and embedding pipelines.
- Familiarity with MLOps principles and tools.
- If you are interested in this position, please apply online for immediate consideration.
Skills
- SQL (Client dialect), dbt Core/Cloud basics.
- Basic Python (scripting, pytest), with a strong understanding of its application in data pipelines and AI/ML.
- Git / GitLab branching and MR workflows.
- Familiarity with Terraform (reading/editing.tfvars).
- Understanding of incremental models, source freshness, and dbt state: selectors.
- Control-M scheduling concepts.
- Client warehousing (sizing, multi-clustering). dbt Cloud CLI, Poetry.
- Practical experience or strong theoretical knowledge of applying AI/LLMs to data processing tasks.
- Ability to understand and work with unstructured and semi-structured data for AI applications.
- Familiarity with prompt engineering principles for interacting with LLMs.
- Strong analytical and problem-solving skills, with a proactive approach to learning new AI technologies.
- US military Background is required.
Benefits
- Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
Apply directly at Pyramid Consulting Inc. →Create a free account for alerts like thisView Pyramid Consulting Inc. immigration profile
This listing is sourced directly from Pyramid Consulting Inc.'s careers page and normalized into a canonical job model.