Spear AI

Spear AI

Mission Data Engineer

Washington, DC · Full-time

No sponsorshipDetected 455 days ago
PythonSQLAWSCloud PlatformsMachine LearningSparkAirflowData EngineeringCybersecurity

About the role

  • Handle data ingestion, transformation, and validation with auditable, secure processes.
  • Ensure compliance with DIA's data governance and cross-domain security standards.

Responsibilities

  • Design and manage secure data pipelines enabling ML and analytics workflows.
  • Collaborate with mission engineers and data scientists to align infrastructure with operational objectives.
  • Optimize data processing and storage for real-time and batch operations.
  • Spear AI seeks a Data Engineer to build robust, secure data infrastructure supporting the an IC Task Force.
  • The role involves creating resilient pipelines to power analytics and decision support systems.
  • Primary Responsibilities: Design and manage secure data pipelines enabling ML and analytics workflows.

Requirements

  • 3-7 years in data engineering, preferably within secure, high-side environments.
  • Proficiency in Python, Spark, SQL, and data orchestration tools (e.g., Airflow).
  • Experience with classified data management, secure networking, and infrastructure optimization.
  • Required Experience: Active Secret clearance.

Nice to have

  • Familiarity with IC standards (UDS, IC ITE) and secure cloud environments (AWS GovCloud, C2S).
  • Strong troubleshooting and optimization skills within complex operational settings.
  • Preferred Experience: Familiarity with IC standards (UDS, IC ITE) and secure cloud environments (AWS GovCloud, C2S).

This listing is sourced directly from Spear AI's careers page and normalized into a canonical job model.