Indiana University
Lead Data Engineer (Data Engineer)
Bloomington, Indiana, USA · Staff+ · Full-time
Sponsorship not specifiedDetected 43 days ago
PythonVector DatabasesAWSAzureDockerCI/CDRESTMachine LearningData AnalysisData EngineeringLLMsRAGAgentic AILangGraphStatisticsResearchCommunicationTime ManagementMentoring
About the role
- May contribute to committees and communities of practice to share and improve data engineering practices across the university; provides a high level of consultation and mentoring to other groups and staff on the use of data engineering tools and software.
- Qualifications Combinations of related education and experience may be considered.
Responsibilities
- Job Summary Performs advanced data management tasks, including complex data modeling, conversion, de-duplication, migration, and identification and repair of data quality issues.
- Designs, develops, and implements complex custom data systems and advanced reconciliation tools, processes, rules, solutions etc. to validate data, match/merge, and upload batch lists.
- Creates and tunes highly complex stored procedures and queries for advanced data management and extraction.
- Makes recommendations to improve, as well as implements, documentation and security protocols and procedures for data engineering projects and/or activities; fixes complex problems and resolves issues accordingly.
- Performs advanced-level research and stays up-to-date with data engineering best practices and approaches; stays abreast of latest security threats and risks to proactively address potential exposures.
- May serve as project lead; often provides guidance to junior peers.
Requirements
- SKILLS Required Proficient communication skills.
- Maintains a high degree of professionalism.
- Possesses a high degree of initiative.
- Experience with prompt engineering, inference pipelines, and APIs for deploying AI agents at scale.
Skills
- Demonstrates time management and priority setting skills.
Benefits
- Our innovative curriculum is built on personal development, teamwork, and experiential learning with an emphasis on global and social responsibility.
- Education beyond the minimum required may be substituted for work experience.
- Work experience beyond the minimum required may be substituted for education.
- EDUCATION Required Bachelor's degree (preferably in computer science, information science, or related field.) WORK EXPERIENCE Required 5 years data management, engineering, or related experience.
- Preferred Familiarity with conventional machine learning models and processes, including classification, clustering, and retrieval.
Equal opportunity
- Indiana University is an equal opportunity employer and provider of ADA services and prohibits discrimination in hiring.
- See Indiana University Notice of Non-Discrimination here which includes contact information.
- Campus Safety and Security The Annual Security and Fire Safety Report, containing policy statements, crime and fire statistics for all Indiana University campuses, is available online.
- You may also request a physical copy by emailing IU Public Safety at or by visiting IUPD.
Apply directly at Indiana University →Create a free account for alerts like thisView Indiana University immigration profile
This listing is sourced directly from Indiana University's careers page and normalized into a canonical job model.