Seeking a Data Engineer with a strong background designing, implementing, and optimizing data pipelines, including building data pipelines from scratch. This role requires a high proficiency in T-SQL and developing complex data processing solutions in an Azure SQL environment.
Duties and Responsibilities:
- Design, develop, and optimize end-to-end data pipelines utilizing ETL processes, ensuring scalability, reliability, and high-performance.
- Perform data cleansing, data integration, and data QA/QC activities to maintain the accuracy and integrity of large datasets.
- Identify, design, and implement data processing improvements, such as automating manual processes, optimizing data delivery, enhancing process performance, etc.
- Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
- Provide technical expertise in code analysis, debugging, and troubleshooting.
- Ensure that all deliverables developed are high quality, thoroughly tested, and appropriately documented, including conducting comprehensive functional testing.
- Work with team to keep standard procedures, how-to guides, and other team documentation current.
Required Qualifications:
- 5+ years of data engineering experience, including design and implementation of ETL processes to establish and improve data pipelines.
- 5+ years of experience with data processing in Microsoft SQL Server / Azure SQL databases, including high proficiency in writing efficient SQL queries, stored procedures, functions, etc. for complex data tasks.
- 3+ years of experience developing solutions using Azure data processing services, such as Azure Data Factory, Azure Databricks, or Azure Synapse
- Demonstrated understanding of database and schema design principles, data integrity, and data governance practices.
- Strong problem-solving skills and ability to troubleshoot/solve complex data-related issues.
- Experience using version control system such as Git.
- Bachelor’s Degree, preferably in a quantitative discipline such as Computer Science, Software Engineering, or Mathematics.
- Ability to obtain a DoD SECRET clearance.
Desired Qualifications:
- Experience with Department of Defense enterprise application development/release in Azure Government Cloud environment
- Experience with statistical software and data analysis tools, such as R.
Job Type: Full-time
Pay: $105,000.00 - $115,000.00 per year
Benefits:
- 401(k)
- 401(k) matching
- Dental insurance
- Health insurance
- Paid time off
- Vision insurance
Schedule:
- 8 hour shift
- Monday to Friday
Experience:
- ETL: 5 years (Preferred)
- SQL/Azure: 5 years (Preferred)
- Data warehouse: 3 years (Preferred)
Work Location: Remote