Data Engineer
Sumter, SC
Applications will be accepted on an ongoing basis.
ICR is a rapidly growing employee-owned company focused on solving the hardest problems for the US Government. Join our TACOMA Command Technology & Data Office (CTDO) team to help govern unstructured data within and promote data literacy throughout the Command.
Responsibilities
- Work with the team to evaluate business needs and priorities, liaise with key business partners and address team needs related to data systems and management.
- Translate business requirements into technical specifications; establish and define details, definitions, and requirements of applications, components and enhancements.
- Participate in project planning; identifying milestones, deliverables and resource requirements; tracks activities and task execution.
- Generate design, development, test plans, detailed functional specifications documents, user interface design, and process flow charts for execution of programming.
- Develop data pipelines / APIs using Python, SQL, potentially Spark and AWS, or Azure Methods.
- Use an analytical, data-driven approach to drive a deep understanding of fast changing business.
- Build large-scale batch and real-time data pipelines with data processing frameworks in AWS, or Azure cloud platform.
- Moving data from on-prem to cloud and cloud data conversions.
Required Qualifications
- Bachelor's degree or equivalent work experience.
- Active Top Secret clearance with SCI access.
- 2+ years of experience in data engineering with an emphasis on data analytics and reporting.
- 2+ years of experience with at least one of the following cloud platforms: Microsoft Azure, Amazon Web Services (AWS), Google Cloud Platform (GCP), others.
- 2+ years of experience in SQL, data transformations, statistical analysis, and troubleshooting across more than one Database Platform (Cassandra, MySQL, Snowflake, PostgreSQL, Redshift, Azure SQL Data Warehouse, Databricks, etc.).
- 2+ years of experience in the design and build of data extraction, transformation, and loading processes by writing custom data pipelines.
- 2+ years of experience with one or more of the follow scripting languages: Python, SQL, R, and/or other.
- 2+ years of experience designing and building solutions utilizing various Cloud services such as EC2, S3, EMR, Kinesis, RDS, Redshift/Spectrum, Lambda, Glue, Athena, API gateway, etc.
Preferred Qualifications
- Master's degree or higher.
- AWS, Azure and/or Google Cloud Platform Certification.
- Expertise in one or more programming languages, preferably Scala, PySpark and/or Python.
- Experience working with either a Map Reduce or an MPP system on any size/scale.
- Experience working with Agile development methodologies such as Sprint and Scrum.
- Experience in identifying authoritative data sources for specific data domains, cross system domains, and data lineage roadmaps in conjunction with data scientists, data analytics staff, SMEs (Subject Matter Experts), data stewards, governance, and data quality staff.
- Experience in discerning and developing data mapping guidelines and best practices in the identification, prioritization, and mitigation of redundant, inconsistent, obsolete, and trivial data for critical data elements (CDEs) across and within core mission operational systems.
- Experience in designing, managing, and delivering large, complex data solutions across a variety of disparate and ambiguous authoritative data sources, various levels of data quality (veracity), and significant data velocities and volumes that support, sustain and scale complex data analytics needs and time urgency.
Salary Range: $90,000 - $150,000
This position offers a comprehensive benefits package that includes company equity, retirement plan, company-paid health care benefits, flexible paid time off policy, and opportunity for a raise and bonus during the year.
ICR, Inc. considers several factors when extending job offers, including but not limited to candidates’ key skills, relevant work and/or military experience, education, training certifications and work location.
ICR is proud to be an equal opportunity employer and considers qualified applicants for employment without regard to race, color, creed, religion, national origin, sex, sexual orientation, gender identity and expression, age, disability, veteran status, or any other protected factor.