Job Overview:
We are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering and a passion for building scalable, reliable, and high-performance data pipelines. The role involves designing and implementing data infrastructure, data ingestion and processing, and data analytics and visualization. The successful candidate will have experience working with a variety of data technologies and tools, and will be able to collaborate with data scientists to develop and deploy data models and machine learning algorithms.
Duties:
- Design and implement data architectures using Hadoop, AWS, and Azure Data Lake, ensuring data is secure, scalable, and easily accessible.
- Develop and maintain complex data pipelines using Shell scripting, Informatica, and VBA.
- Analyze data using various tools and techniques, including data modeling and data visualization.
- Collaborate with data scientists to develop and deploy machine learning models, including model training and hyperparameter tuning.
- Design and implement databases to store and manage large amounts of data.
- Ensure data integrity, accuracy, and compliance with relevant regulations.
- Troubleshoot and optimize data processing and ingestion workflows.
- Work closely with cross-functional teams to ensure data is properly integrated with other systems and applications.
- Stay up-to-date with the latest trends and technologies in data engineering and machine learning.
Qualifications:
- Bachelor's degree in Computer Science, Data Science, or a related field.
- Strong experience with data engineering and data architecture.
- Proficiency in Shell scripting and experience with AWS, Azure, and/or Hadoop.
- Experience with Informatica, VBA, and/or other data integration tools.
- Excellent analytical and problem-solving skills.
- Strong understanding of database design and data modeling.
- Experience with machine learning and model training.
- Ability to work collaboratively in a fast-paced environment.
- Strong communication and project management skills.
Job Type: Full-time
Pay: $96,721.00 - $104,730.00 per year
Benefits:
- 401(k)
- Dental insurance
- Health insurance
Schedule:
Ability to Commute:
- Washington, MS 39190 (Required)
Ability to Relocate:
- Washington, MS 39190: Relocate before starting work (Required)
Work Location: In person