Senior Data Engineer (Databricks Expert)
Location: Hybrid (Dallas, TX or Miramar, FL)
Duration: 6+ Months Contract to Hire
Manager wants a Databricks SME
Sr. Developer ETL, Databricks Platform Admin on AWS
Responsibilities:
- Join a growing Databricks team focused on GenAI platform development.
- Work within the platform operations team, which currently consists of 7 members.
- Manage and ensure the Databricks platform is up and running smoothly.
- Leverage advanced Python skills for Databricks development.
- Collaborate with the team to manage AWS datasets, primarily from SAP.
- Work with APIs, frameworks, and backend components, ensuring optimal functionality and security.
- Oversee user provisioning and access management.
- Maintain and enhance the cloud infrastructure and data lake house.
Key Requirements:
- Experience in Databricks, with an emphasis on platform and cloud management.
- Strong background in ETL development, with experience in data engineering.
- Advanced Python programming skills, particularly in Databricks.
- Proficient with AWS, especially working with datasets from SAP.
- Familiarity with Redshift, Informatica, and components API frameworks.
- 3+ years of experience in Framework Development.
- Understanding of Data Lake House architecture and best practices.
Additional Notes:
- AWS expertise is essential.
- Databricks experience, particularly in managing cloud infrastructure, is crucial.
- Redshift knowledge is a bonus as it is part of the ecosystem.
- The role is focused on platform management, with a key focus on security and control of data.
Job Type: Contract
Pay: $60.00 - $70.00 per hour
Schedule:
- Day shift
- Monday to Friday
Work Location: In person
