Job Description:
- Design and develop scalable data pipelines using modern data stack technologies for Pershing X’s Cloud data platform.
- Write ETL processes, design data applications and develop data pipelines for Operational Business Intelligence MartRole involves analyzing technical metadata, Data Pipeline logs and data lineage for data platform, and providing insights to support data platform operational decisions.
- Collaborate with cross-functional teams to understand and Elucidate Observability requirements for the data platform considering SLA, operational needs, DQ and proactive monitoring.
- Work with other engineers on the team to elevate technology and consistently apply best practices.
Required Skill and Experience:
- 'A minimum of five (5) years of IT experience in data engineering or data management field
- 4 - 5 years of experience in application development using SQL, PLSQL
- Strong working knowledge and min of 2 years’ experience in DBT, Snowflake
- Recent experience as a Senior Data Engineer in any public cloud, preferably on Azure as well as on a cloud warehouse like Snowflake is required
- 2+ years of experience in building data pipelines using various ETL and ELT tools
- Hands-on experience with Airflow is highly preferred
- Experience in building cloud native solutions, preferably on Azure including the use of DevOps CI / CD tools and containers.
- Proven experience as a Data Analyst or in a similar role.
- Strong proficiency in Data Modelling, process metadata, observability, and monitoring data platforms.
- Familiarity with data modelling tools / techniques is a plus
- Azure or Snowflake training / certification is a plus
- Strong analytical, problem solving, communication, collaborative and organizational skills
- Self-driven, self-directed, passionate analytical and focused on delivering the right results
Work location: Jersey City, NJ
Contact:
Joy - HR Recruiter
Cell:925-230-9484
Info Way Solutions LLC
Job Type: Full-time
Pay: $113,873.00 - $123,393.00 per year
Benefits:
- 401(k)
- Dental insurance
- Health insurance
Schedule:
- 10 hour shift
- Day shift
- Monday to Friday
Education:
Experience:
- SQL: 5 years (Required)
- DBT: 2 years (Required)
- Data pipelines: 2 years (Required)
- DevOps CI / CD: 2 years (Required)
- Data Analyst: 2 years (Required)
Ability to Commute:
- Jersey City, NJ (Required)
Ability to Relocate:
- Jersey City, NJ: Relocate before starting work (Required)
Work Location: On the road