Overview:
The Data Engineer will be responsible for developing and supporting database applications to drive automated data collection, storage, visualization and transformation as per business needs. The candidate will uphold Prodapt’s winning values and work in a way that contributes to the Company’s vision.
Responsibilities:
- Data Pipeline and Software Implementation.
Design, build, and maintain data pipelines that extract, transform, and load (ETL) data from various sources to GCP services such as BigQuery, Cloud Storage, and Cloud Dataproc.
-
Implement data pipelines as per the design document
-
Assist in the implementation of technical systems and software, solutions • Perform Unit testing and troubleshoot
-
Database design, Data Modelling and Mining
-
Consolidate data across multiple sources and databases to make it easier to locate and access
-
Implement automated data collection and data storage systems
-
Provide database support by coding utilities, respond to and resolve user problems
-
Cloud Enablement
-
Develop and deploy applications at the direction of leads including large-scale data processing, computationally intensive statistical modeling, and advanced analytics
-
Data Visualization and Presentation
-
Write complex SQL queries (T-SQL/PL-SQL) and stored procedures
Requirements:
Bachelor’s degree (in any field).
-
MSc/BE/Masters with specialization in IT/Computer Science is desirable.
-
Proficiency in GCP services (BigQuery, Cloud Storage, Dataflow, Dataproc, etc.).
-
Experience with data warehousing concepts and tools.
-
Knowledge of programming languages (e.g., Python, Java, SQL).
-
Familiarity with data modeling techniques and optimization strategies.
