Data Engineer for Amplifi Loyalty Solutions, LLC, Naperville, IL.
Develop and lead the implementation of sophisticated software-based data programs specific to the financial services industry. Utilize extensive knowledge of data warehousing, infrastructure, and data analysis to manage large data sets effectively, uncovering significant insights that solve real-world financial problems and influence strategic decision making.
- Design, develop and maintain modular code base to solve “real” world problems.
- Conduct regular peer code reviews to ensure code quality and compliance following best practices in the industry.
- Work in a cross-disciplinary teams to understand client needs and ingest rich data sources.
- Research, experiment and utilize leading Big Data technologies in AWS.
- Participate in developing and presenting thought leadership and assist in ensuring that ampliFI’s “data source” technology stack incorporates and is optimized for using specific technologies.
- Automate and monitor data ingestion pipelines from various internal and external sources, including market data feeds, transaction logs, and customer databases.
- Ensure data is correctly extracted, transformed, and loaded (ETL) into the data warehouse or data lakes, resolving any issues that arise during data transfers.
- Implement and enforce data quality standards to ensure high accuracy and completeness of the data collected. Perform routine data quality checks and validations using automated scripts; rectify any data inconsistencies or anomalies.
- Administer database operations including indexing, partitioning, and tuning to optimize performance for large-scale data operations.
- Manage data storage according to compliance and security policies, ensuring data is encrypted and securely stored.
- Design and modify data warehousing solutions that are scalable and efficient.
- Update data schemas and models as new requirements emerge, ensuring that the warehouse evolves with changing business needs.
- Continuously improve and streamline data pipelines for greater efficiency and reliability. Develop new data pipelines to support additional data sources or new analytical demands from business users.
- Evaluate and adopt new tools and technologies that can enhance the data infrastructure of the financial institution.
- Participate in workshops and training to stay current with the latest trends and best practices in data engineering.
- Act as a primary point of contact for any data-related issues encountered by users. Quickly diagnose and resolve issues to minimize the impact on business operations.
Position is based out of and reports to Amplifi’s HQ in Naperville, IL, but allows for the option to telecommute from a home office outside of IL (except the following states from which remote work is not an option for tax reasons: AL, AK, AR, CA, CT, DE, HI, ID, IA, KS, KY, LA, ME, MD, MI, MN, MS, NV, NM, ND, OK, OR, RI, SD, VT, WA, WV, and WY.
Requirements:
At least a Bachelor's or higher in Computer Science, Information Technology, Computer Engineering, or other engineering degree provided program included coursework in analytics & statistical design and three (3) years of experience as a data engineer or data/business analyst developing and implementing big data methodologies with multiple programming languages and technologies.
In addition, the position requires at least 3 years of work experience in the financial service sector.
Requires at least 3 years of experience and the ability to demonstrate competency in each of the following:
- Working with Unix/Linux;
- Working with source code management systems such as GIT;
- Utilizing Python, Pandas, Spark and Java;
- Engineering and visualizing data, both for ad hoc and product level (e.g. automated) data & analytics solutions;
- Developing and implementing Large scale, AWS big data methods including EC2, S3, EMR, Kinesis, DynamoDB, Athena, AWS-Glue and Redshift;
- Utilizing programming methodologies (Terraform, version control, testing, QA);
- Working in an agile environment and with agile development methodologies;
- Two-week sprint cycles;
- Partnering with Quality Analysts to test software or application and identify setbacks and errors;
- Documenting work for future review and use;
- Reviewing code and framework for potential issues; and
- Completing duties in the given time frame.
Salary: $124,200
#LI-DNI
