Responsibilities: Manage the end to end data pipelines that pull data from operational system and from different end points, transform and load the data to the company data lake Current environment is set up on hadoop, but the team will be responsible to complete migration to a new Spark based environment on AWS Qualifications: 4+ years of hands-on experience as a Data Engineer BA/BSc in a related field such as CS, engineering, information systems, or equivalent. High proficiency in SQL & Py
Remote-friendly
