Data Engineer

Data Engineer

Typical Day in the Role:
•Create framework that can be adopted for multiple projects
Setting up framework
Following and setting best practices and standards
Setting up reusable patterns
Ensuring data pipelines are delivered

•Must Have Skills/Requirements:
1) Big Data (Spark) 3+ years of hands on experience
2) Relational database: 3+ years of hands on experience
3) Advanced SQL skills (PL/SQL, TSQL): 3+ years of hands on experience
4) Java/Scala/Python Programming: 5+ years of hands on experience
5) Setting up data pipelines using Java or any open source tool
6) Shell scripting hands on experience

•Nice to have Skills:
Customizing DevOps Pipelines (setting up their own Dev platform, and configuring Git & Jenkins pipelines)
Enterprise scheduler (AutoSys, etc.)
orchestrating pipelines
FI/Banking experience
Agile experience

Soft Skills:
Hands on but leading the development (guide other team members, delegate)
Strong communication skills
Verbal & written (technical documentation)

Education: Post Secondary education in a related field or equivalent work experience