Data Engineer
Location Address: WFH, location downtown Toronto
Contract Duration: 6 months
Extension: Possible
FTE: Possible
Number of Positions: 1
Schedule Hours: 9am-5pm, Monday-Friday
OT: Potential overtime on Saturdays once a month for releases.
Story Behind the Need
• Business group: GWRT – Business Support & Engineering
• Project: Trade Central – midstream application with many consumers and data points. Do ETLs and send data to downstream consumers within deadlines.
• Reason for request: Onboard Data engineer for new projects in the pipeline
Candidate Value Proposition
– The successful candidate will have the opportunity to work on a growing and inclusive team with high visibility within the bank. The project is critical to bank operations, compliance, success of trades, etc. Opportunity to work on new technologies such as Spark and Kafka.
Typical Day in Role
• Working with BAs, other team members, as well as the business stakeholders
• Understanding the process and what needs to be done on the given data pipeline
• Designing, testing, and developing for meeting objectives
• Being the level II or level III support, if the need arises. Potential support once a month needed on Saturdays for releases.
• Have autonomy to make decisions on current technologies
• Ensure scalability of the project
Candidate Requirements/Must Have Skills:
• 3-5 years’ experience working with Spark, Nifi, Hive, and Tez on a high level (must have a demonstratable ability to use these technologies)
• Software development background with experience in Bitbucket, Unix,
• 3+ years’ experience with scripting (preferably Bash Scripts)
• Familiarity with big data and technologies such as Airflow, Oozie, etc.
• 5+ years’ experience with SQL
Nice-To-Have Skills:
• Java or Python would be an asset
• Capital Market exposure working building scalable data pipelines
• Proficiency with relational databases (Oracle, DB2, Redshift, etc.)
Soft Skills:
• Team Player
• Good communication
• Independent
• Proactive and ability to problem solve
Best vs Average: Willing to take leadership and ownership on the team, as the team is relatively new and on-time delivery is critical. Initiative is important. More experience in listed technologies would increase confidence in the candidate’s ability to perform.
Degrees or certifications:
• Bachelor's degree in a technical field such as computer science, computer engineering or related field required
Candidate Review & Selection
• Structure and Format:
o First round: Technical interview (1-2 interviewers)
o Second round: Interview with management
o Note: may hold both rounds in one if team is able to coordinate the same time