• Skip to primary navigation
  • Skip to main content
  • Skip to footer

1.844.822.0541

info@nexusgroup.ca

  • Email
  • Facebook
  • Instagram
  • LinkedIn
  • Twitter
  • English
    • Français
  • Consultant Login
  • Find Your Opportunity
Nexus Systems Group

Nexus Systems Group

  • Home
  • What We Do
    • Staffing Solutions Made Easy
    • Contingent Workforce Management and Payroll Solutions
    • Technology Consulting and Delivery
  • Who We Serve
  • Who We Are
    • Our Team
    • News and Awards
    • Associations and Community
  • Contact Us
  • News

Data Engineer

September 7, 2022 by

Data Engineer

Typical Day in Role:
• Hands-on Engineering of Data Processing applications
• Experience with automated deployment of code using CI/CD tools like Jenkins, Bitbucket, Docker, Artifactory
• Experience with Big Data technologies, assisting clients in building software solutions that are distributed, highly scalable and across multiple data centers
• Hands on experience in architecting Big Data applications using Hadoop technologies such as Spark, , HDFS, Hive, Sqoop, HBase, Python
• Database setup/configuration/troubleshooting
• Automating work schedules with Airflow
• Strong Experience with event stream processing technologies such as Spark streaming, Storm, Akka, Kafka
• Experience working with Python & Spark
• Extensive experience with at least one major Hadoop platform (Cloudera, Hortonworks, MapR)
• Experience working with Business Intelligence teams, Data Integration developers, Data Scientists, Analysts and DBA’s to deliver well-architected and scalable Big Data & Analytics eco-system
• Proven track record of architecting Distributed Solutions dealing with real high volume of data(petabytes)
• Strong troubleshooting and performance tuning skills.
• Experience with SQL and scripting languages (such as Python, R)
• Deep understanding of . Google Cloud computing infrastructure and platforms
• Good understanding of Big data design patterns
• Ability to analyze business requirement user stories and model it to domain based services
• Experience working under agile delivery methodology

Must haves/Requirements:
• A minimum of 4 years’ experience in hands-on development as Data Engineer or related field
• 4+ years’ experience deploying data engineering solutions in a production setting
• 3+ years of hands-on experience with GCP is required
• Experience with Python & Spark. (Production level coding)
• Capability to architect highly scalable distributed data pipelines using open source tools and big data technologies such as Hadoop, HBase, Spark, etc.
• Experience of designing scalable solutions with proficiency in use of data structures and algorithms
• Previous work experience with Data Modeling (Basic Level) & Data Architecture

Nice to have:
• Experience architecting, implementing, and customizing digital analytics/customer data platform solutions with the Adobe Experience platform
• Expertise in data governance for big data space with knowledge of various MDM/entity resolution solutions
• Previous experience with Adobe’s Experience Platform (AEP) Real-time CDP solution
• Experience in cloud-based environment with PaaS & IaaS
• Previous experience with AEP digital marketing platform, Adobe tech stack.
Experience with Talend/ ETL tool.

Soft skills:
• Excellent written, presentation, and verbal communication skills
• Ability to work as part of a team, as well as work independently or with minimal direction..
• Collaborate with data architects, modelers and IT team members on project goals.

Education/Experience:
• Bachelor’s degree in a technical field such as computer science, computer engineering or related field required
• GCP certification is a plus

  • Apply Now
  • See All Jobs

Footer

ABOUT NEXUS SYSTEMS GROUP

Nexus is one of North America’s leaders in the provision of technology staff augmentation and strategic resource consulting. With a team of talented professionals using best of breed methodologies, Nexus consistently over delivers with quick, quality and trusted results to its clients and consultants.

LATEST OPPORTUNITIES

  • Developer- Postgres/ Python January 31, 2023
  • Talend Developer- Spark/ Elastic Search/ Kafka/ Postgres January 31, 2023
  • Bilingual Product Owner (Spanish/ English) January 31, 2023
  • Senior Technical Business Analyst January 31, 2023

SOCIAL

  • Email
  • Facebook
  • Instagram
  • LinkedIn
  • Twitter
Report on Business Canada's Top Growing Companies - Nexus Group
Nexus Group Growth 500 2019
Nexus Systems Group Growth 500 2018
NEXUS GROUP SYSTEMS GROUP INC. NEXUSGROUP.CA
  • Contact Us
  • Terms & Conditions
  • Privacy Policy