Hadoop DevOps
Description:
12 months contract
Location – Mississauga
Responsible for the development, design, and implementation of application systems. Designs and codes programs, including the ability to test their coding, find errors, and correct codes to provide quality coding. Interfaces with technical team to design and implement application systems.
Participate in all aspects of Big Data solution delivery life cycle including analysis, design, development, testing, production deployment, and support
Develop standardized practices for delivering new products and capabilities using Big Data technologies, including data acquisition, transformation, and analysis
Ensure Big Data practices integrate into overall data architectures and data management principles (e.g. data governance, data security, metadata, data quality)
Create formal written deliverables and other documentation, and ensure designs, code, and documentation are aligned with enterprise direction, principles, and standards
Train and mentor teams in the use of the fundamental components in the Hadoop stack
Assist in the development of comprehensive and strategic business cases used at management and executive levels for funding and scoping decisions on Big Data solutions
Troubleshoot production issues within the Hadoop environment
Performance tuning of a Hadoop processes and applications
Proven experience as a Hadoop Developer/Analyst in Business Intelligence and Data management production support space is needed.
Bachelor in Computer Science, Management Information Systems, or Computer Information Systems is required.
Minimum of 4 years of Building Java apps
Minimum of 2 years of building and coding applications using Hadoop components – HDFS, Hbase, Hive, Sqoop, Flume etc.
Minimum of 2 years of coding Java Scala / Spark, Python, Pig programming, Hadoop Streaming, HiveQL
Minimum 4 years understanding of traditional ETL tools & Data Warehousing architect.
Strong personal leadership and collaborative skills, combined with comprehensive, practical experience and knowledge in end-to-end delivery of Big Data solutions.
Experience in Exadata and other RDBMS is a plus.
Must be proficient in SQL/HiveQL
Hands on expertise in Linux/Unix and scripting skills are required.
Strong communication, technology awareness and capability to interact work with senior technology leaders is a must
Good knowledge on Agile Methodology and the Scrum process
Delivery of high-quality work, on time and with little supervision
Critical Thinking/Analytic abilities
MSTR or Tableau (Consumption) experience – Bonus and not mandatory