Senior Developer
Story Behind the Need
Support multiple projects, waterfall and agile , different stages, from design, to development, unit testing, documentation and implementation
Responsibilities:
• Proficient in developing strategies for Extraction, Transformation and Loading (ETL) mechanism.
• Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, Remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XML.
• Expert in designing Server jobs using various types of stages like Sequential file, ODBC, Hashed file, Aggregator, Transformer, Sort, Link Partitioner and Link Collector.
• Expert in working with DataStage Manager, Designer, Administrator, and Director.
• Experience in analyzing the data generated by the business process, defining the granularity, source to target mapping of the data elements, creating Indexes and Aggregate tables for the data warehouse design and development.
• Excellent knowledge of studying the data dependencies using metadata stored in the repository and prepared batches for the existing sessions to facilitate scheduling of multiple sessions.
Must have
• 3+ years of experience as DataStage Developer or related field
• 3+ years of experience Hands-on experience with Parallel jobs using various stages like Join, Merge, Lookup, Remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XML.
• 3+ years of experience Hands-on DataStage Manager, Designer, Administrator, and Director.
• 3+ years of experience Hands-on Big Data concept and platforms, such as Hadoop, Hive, Beeline, EDL
• Expertise in UNIX shell scripts using K-shell for the automation of processes and scheduling the DataStage jobs.
Nice to have
• Expert in designing Server jobs using various types of stages like Sequential file, ODBC, Hashed file, Aggregator, Transformer, Sort, Link Partitioner and Link Collector.
• Experienced in integration of various data sources (DB2-UDB, PL/SQL, Hadoop data) into data staging area.
• Experience in Agile development and tools, such as Jira, Confluence, Bitbucket, Jenkins, etc.
• Excellent knowledge of studying the data dependencies using metadata stored in the repository and prepared batches for the existing sessions to facilitate scheduling of multiple sessions.
• Proven track record in troubleshooting of DataStage jobs and addressing production issues like performance tuning and enhancement.
• Experienced in Database programming for Data Warehouses (Schemas), proficient in dimensional modeling.
• Experienced in Data Modeling as well as reverse engineering using tools Erwin and MS Visio.