ETL Developer
Government Client
2024-09-30 – 2025-03-31
Security – Enhanced
Toronto – 3 days onsite
DELIVERABLES:
As a member of the reporting team, you will be responsible deliver the MVP for reporting, build the new data warehouse/lakehouse and deliver the required reporting. A high-level list of deliverables for the data migration team follows:
• Data Warehouse Design: analyze business requirements and design an efficient data warehouse/lakehouse/golden layer on Microsoft Azure
• Data Integration and ETL: help develop and automate ETL processes to load data from Dynamics 365 CE and F&O into the new data warehouse/lakehouse (bronze/silver/golden layers). Help integrate data from diverse sources into the new data warehouse.
• Data Modeling: create logical and physical data models that align with the project’s reporting and analytical needs.
• Data Security and Governance: implement appropriate security controls to protect sensitive data within the data warehouse and reports.
• Reporting and Visualization: develop reports, dashboards and visualizations as per reporting MVP. Ensure the quality, accuracy and integrity of reports.
• Performance Optimization: fine-tune the data warehouse and reporting processes to optimize query performance and overall system efficiency.
• Other duties as assigned.
The Vendor’s Personnel will also be required to:
• Complete work and achieve milestones within the assigned deadlines.
• Notify the Cluster/Ministry project Manager in writing of any issues or other material concerns related to the Assignment Deliverables, as soon as he/she becomes aware of them
• Submit Deliverables for the Cluster/Ministry approval as they are completed.
Provide knowledge and skill transfer to a designated Cluster/Ministry staff; and
• Comply with the Ontario Government I&IT Directive, Operational Policy on the I&IT Project Gateway Process, and other applicable Guidelines, Standards and Procedures.
Skills
Experience and Skill Set Requirements
MANDATORY REQUIREMENTS:
• Power BI: Proficiency in Power BI, including data modeling, creating interactive reports and dashboards and utilizing advanced features.
• ETL/Microsoft Azure Synapse Analytics experience, including its architecture, data storage options, data ingestion mechanisms and security features.
• Dynamics 365 CE and/or F&O report development experience.
NICE TO HAVE REQUIREMENTS:
• Azure cloud certifications (e.g. Azure fundamentals, Azure Power BI Data Analyst Associate)
• Dynamics 365 certifications
SKILLS AND KNOWLEDGE:
• Data Warehouse/Lakehouse Concepts: Strong understanding of data warehousing principles, including data modeling, ETL processes, data integration, and data governance.
• Microsoft Azure Synapse: In-depth knowledge and experience with Azure Synapse Analytics, including its architecture, data storage options (e.g., SQL Data Warehouse, Data Lake Storage), data ingestion mechanisms (e.g., Azure Data Factory), and security features.
• Power BI: Proficiency in Power BI, including data modeling, creating interactive reports and dashboards, configuring data gateways, and utilizing advanced features such as DAX and Power Query.
• SQL and Query Optimization: Strong SQL skills for writing complex queries, optimizing database performance, and troubleshooting query performance issues. Understanding of indexing, partitioning, and query execution plans.
• Development experience with Dynamics 365 and understanding of the Common Data Model for Dynamics.
• Report development experience for Microsoft Dynamics 365 Customer Engagement (CE) and/or Finance and Operations (F&O)
• Familiarity with version control systems (e.g., Azure Repos) and collaboration tools (e.g., Azure DevOps) for managing code, tracking changes, and collaborating with team members.
CRITERIA:
Criteria 1 – PowerBI (25 Points)
• Demonstrated experience working Power BI, creating interactive reports and dashboards, configuring data gateways, utilizing advanced features such as DAX and Power Query.
• Experience with SSIS, SSRS
Criteria 2 – ETL / Azure Platform (25 Points)
• Experience with Azure Synapse Workspaces and/or Azure Data Factory
• Azure cloud certifications
Criteria 3 – Dynamics 365 (25 Points)
• Demonstrated software development experience with PowerApps platform, Power Automate, Dynamics CE &F&O and producing reports from Dynamics
Criteria 4 – SQL / DB (15 Points)
• Demonstrated experience with data manipulation languages (T-SQL, PL/SQL), data definition languages, query performance analysis & tuning
• Demonstrated experience with SQL Server, Oracle, Azure SQL Databases
Criteria 5 – Azure DevOps (10 Points)
• Demonstrated experience with Azure DevOps for version control, managing code, tracking changes, and collaborating with team members.
KNOWLEDGE TRANSFER:
Knowledge to be Transferred:
Document the tasks executed and in process of execution as a member of the data migration team using the approach and tools required by the project manager.
Knowledge to be Transferred to:
Project Manager / Team members
Details of Transfer:
1:1 meetings / team meetings / documentation in DevOps Wiki and boards throughout the duration of the project life cycle.