Senior ETL Developer

About the role

Responsibilities/Assignment Deliverables – Senior ETL Developer

Mandatory Skills:

• Experience with the Microsoft suite of technology including: Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI
• Experience with Databricks Platform
• Experience with the Amazon Web Services (AWS) suite of technology including: Amazon Aurora, Amazon Relational Database Search, Glue, OpenSearch, etc.
• Experience with developing data extraction, transformation, and load programs (daily and initial load) functionality on a wide range of data repositories (structured and semi-structured files, relational and multi-dimensional data stores)
• Experience with developing, implementing, and maintaining schedule/dependency logic for Extract Transform Load (ETL) scripts
• Experience with data integration, data cleansing, and data analytics
• Experience with data modeling and design principles for data marts and data warehouses
• Experience in database management and administration
• Experience in constructing complex SQL queries and performance tuning
• Experience with Git and knowledge of source control strategies
• Experience creating technical documentation including ETL source-to-target mappings, data model diagrams, architecture artifacts, detailed design documents, etc.
• Experience in eliciting, documenting, and validating business requirements
• Experience in software development lifecycle from Development, to Testing and Quality Assurance, to Delivery
• Solid communications skills: the ability to understand, comprehend, and follow instructions and requirements to communicate clearly and effectively both verbally and in writing.

Nice to have skills:

• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards
• Experience designing visual dashboards to highlight trends and Key Performance Indicators (KPIs), and developing canned reports (scheduled and ad-hoc)
• Experience with programming languages such as C#, developing application code such as APIs, Functions, etc.
• Experience writing scripts with PowerShell and other scripting languages

Description

Core Technical Skills

• Experience with the Microsoft suite of technology including: Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI
• Experience with the Amazon Web Services (AWS) suite of technology including: Amazon Aurora, Amazon Relational Database Search, Glue, OpenSearch, etc.
• Experience with developing data extraction, transformation, and load programs (daily and initial load) functionality on a wide range of data repositories (structured and semi-structured files, relational and multi-dimensional data stores)
• Experience with developing, implementing, and maintaining schedule/dependency logic for Extract Transform Load (ETL) scripts
• Experience with data integration, data cleansing, and data analytics
• Experience with data modeling and design principles for data marts and data warehouses
• Experience in database management and administration
• Experience in constructing complex SQL queries and performance tuning
• Experience creating technical documentation including ETL source-to-target mappings, data model diagrams, architecture artifacts, detailed design documents, etc.

MUST HAVES:

• Experience with the Microsoft suite of technology including: Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI
• Experience with Databricks Platform
• Experience with the Amazon Web Services (AWS) suite of technology including: Amazon Aurora, Amazon Relational Database Search, Glue, OpenSearch, etc.
• Experience with developing data extraction, transformation, and load programs (daily and initial load) functionality on a wide range of data repositories (structured and semi-structured files, relational and multi-dimensional data stores)
• Experience with developing, implementing, and maintaining schedule/dependency logic for Extract Transform Load (ETL) scripts
• Experience with data integration, data cleansing, and data analytics
• Experience with data modeling and design principles for data marts and data warehouses
• Experience with designing modern analytics architectures (e.g., data warehouses, data lakes, lakehouses).