Senior Data Engineer
Edmonton, Alberta
Contract
Posted 3 weeks ago
Data Engineer
7.25 hours per day for a total of 36.25 hours per week. Primarily remote with occasional meetings or work sessions in the office. Some travel within Alberta may be required to conduct field research and user interviews. Candidate may be required to work fewer or more hours depending on the nature and needs of their work.
Role Description
We are seeking a talented and versatile Data Engineer. The ideal candidate will have a strong foundation in data engineering practices, combined with the analytical skills necessary to derive actionable insights from data. This role involves designing, implementing, and maintaining robust data pipelines and architectures, as well as performing detailed data analysis to support business decisions.
Responsibilities
- Design, build, and maintain data pipelines on-premises and in the cloud (Azure, GCP, AWS) to ingest, transform, and store large datasets. Ensure pipelines are reliable and support multiple business use cases.
- Create and optimize dimensional models (star/snowflake) to improve query performance and reporting. Ensure models are consistent, scalable, and easy for analysts to use.
- Integrate data from SQL, NoSQL, APIs, and files while maintaining accuracy and completeness. Apply validation checks and monitoring to ensure high-quality data.
- Improve ETL/ELT processes for efficiency and scalability. Redesign workflows to remove bottlenecks and handle large, disconnected datasets.
- Build and maintain end-to-end ETL/ELT pipelines with SSIS and Azure Data Factory. Implement error handling, logging, and scheduling for dependable operations.
- Automate deployment, testing, and monitoring of ETL workflows through CI/CD pipelines. Integrate releases into regular deployment cycles for faster, safer updates.
- Manage data lakes and warehouses with proper governance. Apply security best practices, including access controls and encryption.
- Partner with engineers, analysts, and stakeholders to translate requirements into solutions. Prepare curated data marts and fact/dimension tables to support self-service analytics.?
- Analyze datasets to identify trends, patterns, and anomalies. Use statistical methods, DAX, Python, and R to generate insights that inform business strategies.
- Develop interactive dashboards and reports in Power BI using DAX for calculated columns and measures. Track key performance metrics, share service dashboards, and present results effectively.
- Build predictive or descriptive models using statistical, Python, or R-based machine learning methods. Design and integrate data models to improve service delivery.
- Present findings to non-technical audiences in clear, actionable terms. Translate complex data into business-focused insights and recommendations.
- Deliver analytics solutions iteratively in an Agile environment. Mentor teams to enhance analytics fluency and support self-service capabilities.
- Provide data-driven evidence to guide corporate priorities. Ensure strategies and initiatives are backed by strong analysis, visualizations, and models.
Required Skills and Experience
- Bachelor degree in Computer Science, IT or related field of study
- 3 years designing efficient dimensional models (star and snowflake schemas) for warehousing and analytics
- 3 years ensuring data quality, security, and governance.
- 3 years experience and technical knowledge of Microsoft tabular models and DAX
- 5 years experience as a Data Analyst, Data Engineer or in a similar role.
- 2 years experience using Git, collaborative workflows, CI/CD pipelines, containerization (Docker/Kubernetes), and Infrastructure as Code (Terraform, ARM, CloudFormation) to deploy and migrate data solutions.
- 3 years experience with development for dashboards and reports
- 3 years experience with SSIS, Azure Data Factory (ADF), and using APIs for extracting and integrating data across multiple platforms and applications.
- 3 years experience working with Power BI
- 2 years performing migrations across on-premises, cloud, and cross-database environments.
Desired Skills and Experience
- 2 years experience leading custom software application development projects following a formal project life cycle methodology.
- 2 years experience with databases and data integration, including PostgreSQL, MongoDB, Azure Cosmos DB, Azure Synapse, and Talend.
- 1 year experience with the IT infrastructure, business direction, strategies, shared service initiatives and/or applications
- 1 year of exposure to AI/ML tools and workflows relevant to data engineering, such as integrating AI-driven analytics or automation within cloud platforms like Databricks and Azure.
Please note that while all applications are appreciated, only candidates selected for interview will be contacted.
InSync Systems Inc. is a privately-owned boutique Canadian Resourcing and Consulting Services Company that works closely with a range of corporate clients across multiple industries to bring them solutions that effectively address their business needs.
