Job Information
Insight Global Data Engineer in Toronto, Ontario
Job Description
Insight Global is looking for a Data Engineer to support a large beverage company's data and analytics initiatives. This delivery-focused role is responsible for designing and maintaining scalable data pipelines and analytics solutions on Azure Databricks, including Unity Catalog. The Data Engineer will build and optimize ETL/ELT pipelines and Apache Spark jobs, ensure data quality and reliability, and collaborate with product owners and analytics teams to translate business needs into technical solutions.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Skills and Requirements
Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience
Minimum of 3-5 years of experience in data engineering roles is required
At least 2 years of hands-on experience with Azure Databricks and Apache Spark
Strong programming skills in Python, along with proficiency in SQL and experience with relational and non-relational databases Azure certifications such as Azure Data Engineer Associate or Databricks certifications
Experience with streaming data processing using Structured Streaming or Event Hubs
Knowledge of infrastructure as code using Terraform/Terragrunt or ARM templates
Familiarity with data governance tools and practices are valued
Experience with Unity Catalog for data governance and understanding of data security and compliance