Senior Data Engineer

 

Description:

This job description does not represent a comprehensive listing of job duties that are required of the employee performing this role. We reserve the right to change duties or assign additional duties at any time with or without notice.

 

Individual Accountabilities:

  • Executes scripts based on specifications and standards
  • Documents and executes simple software components of larger architectures
  • Contributes to portions of value stream codebase
  • Builds, codes, tests, maintain high quality software
  • Participates in Agile sprints and ceremonies; supports rapid iteration and development
  • Translates user requirements into software requirements
  • Develops, maintains, and tests data pipelines, application framework, infrastructure for data generation; works closely with information architects and Data Scientists
  • Managing Hadoop based EDL platform using Ambari
  • Develop automation of provisioning Azure services and resources

 

Required Skills:

  • 5 + years of experience in similar role
  • Experience in migration from Cloudera to Azure would be an asset.
  • Experience initializing and managing cloud platforms: Azure preferred
  • Experience with terraform, ARM template, Azure Python SDK
  • Experience with Hadoop based technologies, HDFS, Hive,Spark, etc.
  • Experience with using Jenkins to support IaC and data pipelines
  • Familiarity with agile and DevOps principles, test-driven development, continuous integration, and other approaches to accelerate the delivery of new features
  • Understanding of software development lifecycle
  • Understanding of how technology supports Manulife business strategy
  • Good communication and interpersonal skills
  • Familiar with platform technologies
  • Familiar with modern software architectures and API-driven development
  • Familiar with scripting languages
  • Familiar with database technologies such as: MySQL, Postgres, Hadoop, Spark
  • Familiar with ETL technologies such as: Informatica
  • Good organizational and problem-solving abilities
  • Ability to work alone with little guidance.

Organization Manulife
Industry Engineering Jobs
Occupational Category Senior Data Engineer
Job Location Ontario,Canada
Shift Type Morning
Job Type Full Time
Gender No Preference
Career Level Intermediate
Experience 2 Years
Posted at 2022-10-19 3:03 pm
Expires on Expired