Lead Data Engineer

Description:

Mastercard, a global technology company in the payments industry, is seeking a Lead Data Engineer to join its Marketing Technology Solutions team in Toronto, ON. This role is integral to developing and maintaining advanced data and analytics solutions that support Mastercard’s B2B marketing initiatives. As a key member of a collaborative team, you will work with large-scale data sets, integrating diverse data sources to enable high-quality, scalable, and efficient data-driven marketing campaigns.

Key Responsibilities:

• Drive the evolution of data-driven marketing through innovative data engineering practices and scalable solutions.

• Design, build, and optimize data pipelines, libraries, and frameworks to handle complex, multi-layered datasets.

• Develop and manage feature stores, analytical stores, and curated datasets to ensure data quality and usability.

• Integrate various data sources including real-time, streaming, batch, and API-based inputs.

• Implement and validate data governance policies, including data lineage, classification, and quality checks.

• Support deployed data applications and models, identifying issues and ensuring timely resolution.

• Explore and implement new tools to improve the development, testing, deployment, and management of data pipelines.

• Collaborate with cross-functional teams to determine priority challenges and deliver innovative solutions.

• Establish best practices for data engineering, including coding standards, documentation, and code reviews.

• Ensure compliance with data security and privacy standards.

Qualifications & Skills:

• Bachelor’s degree in Computer Science, Software Engineering, or a related field.

• Strong expertise in data engineering with proven experience in Big Data environments.

• Proficiency in Python, Java/Scala, Hadoop, Spark, Kafka, and related data processing frameworks.

• Hands-on experience with cloud platforms such as Azure, Databricks, AWS, or GCP.

• Skilled in database schema optimization, SQL tuning, and ETL development.

• Experience with orchestration tools like Apache NiFi or Apache Airflow.

• Strong problem-solving, analytical, and communication skills, with the ability to work effectively across geographically distributed teams.

• Experience in Agile development environments.

Corporate Responsibility:
All employees are expected to uphold Mastercard’s information security policies, protect data confidentiality, and comply with mandatory security training requirements.