Data Engineer

Description:

The Data Engineer will be an integral part of MSCI’s Data Engineering Development team, contributing to the creation of a next-generation Lakehouse architecture designed to drive data-driven decision-making across the organization. This advanced platform combines structured and unstructured data pipelines, serving as the analytical foundation for MSCI’s Marketing, Coverage, and Finance teams, enabling the delivery of real-time insights and business intelligence.

This role requires an experienced professional with strong technical acumen in cloud-based data engineering, SAP integration, and large-scale data transformation. The successful candidate will work in a collaborative global environment to build scalable, high-performance data pipelines that integrate diverse data sources into MSCI’s Azure-based Enterprise Data Warehouse (EDWH) Lakehouse.

Key Responsibilities:

Data Pipeline Development

• Design, develop, and maintain high-performance, scalable data pipelines to ingest and process structured and unstructured data from SAP systems into Azure Data Lake using Azure Data Factory (ADF) and Databricks.

• Develop robust data workflows connecting SAP, Revstream, Oracle, and SQL Server platforms.

• Ensure efficient data ingestion, transformation, and integration for financial analytics.

Data Governance and Quality

• Ensure data consistency, reliability, and accessibility across systems.

• Implement and maintain data governance, security, lineage, and compliance within all pipelines.

• Optimize ETL performance and resource utilization in Databricks and ADF environments.

Collaboration and Business Support

• Work with cross-functional teams to capture and translate data requirements for analytics, KPIs, and reporting.

• Partner with business units to support dashboard development and ensure data models in Power BI are optimized for performance.

• Participate in code reviews, documentation, and process automation initiatives.

Optimization and Automation

• Identify opportunities for process automation and optimization of data flows.

• Implement scalable solutions that align with enterprise data architecture standards.

Skills and Experience Required:

• 5–7 years of experience in data engineering or a related technical field, ideally within a financial or enterprise data environment.

• Proven expertise in Azure Cloud technologies, including:

  • Azure Data Factory (ADF)

  • Azure Synapse Analytics

  • Azure Data Lake Storage (ADLS)

  • Databricks / Apache Spark

• Strong proficiency in SQL, Python, and PySpark for ETL and data transformation.

• Experience with SAP modules (FI/Sales) and SAP data extraction tools such as SAP BW.

• Hands-on experience with Power BI or similar visualization tools for data analytics.

• In-depth understanding of data modeling, ETL frameworks, and performance tuning.

• Excellent analytical, problem-solving, and collaboration skills.

Preferred Skills:

• Knowledge of CI/CD pipelines, version control tools (e.g., Git), and Infrastructure-as-Code methodologies.

• Experience with data quality frameworks and monitoring systems.

• Familiarity with enterprise data cataloging and metadata management tools.

About MSCI Inc.:

MSCI Inc. is a global leader in investment decision support tools and services, offering over 50 years of expertise in research, data, and technology. The company enables clients to make better investment decisions by providing insights into key risk and return drivers, enhancing portfolio transparency, and improving performance outcomes.

At MSCI, employees are part of an innovative, high-performance culture that values creativity, collaboration, and continuous learning. The company offers a dynamic global network, comprehensive benefits, and flexible working arrangements that promote professional growth and work-life balance.

What MSCI Offers:

• Competitive compensation and benefits packages tailored to location.

• Flexible hybrid working arrangements and cutting-edge digital infrastructure.

• A culture that promotes innovation, learning, and professional advancement.

• Access to global learning resources, including Learning@MSCI and LinkedIn Learning Pro.

• Inclusion programs and Employee Resource Groups (ERGs), such as Women in Tech, Pride & Allies, Black Leadership Network, and Climate Action Network.

Equal Opportunity Commitment:

MSCI is an equal opportunity employer, dedicated to maintaining a workplace free from discrimination and harassment. Employment decisions are based on merit, qualifications, and business needs, without regard to protected characteristics such as race, gender, age, disability, sexual orientation, or national origin.

If you require a reasonable accommodation during the recruitment process, please contact disability.assistance@msci.com and specify your accommodation needs.