Integration Engineer

Description:

This position is for an Integration Engineer with a background in SSIS, Python, SQL, and data warehousing for enterprise-level systems. The role involves working with business users and analysts, troubleshooting ETL processes, and ensuring data integrity in large datasets.

Key Responsibilities:

• Provide Level 2/3 support for existing ETL processes.

• Monitor and troubleshoot scheduled ETL jobs, identify and resolve issues or bottlenecks.

• Develop ETL processes in SSIS, Python, and SQL (SQL Server / Oracle).

• Write SQL queries, including stored procedures, and reverse-engineer existing processes.

• Build and optimize data pipelines for efficient data ingestion, transformation, and loading from various sources, ensuring data quality and integrity.

• Work with structured, semi-structured, and unstructured data.

• Implement best practices for data management, security, and governance.

• Perform code reviews to ensure optimal execution patterns and adherence to standards.

Required Skills:

• 5+ years of SSIS development experience.

• 5+ years of Python coding experience.

• 5+ years of SQL Server-based development with large datasets.

Additional Skills:

• Experience in the financial services industry.

• Experience with enterprise schedulers/orchestration platforms like Tidal, Airflow.

• Experience with cloud data warehouses like Snowflake.

• Data warehousing experience (OLTP, Dimensions, Facts, and Data Modeling).

• Experience with cloud-based data architectures, messaging, and analytics.

• Experience with Databricks Pyspark for ETL pipelines.

Education:

• BA/BS degree in engineering and/or computer science.

• Master’s degree preferred.