Lead Cloud Engineer

Description:

Responsibilities and Impact:
As Lead engineer, you will help to ensure that the messaging platform functions successfully, safely, and efficiently. You will also work to increase productivity, decrease downtime, and support the mission of the Market Intelligence division. Giving client teams a dependable application infrastructure and helping them to succeed with their unique business use cases are important functions of this role. You will also be working on fixing technical issues, maintaining infrastructure, providing oncall support and making enhancements as needed by business clients.

You will be posted as a lead level contributor or assigned to collaborate with user groups or client teams in the following areas.

Kafka Platform Engineering:
Install, configure, and maintain Kafka clusters and associated infrastructure across multiple regions and accounts.
Monitor & troubleshoot technical issues and take corrective action as required.
Develop and implement backup and disaster recovery plans for Kafka clusters.
Configure and manage Kafka topics, partitions, and consumer groups.
Manage access controls, security, and authentication protocols for Kafka clusters.

Cloud Architecture & Infra Management:
Design, develop, and deploy scalable, reliable, and secure AWS solutions.
Optimize AWS platform performance, scalability, and cost-efficiency.
Develop and maintain blueprints and design documents for platform architecture.

Process Automation:
Automate cloud operations using Infrastructure as Code (IaC) tools like Terraform, Ansible, or AWS CloudFormation.
Use scripting languages (Python, Bash, PowerShell) to optimize and automate workflows.

Governance & Security:
Implement security best practices to safeguard cloud resources and ensure compliance with organizational and regulatory standards.
Develop risk assessments, disaster recovery plans, and support execution during disaster recovery exercises.

Collaboration & Stakeholder Engagement:
Partner with product and platform owners to deliver innovative solutions to empower business applications with scalable infrastructure.
Work with cross-functional teams to evaluate solutions and recommend strategies for modernizing and consolidating legacy platforms.

Production Support:
Provide operations support for event streaming platforms, ensuring Kafka cluster health and stability. Handle incident management, request fulfilment, and escalation.
Analyze logs to debug issues and performance bottlenecks. Collaborate with client teams to troubleshoot platform issues, consumer lag, and data replication inconsistencies.
Perform routine maintenance tasks, including log retention management and partition rebalancing.