Principal Software Engineer

Description:

As a Principal Software Engineer, you will be a technical leader driving the design and implementation of complex backend systems at scale. You will set technical direction, guide team members, and solve challenging technical problems while ensuring our systems meet the highest standards of reliability, performance, and maintainability. Your expertise will be critical in advancing our Agentic AI capabilities.
What You Will Do

Lead the design and implementation of complex, distributed systems using Python and Java, establishing architectural patterns and best practices.

Design and optimize highly scalable, fault-tolerant microservices that handle high-throughput workloads across multiple cloud environments.

Design and implement sophisticated Agentic AI systems, building proof-of-concepts and production implementations that demonstrate advanced architectures and orchestration patterns.

Champion the adoption and advancement of Agentic AI capabilities, designing sophisticated agent architectures and orchestration patterns

Provide technical leadership and guidance to the team, conducting design & code reviews

Drive design decisions around data storage, processing, and retrieval strategies across SQL, NoSQL, Vector databases, and search technologies.

Collaborate with other senior team members, product management, and cross-functional teams to translate requirements into robust technical solutions.

Lead incident response for critical production issues, perform deep-dives & root cause analysis, and implement systemic improvements.

Establish and enforce engineering excellence through coding standards, architectural guidelines, testing strategies, and operational best practices.

Stay at the forefront of technology trends, evaluate emerging technologies, and drive innovation across the engineering organization.

Promote continuous improvement, technical excellence, and knowledge sharing.

The Experience You Bring

Technical Leadership: 8+ years of experience in backend software engineering with a proven track record of leading complex technical initiatives and architectural decisions. 

Advanced Backend Development: Deep expertise in Python and Java with proficiency in modern frameworks including FastAPI, Django, Flask, Spring Boot. Proven ability to build highly scalable systems.

Database Architecture: Expertise in database design, optimization, and scaling strategies across SQL, NoSQL, Vector databases, and OpenSearch. Experience designing data models for complex domains and implementing sophisticated data partitioning and replication strategies.

Agentic AI Expertise: Experience in Agentic AI architecture and implementation. Good understanding of agent design patterns, multi-agent orchestration, tool integration, memory systems & architectures. Hands-on experience building production-grade agentic systems and custom agent architectures. Experience with RAG (Retrieval-Augmented Generation), prompt engineering, and LLM integration strategies.

Cloud & Infrastructure: Extensive experience architecting and operating systems on AWS, Azure, or Google Cloud at scale. Deep understanding of cloud-native patterns, cloud architectures, and cost optimization strategies.

Microservices & Containers: Expertise in microservices architecture, distributed systems patterns, and container orchestration using Kubernetes/EKS.

Infrastructure as Code: Knowledge and proficiency in Terraform, CloudFormation, or Ansible. Experience building self-service infrastructure platforms and developer tooling.

DevOps & SRE Practices: Deep understanding of CI/CD pipelines, deployment strategies, observability, monitoring, and incident management. Experience establishing SLIs, SLOs, and error budgets.

System Design Excellence: Proven ability to design highly scalable systems with strong understanding of consistency, availability, tolerance, latency, and cost. Experience with distributed caching, message queues, event streaming, and asynchronous processing patterns.

Quality & Testing Leadership: Champion of testing best practices including TDD, integration testing, and chaos engineering. Experience establishing testing frameworks and quality gates that enable rapid, confident deployments.

Performance & Optimization: Deep expertise in performance profiling, optimization, and capacity planning. Experience identifying and resolving bottlenecks in distributed systems.

Mentorship & Communication: Strong communication skills with the ability to explain complex technical concepts to both technical and non-technical audiences. Experience leading technical discussions, design reviews, and architecture forums.

Agile & Process Leadership: Strong understanding of Agile/Scrum methodologies with experience shaping engineering processes, tooling (Jira, Confluence), and practices that enhance team productivity.

Any prior experience with LLM model Reinforcement fine tuning, model distillation, building inference infrastructure/framework, model evaluation is going t be a big plus
Education & Experience

Bachelor's or Master's degree in Computer Science or related field with 8+ years of professional experience in backend software development, including 2+ years in technical leadership roles.

Demonstrated thought leadership through technical blogs, conference talks, open-source contributions, or patents is highly valued.