We are seeking a Senior / Lead ETL Developer with deep expertise in designing, developing, deploying, and supporting cloud-native, distributed applications with the focus on Microsoft Azure cloud development, Azure Data Factory (ADF), and enterprise Data Lake and Data Hub architectures. The ideal candidate will have strong hands-on expertise in Java, microservices, Azure cloud resources, containerization, and modern DevOps toolchains. This role requires a blend of technical leadership, solution design, problem-solving, and cross-functional collaboration.
Key Responsibilities
Technical Leadership & Architecture
• Design, Develop and maintain Cloud and enterprise ETL/ELT solutions on the Azure data platform • Define and enforce ETL design standards, best practices, and reusable frameworks, ensuring scalability, resilience, and maintainability.
• Partner with data architects, cloud engineers, and analytics leaders to align solutions with enterprise strategy
Development & Delivery
• Design, build, and optimize complex ADF pipelines and data flows • Lead data ingestion and transformation into Azure Data Lake and Data Hub platforms • Manage large-scale, high-volume data integrations across on prem, cloud, SaaS, and API sources • Implement advanced error handling, monitoring, logging, and recovery mechanisms • Tune performance, scalability, and cost efficiency of ETL workloads
Cloud Engineering (Azure)
• Build and deploy applications on Azure Cloud, leveraging:
o Azure Kubernetes Service (AKS) for container orchestration.
o Azure Event Hub for event-driven architectures.
o Azure Cosmos DB (MongoDB API) and Azure PostgreSQL for data storage.
• Implement secure and scalable networking using Azure VNet and private network configurations.
• Automate provisioning and management of cloud resources using scripts and templates.
Containerization & Orchestration
• Package applications using Docker and create optimized, secure container images.
• Manage deployment, scaling, and lifecycle of applications in Azure Kubernetes.
DevOps & Continuous Delivery
• Build and maintain CI/CD pipelines using GitHub Actions for automated testing, building, and deployment.
• Manage source code and release processes using Git, GitHub, and CloudSmith.
• Drive automation wherever possible to improve operational efficiency and reduce manual tasks.
Observability, Monitoring, and Security
• Implement monitoring and performance management using Dynatrace.
• Configure and optimize logging pipelines using Dynatrace & Mezmo.
• Apply cloud-native security best practices, ensuring compliance, reliability, and threat mitigation.
Collaboration & Leadership
• Work closely with cross-functional teams in an Agile/Scrum environment.
• Provide mentorship to junior engineers and promote continuous improvement.
• Communicate clearly with product owners, stakeholders, and technical teams.