This list is intended to reflect the current job but there may be additional essential functions (and certainly non-essential job functions) that are not referenced. Management will modify the job or require other tasks be performed whenever it is deemed appropriate to do so, observing, of course, any legal obligations including any collective bargaining obligations.
· Writes, tests, and documents technical work products (e.g., code, scripts, processes) according to organizational standards and practices
· Solves technical problems and builds components/libraries with far-ranging impact
· Delivers high quality work and coaches more junior engineers on technical craftsmanship
· Conducts root cause analysis to identify systemic problems and defines and leads execution of action items to address
· Designs thoughtfully integrated systems that model organizational best practices, allowing disparate teams across product domains to deliver value with speed, scale, and reliability
· Oversees the management of technical debt in existing systems and drives opportunities to eliminate within ongoing implementations
· Consistently anticipates scaling, latency, and durability challenges and guides teams in implementation of mitigating strategies
· Partners with the security organization to incorporate security conscious practices early in the lifecycle of new systems
· Thoughtfully evaluates technical risks and guides toward practical prevention strategies
· Consistently reflects on squad delivery practices throughout their span of of influence, recommends improvements to leadership and drives their implementation
· Maintains a focus on removing the duplication of effort across teams and proactively identifies opportunities for reuse within their span of influence
· Thoughtfully measures and assesses team and identifies areas of development for individuals
· Explores emerging technologies, leads development of prototypes with little or no guidance and incorporates into architectural solutions where appropriate
ALL YOU’LL NEED FOR SUCCESS
Top Requirement:
• 3-5 years of experience in ETL/data integration development • Strong hands-on experience with Microsoft Azure, including:
• Azure Cloud
• Bachelor’s degree in computer science, Information Systems, or related field (or equivalent experience) • Java 17+ (Spring Boot 3 for API development)
Nice to have:
Core Technical Skills
o Azure Data Lake Storage (ADLS Gen2)
• Solid understanding of Data Hub and data integration patterns • Proficiency in SQL and relational databases • Experience handling large-scale data volumes and batch processing • Familiarity with REST APIs, file-based integrations, and SaaS data sources • Strong problem-solving skills and ability to work independently • REST/GraphQL (Apollo, Spring GraphQL)
We are seeking a Senior / Lead ETL Developer with deep expertise in designing, developing, deploying, and supporting cloud-native, distributed applications with the focus on Microsoft Azure cloud development, Azure Data Factory (ADF), and enterprise Data Lake and Data Hub architectures. The ideal candidate will have strong hands-on expertise in Java, microservices, Azure cloud resources, containerization, and modern DevOps toolchains. This role requires a blend of technical leadership, solution design, problem-solving, and cross-functional collaboration.
Key Responsibilities
Technical Leadership & Architecture
• Design, Develop and maintain Cloud and enterprise ETL/ELT solutions on the Azure data platform • Define and enforce ETL design standards, best practices, and reusable frameworks, ensuring scalability, resilience, and maintainability.
• Partner with data architects, cloud engineers, and analytics leaders to align solutions with enterprise strategy
Development & Delivery
• Design, build, and optimize complex ADF pipelines and data flows • Lead data ingestion and transformation into Azure Data Lake and Data Hub platforms • Manage large-scale, high-volume data integrations across on prem, cloud, SaaS, and API sources • Implement advanced error handling, monitoring, logging, and recovery mechanisms • Tune performance, scalability, and cost efficiency of ETL workloads
Cloud Engineering (Azure)
• Build and deploy applications on Azure Cloud, leveraging:
o Azure Kubernetes Service (AKS) for container orchestration.
o Azure Event Hub for event-driven architectures.
o Azure Cosmos DB (MongoDB API) and Azure PostgreSQL for data storage.
• Implement secure and scalable networking using Azure VNet and private network configurations.
• Automate provisioning and management of cloud resources using scripts and templates.
Containerization & Orchestration
• Package applications using Docker and create optimized, secure container images.
• Manage deployment, scaling, and lifecycle of applications in Azure Kubernetes.
DevOps & Continuous Delivery
• Build and maintain CI/CD pipelines using GitHub Actions for automated testing, building, and deployment.
• Manage source code and release processes using Git, GitHub, and CloudSmith.
• Drive automation wherever possible to improve operational efficiency and reduce manual tasks.
Observability, Monitoring, and Security
• Implement monitoring and performance management using Dynatrace.
• Configure and optimize logging pipelines using Dynatrace & Mezmo.
• Apply cloud-native security best practices, ensuring compliance, reliability, and threat mitigation.
Collaboration & Leadership
• Work closely with cross-functional teams in an Agile/Scrum environment.
• Provide mentorship to junior engineers and promote continuous improvement.
• Communicate clearly with product owners, stakeholders, and technical teams.