Summary:
We are looking for a Databricks Integration Engineer with strong Java development experience to design and build secure scalable connectors that enable enterprise applications to integrate with Databricks platforms The role involves developing application to Databricks connectivity for data ingestion processing and analytics use cases
We are looking for a Databricks Integration Engineer with strong Java development experience to design and build secure scalable connectors that enable enterprise applications to integrate with Databricks platforms The role involves developing application to Databricks connectivity for data ingestion processing and analytics use cases
Key Responsibilities:
- Design develop and maintain Java Based connectors for application integration with Databricks via JDBCODBC REST APIs Delta Lake
- Enable data ingestion and extraction between enterprise applications and Databricks using batch and streaming approaches
- Implement secure authentication and authorization mechanisms OAuth PAT Azure ADAWS IAM token based access
- Develop reusable Java libraries and services to abstract Databricks connectivity for upstream applications
- Optimize connector performance for high volume data transfers and lowlatency querying
- Handle schema evolution error handling retries and logging in connector implementation
- Work closely with data engineering platform and DevOps teams to deploy and monitor integrations
- Support CICD pipelines and automated testing for connector releases
- Troubleshoot integration issues related to connectivity performance and data consistency
Required Technical Skills:
- Strong handson experience in Java Java 8 Spring Boot and RESTful services
- Experience integrating applications with Databricks using
- Databricks JDBC ODBC
- Databricks REST APIs
- Delta Lake tables
- Solid understanding of distributed data systems and big data concepts
- Experience with SQL Spark concepts jobs clusters notebooks
- Authentication security knowledge
- OAuth 20 token based auth
- Cloud IAM AWS IAM Azure AD depending on environment
- Experience with cloud platforms AWS Azure GCP especially
- S3 ADLS GCS
- Familiarity with CICD pipelines Git MavenGradle
- Strong debugging and performance tuning skills
Skills
- Mandatory Skills : Databricks, Java
- Good to Have Skills : Python