Job Title : Lead data Engineer with Druid experience
Job Location: San Francisco, CA (Onsite)
Job Duration : Long term contract position
Job Description :-
- Druid – Deployment, monitoring and troubleshooting
- SRE – Big Data
- Druid SRE + Linux
Job Summary:
The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python.
The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements and align with best practices. (1.) Key Responsibilities
1. Lead and manage end-to-end data engineering projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.
2. Collaborate with stakeholders to gather and understand requirements for data pipelines and analytics solutions.
3. Design and develop etl processes, data models, and data integration solutions.
4. Provide technical guidance and mentorship to the team members.
5. Ensure data quality, data governance, and data security standards are maintained throughout the project lifecycle.
6. Troubleshoot and optimize data pipelines and processes for performance and efficiency.
7. Stay updated on the latest trends and technologies in data engineering and contribute to continuous improvement efforts.
Skill Requirements:
1. Proficiency in azure data factory (ADF) and azure databricks for building and managing data pipelines.
2. Strong experience with SQL and oracle PL/SQL for data querying and manipulation.
3. Advanced programming skills in python for scripting and data processing tasks.
4. Knowledge of data modeling, data warehousing concepts, and database design principles.
5. Ability to work in a collaborative team environment and communicate effectively with stakeholders.
6. Strong analytical and problem-solving skills with attention to detail.
7. Experience in data visualization tools and techniques is a plus.
Certifications:
Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle PL/SQL, or Python are advantageous.
Additional requirement:
Druid – Deployment, monitoring and troubleshooting
SRE – Big Data
Bachelor’s degree in computer science, Engineering, or related field.
Proficiency in Linux system administration, shell scripting, and networking concepts including IPtables, and IPsec.
Strong understanding of networking, opensource technologies, and tools. 5-8 years of experience in the design, set up, and management of largescale Hadoop clusters, ensuring high availability, fault tolerance, and performance optimization.
Strong understanding of distributed computing principles and experience with big data, Azure, SQL, Python
Thanks & Regards
Raghwendra Singh
Technical Recruiter
Email: raghwendra.s@e-solutionsinc.com