Data Engineer LLM and Gen AI ,Databricks

Visa – H1B with PP No and USC

Role Description:           Design, develop, and optimize advanced data pipelines using Databricks (SQL, Python, Spark, Delta Lake)Integrate customer and enterprise data for analytics, AI, and MDMBuild and maintain custom internal applications to support data workflowsDevelop and refine prompts and workflows for LLM/GenAI use casesCollaborate with MDM teams on identity resolution and golden record managementEnable data consumption via Power BI, Tableau, and other BI toolsPerform data replication via Fivetran and reverse ETL using tools like CensusApply UX principles to internal data tools and dashboardsMaintain high standards of data quality, reliability, and performance

Competencies:  Digital : Databricks, Generative AI

Experience (Years):       4-6

Essential Skills: Databricks expertise (Spark, Delta Lake, Lakehouse architecture, orchestration, notebooks)SQL proficiency and data modeling best practicesExperience with data engineering (minimum 3 years)Experience in generative AI and LLMs (prompt engineering, AI-assisted workflows)Custom application/APIs/internal tools developmentUnderstanding of customer data structures, MDM, and data governanceCloud platform experience (Azure, AWS, or GCP)

Desirable Skills: Power BI or Tableau experienceReverse ETL platforms (e.g., Census)Support for marketing/sales/customer experience analyticsUX design knowledge (especially for internal data tools)Strong collaboration and communication with technical/business stakeholders