Title: Technical Lead-Biz Intelligence
Azure Data Engineer with Databricks and PySpark
Job Description:
Years of experience 8 to 10 Years – 5B – Sr Tech Lead
- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)
- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.
- Experience in creating Technical Specification Design, Application Interface Design.
- Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Databricks) and PySpark
- Develop batch processing and integration solutions and process Structured and Non-Structured Data
- Demonstrated in-depth skills with Azure Databricks and PySpark, and SQL
- Collaborate and engage with BI & analytics and the business team.
- Minimum 3 year of Project experience in Azure Databricks
- Minimum 5 years of experience in ADF
- Minimum 2+ years of experience in PySpark
- Overall ETL experience should be 6+ years including DWH
- Good to have knowledge on Agile methodology and framework
- Good Communication and attitude to scale up
- Good Team Player
Location: Mumbai, Pune, Noida