W r a p p i n g   I d e a s   I n n o v a t i v e l y

Azure Data factory / Azure data bricks / Pyspark

Experience

Experience

4-8yrs

Location

Location

Remote | Work from home

Open

Positions Open

3

Job Description

Primary focus should be

  1. Databricks with Pyspark ( heavily used in transformation)
  2. ADF,Synapse and Delta lake  

 

 

 

Responsibilities  

·         Design and Development of data pipelines in Azure DataBricks with Pyspark , ADF, and Synapse.

·         Understanding of Delta lake Architecture

·         Requirement analysis and designing source to target data mapping 

·         Build CI/CD pipelines for data integration 

·         Assist in building data model for various layers in the data lake/delta lake

 

Required Experience  

·         Expertise in Azure DataBricks with Pyspark , ADF, SQL,  Data Lake and Synapse

·         Experience in Azure Data lake

·         Experience in implementing solutions in Azure Data Services 

·         Knowledge of DevOps, Agile methodology 

·         4+ years

·         Excellent strong presentation, verbal, and written skills

Apply Now

Click here to refresh.