SC Cleared Azure Data Engineer Contract

Role:                    SC Cleared Azure Data Engineer

Location:            Remote

Duration:            1 -3 Months

Rate:                     £500 per day (Inside IR35)

Responsibilities:

• Analyse raw data (mostly in Json format ) for data parsing, schema evolution,  data transformation towards metric development purpose.
• Analyse reporting/metric requirements from data engineering perspective for refinement, estimation , development and deployment.
• Closely work with analysts , data scientists to understand the business requirements, data sources and logic for metric development.
• Create normalised/dimensional data models based on the requirement.
• Translated and refine the notebooks and logics developed as part of prototype
• Transform data from landing/staging/transformed to synapse dimensional model.
• Creating notebooks in Databricks for incremental data load and transformation.
• Creating stored procedures for data load and transformation in azure synapse dedicated pools
• Created ADF pipelines for data orchestration across different data layers of data bricks and synapse

Skills:

• Solid background in Azure data services like ADF, Synapse, SQL, ADB ,  etc..
• Experience with Databricks notebooks development for data ingestion, validation, transformation and metric build.
• Strong in PySpark and SQL.
• Experience in ADF pipeline development, data orchestration techniques, monitoring and troubleshooting
• Experience in stored procedure development.
• Good Knowledge in data modelling and Power BI.

Candidates should either hold or be willing to undergo SC Clearance.