Data Engineer Contract

Role: Data Engineer  

Location: Remote

Length: 6 Months

Rate:  Market Rates (Outside IR35)

This is an exciting opportunity for someone to join a rapidly growing technology company. We are looking for a Data Engineer for a 6 month contract (outside IR35) to be based remotely.

The Data Engineer will help propose and implement solutions primarily based around AWS, including designing and implementing ETL tasks, identifying key data relationships.

The Job role  

The role will involve building data pipelines that allow data to be used by cross functional agile teams, that contain data scientists, data architects, data engineers and specialists that can help support client’s requirements.

Data analysis of source data structures is required to enable the most efficient loading and transformation patterns to be designed. There will be a focus on automating tasks and continuous integration-based delivery

Essential Skills:

Cloud environments, AWS as strong preference

ETL, ELT, data migration and cleansing.

Lambda & Glue  experience

AWS SAM (for SDLF)

Python

RedShift

Snowflake

Data Lakes, data analytics and working with large data sets.

Agile working.

The ability to work independently yet seek advice where required

Committed to delivering excellence for customers

Essential experience:

• Hands on experience with AWS, building and configuring environments.
• Familiarity with variety of Databases, incl. structured RDBMS.
• Experience in analysing and cleansing data using a variety of tools and techniques.
• Experience in working with a variety of data formats, JSON, XML, CSV, Parquet etc.
• Experience with building and maintaining data dictionaries / meta-data.
• Experience of Linux and cloud environments.
• Using patterns for cloud data warehouse solution (e.g. ELT rather than ETL)

Desirable experience:

• Hands on experience with AWS Athena and S3
• Familiarity with ETL tools ( Alteryx, SSIS or similar)
• Familiarity with AWS data lake related components
• Familiarity with large data techniques (Hadoop, MapReduce, Spark etc.)
• Familiarity with providing data via a micro service API.
• Experience with Azure Data Lake components
• AWS Certifications (particularly Solution Architect Associate and Big Data Speciality)
• Machine Learning experience or exposure.
• Data Visualisation Technologies (e.g. Amazon QuickSight, Tableau, Looker, QlikSense)