Our client, an exciting Data Analytics and Machine Learning focused consultancy is recruiting for a Data Engineer to join their expanding team. You will be responsible for helping propose and implement solutions primarily based around AWS, including designing and implementing ETL tasks, identifying key data relationships. The role will involve working with colleagues, both IT and business, to help define the long term strategy.
The Job role
The role will involve building data pipelines that allow data to be used by cross functional agile teams, that contain data scientists for ML. Data Analysis of source data structures is required to enable the most efficient loading and transformation patterns to be designed. There will be a focus on automating tasks and continuous integration based on delivery.
,
Essential Skills:
Cloud environments, AWS as strong preference
ETL, ELT, data migration and cleansing.
Data Lakes, data analytics and working with large data sets.
Relational databases.
Agile working.
The ability to work independently yet seek advice where required
Committed to delivering excellence for customers
Essential experience:
Hands on experience with AWS, building and configuring environments.
Familiarity with variety of Databases, incl. structured RDBMS.
Experience in analysing and cleansing data using a variety of tools and techniques.
Experience in working with a variety of data formats, JSON, XML, CSV, Parquet etc.
Experience with building and maintaining data dictionaries / meta-data.
Experience of Linux and cloud environments.
Using patterns for cloud data warehouse solution (e.g. ELT rather than ETL)
Desirable experience:
Hands on experience with AWS Athena, Glue and S3
Familiarity with ETL tools (Matillion, Alteryx, SSIS or similar)
Familiarity with AWS data lake related components
Familiarity with large data techniques (Hadoop, MapReduce, Spark etc.)
Familiarity with providing data via a micro service API.
Experience with Azure Data Lake components
AWS Certifications (particularly Solution Architect Associate and Big Data Speciality)
Machine Learning experience or exposure.
Data Visualisation Technologies (e.g. Amazon QuickSight, Tableau, Looker, QlikSense)
Tagged as: Data Engineer
Data Analytics & Insight Office Manager Location: London Length: 5 Month – end August 2021 Rate: Market Rates The Role:...
Apply For This JobSenior Data Scientist London, up to 90k We are currently working with a successful Machine Learning Consultancy who are actively looking...
Apply For This JobSoftware Development Engineer Contract Ipswich £375 – £400 per day You will be responsible for software design, development and...
Apply For This JobSoftware Engineer – JavaScript Remote 3+ Months Up to £400 p/day Are you a highly experienced Software Engineer/Developer in...
Apply For This JobWe have an exciting opportunity for a Solutions Engineer to join a growing Cloud & Data Solutions Consultancy. Due to...
Apply For This JobCloud Engineer Our client, an exciting Data Analytics and Machine Learning focused consultancy is recruiting for a Cloud Engineer to join their...
Apply For This JobTo apply for this job email your details to cassie@ifrecruit.com.