Job Description
Data Engineer Hybrid London
My client is a growing company based in London looking for mid-level to senior Data Engineer
You must be based in UK and have a valid visa to work in UK
As the Data Engineer, you will build the required ETL/ELT pipelines for the collection, preparation and storage of data in a form that is optimised, secure and reliable. You will have a specific focus on developing the data inputs that are utilised by the organisation’s internal forecasting model; designing a framework that scales effectively along with the source data.
Data Engineer Skills
- Design data infrastructure to support modelling and data analytics
- Build and maintain ETL/ELT pipelines to make data accurate and easy to use
- Work to ingest and transform data sets from a variety of data sources
- Explore ways to enhance data quality and reliability
- Assist with the establishment of a data culture across the organisation
- Drive better data governance through the creation and embedding of principles and processes e.g. Logical Data Model & Flow Diagram, Data Dictionary, Data Semantic Layers
- Set service level indicators and monitor execution of data workflows and configure alerts
- Apply dimensional data modelling concepts and practices to develop conceptual, logical and physical data models to support insight delivery
- Identify data quality issues through data profiling, analysis and stakeholder engagement
- At least 2 years of designing data infrastructure to support modelling and data analytics
- Experience building, modelling, and maintaining data pipelines
- Strong experience in SQL optimisation, performance tuning, data modelling and SQL/database design skills.
- Hands on experience within the Azure Data ecosystem, with Azure Databricks, Data Factory, Data Lake, and Synapse. Certifications are a plus.
Highly Desirable
- Strong competence in Python or Scala, ideally PySpark experience
Interested or for more information please send CV
Job Types: Full-time, Permanent
Salary: £50,000.00-£70,000.00 per year
Benefits:
- Flexitime
- Life insurance
- Work from home
Schedule:
- Flexitime
- Monday to Friday
Supplemental pay types:
Ability to commute/relocate:
- London: reliably commute or plan to relocate before starting work (required)
Experience:
- data engineer: 2 years (preferred)
Work authorisation:
- United Kingdom (preferred)
Work Location: Hybrid remote in London
Reference ID: zi-hl-de