Purpose of role:

As a Data Engineer, you will play a pivotal role in designing, building, and optimising data pipelines, architectures, and workflows for our diverse client base. You’ll work within dynamic, multi-disciplinary project teams to implement scalable data solutions while adhering to best practices and emerging trends in data engineering.

Responsibilities:

• Data Pipeline Development: Design and implement robust, scalable, and efficient data pipelines to collect, transform, and integrate data from various sources.
• Data Architecture: Develop and optimize data architectures, including data warehouses, data lakes, and other storage solutions.
• ETL/ELT Processes: Create and maintain reliable ETL/ELT workflows that ensure data quality and accessibility.
• Collaboration: Work closely with data scientists, analysts, and client stakeholders to understand requirements and deliver impactful solutions.
• Performance Optimisation: Monitor and enhance the performance of data systems to ensure minimal downtime and fast query responses.
• Automation and Tools: Identify opportunities for automation and recommend tools to improve data engineering workflows.
• Documentation: Maintain detailed technical documentation for all solutions and processes.

Skills/Experience:

• Programming: Proficiency in Python, or similar languages for data processing.
• Big Data Technologies: Hands-on experience with big data tools e.g. (primarily Databricks, Apache Spark, Hadoop).
• Cloud Platforms: Familiarity with Azure or other cloud ecosystems for data engineering tasks.
• Database Management: Expertise in relational databases (e.g. postgres, sql server)
• Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend.
• Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design.
• Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines for deployment.

What we offer:

• A great work environment built by amazing people, working with high-level technologies & products;
• Being part of a company that values you at your highest professional and personal attributes;
• Being valued within important events throughout the year - we offer a diverse benefit pack including special events gifts, a free paid day for your birthday, Christmas & Easter vouchers;
• Enjoying a competitive salary, meal vouchers, as well as a top medical subscription;
• Sport subscription;
• Career development opportunities.

Show more
Show less