Who We Are
At the heart of our outsourcing organization, the Data & Intelligence Competence Center serves as a dedicated hub for advanced data-driven solutions. We specialize in data engineering, analytics, and AI-powered insights, helping businesses turn raw information into actionable intelligence. By combining deep technical expertise with industry best practices, we enable smarter decision-making, optimize processes, and foster innovation across diverse sectors.
To deliver on this mission, we rely on talented professionals who can transform complex data challenges into robust, scalable solutions. This is where you come in. We are looking for a Data Engineer with strong expertise in Azure, Databricks, and Spark to support our transition from the current data platform to a modern, scalable Databricks-based architecture. You will play a key role in designing, building, and migrating data pipelines, ensuring that the next-generation data landscape is efficient, maintainable, and ready for advanced analytics and AI capabilities.
What You'll Be Doing

• Design, develop, and optimize data pipelines using Azure Databricks, Spark, and related Azure services
• Lead and support migration activities from the existing data warehouse/ETL stack into Databricks and modern data lakehouse architectures
• Collaborate with architects, data engineers, and analysts to define migration approaches, integration patterns, and technical standards
• Build and maintain data ingestion, transformation, and orchestration workflows aligned with best practices for Databricks and Delta Lake
• Improve performance, scalability, and reliability of Spark workloads through tuning, optimization, and efficient resource management
• Implement data quality, monitoring, and observability components for migrated pipelines
• Contribute to platform governance, reusable components, and engineering standards to enable consistent delivery across teams
• Document migration procedures, architectural decisions, data models, and operating guidelines
• Participate in Agile ceremonies to ensure predictable and transparent delivery during the migration program
  

What you'll bring along

• Strong hands-on experience with Azure Databricks and Spark (batch and/or streaming)
• Demonstrated experience migrating legacy pipelines or data warehouses into Databricks or similar cloud architectures
• Proficiency in Python and SQL for building and optimizing data transformations
• Knowledge of Delta Lake, Lakehouse principles, and scalable data modeling approaches
• Familiarity with CI/CD pipelines and DevOps practices (e.g., Azure DevOps) for data engineering workflows
• Understanding of performance tuning, cluster configuration, and efficient resource usage in Spark environments
• Ability to translate business data requirements into robust engineering solutions
• Experience working in Agile delivery environments
• Excellent command of spoken and written English
• Experience supporting ML or GenAI workloads in Databricks is nice-to-have
• Exposure to DataOps or MLOps concepts is nice-to-have
  

Show more
Show less