Data Engineer - Databricks
Adaugat: 3 săptămâni în urmă
Atos
Data Engineer - Databricks
Adaugat: 3 săptămâni în urmă
Atos
Acest anunt este cu aplicare externa. Cand dati click pe Aplicare Externa veti fi redirectionat pe un alt site pentru a aplica.
Who we are.
We are a team of passionate experts with a clear ambition applying digital technology to advance what matters for our clients and society.
Together we create reliable and responsive digital foundations for the world’s businesses, institutions, and communities.
With a 10 year history in Romania and over 2200 employees, Atos has a presence in 3 of the largest cities in Romania Bucharest, Brasov and Timisoara. Our Global Delivery Center in Romania offers cutting-edge, best in class, end-to-end IT services for more than 300 clients located around the world.
Learn more on Advancing what matters
We are looking for a Data Engineer with deep expertise in Databricks to design, build, and scale our data platform. You will own the architecture and performance of large-scale data pipelines, drive best practices across the Lakehouse stack, and partner closely with Data Science, Analytics, and AI Engineering teams to deliver reliable, production-grade data infrastructure.
This role is ideal for someone who has moved beyond writing pipelines to also shaping platform standards, mentoring engineers, and making architectural decisions on a Databricks-based Lakehouse.
Key Responsibilities
- Design, build, and optimize scalable ETL/ELT pipelines on Databricks, processing large volumes of structured and unstructured data
- Architect and maintain Delta Lake-based data models, ensuring data quality, reliability, and performance across Bronze/Silver/Gold layers
- Develop and orchestrate workflows using Databricks Workflows, Delta Live Tables (DLT), and job scheduling tools
- Implement data governance, access control, and lineage using Unity Catalog
- Optimize Spark jobs for performance and cost (cluster sizing, partitioning, caching, Photon, Z-ordering, file compaction)
- Build and maintain CI/CD pipelines for Databricks notebooks/jobs (Databricks Asset Bundles, Repos, Git integration)
- Collaborate with Data Scientists and ML Engineers to support feature engineering and MLflow-based model lifecycle workflows
- Define and enforce data engineering best practices testing, version control, observability, and documentation
- Monitor pipeline health and cost, implementing alerting and proactive optimization (cluster policies, job clusters vs. all-purpose clusters)
- Mentor mid-level engineers and contribute to technical decision-making and platform roadmap
- Ensure compliance with data security and privacy requirements (e.g., GDPR)
Must-Have Skills
- 5+ years of experience in Data Engineering, with 3+ years hands-on with Databricks
- Databricks Technical Administration and Maintenance (SME-level knowledge acquisition, ongoing support and maintenance of the Databricks platform)
- Skills Databricks Platform, Data Science
- Strong proficiency in Apache Spark (PySpark and/or Scala)
- Solid experience with Delta Lake architecture (Bronze/Silver/Gold, ACID transactions, schema evolution)
- Hands-on experience with Unity Catalog for governance and access management
- Strong SQL skills and experience with Databricks SQL Warehouses
- Experience building and orchestrating pipelines with Delta Live Tables and/or Databricks Workflows
- Proficiency in Python
- Experience with CI/CD for data pipelines (Databricks Asset Bundles, Git, Azure DevOps/GitHub Actions/GitLab CI)
- Strong understanding of cloud data architecture (any of Azure, AWS, or GCP)
- Experience with performance tuning and cost optimization on Databricks clusters
Nice-to-Have Skills
- Cloud-specific Databricks experience Azure Databricks, Databricks on AWS, or Databricks on GCP
- Experience with MLflow for experiment tracking and model registry
- Familiarity with Terraform for infrastructure-as-code (Databricks provider)
- Exposure to streaming data pipelines (Structured Streaming, Kafka, Event Hubs/Kinesis)
- Experience with dbt on Databricks
- Knowledge of data observability tools (e.g., Monte Carlo, Great Expectations)
- Familiarity with LLMOps/AI workloads on Databricks (Vector Search, Model Serving)
- Databricks certifications (Data Engineer Professional/Associate, Spark Developer)
- Experience working under compliance frameworks (GDPR, ISO 27001, DORA)
Learn More About Us
At Atos, we embrace diversity as the ultimate engine of ingenuity for our clients, and we constantly strive to create a culture where people feel supported and encouraged. Read more about our commitment here.
Whether it is fighting climate change, promoting digital inclusion, or ensuring trust in data management – tech for good sits at the core of our identity. With numerous global recognitions for our ESG practices, we are committed to building a better future for all by harnessing the power of technology. Learn more here.
Show more
Show less
Sfaturi de siguranta
- Nu trimiteti niciodata BANI in avans sau acte de identitate pentru aplicarea la un loc de munca. Nu trimiteti bani in avans pentru promisiuni de angajare sau alte oferte similare.
- Daca aveti impresia ca acest anunt nu este real, va rugam sa il raportati apasand butonul "Raporteaza Job"
This action will pause all job alerts. Are you sure?
Locuri de munca similare
Fii informat
Aboneaza-te la newsletter-ul nostru si primeste cele mai recente oferte de munca si informatii despre cariera direct in inbox-ul tau.
Securitatea datelor dumneavoastra este importanta pentru noi. Citeste Politica de confidentialitate.