Senior Data Engineer
Adaugat: Azi
the rec hub.
Senior Data Engineer
Adaugat: Azi
the rec hub.
Acest anunt este cu aplicare externa. Cand dati click pe Aplicare Externa veti fi redirectionat pe un alt site pentru a aplica.
We are looking for a Senior Data Engineer specialized in Python, PySpark, AWS, and data to join our clients dynamic team. You will play a key role in designing, optimizing, and improving data pipelines for the ingestion, enrichment, and exposure of classified and transactional data on AWS. You will work directly under the supervision of a Data Engineering Team Lead, who will organize tasks and ensure the smooth delivery of the project.
Tasks
- Pipeline Optimization:
Analyze and improve existing data pipelines to optimize performance, cost efficiency, and scalability.
- Pipeline Transformation:
Transition batch/snapshot pipelines to delta-based data processing pipelines.
- Infrastructure as Code:
Develop and maintain Terraform modules for efficient infrastructure management on AWS.
- Pipeline Migration:
Migrate data pipelines from Google Cloud Platform to AWS while minimizing downtime and ensuring high reliability.
- Monitoring and Alerts:
Design and implement DataDog dashboards and alerting systems to enable proactive monitoring of data pipeline performance.
- Technology Watch & Innovation:
Stay up to date with emerging technologies and actively promote relevant innovations and improvements within the team.
- Mentoring & Team Support:
Support and guide junior team members, share expertise and best practices, and contribute to the overall growth of the team.
Requirements
Required Technical Skills:
- AWS: Strong hands-on experience with AWS services such as S3, ECS, etc., with particular emphasis on Lambda and Glue.
- Python: Advanced Python skills for data manipulation, scripting, and pipeline development.
- PySpark: Solid experience building scalable and distributed data pipelines using PySpark.
- SQL: Strong command of SQL for querying and transforming large datasets.
- Terraform: Experience designing and managing infrastructure using Terraform. Knowledge of Terragrunt is a plus.
- CI/CD (CircleCI): Experience configuring and maintaining pipelines to support automation and deployment workflows.
- DataDog: Knowledge of DataDog for monitoring, alerting, and dashboard creation.
Desired Qualities
- Autonomous in project management, with strong ownership of production infrastructure and data access.
- Open-minded and driven by innovation and continuous improvement.
- Pragmatic, solution-oriented, and able to adapt quickly.
- Strong focus on code quality and adherence to best practices.
- Ensures high-quality testing and maintains a customer-focused approach.
Join a fast-scaling tech platform revolutionizing marketplaces at scale. Work with elite engineering teams on mission-critical AI, data, and optimization challenges.
Extremely competitive comp + equity. Bucharest or Belgrade offices.
Apply to build the future of intelligent platforms.
Show more
Show less
Sfaturi de siguranta
- Nu trimiteti niciodata BANI in avans sau acte de identitate pentru aplicarea la un loc de munca. Nu trimiteti bani in avans pentru promisiuni de angajare sau alte oferte similare.
- Daca aveti impresia ca acest anunt nu este real, va rugam sa il raportati apasand butonul "Raporteaza Job"
This action will pause all job alerts. Are you sure?
Locuri de munca similare
Fii informat
Aboneaza-te la newsletter-ul nostru si primeste cele mai recente oferte de munca si informatii despre cariera direct in inbox-ul tau.
Securitatea datelor dumneavoastra este importanta pentru noi. Citeste Politica de confidentialitate.