Lead/Architect Data Engineer
Adaugat: Azi
SoftServe
Lead/Architect Data Engineer
Adaugat: Azi
SoftServe
Acest anunt este cu aplicare externa. Cand dati click pe Aplicare Externa veti fi redirectionat pe un alt site pentru a aplica.
About The RoleIn this role, you will contribute to validating and refining the approach for migrating Apache Airflow workflows from Astronomer to AWS Managed Workflows for Apache Airflow (MWAA). Combining hands-on Data Engineering with an architectural mindset, you will execute a pilot migration, identify technical constraints and dependencies, and provide recommendations that will help shape the approach for further migration activities.ResponsibilitiesExecute the pilot migration of selected Apache Airflow DAGs from Astronomer to AWS MWAAValidate the proposed migration approach through hands-on implementation, testing, and technical analysisIdentify and document technical constraints, dependencies, compatibility considerations, and limitations affecting the migrationTroubleshoot and resolve technical issues identified during the pilot migrationEvaluate migration challenges and propose practical workarounds or alternative technical approaches where requiredDocument unresolved issues and dependencies to support subsequent analysis and remediationAssess pilot outcomes and contribute to refining the migration approach for further migration activitiesCollaborate with technical stakeholders to communicate findings, risks, and recommended solutionsProvide technical recommendations and implementation guidance based on lessons learned during the pilotRequirements5+ years of experience in Data Engineering, including experience designing and supporting production data workflowsStrong hands-on experience with Apache Airflow, including DAG development, configuration, troubleshooting, and workflow orchestrationPractical experience with AWS and AWS Managed Workflows for Apache Airflow (MWAA)Experience with migration or modernization of data orchestration platforms and workflowsStrong troubleshooting and analytical skills with the ability to identify technical constraints, dependencies, and compatibility issuesAbility to evaluate technical approaches and recommend practical solutions based on implementation findingsExperience working independently on technically complex initiatives while collaborating closely with engineering and architecture stakeholdersStrong documentation and communication skills for presenting technical findings, risks, and recommendationsUpper-intermediate or higher level of EnglishSoftServe is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law. Show more Show less
Sfaturi de siguranta
- Nu trimiteti niciodata BANI in avans sau acte de identitate pentru aplicarea la un loc de munca. Nu trimiteti bani in avans pentru promisiuni de angajare sau alte oferte similare.
- Daca aveti impresia ca acest anunt nu este real, va rugam sa il raportati apasand butonul "Raporteaza Job"
This action will pause all job alerts. Are you sure?
Locuri de munca similare
Fii informat
Aboneaza-te la newsletter-ul nostru si primeste cele mai recente oferte de munca si informatii despre cariera direct in inbox-ul tau.
Securitatea datelor dumneavoastra este importanta pentru noi. Citeste Politica de confidentialitate.