Vaga de Middle Data Engineer em Rio de Janeiro/RJ

Rio de Janeiro, RJ
03/05/2024
Compartilhar

A**********e

Para ver o nome da empresa faça o login

Descrição da Vaga

Job Description AgileEngine is a top-ranking provider of software solutions to Fortune 500, Global 500, and Future 50 companies.

Listed on Inc.

5000 among the fastest-growing US companies, we are always open to talented software, UX, and data experts in the Americas, Europe, and Asia.

If you like a challenging environment where you’re working with the best and are encouraged to learn and experiment daily, there’s no better place — guaranteed! :) What you will do Designing and implementing efficient data pipelines (ETLs) to integrate data from various sources into Indeed’s data platforms;
Designing and implementing data model changes that align with data standards;
Work with existing APIs written in Flask (python);
Monitoring production data pipelines daily to ensure completion, maintain data quality, and address performance issues;
Reading and interpreting system logs to evaluate system health or perform root cause analysis;
Identifying pipeline issues and working with colleagues, vendors, and external teams to resolve;
Clearly communicating pipeline statuses with management and stakeholders.

Must haves Ideally a bachelor’s degree in computer science, computer engineering, or an engineering discipline;
5+ years of industry experience in software development and/or data engineering with strong expertise in fast-paced and deliver-focused environments;
Extensive production experience in SQL;
Extensive experience building an ETL from scratch;
3+ years of experience with: Python/Flask;
3+ years of hands-on experience with big data technologies (such as Redshift, Hive, Trino/Presto, or similar technologies);
Experience with modeling data;
Experience in Athena;
Experience with MySQL;
Experience in Gitlab CI;
Experience in AWS cloud platform (SQS, S3 services);
Extensive experience in writing technical documentation;
Upper-intermediate English level.

Nice to haves Experience in Spark;
Experience in Tableau or Google Data Studio;
ETL work will be in Dagster but may not be a primary focus of the individual.

The benefits of joining us Professional growth Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.

Competitive compensation We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.

A selection of exciting projects Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.

Flextime Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.

Requirements Ideally a bachelor’s degree in computer science, computer engineering, or an engineering discipline;
5+ years of industry experience in software development and/or data engineering with strong expertise in fast-paced and deliver-focused environments;
Extensive production experience in SQL;
Extensive experience building an ETL from scratch;
3+ years of experience with: Python/Flask;
3+ years of hands-on experience with big data technologies (such as Redshift, Hive, Trino/Presto, or similar technologies);
Experience with modeling data;
Experience in Athena;
Experience with MySQL;
Experience in Gitlab CI;
Experience in AWS cloud platform (SQS, S3 services);
Extensive experience in writing technical documentation;
Upper-intermediate English level.

Esta vaga foi obtida de um site de empregos.

Esta vaga aparece também