Data Engineer (Scala / Spark / Databricks) - MT0639
Mindtech
Aplica a esta posiciónModalidad
Remoto
Descripción del puesto
Data Engineer (Scala / Spark / Databricks) / Remote, LatAm
About the Role
We are looking for a skilled Data Engineer to join an exciting project focused on building, enhancing, and maintaining scalable data pipelines.
In this role, you will work with modern data engineering technologies, including Scala, Apache Spark, Python, and Databricks, to develop reliable and efficient data processing solutions.
You will collaborate closely with clients and cross-functional teams, actively contributing to technical design discussions, Agile ceremonies, and continuous improvement initiatives.
Key Responsibilities
Design, develop, enhance, and maintain scalable data pipelines.
Build and optimize data processing workflows using Scala, Apache Spark, Python, and Databricks.
Support existing data pipelines, troubleshoot issues, and implement improvements.
Work with cloud-based data services and technologies within the AWS ecosystem.
Participate in technical design sessions, contributing ideas and recommending solutions.
Collaborate directly with clients to understand requirements and discuss technical approaches.
Participate actively in Scrum meetings, sprint planning, and other Agile ceremonies.
Ensure data pipeline reliability, maintainability, and performance.
Collaborate with engineering teams to deliver high-quality data solutions.
Required Technical Skills
Scala: Hands-on experience developing data processing applications.
Apache Spark: Experience building and maintaining distributed data processing pipelines.
Python: Proficiency in scripting, data manipulation, and pipeline development.
Databricks: Practical experience developing and managing data engineering workloads.
AWS: Working knowledge of cloud data technologies, particularly:
AWS Glue
Amazon S3
Amazon Athena
Snowflake (cloud data warehouse)
Data Pipelines: Experience developing, maintaining, and optimizing data workflows.
English: B2+ proficiency, with the ability to communicate effectively with clients and technical stakeholders.
Requisitos excluyentes
- 3+ años de experiencia desarrollando pipelines de datos con Apache Spark en producción.
- 2+ años de experiencia práctica con Scala en aplicaciones de procesamiento de datos.
- Experiencia comprobada trabajando con Databricks en desarrollo y gestión de cargas de trabajo.
Requisitos deseables
- Experiencia laboral con servicios de datos en AWS, incluyendo Glue, S3 o Athena.
Sobre la empresa
Mindtech is your gateway to exciting and impactful tech projects. We specialize in end-to-end software outsourcing, linking Latin American talent with global opportunities. Our fast, cost-effective approach ensures that our clients receive exceptional service and innovative solutions. With a diverse team of over 70 skilled professionals across Latin America and the US, we are committed to delivering software that drives success.