O que a vaga pede
Senior Data Engineer
Location: São Paulo, Brazil
About the Role
We are looking for a Senior Data Engineer to join a growing technology team focused on delivering scalable, high-performance data platforms within the Financial Markets space.
This role is ideal for an experienced engineer who enjoys working at the intersection of cloud technologies, big data, data engineering, and FX trading systems. You will be responsible for designing, building, and operating robust data pipelines, enabling the processing of large-scale datasets while supporting critical business and trading functions.
You'll collaborate closely with software engineers, data specialists, product teams, and business stakeholders to deliver reliable, cloud-native data solutions that drive decision-making and support real-time market operations.
What You'll Be DoingData Engineering & Platform Development
- Design, develop, and maintain scalable ETL/ELT pipelines.
- Build solutions for data ingestion, transformation, validation, orchestration, and monitoring.
- Develop high-quality, production-ready applications using Python and Java.
- Manage and optimize large-scale data processing workflows.
- Implement data quality controls and monitoring frameworks.
- Design analytical data models and storage solutions to support reporting and advanced analytics.
Cloud & Infrastructure
- Build and maintain cloud-native solutions leveraging AWS services.
- Develop and deploy containerized applications using Docker.
- Support scalable and resilient production environments.
- Contribute to infrastructure automation and platform reliability initiatives.
Big Data & Real-Time Processing
- Develop distributed data processing solutions using Spark and related technologies.
- Optimize data pipelines for performance, scalability, and efficiency.
- Support real-time and near-real-time data processing requirements.
- Work with large and complex datasets in demanding business environments.
Collaboration & Innovation
- Partner with engineering, product, and business teams to understand requirements and deliver solutions.
- Contribute to architecture discussions and technical decision-making.
- Apply software engineering best practices, including testing, debugging, observability, and operational excellence.
- Leverage modern AI-assisted and agentic development workflows to improve productivity and code quality.
Required Skills & ExperienceTechnical Skills
- Strong experience with Python and Java development.
- Hands-on experience with AWS services and cloud-native architectures.
- Proven experience with Big Data frameworks, particularly Apache Spark.
- Strong background in designing and operating ETL/ELT pipelines.
- Excellent understanding of analytical data storage concepts and architectures.
- Experience with Docker and containerized application development.
- Solid understanding of software engineering principles, system design, debugging, testing, and production support.
- Experience working with modern AI-powered development tools and agentic coding workflows.
Financial Markets Experience
- Experience working within FX (Foreign Exchange) environments.
- Understanding of trading data, market data flows, financial systems, or electronic trading platforms is highly desirable.
Professional Experience
- Minimum 6 years of professional experience in Data Engineering, Software Engineering, or related disciplines.
- Proven track record of delivering scalable and reliable data platforms in production environments.
- Strong communication, collaboration, and problem-solving skills.
Nice to Have
Experience with any of the following technologies will be considered a strong advantage:
- ClickHouse
- QuestDB
- KX/kdb+
- Kubernetes
- Apache Kafka or other distributed messaging platforms
- Terraform or other Infrastructure-as-Code tools
- Apache Airflow or similar workflow orchestration platforms
- Real-time analytics and time-series data platforms
- Capital Markets or Electronic Trading environments
What We're Looking For
We're seeking a proactive and technically strong engineer who thrives in a fast-paced environment and enjoys solving complex data challenges. The ideal candidate combines deep data engineering expertise with a strong software engineering mindset and an interest in financial markets technology.
You should be comfortable owning solutions end-to-end, collaborating across teams, and contributing to the evolution of modern cloud-based data platforms.