GCP Data Engineer

Job Title – GCP Data Engineer

Job Location – Brazil (Remote)

Experience level – 5+ Years

Job type –­ Contract

Job Description:

We are looking for the below skills:

BigQuery, Dataflow, or Looker, Data Platform on GCP, Preferred Data Governance

Key Responsibilities

Data Platform Architecture & Pipeline Engineering

· Design & Build: Develop robust, scalable, and automated Lambda/Kappa data pipelines for both batch and real-time streaming data using GCP Dataflow (Apache Beam) and Cloud Data Fusion.

· Data Warehousing: Optimize and manage enterprise data warehouses in Google BigQuery, ensuring efficient storage, partitioning, clustering, and query performance.

· Orchestration: Work with orchestration tools like Cloud Composer (Apache Airflow) to manage complex data workflows and dependencies.

· CI/CD & DevOps: Implement Infrastructure as Code (IaC) using tools like Terraform and maintain CI/CD pipelines for seamless data deployment.

Business Intelligence & Enablement

· Semantic Modeling: Collaborate with analytics teams to model data and develop robust LookML models within Looker.

· Performance Tuning: Optimize Looker queries and BigQuery costs by implementing caching strategies, materialized views, and efficient BI Engine configurations.

Data Governance & Quality (Preferred)

· Compliance & Security: Implement data governance frameworks on GCP using Dataplex, Cloud Data Loss Prevention (DLP), and IAM policies to ensure data privacy and compliance.

· Data Lineage & Cataloging: Establish and maintain data catalogs, metadata management, and end-to-end data lineage.

· Data Quality: Build automated testing frameworks to monitor data quality, anomalies, and pipeline health.

Qualifications & Skills

Required Technical Skills

· GCP Expertise: Minimum of 3–5 years of hands-on experience building production-grade data solutions on Google Cloud Platform.

· Core Tools: Deep, practical knowledge of BigQuery (SQL optimization, slot management) and Dataflow (Apache Beam in Python or Java).

· Programming: Strong proficiency in Python, Java, or Scala, alongside expert-level SQL skills.

· Data Modeling: Solid understanding of data modeling concepts (Star Schema, Snowflake Schema, Data Vault 2.0).

· Looker/LookML: Experience writing LookML, building explores, and managing Looker deployments.

· Data Governance: Familiarity with GCP Dataplex, Apache Atlas, or similar data governance and cataloging suites.

Certifications: GCP Professional Data Engineer or GCP Professional Cloud Architect certification is a major plus.

Attributes

• Strong problem-solving skills with the ability to handle open-ended, complex data challenges.
• Excellent communication skills, with the ability to bridge the gap between technical engineering and business stakeholders.

Tekshapers is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.