Jobiglo

No results.

Data Engineer – AI‑First Consultancy

palo-it · Sao paulo

New
🇬🇧 English
Python SQL Apache Spark Databricks dbt Kafka Apache Beam Snowflake Airflow Dagster Great Expectations Deequ DataHub OpenLineage

Job description

About the role

As a Data Engineer for a leading insurance company, you will play a key role in building a data‑driven decision‑making culture. You will design resilient and secure solutions that transform raw data into strategic insights for underwriting, risk management, fraud prevention, and customer experience.

Key responsibilities

  • Design, build, and maintain scalable and secure data pipelines in cloud environments (AWS, GCP, or Azure).
  • Integrate large volumes of structured and unstructured data from core insurance systems such as policies, claims, CRM, and ERP.
  • Automate data ingestion, transformation, and quality processes using Apache Spark, dbt, Kafka, and Airflow.
  • Build and maintain modern data lakes and warehouses like Snowflake, BigQuery, and Redshift.
  • Implement data quality, lineage, and governance validations with tools such as Great Expectations and OpenMetadata.

Required profile

  • Strong command of Python and advanced SQL.
  • Hands‑on experience with Azure cloud platforms (Data Factory, Synapse) and other major clouds.
  • Experience with modern data processing frameworks such as Spark, Databricks, dbt, Kafka, and Apache Beam.
  • Familiarity with DataOps, testing, and CI/CD practices for data pipelines.
  • Upper‑intermediate English level (B2 or higher) for global collaboration.

Required skills

  • Python
  • SQL
  • Apache Spark / Databricks
  • dbt
  • Kafka
  • Apache Beam
  • Azure Data Factory & Synapse
  • Snowflake, Amazon Redshift, Google BigQuery
  • Airflow (or Dagster)
  • Great Expectations, Deequ, DataHub, OpenLineage

What we offer

  • Stimulating working environment with a unique career path.
  • International mobility and internal R&D projects, including the Gen‑e2™ AI platform.
  • Personalized training through the PALO IT Academy and knowledge‑sharing initiatives.
  • Opportunities for entrepreneurship and intrapreneurship.

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec palo-it.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:ashby

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

By continuing, you accept our terms of use.

Already have an account? Login

💬 Chat with us on Telegram Chat on WhatsApp

Published 1 day ago

Expires 1 month from now

13 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

palo-it

Sao paulo