Jobiglo

No results.

Principal Data Engineering

3m · Sumare

New
Senior 🇬🇧 English
Python Apache Spark PySpark Databricks AWS SQL NoSQL Kubernetes Airflow JIRA Confluence

Job description

About the role

3M is looking for a Principal Data Engineer to join the Corporate Research Digital Platforms (CRDP) and build scalable data systems and solutions. Working in an agile team, the role supports applications in energy, manufacturing, personal safety, transportation, electronics and consumer markets, and helps design and support an enterprise data mesh.

Key responsibilities

  • Design, architect and build scalable, efficient and fault-tolerant data operations.
  • Work with senior leadership, analysts, engineers and scientists to implement mesh domain nodes and data initiatives.
  • Drive technical architecture for data integration, modeling, governance and applications, and recommend new tools and technologies.
  • Improve data engineering and analytics engineering best practices and design physical data models and mappings with domain teams.
  • Develop and maintain scalable data pipelines for ingesting, transforming and distributing data streams.
  • Perform code reviews, manage code performance and enforce maintainability standards.
  • Mentor data scientists and advise on data standards, pipeline development and consumption.
  • Guide project planning, manage timelines and resources, and foster a positive team environment, including recruitment support and training.

Required profile

  • Bachelor's degree or higher in Computer Science, or equivalent education or experience.
  • Solid professional experience in data management, data governance and data warehouse/lakehouse design and development.
  • Advanced English.
  • Hands-on experience extracting data from APIs and building data pipelines with Python.

Required skills

  • Proficiency in SQL and NoSQL data management systems.
  • Distributed cloud architecture and workloads (AWS, Databricks).
  • Python, Apache Spark, PySpark and data lakehouses (preferably Databricks).
  • Relational SQL and NoSQL databases, data quality and validation principles, and security principles.
  • Plus: data mesh principles, AWS services (S3, Glue, EMR), stream processing (Kinesis, Kafka, Storm), Docker, Kubernetes, Airflow, and visualization tools (Tableau, Power BI, Dash).

The position is onsite, with at least four days per week in the 3M Sumaré office.

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec 3m.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:workday

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 4 days ago

Expires 1 month from now

12 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

3m

Sumare