Sr. Designated Support Engineer, Apache Spark

About the role

Databricks is looking for an experienced Sr. Designated Support Engineer (Premier Support Engineer) in São Paulo, Brazil. The role is hybrid and requires at least three days a week in the São Paulo office. The engineer builds close relationships with strategic customers, manages and prioritizes critical issues and delivers a high-touch, proactive support experience.

Key responsibilities

• Manage large strategic accounts to deliver a high-touch support experience.
• Analyze Spark UI, thread dumps and driver/executor logs to resolve complex Spark and data engineering issues.
• Advise customers on best practices such as optimizing ETL/ELT pipelines, data modeling and using Delta Lake and Iceberg.
• Project manage open support cases and coordinate with Engineering, Product, SME and Accounts teams to close tickets.
• Engage directly on business-impacting situations and with senior leadership to remove roadblocks and recover functionality.
• Review customer cases regularly to spot trends and optimization opportunities, and champion customers through roundtables.
• Help customers become self-sufficient by teaching them how to use the Databricks Support organization and tools.

Required profile

• Minimum 3 years of experience building, deploying and maintaining large-scale data pipelines.
• Minimum 3 years designing, developing, testing and sustaining Python, Java or Scala applications.
• Proven track record of troubleshooting complex Spark and big data issues such as data skew, OOM errors and slow broadcast joins.
• Bilingual: full professional fluency in English and Portuguese.
• Customer-facing experience as a Support Engineer, Technical Account Manager or similar is preferred.

Required skills

• Deep knowledge of Apache Spark internals (Drivers, Executors, memory management, DAGs, Catalyst Optimizer, Tungsten).
• Strong project management and communication skills, able to explain complex technical topics to non-technical stakeholders.