Engenharia de Dados (Databricks)
About the role
Accountabilities
Design, develop, and continuously evolve scalable data solutions within cloud environments.
Build, maintain, and optimize data pipelines for processing and transforming large volumes of data.
Use Databricks, Python, PySpark/Spark, SQL, Delta Lake, and Lakehouse architecture to deliver robust data engineering solutions.
Develop and manage Databricks Workflows and Jobs, ensuring effective pipeline orchestration.
Apply best practices for data performance, governance, monitoring, reliability, and operational support.
Analyze technical and business requirements and translate them into sustainable, high-quality data solutions.
Identify opportunities to improve architecture, processes, automation, and overall efficiency.
Work autonomously while collaborating with data and technology teams to evolve the organization's data capabilities.
Solid professional experience as a Senior Data Engineer.
Strong hands-on expertise with Databricks and cloud-based data architecture.
Proven experience designing, developing, and evolving data pipelines.
Strong knowledge of ETL/ELT processes and large-scale data processing.
Professional experience with Python and PySpark/Spark.
Solid SQL skills.
Experience with Delta Lake and Lakehouse architecture.
Knowledge of Databricks Workflows/Jobs and data pipeline orchestration.
Understanding of best practices related to performance optimization, data governance, monitoring, and solution maintenance.
Hands-on and autonomous profile, with the ability to take ownership of technical challenges and drive solutions forward.
Strong analytical and problem-solving skills, with a continuous improvement mindset.
Permanent CLT employment contract.
40-hour workweek with flexible working hours.
Fully remote work model.
SulAmérica health and dental insurance, including eligible dependents.
Flexible meal and food allowance through Caju Benefits.
Life insurance.
Home-office allowance through Caju Benefits.
Wellhub (Gympass).
TotalPass.
SESC benefits, including eligible dependents and access to services throughout Brazil.
Corporate learning through an internal university with more than 20,000 courses.
Language Academy for professional language development.
Internal knowledge-sharing sessions, talks, and technical chapters.
Pet health plan through Guapeco.
Onhappy travel and leisure benefit.
Option to use your own notebook through a monthly BYOD allowance or use company-provided equipment.
Birthday cake benefit.
Referral reward program for recommending new employees.
Requirements
Benefits