Otacilio P S Filho

Logo

Data Engineer

View My GitHub Profile

Hi! I’m a Brazilian Data Engineer working around the world!

Lead Data Engineer with 6+ years of hands-on experience designing and delivering enterprise-scale data platforms for global leaders including PepsiCo, Volvo Group, and P&G. Experienced in leading cross-functional teams (up to 7 engineers and analysts), designing lakehouse architectures on Azure and Databricks, migrating legacy ETL platforms (Informatica, SAS) to modern cloud-native solutions, and translating business needs into scalable, production-grade data products.


Skilled in the Azure ecosystem (Databricks, ADF, Synapse, Functions), with deep proficiency in Spark, Python, SQL, and Delta Lake.


Technical Skills:
  • Cloud Platforms: Microsoft Azure (Data Factory, Synapse Analytics, Storage Account/data lake, Functions)
  • Big Data & ETL: Databricks, Delta Lake
  • Programming: Python, Spark, SQL, Shell, PowerShell
  • DevOps & Containers: CI/CD (Azure DevOps), Docker, Kubernetes, Linux/WSL

Skills

Azure Databricks Python Spark Delta Lake Docker Kubernetes

Certifications

Databricks Certified Data Engineer Professional Databricks Certified Data Engineer Associate Databricks Certified Associate Developer for Apache Spark 3.0 Databricks Certified Data Analyst Associate Partner Training - Solutions Architect Essentials Academy Accreditation - Databricks Lakehouse Fundamentals
Azure Data Engineer Associate Azure Data Fundamentals Azure Fundamentals Azure AI Fundamentals Microsoft Security, Compliance, and Identity Fundamentals

Repos

Readme Card Readme Card Readme Card Readme Card Readme Card Readme Card