Otacilio P S Filho

Logo

Data Engineer

View My GitHub Profile

Hi! I’m a Brazilian Data Engineer working around the world!

Results-driven Data Engineer with extensive experience in data ingestion and pipeline development within the Big Data ecosystem, both on-premises and in the cloud. Expertise in lakehouse storage, Python, Spark, Azure, Databricks and Snowflake, with a strong background in SQL, Linux, Docker and CI/CD pipelines. Adept at leading teams, solution design, and data migration projects.


I hold a degree in Industrial Engineering and a master's in Big Data and Business Intelligence, combining my strong analytical background with a deep passion for technology and programming. With a data-driven mindset and a goal-oriented approach, I thrive on solving complex problems and driving impactful results.


Technical Skills:
  • Cloud Platforms: Microsoft Azure (Data Factory, Synapse Analytics, Storage Account (data lake), DevOps, Kubernetes, Functions)
  • Big Data & ETL: Databricks, Delta Lake, Snowflake
  • Programming: Python, Spark, SQL, Shell, PowerShell
  • DevOps & Containers: CI/CD (Azure DevOps), Docker, Linux/WSL

Skills

Azure Databricks Python Spark Delta Lake Docker Kubernetes

Certifications

Databricks Certified Data Engineer Professional Databricks Certified Data Engineer Associate Databricks Certified Associate Developer for Apache Spark 3.0 Databricks Certified Data Analyst Associate Partner Training - Solutions Architect Essentials Academy Accreditation - Databricks Lakehouse Fundamentals
Azure Data Engineer Associate Azure Data Fundamentals Azure Fundamentals Azure AI Fundamentals Microsoft Security, Compliance, and Identity Fundamentals

Repos

Readme Card Readme Card Readme Card Readme Card Readme Card Readme Card