Matheus B.Data Engineer
Skills
Data Engineer with expertise in Databricks, specializing in process optimization and the creation of high-performance data engineering solutions. Skilled in developing and optimizing data pipelines, and integrating a variety of data sources including SQL Server, MySQL, and APIs such as SAP ERP API. Proficient in Python, employing clean code practices, common design patterns, and Object-Oriented Programming (OOP) principles to deliver scalable and efficient solutions. Utilizes GitHub for code collaboration and version control to maintain team transparency and alignment. Experienced in deployment and release processes, ensuring seamless transitions between development and production environments. Collaborative team player, adept at translating complex requirements into impactful solutions.
Data Engineer
10/1/2023 - Present
Developed advanced skills in Apache Spark and Databricks, applying these tools to optimize and manage big data workflows. Utilized Azure Data Factory for orchestrating and automating data movement and transformation. Leveraged a suite of Azure tools, including Azure Blob Storage for data storage solutions, Azure Synapse Analytics for large-scale data warehousing, and Azure Data Lake for scalable storage solutions. Demonstrated capabilities in designing ETL processes, ensuring data integrity and efficiency. Showcased expertise in performance tuning and troubleshooting within these environments to enhance processing speed and reliability.Data Engineer
12/1/2022 - 10/1/2023
As a Data Engineer, extensive expertise was developed in utilizing the Azure platform, particularly Azure Databricks and SQL Server, to optimize processes and create high-performance data engineering solutions. Mastery of SQL Server was crucial for hosting and managing large datasets essential to the company's operations. Expertise in integrating and managing data using Azure Blob Storage Gen2, especially in conjunction with SQL Server, facilitated organized, secure, and efficient data access, forming the backbone of several ETL/ELT pipelines and processes.
Proficiency in Python was refined with a focus on clean code practices and common design patterns, ensuring robust and maintainable codebases. Skillful use of GitHub for version control ensured effective collaboration and transparency throughout all phases of development.
A significant role was played in deployment and release processes, guaranteeing seamless transitions of solutions from development to production environments. Consistent collaboration with multidisciplinary teams was key, aligning technical expertise with internal requirements to deliver solutions that met and often exceeded expectations.Data Scientist
1/1/2022 - 12/1/2022
Handled and structured unstructured and varied data with a focus on precision and integrity due to the sensitive sector. Developed proficiency in Python and MySQL to create specific data pipelines tailored for each client. This involved detailed data validation to ensure correctness and relevance. Utilized Metabase to create visualization dashboards for both clients and internal use, leveraging SQL queries for in-depth analysis and resolving inconsistencies. Ensured collaborative and transparent code maintenance using GitHub for versioning and team alignment. Demonstrated expertise in developing ETL tools within a local environment, addressing data cleaning, database management, and data quality validation with MySQL, Python, Metabase, and GitHub.
Production Engineering at Campo Real University Center
2013 - 2017Mathematics and Computer Science at State University of Midwestern
2020 - 2023MBA in Data Science and Analytics at University of São Paulo, College of Agriculture Luiz de Queiroz (USP/Esalq)
2021 - 2023Business Administration at SENAI Paraná
2011 - 2012
Google Data Analytics Certificate at Coursera
2/1/2021
Matheus is available for hire
Hire Matheus B.
All Howdy Candidates are vetted for skills and english proficiency.
