Howdy Logo
Image of Ney P.

Ney P.
Data Engineer

Spark
Sql
Al
Github
Javascript
Python
Google Cloud
Docker Cloud
Bio

Data Scientist and Python Developer with a focus on autonomy, integrity, and analytical quality. Passionate about continuous learning and adaptable to new challenges. Holds a Bachelor's degree in Science and Technology and a postgraduate degree in IT (Business Intelligence and Analytics) with a concentration on data science products. Currently pursuing an MBA in Data Science and Analytics.

Possesses extensive experience in Business Intelligence and Analytics, contributing to significant institutional improvements through AI, automation, and various decision-support solutions. Expertise includes MLOps, machine learning models with natural language processing, data pipeline orchestration, PySpark, and tools on the Google Cloud Platform, such as BigQuery, Cloud Storage, Dataflow, and Dataproc.

Demonstrates a keen interest in aiding organizations to efficiently collect, organize, and explore digital assets while enforcing data quality governance. Adept in interpersonal communication, enhancing stakeholder engagement and fostering professional collaboration on diverse projects.

  • Business Intelligence | Analytics
    4/1/2022 - 11/1/2023

    Developed machine learning models utilizing XGBoost and Deep Learning to enhance the court's decision-making process. Created virtual assistants and chatbots to facilitate external public interaction, employing the RASA framework and GPT-3.5 API. Executed a data extraction project from the JFRN website, leveraging Langchain to supply Large Language Models such as GPT-3.5 and GPT-4. Engineered RESTful APIs for model deployment with FastAPI and NodeJS, and designed microservices using Docker, incorporating CI/CD practices on GitLab. Constructed data pipelines for AI projects, incorporating data checks and validations with Great Expectations and Pydantic to ensure data quality. Developed dashboards on the Qlik platform for analyzing and monitoring KPIs related to citizen service chats. Played a key role in implementing new tools and selecting appropriate solutions to foster MLOps and DataOps culture, which included versioning metrics, data, and models. Operated within Agile, self-managed teams that included facilitators acting as project managers to assist with overcoming impediments.

  • Data Engineer Apprentice
    1/1/2022 - 4/1/2022

    Extracted data from public APIs using Python, executed ETL processes leveraging Pandas and PySpark, and persisted data into MySQL, MongoDB, and Google Cloud Storage. Managed and analyzed data with BigQuery, and enforced data validations using PySpark schemas and Pandera. Developed data pipelines for both Batch and Streaming with Apache Beam on Dataflow, integrating Pub/Sub for messaging. Handled Big Data tasks utilizing Apache Spark on Dataproc and designed interactive dashboards with DataStudio.

  • Research Technician
    3/1/2017 - Present

    Handled the collection and validation of accounting data from the commerce, industry, and services sectors in Brazil, essential for analyzing economic performance and trends. Contributed to team management by implementing and monitoring key performance indicators (KPIs) to consistently uphold the quality of data collection and professional output. Utilized effective communication skills to interact with various profiles, ensuring clear understanding of research objectives among collaborators and informants. Demonstrated high quality of work and rapid data collection, leading to involvement in the more complex Annual Industrial Survey. Engaged in continuous improvement efforts by providing suggestions and participating in problem-solving activities during weekly teamwork meetings.

  • Sciences and Technology (Computer Science) at Federal University of Rio Grande do Norte
    2011 - 2017

  • Business Administration (Data Science and Analytics) at University of São Paulo
    2022 - 2024

  • Information Technology (Business Intelligence and Analytics) at Federal University of Rio Grande do Norte
    2022 - 2023

  • Business English at Pearson College London / IBS Americas
    1/1/2024

  • Data Science Applied to Business at Pearson College London / IBS Americas
    1/1/2024

  • Life Cycle Canvas® Associate Certified at Life Cycle Canvas
    7/1/2022

  • From Data to Insights with Google Cloud Specialization at Coursera
    6/1/2022

  • Applying Machine Learning to your Data with Google Cloud at Coursera
    6/1/2022

  • Achieving Advanced Insights with BigQuery at Coursera
    6/1/2022

  • English Certificate Level C1 Expert – Common European Framework of Reference for Languages (CEFR) at Lingopass
    4/1/2022

  • Agile Software Development at LinkedIn
    4/1/2022

  • Creating New BigQuery Datasets and Visualizing Insights at Coursera
    4/1/2022

  • Perform Foundational Infrastructure Tasks in Google Cloud at Qwiklabs
    2/1/2022

  • Create and Manage Cloud Resources at Qwiklabs
    2/1/2022

  • Build and Secure Networks in Google Cloud at Qwiklabs
    2/1/2022

  • Python Fundamentals for Data Analysis 3.0 at Data Science Academy
    11/1/2021

  • Artificial Intelligence Fundamentals 2.0 at Data Science Academy
    11/1/2021

  • M001: MongoDB Basics at MongoDB
    9/1/2021

  • Web Developer at Universidade Federal do Rio Grande do Norte
    3/1/2021

Ney is available for hire

Hire Ney P.
Check icon

All Howdy Candidates are vetted for skills and english proficiency.