![Image of Wesley D.](/_next/image?url=https%3A%2F%2Fcdn.sanity.io%2Fimages%2F218g3l3q%2Fproduction%2Fcf996f44eb5d1e90f93acf9996753cce3b303461-200x200.jpg%3Fw%3D150%26h%3D150%26fit%3Dmax%26auto%3Dformat&w=384&q=75)
Wesley D.Back-end and Systems Engineer
Skills
Web Scraping Data Engineer
7/1/2022 - Present
Contributed to the data collection team responsible for various company sectors, focusing on both the creation of new automation robots and the maintenance of existing ones. Managed the entire development lifecycle, from initial coding to deployment within an AWS architecture. Utilized Python as the main programming language, employing Selenium for automation in building various Crawlers and Beautiful Soup for scraping thousands of HTML pages. Conducted extensive ETL (Extract, Transform, Load) processes to standardize the delivery of millions of daily data collections. Leveraged a wide range of AWS services including S3, EC2, ECS, SQS, Lambda, and CloudWatch to ensure efficient and reliable data handling and operational monitoring.Systems Analyst II
2/1/2022 - 6/1/2022
Served as a Data Engineer in a data-centric team responsible for creating and maintaining robust data pipelines to ensure organized and accessible data for various departments across the organization. Developed proficiency in Python and SQL for data extraction, transformation, and loading (ETL) processes. Utilized Apache Airflow for workflow automation and scheduling, ensuring timely and reliable data pipeline execution. Leveraged AWS services, including S3, Redshift, and Lambda, to build scalable and cost-efficient data infrastructure. Demonstrated expertise in data warehousing solutions and implemented data modeling best practices to optimize query performance and data storage. Employed version control systems like Git for collaborative development and code maintenance. Skills in troubleshooting and performance tuning were applied to enhance the efficiency and reliability of data pipelines. Conducted data quality assessments and implemented validation strategies to ensure data integrity. Collaborated closely with data analysts, data scientists, and other stakeholders to understand data requirements and provide actionable insights.Python Developer
9/1/2020 - 1/1/2022
Gained substantial experience in automating banking processes and routines by creating robots using Python. Utilized tools such as Beautiful Soup (Bs4), Requests, Django, and Celery to enhance task efficiency and execution.Intern
7/2/2015 - 1/2/2016
Developed competency in assisting with basic computer activities and tasks. Gained proficiency in utilizing the Office suite, including Word, Excel, and PowerPoint, to create and manage documents, spreadsheets, and presentations. Demonstrated ability to guide and support users in effectively operating these software programs and troubleshooting common issues.
Computer Science at State University of Piauí
2013 - 2019
Data Mesh: Data as Products at Alura
12/1/2023Apache Airflow: Orchestrating Your First Data Pipeline at Alura
11/1/2023Kafka: Producers, Consumers, and Streams at Alura
7/1/2023Data Mesh: A Distributed Approach to Data at Alura
7/1/2023Spark: Data Streaming at Alura
2/1/2023Apache Airflow: Data Extraction at Alura
2/1/2023Spark: Introducing the Tool at Alura
1/1/2023String in Python: Extracting Information from a URL at Alura
6/1/2021Automated Tests: TDD with Python at Alura
6/1/2021Design Patterns Python I: Good Programming Practices at Alura
6/1/2021Amazon Lambda: Running Serverless Code at Alura
5/1/2021Scraping with Python: data collection on the web at Alura
3/1/2021Image Recognition: Twitter and Computer Vision API at Alura
3/1/2021Python: Advancing in Object Orientation at Alura
2/1/2021API with Django 3: Django Rest Framework at Alura
2/1/2021Python for Data Science: Functions, Packages, and Pandas at Alura
2/1/2021
Wesley is available for hire
Meet Wesley D.All Howdy Candidates are vetted for skills and english proficiency.