top of page

My Work

Enthusiastic and certified Data Science Master's student with a robust background in end-to-end data engineering, cloud computing, and machine learning. Proven leadership in managing teams, implementing Agile methodologies, and delivering impactful data-driven insights across diverse industries. Welcome to my Project Page.

AWS Glue logo.webp

01

This is my AWS Glue ETL Project. AWS Glue is a fully managed ETL (extract, transform, and load) service that makes it simple and cost-effective to categorize your data, clean it, enrich it, and move it reliably between various data stores and data streams. It supports python and spark languages.

02

This is a simple data pipeline on Azure platform. We will use Tokyo Olympic data available on Kaggle. We will extract data from Github, ingest it into Data Factory and then store it into Data Lake Gen 2. Then we wll use transformation using Azure Databricks and store the transformed data back to Data Lake. Finally I will build a dashboard using Azure Synapse Analytics.

Screenshot 2024-02-05 at 10.35.58 PM.png

03

graphs.png

Using The Witcher Novels we will create a Social Network of characters using Network Analytics. We will generate a network graph of all the characters and will try to answer the following questions.

  • What are the most important characters ?

  • How their importance evolves over time ?

  • Main communities in the network ?

04

Barrio Map offers fundamental functionalities like finding locations by conducting searches or selecting coordinates. Users can select from predefined scales and export the scaled maps to particular page sizes. Maps generated using Barrio Map are formal descriptions of particular sites with defined values of resolution, scales, and explicit information on distances. Barrio Map, in conjunction with OpenStreetMaps, is written in R, with functionalities largely leveraged from packages such as Leaflet and Shiny.

F71297C3.JPG

The question is not whether intelligent machines can have any emotions, but whether machines can be intelligent without any emotions.

Sarthak Haldar

bottom of page