How I Built a Production-Grade E-Commerce Data Analytics Pipeline With AWS and Databricks Nov 16, 2025路40 min read路22
Deploying Kubernetes on AWS EC2: Infrastructure Management Made Easy for Data EngineersOct 30, 2024路12 min read路45
Real-World Data Engineering: Healthcare Claims Pipeline Using AWS SNS, SQS, Snowpipe, and dbt Part 1 of 2: This post covers building the foundational data pipeline for a healthcare claims analytics project called claims-pulse. We walk through realistic data generation, uploading to S3 using boDec 29, 2025路24 min read路32
Real-Time Data Engineering: Streaming Unstructured Data to AWS with Apache SparkSep 17, 2024路15 min read路168
Analytics on S3 Data lake using AWS Glue Crawler and Amazon AthenaIntroduction In today's world, data is growing at an exponential rate. While this data holds immense value and has the potential to impact various aspects of our world, extracting value from such large datasets is no simple task. This is where data a...Dec 3, 2023路12 min read路68
Unleashing the power of ELT in AWS using AirbyteIntroduction At present, data exists like a vast ocean, and extracting valuable insights from this is like looking for a small needle in a big haystack. Enter ELT(Extract, Load, Transform) the modern way to process and analyze data, and data lakes, a...Nov 19, 2023路12 min read路59
A Beginner's Guide to Data Engineering: Building an ETL Pipeline in AWS with RedshiftIntroduction Hello There 馃憢馃徎. Hope you all are doing well. In this blog, I will elucidate a recent data engineering project I undertook, leveraging the prowess of AWS services. Throughout this endeavor, I harnessed the capabilities of AWS S3, Python...Jul 5, 2023路14 min read路705
A Beginner鈥檚 Guide to Data Engineering: Harnessing the Power of Python to Access AWS ServicesIntroduction Hello There 馃憢馃徎. Hope you all are doing well. In my previous blog, I discussed various AWS services that are commonly used in the data engineering field to store, manage, and process large volumes of data. As a widely popular cloud comp...May 16, 2023路8 min read路252
A Beginner鈥檚 Guide to Data Engineering: Unlocking the Power of Data with AWSIntroduction Hello There 馃憢馃徎. Hope you all are doing well. In my previous blog, I discussed the significance of data engineering for data-driven organizations and highlighted several essential components of data engineering. And, In this blog post, ...May 9, 2023路9 min read路407
A Beginner鈥檚 Guide to Data Engineering: Understanding the Core ComponentsIntroduction With the rise of the internet and modern technologies, a huge amount of data is being generated every second. As this data brings great value to business organizations, an ability to understand and work with such a vast amount of data is...May 3, 2023路5 min read路379
