List: Reading list | Curated by Thin Nguyen Duy

Feb 24, 2023
32 stories
Reading list
Irem Ertürk
Managing Partitions with SparkIf you ever wonder why everyone moved from Hadoop to Spark, I highly recommend understanding the differences between memory and disk-based…
Apr 3, 2022
1
Apr 3, 2022
1
In
The Slalom Blog
by
Amarpreet Singh
Introduction to Schema Registry in KafkaApache Kafka has been gaining so much popularity these past few years due to its highly scalable, robust, and fault-tolerant…
Apr 15, 2020
3
Apr 15, 2020
3
In
Geek Culture
by
Nirav Bhatt
Why Every Developer Should Learn CloudEasiest way to stay relevant in ever-changing market
Jul 6, 2021
Jul 6, 2021
In
TDS Archive
by
Antony Henao
Building a Data Warehouse: Basic Architectural principlesAn approach towards simplifying data warehousing
Feb 10, 2020
3
Feb 10, 2020
3
Lewis Gavin
How to architect the perfect Data WarehouseKey warehousing techniques made simple
Jul 26, 2018
12
Jul 26, 2018
12
In
SoftwareMill Tech Blog
by
Andrzej Ludwikowski
The best serialization strategy for event sourcingA brief summary of the existing serialization solutions (not only) for events in Event Sourced systems.
Jun 19, 2019
6
Jun 19, 2019
6
In
WhatfixEngineeringBlog
by
Saravanan A R
Real-Time data processing architecture using Apache Spark, Apache Kafka, and ClickHouseThis blog will talk about Real-time data processing architecture using Apache Spark, Apache Kafka, and ClickHouse.
Jan 3, 2022
1
Jan 3, 2022
1
In
OmarElgabry's Blog
by
Omar Elgabry
Data Structures — A Quick Comparison (Part 2)We could vastly improve the performance of our code by picking an alternative data structure
Nov 9, 2016
1
Nov 9, 2016
1
In
Robinhood
by
Arpan Shah
Taming ELKThe ELK (Elasticsearch[ES], Logstash and Kibana) stack is an extremely powerful and useful tool for powering search and analytics. At large…
May 3, 2017
May 3, 2017
In
Robinhood
by
Vineet Goel
Adding Faust to your Existing ArchitectureQuick Links: GitHub | Documentation
Aug 22, 2018
4
Aug 22, 2018
4
In
TDS Archive
by
Kiruparan Balachandran
Connecting the Dots (Python, Spark, and Kafka)Python, Spark, and Kafka are vital frameworks in data scientists’ day to day activities. It is essential to enable them to integrate these…
Jul 8, 2019
1
Jul 8, 2019
1
In
TDS Archive
by
Giorgos Myrianthous
Kafka No Longer Requires ZooKeeperVersion 2.8.0 Gives You Early Access to Zookeeper-Less Kafka
Apr 27, 2021
1
Apr 27, 2021
1
sudan
Exactly-Once Processing in Kafka explainedThis article explains how Exactly-Once Processing in Kafka works internally. It assumes that the reader is already familiar with the…
Mar 9, 2021
Mar 9, 2021
In
Insight
by
Sriram Baskaran
Airflow 101: Start automating your batch workflows with easeIn this blog, I cover the main concepts behind pipeline automation with Airflow and go through the code (and a few gotchas) to create your…
Oct 17, 2018
5
Oct 17, 2018
5
In
TDS Archive
by
Mustavi Sarker
Using Kafka to optimize data flow of your Twitter StreamA guide to processing big data from Twitter efficiently
Jul 30, 2020
1
Jul 30, 2020
1
In
TDS Archive
by
Steven Van Dorpe
Kafka-Python explained in 10 lines of codeAlthough it’s not the newest library Python has to offer, it’s hard to find a comprehensive tutorial on how to use Apache Kafka with…
Aug 13, 2018
23
Aug 13, 2018
23
 This story is no longer available
Adnan Siddiqi
Create your first ETL Pipeline in Apache Spark and PythonIn this post, I am going to discuss Apache Spark and how you can create simple but robust ETL pipelines in it. You will learn how Spark…
Jun 9, 2019
6
Jun 9, 2019
6
In
TDS Archive
by
Calvin Canh Tran
How did I deploy Airflow on Kubernetes?A complete guide with best practices.
Dec 20, 2020
2
Dec 20, 2020
2
Bex T.
Good-bye Pandas! Meet Terality — Its Evil Twin With Identical Syntax… but up to 30 times faster
Jan 17, 2022
17
Jan 17, 2022
17