Shahin's blog

Shahin's blog

Follow
Follow
homePersian Blog

Composing Functions for PySpark's Structured Streaming

ShahinShahin
Oct 12, 20232 min read

In PySpark's structured streaming, striving for modular, reusable code while ensuring adaptability for each unique use case is a common challenge. I...

Composing Functions for PySpark's Structured Streaming

Iceberg on Glue: The table name confusion!

ShahinShahin
Oct 10, 20232 min read

Lately, our team has embarked on a journey to enhance our data storage infrastructure. We invested in Iceberg as our storage layer for data product...

Iceberg on Glue: The table name confusion!

Introducing devenv Templates: Simplifying Development Environments with Nix

ShahinShahin
Oct 8, 20233 min read

Over the past year, I've dived deep into the world of NixOS, discovering its robustness, flexibility, and power. I've crafted various configurations...

Introducing devenv Templates: Simplifying Development Environments with Nix

The Fire of Purpose: From Personal Growth to Team Success

ShahinShahin
Oct 1, 20232 min read

Deep within each of us, there's a burning desire—a fundamental drive that shapes our actions and decisions. For me, it boils down to one thing:...

The Fire of Purpose: From Personal Growth to Team Success

TIL: Kafka CLI and group offset

ShahinShahin
Jun 15, 20231 min read

Today, I discovered that when utilizing kafka-console-consumer and including the --group flag without specifying --from-beginning, the offset is set...

TIL: Kafka CLI and group offset

AI is here; what's your plan?

ShahinShahin
May 29, 20232 min read

Over a decade ago, big data became a buzzword, and everyone envisioned a future where data-driven decision-making would be the norm. However, fast...

AI is here; what's your plan?