PinnedAni·Nov 5, 2021How did I become a Data Engineer?I still remember the day when I first saw a computer in a book fare near to my home. The most important thing that astonished me was…A response icon3A response icon3
Ani·Mar 19Why MCP Tool Servers Break Under Naive Horizontal ScalingIntroductionA response icon1A response icon1
Ani·Aug 4, 2025Why I Stopped Medium(For Now): A Data Freak’s ConfessionThere was a time — not so long ago — when writing felt like magic. An idea would simmer in my mind during a walk or while sipping chai on…A response icon2A response icon2
Ani·Apr 22, 2025Semantic Chunking for RAG: Unlocking Better Contextual Retrieval“The meaning of life is that it stops.” — Franz KafkaA response icon1A response icon1
Ani·Apr 7, 2025How GenAI Is Changing the Big Data Engineer’s Role — But Why Humans Still Matter More Than Ever“Master AI before AI masters you.” ~Dave Waters
Ani·Apr 2, 2025Mastering Text Chunking for LLMs and Vector DatabasesI don’t like broad swords. They’re not much fun. A broad sword is just a big chunk of steel, and there’s not much finesse in it, not much…
Ani·Mar 12, 2025Simulating Cursors in Spark SQLW hen working with databases like Snowflake, you might be familiar with cursors — a handy tool for iterating through rows in a result set…
Ani·Feb 13, 2025Human-in-the-loop Augmentation: Bridging AI and Human Intelligence for Optimal OutcomesArtificial Intelligence (AI) has made significant strides in automation, yet there remain crucial areas where human judgment, intuition…
Ani·Oct 16, 2024Kafka, Spark Streaming & Flink : Are they on War?Rivers, ponds, lakes and streams — they all have different names, but they all contain water. Just as religions do — they all contain…A response icon1A response icon1
Ani·Oct 16, 2024Poetry: Dependency Management and Packaging Simplified in PythonIn three words I can sum up everything I’ve learned about life: it goes on.