PinnedHow did I become a Data Engineer?I still remember the day when I first saw a computer in a book fare near to my home. The most important thing that astonished me was…Nov 5, 20213Nov 5, 20213
Simulating Cursors in Spark SQLW hen working with databases like Snowflake, you might be familiar with cursors — a handy tool for iterating through rows in a result set…1d ago1d ago
Human-in-the-loop Augmentation: Bridging AI and Human Intelligence for Optimal OutcomesArtificial Intelligence (AI) has made significant strides in automation, yet there remain crucial areas where human judgment, intuition…Feb 13Feb 13
Kafka, Spark Streaming & Flink : Are they on War?Rivers, ponds, lakes and streams — they all have different names, but they all contain water. Just as religions do — they all contain…Oct 16, 20241Oct 16, 20241
Poetry: Dependency Management and Packaging Simplified in PythonIn three words I can sum up everything I’ve learned about life: it goes on.Oct 16, 2024Oct 16, 2024
Why LLMs Offer Better Contextual Understanding than RAG“I can’t ask Aristotle a question. I mean — I can, but I won’t get an answer,” Jobs jokes in that meeting in Sweden, which you can see…Oct 2, 2024Oct 2, 2024
The Bat Mobile : Fun of Tuning Spark JobLife is made up of sobs, sniffles, and smiles, with sniffles predominating. The magi, as you know, were wise men — wonderfully wise men —…Sep 22, 2024Sep 22, 2024
Partitioning & Bucketing — A Big Data EsThe most successful Subway customers, of course, are the ones who can’t keep their hands off their sandwich. Join your artist in the…Sep 9, 20241Sep 9, 20241
