PinnedHow did I become a Data Engineer?I still remember the day when I first saw a computer in a book fare near to my home. The most important thing that astonished me was…Nov 5, 2021A response icon3Nov 5, 2021A response icon3
Semantic Chunking for RAG: Unlocking Better Contextual Retrieval“The meaning of life is that it stops.” — Franz KafkaApr 22A response icon1Apr 22A response icon1
How GenAI Is Changing the Big Data Engineer’s Role — But Why Humans Still Matter More Than Ever“Master AI before AI masters you.” ~Dave WatersApr 7Apr 7
Mastering Text Chunking for LLMs and Vector DatabasesI don’t like broad swords. They’re not much fun. A broad sword is just a big chunk of steel, and there’s not much finesse in it, not much…Apr 2Apr 2
Simulating Cursors in Spark SQLW hen working with databases like Snowflake, you might be familiar with cursors — a handy tool for iterating through rows in a result set…Mar 12Mar 12
Human-in-the-loop Augmentation: Bridging AI and Human Intelligence for Optimal OutcomesArtificial Intelligence (AI) has made significant strides in automation, yet there remain crucial areas where human judgment, intuition…Feb 13Feb 13
Kafka, Spark Streaming & Flink : Are they on War?Rivers, ponds, lakes and streams — they all have different names, but they all contain water. Just as religions do — they all contain…Oct 16, 2024A response icon1Oct 16, 2024A response icon1
Poetry: Dependency Management and Packaging Simplified in PythonIn three words I can sum up everything I’ve learned about life: it goes on.Oct 16, 2024Oct 16, 2024
