PinnedAniHow did I become a Data Engineer?I still remember the day when I first saw a computer in a book fare near to my home. The most important thing that astonished me was…Nov 5, 20213Nov 5, 20213
AniUnderstanding Spark Re-Partition“The bad news is time flies. The good news is you’re the pilot.” — Michael Altshuler4d ago4d ago
Ani[DSA] Patience Sorting“Two things define you: your patience when you have nothing and your attitude when you have everything.” — George Bernard Shaw.May 1May 1
AniRAG — Retrieval-Augmented Generation“Questions are never indiscreet, answers sometimes are.” — Oscar WildeDec 18, 20231Dec 18, 20231
AniSpark 3.4 — Parameterised SQLCode reuse is the Holy Grail of Software Engineering. Douglas CrockfordAug 4, 20231Aug 4, 20231
AniApache Spark — Play with nested files“Setting goals give you a life to live. When you have zero goals its life that consumes you.” ― Thomas VatoMar 2, 20231Mar 2, 20231
AniinSelectFromSpark Optimization : Reducing Shuffle“Shuffling is the only thing which Nature cannot undo.” — Arthur EddingtonJul 30, 20226Jul 30, 20226
AniDesign a Scalable Data Solution : Know the requirementsA recipe has no soul. You as the cook must bring soul to the recipe.” – Thomas KellerJul 17, 2022Jul 17, 2022
AniTame The Spark UI“An artist’s concern is to capture beauty wherever he finds it.” ― Kazuo Ishiguro, An Artist of the Floating WorldJun 10, 20221Jun 10, 20221
AniScala Fun : Create your custom configWork hard and figure out how to be useful and don’t try to imitate anybody else’s success. Figure out how to do it for yourself with…Jun 3, 2022Jun 3, 2022