Weekly Notes 01/2023
Welcome to the new year. We are still in Thrissur, though I am in Mumbai today for a short visit. I am back in Thrissur tomorrow night. We should be back in Bangalore next week.
Thejesh GN Blog
The Year that was 2022
I must say 2022 was a better year than 2020 or 2021, both personally and professionally. Many things which we started earlier; started showing results this year. Hopefully, the world has begun recovering from COVID as well.
A very happy new year to you all. I wish you the very best.
Weekly Notes 52/2022
We were supposed to be in Bangalore tomorrow, just in time for the new year. But Anju’s grandmother passed away this morning. She was 90+ years. She had a wonderful life filled with grand-kids, great grand-kids. Death was peaceful. Her image in my head is always of the person reading the newspaper in the morning.
Programmatically Creating Embulk Configuration Files
Embulk needs a YAML file configuration for each data load. It’s a simple format, very human-readable. But there are cases where I want the YAML files to generate dynamically. Embulk does support an experimental feature that involves liquid templates. But my team is well versed in Python and Jinja2. Hence that is what we use.
Weekly Notes 51/2022
We are in Thrissur. It took us eight hours to reach Thrissur from Bangalore, which is a bit faster than last year or so. Primarily due to the Kuthiran tunnel. The tolls have also increased quite a bit. I will have a page to track it.
My Boring Yet Modern Data Stack
We have a data stack that we have been using for years now. We have used it with medium to large customers, and they have worked very well. The goal has always been simple, stable, composable tools that can be used on the developer’s machine and scaled to work with massive data on production. You can self-host them, host them on the cloud, or get managed services based on your need.
Very similar to my web stack. It’s called “Boring” not because it’s dull but because there are minimal unwanted surprises. So my current stack for data looks like this. This stack is both “Modern” and “Boring.”
