Author: Thejesh GN

Pathu's favorite pass time is to watch people. 2

The Year that was 2022

I must say 2022 was a better year than 2020 or 2021, both personally and professionally. Many things which we started earlier; started showing results this year. Hopefully, the world has begun recovering from COVID as well.

A very happy new year to you all. I wish you the very best.

Image of Anju's grandmother in my head. 1

Weekly Notes 52/2022

We were supposed to be in Bangalore tomorrow, just in time for the new year. But Anju’s grandmother passed away this morning. She was 90+ years. She had a wonderful life filled with grand-kids, great grand-kids. Death was peaceful. Her image in my head is always of the person reading the newspaper in the morning.

2

Programmatically Creating Embulk Configuration Files

Embulk needs a YAML file configuration for each data load. It’s a simple format, very human-readable. But there are cases where I want the YAML files to generate dynamically. Embulk does support an experimental feature that involves liquid templates. But my team is well versed in Python and Jinja2. Hence that is what we use.

Echo resting under the tree. 1

Weekly Notes 51/2022

We are in Thrissur. It took us eight hours to reach Thrissur from Bangalore, which is a bit faster than last year or so. Primarily due to the Kuthiran tunnel. The tolls have also increased quite a bit. I will have a page to track it.

3

My Boring Yet Modern Data Stack

We have a data stack that we have been using for years now. We have used it with medium to large customers, and they have worked very well. The goal has always been simple, stable, composable tools that can be used on the developer’s machine and scaled to work with massive data on production. You can self-host them, host them on the cloud, or get managed services based on your need.

Very similar to my web stack. It’s called “Boring” not because it’s dull but because there are minimal unwanted surprises. So my current stack for data looks like this. This stack is both “Modern” and “Boring.”

0

Weekly Notes 50/2022

Since I write weekly notes and there is a week number in the title, I pay attention to how fast the time moves. It’s been an excellent way to keep track of time. We are just two weeks away from 2023. Happy holidays folks.