A container for all my views with excerpts from technology, travel, films, books, kannada, friends and other interests. I am Thejesh GN, friends call me Thej.
Embulk needs a YAML file configuration for each data load. It’s a simple format, very human-readable. But there are cases where I want the YAML files to generate dynamically. Embulk does support an experimental feature that involves liquid templates. But my team is well versed in Python and Jinja2. Hence that is what we use.
We are in Thrissur. It took us eight hours to reach Thrissur from Bangalore, which is a bit faster than last year or so. Primarily due to the Kuthiran tunnel. The tolls have also increased quite a bit. I will have a page to track it.
We have a data stack that we have been using for years now. We have used it with medium to large customers, and they have worked very well. The goal has always been simple, stable, composable tools that can be used on the developer’s machine and scaled to work with massive data on production. You can self-host them, host them on the cloud, or get managed services based on your need.
Very similar to my web stack. It’s called “Boring” not because it’s dull but because there are minimal unwanted surprises. So my current stack for data looks like this. This stack is both “Modern” and “Boring.”
Since I write weekly notes and there is a week number in the title, I pay attention to how fast the time moves. It’s been an excellent way to keep track of time. We are just two weeks away from 2023. Happy holidays folks.
Embulk is a bulk data loader. It helps transfer data between different types of databases, storages, file formats, cloud services, etc. It’s like a Unix tool. It’s simple, robust, and works well with other tools.
I run the microblog.pub as my ActivityPub server. Since I had almost reached 100+ followers and following, I was curious about the diversity or spread of instances. So I wrote some SQL queries to explore the downloaded SQLite.
There are many ways to subscribe to this blog. Email is probably the best.
Thejesh GN (ತೇಜೇಶ್ ಜಿ.ಎನ್) "Thej" is an Independent Technologist, Hacker, Maker, Traveler, Blogger, InfoActivist, Open data and Open internet enthusiast from Bangalore, India. He loves experimenting with all things life and hence some times he is called hacker and other times duct tape. You can read more about him here. Email [ i @ thejeshgn dot com]. PGP/GPG Keys are here.
(C) Thejesh GN.The views expressed on this site are mine (Thejesh GN) alone and do not necessarily reflect the views of my employer. Please read the terms and conditions before reading or commenting on this blog.
