Category: Technology

0

IDVC 2022 – Final Stats

As you would know, I run IDVC survey project, which collects the prices of idli, vada (vada), dose(dosa), and coffee across Bangalore. It’s an ongoing project. The idea is to map the price over time and across geographies in Bangalore.  

Part of that larger plan is also to publish the rates of idli, vada (vada), dose(dosa), and coffee at the end of every year. Since 2022 has ended. I have the stats here.

2

Programmatically Creating Embulk Configuration Files

Embulk needs a YAML file configuration for each data load. It’s a simple format, very human-readable. But there are cases where I want the YAML files to generate dynamically. Embulk does support an experimental feature that involves liquid templates. But my team is well versed in Python and Jinja2. Hence that is what we use.

3

My Boring Yet Modern Data Stack

We have a data stack that we have been using for years now. We have used it with medium to large customers, and they have worked very well. The goal has always been simple, stable, composable tools that can be used on the developer’s machine and scaled to work with massive data on production. You can self-host them, host them on the cloud, or get managed services based on your need.

Very similar to my web stack. It’s called “Boring” not because it’s dull but because there are minimal unwanted surprises. So my current stack for data looks like this. This stack is both “Modern” and “Boring.”

3

Embulk for extracting and loading data

Embulk is a bulk data loader. It helps transfer data between different types of databases, storages, file formats, cloud services, etc. It’s like a Unix tool. It’s simple, robust, and works well with other tools.

My followers 2

microblog.pub : Where do my Followers and Following come from?

I run the microblog.pub as my ActivityPub server. Since I had almost reached 100+ followers and following, I was curious about the diversity or spread of instances. So I wrote some SQL queries to explore the downloaded SQLite.

1

Get Poem-a-Day as Push Notification

Since I get Vachanas as a push notification, the probability of me reading it has increased. This encouraged me to add Poem-a-Day to this list.