A container for all my views with excerpts from technology, travel, films, books, kannada, friends and other interests. I am Thejesh GN, friends call me Thej.
DataMeet community has been doing some amazing work in collecting, cleaning and organizing COVID-19 datasets. The focus in on Indian datasets. The data is mainly sourced from different government websites which are freely available to all the Indians. I recorded a video introducing these datasets. In the video we will go through each...
There is a good chance that you want to allow multiple developers to run their dags/tasks on your Digdag server. It’s painful to maintain the packages/dependencies they need to run their tasks. It specially becomes difficult if they conflict with each other. One way to solve it, is by having some kind of...
In this post we will learn how to manage secrets in Digdag and how to use them in the workflows.
DigDag is a pretty simple tool to install and run. There are quite a few tips and tricks that you can use to make your interaction productive. Here are my favourite ones. Setup DigDag Config DigDag command takes quite a few parameters. Instead of remembering to enter them every time, one can create...
DigDag has been a tool of choice to run data workflows and some batch jobs at First Walkin Technologies. I liked DigDag from day one. Just like any Unix tool, It does a limited set of things but it does them quite well. One of the things I really missed is to trigger...
HOPCOMS Daily rate page moved to a new location last month. It’s not visible on Google search and hence I couldn’t find. But a good soul at HOPCOMS whom I got in touch with sent me this new link. It’s not just change of url. They have changed the structure of the data...
There are many ways to subscribe to this blog. Email is probably the best.
Thejesh GN (ತೇಜೇಶ್ ಜಿ.ಎನ್) "Thej" is an Independent Technologist, Hacker, Maker, Traveler, Blogger, InfoActivist, Open data and Open internet enthusiast from Bangalore, India. He loves experimenting with all things life and hence some times he is called hacker and other times duct tape. You can read more about him here. Email [ i @ thejeshgn dot com]. PGP/GPG Keys are here.
(C) Thejesh GN. The views expressed on this site are mine (Thejesh GN) alone and do not necessarily reflect the views of my employer. Please read the terms and conditions before reading or commenting on this blog.
