A container for all my views with excerpts from technology, travel, films, books, kannada, friends and other interests. I am Thejesh GN, friends call me Thej.
There is a good chance that you want to allow multiple developers to run their dags/tasks on your Digdag server. It’s painful to maintain the packages/dependencies they need to run their tasks. It specially becomes difficult if they conflict with each other. One way to solve it, is by having some kind of...
In this post we will learn how to manage secrets in Digdag and how to use them in the workflows.
Table of Contents1 Setup DigDag Config2 Enable Authentication3 Run a different version of Python4 Use other programming languages or call a binary5 Use Restful APIs6 Use Docker7 Make HTTP Requests DigDag is a pretty simple tool to install and run. There are quite a few tips and tricks that you can use to...
Table of Contents1 A Simple Project and Workflow2 Trigger the task using API2.1 Get Project2.2 Get Current workflowId2.3 Make an Attempt to Run3 Make an Attempt with Params DigDag has been a tool of choice to run data workflows and some batch jobs at First Walkin Technologies. I liked DigDag from day one. Just like any Unix...
HOPCOMS Daily rate page moved to a new location last month. It’s not visible on Google search and hence I couldn’t find. But a good soul at HOPCOMS whom I got in touch with sent me this new link. It’s not just change of url. They have changed the structure of the data...
Table of Contents1 How to add1.1 Using OSMAnd1.2 Using Every Door2 How to get this data3 Surveillance under Surveillance4 What next? For last couple of months I have been driving quite a bit inside the city1. The biggest thing I noticed was the amount of public CCTV cameras across the city. I find...
There are many ways to subscribe to this blog. Email is probably the best.
Thejesh GN (ತೇಜೇಶ್ ಜಿ.ಎನ್) "Thej" is an Independent Technologist, Hacker, Maker, Traveler, Blogger, InfoActivist, Open data and Open internet enthusiast from Bangalore, India. He loves experimenting with all things life and hence some times he is called hacker and other times duct tape. You can read more about him here. Email [ i @ thejeshgn dot com]. PGP/GPG Keys are here.
Fediverse or Mastodon: @[email protected]
(C) Thejesh GN.The views expressed on this site are mine (Thejesh GN) alone and do not necessarily reflect the views of my employer. Please read the terms and conditions before reading or commenting on this blog.
