Managing Secrets in Digdag
In this post we will learn how to manage secrets in Digdag and how to use them in the workflows.
Category: Technology
Seven Useful DigDag Tips and Tricks
Table of Contents1 Setup DigDag Config2 Enable Authentication3 Run a different version of Python4 Use other programming languages or call a binary5 Use Restful APIs6 Use Docker7 Make HTTP Requests DigDag is a pretty simple tool to install and run. There are quite a few tips and tricks that you can use to...
How to use DigDag Restful APIs to Trigger a Job
Table of Contents1 A Simple Project and Workflow2 Trigger the task using API2.1 Get Project2.2 Get Current workflowId2.3 Make an Attempt to Run3 Make an Attempt with Params DigDag has been a tool of choice to run data workflows and some batch jobs at First Walkin Technologies. I liked DigDag from day one. Just like any Unix...
Surveillance in Bengaluru – Updates
I have been mapping Surveillance in Bengaluru for couple of months now. We have made some good progress. I thought it’s good time to share those updates and ask for help. Mapping We have mapped 340 Public and Outdoors CCTV cameras. I think we have made good progress. But to cover the entire...
Updates to HOPCOMS API
HOPCOMS Daily rate page moved to a new location last month. It’s not visible on Google search and hence I couldn’t find. But a good soul at HOPCOMS whom I got in touch with sent me this new link. It’s not just change of url. They have changed the structure of the data...
Now Rusting
To be frank I wanted to learn something new. Something different but still part of my ecosystem. I looked at Go and Rust. I settled with Rust. Rust is very different from what I have learnt ( C, Java, JS, Python ) until now. It also looked like a language that would take...
