Tagged: Code

0

Turning My Laptops into a Dask Distributed Cluster

I wanted a distributed system where the client submitting the job has the code and logic, but the workers don’t. They just execute the workload they get. I had used Dask in the LocalCluster mode, where everything runs on the same computer but in different processes/threads. It works well, and I have used...

0

Send Dramatiq Tasks directly by Pushing JSON to Redis

Dramatiq uses JSON as the messaging format, and the sender or caller of the Job doesn’t need to have access to the Actor or know a lot about it. This has a considerable advantage. Once you set up the workers to execute the Job, all that is needed is to call the Job...

Dramatiq: background tasks 0

Simple and Easy Background Tasks with Dramatiq

For a long time, I have been using Celery to do background tasks. It does work, but has limitations. Limitations become apparent when you teach it to someone or when someone new tries to use it. So I am always looking for simple (not trivial) and easier ways to achieve this. I have...

0

Embedding models for Kannada

Embedding models transform words, sentences, documents, or digital items into vectors of numbers (usually floats) so that machines can understand and compare them semantically1. A good embedding model has enough information to capture the meaning and relationships in dense vector form. I have been using them to replace simple FTS, to implement sophisticated...

3

Simple IMD Alerts

IMD (Indian Meteorological Department) has a district-level alert system. They give rain alerts for today and the next four days. They also have something called NowCast that shows the same alert level for now. Alerts are basically four levels Since it is district-level and not very specific, it might or may not be...

Year 2023 in Weekly Pictures 1

Year 2023 in Weekly Pictures

Below is the gallery of featured images from my 2023 weekly notes. It represents the year pictorially. It’s an exciting way to look at the year. At some point, I want to make a yearly flip book using these pictures, with locations and characters involved. It will be a good yearbook. Also, I...