Tagged: Code

0

Turning My Laptops into a Dask Distributed Cluster

Table of Contents1 Introduction2 Client Code3 Setup and Run4 Usage I wanted a distributed system where the client submitting the job has the code and logic, but the workers don’t. They just execute the workload they get. I had used Dask in the LocalCluster mode, where everything runs on the same computer but...

0

Send Dramatiq Tasks directly by Pushing JSON to Redis

Dramatiq uses JSON as the messaging format, and the sender or caller of the Job doesn’t need to have access to the Actor or know a lot about it. This has a considerable advantage. Once you set up the workers to execute the Job, all that is needed is to call the Job...

Dramatiq: background tasks 0

Simple and Easy Background Tasks with Dramatiq

For a long time, I have been using Celery to do background tasks. It does work, but has limitations. Limitations become apparent when you teach it to someone or when someone new tries to use it. So I am always looking for simple (not trivial) and easier ways to achieve this. I have...

0

Embedding models for Kannada

Table of Contents1 Open Weight Models1.1 nomic-embed-text-v2-moe1.2 paraphrase-multilingual1.3 bge-m31.4 snowflake-arctic-embed22 OpenAI Model2.1 text-embedding-3-large Embedding models transform words, sentences, documents, or digital items into vectors of numbers (usually floats) so that machines can understand and compare them semantically1. A good embedding model has enough information to capture the meaning and relationships in dense vector...

3

Simple IMD Alerts

Table of Contents1 What I want2 IMD WMS Layer3 My plan4 Example pages5 Future improvements6 Note IMD (Indian Meteorological Department) has a district-level alert system. They give rain alerts for today and the next four days. They also have something called NowCast that shows the same alert level for now. Alerts are basically...

Year 2023 in Weekly Pictures 1

Year 2023 in Weekly Pictures

Below is the gallery of featured images from my 2023 weekly notes. It represents the year pictorially. It’s an exciting way to look at the year. At some point, I want to make a yearly flip book using these pictures, with locations and characters involved. It will be a good yearbook. Also, I...