Tagged: Large Language Model
My interest in LLMs has increasingly shifted towards smaller models, small in terms of size and their ability to run on modest local machines. For some time now, I have been using models with fewer than 40 B parameters on my machines in some quantized way. Then I came across BitNet, a project...
I sent this email to all workshop attendees. It made sense to publish it as a post as well. Thank you for attending the “Back to Basics: Build Your Own LLM from Scratch” session. It was great to see so much curiosity and many questions in the room, the feedback many of you...
I did a workshop titled “Back to Basics: Build Your Own LLM from Scratch” at IITM/Paradox 2026, which kind of included some basic theory on how a transformer works, and then building a very small LLM. The idea was to demystify an LLM (or transformer) by understanding what goes on and then building...
I have been exploring LLMs to see if they can be used to do data analysis. LLMs are not good with data by default. But they are good at analyzing a small table and trying to make sense of it. LLMs are also decent at writing code. So my wish was, can I...
The only thing I miss about working remotely is being around people. I enjoy meeting people outside of work, such as over coffee or during lunch breaks. Even working remotely, I have tried to go out and meet and work with people at least once a week. However, for some reason, I didn’t...
I have been searching for models that perform translations between Kannada and English and vice versa. I learned about the Sarvam Translate model, which seemed very promising. I tried it on their site before downloading the model directly to run locally. Model weights are available under GPL. Sarvam-Translate is an advanced translation model...