Jev: The AI Model That Doesn’t Write — It Decides
Author(s): Naimish Baranwal Originally published on Towards AI. A beginner-friendly look at TypeSafe AI’s “System One” model and why it could change how we build AI software. We have spent years teaching AI models to write. Write an email. Write code. Write …
From Vanilla Transformers to Modern LLMs: The Evolution of Transformer Architecture — Part 1: Positional Encoding and Long-Context Handling
Author(s): Naimish Baranwal Originally published on Towards AI. It has been several years since the GPT-2 era — from 2019 to 2026 — and yet, one of the most interesting things about the rapid evolution of AI is that the core idea …
The Rise of the SLMs: Building the Smallest Possible Language Model.
Author(s): Naimish Baranwal Originally published on Towards AI. The Rise of the SLMs: Building the Smallest Possible Language Model. This is the first step toward building SLM(Small Language models). This work replicates the findings reported in https://arxiv.org/abs/2305.077 The referenced research seeks to …
From Vanilla Transformers to Modern LLMs: The Evolution of Transformer Architecture — Part 3: Attention Optimization (MHA, MQA, GQA, MLA)
Author(s): Naimish Baranwal Originally published on Towards AI. From Vanilla Transformers to Modern LLMs: The Evolution of Transformer Architecture — Part 3: Attention Optimization (MHA, MQA, GQA, MLA) TL;DR The problem. When an LLM generates text, each new token has to look …
From Vanilla Transformers to Modern LLMs: The Evolution of Transformer Architecture — Part 2: Inference efficiency (KV Cache)
Author(s): Naimish Baranwal Originally published on Towards AI. From Vanilla Transformers to Modern LLMs: The Evolution of Transformer Architecture — Part 2: Inference efficiency (KV Cache) Intuition Behind KV Cache In the previous part, we discussed Query (Q) and Key (K) while …
Recent Posts
![[Day 37/100] Build Your Own Agent Memory Layer with Postgres and pgvector](https://miro.medium.com/v2/resize:fit:700/1*-Doos2nmUT3FPZ-Qxbk3Hw.png "[Day 37/100] Build Your Own Agent Memory Layer with Postgres and pgvector")
