
Distill and Conquer: How Model Distillation is Redefining AI Economics
If building an AI model from scratch is like baking a cake, then distillation is…
If building an AI model from scratch is like baking a cake, then distillation is like reverse-engineering a top bakery’s best-selling recipe. Think of a world-class pastry chef who spends years perfecting a cake recipe using the finest ingredients, experimenting with different methods, and finally creating something truly exceptional. Then, along comes a talented home…
Imagine you need to order groceries, book a flight ticket, and arrange a cleaning service—several tasks that usually require navigating through different websites, selecting options, and completing payments one at a time. This process can be time-consuming and tedious. But now, imagine a smarter alternative: you simply type your grocery list into a browser, ask…
Let me share a situation I encountered recently. I wanted to know the model with the largest context window. I faintly remember that I read Gemini has a 2MM context window. But I wanted to be sure. Here is my conversation with AI: Iteration 1: Iteration 2: Iteration 3: Iteration 4: Now I got the…
The technology landscape is no stranger to paradigm shifts, and according to Satya Nadella, CEO of Microsoft, we are on the brink of another revolutionary change. Nadella believes the future of application architecture is moving away from traditional Software as a Service (SaaS) models toward an agent-centric approach. This shift promises to redefine how users…
If you are tracking OpenAI model series, then you must have seen OpenAI release o1 three months ago. On December 2034, OpenAI announced its next-level model, o3, which is one step closer towards the AGI (Artificial General Intelligence). But wait, did you miss anything? I mean, did you miss when o2 was launched? The answer…
An year back, I created my first AI agent. What it does? It just asked the name and then looked up the information about the person on the internet and provided me with all their social media accounts (thought it used a lot of API’s which I did not like.). To my surprise, all the…
In recent discussions around AI, Nobel laureates and pioneers like Geoffrey Hinton have warned of artificial intelligence as an “existential threat” to humanity. This point of view begs the issue of whether artificial intelligence can transform the planet in ways hitherto thought of as belonging to nuclear war or climate change. Among the possible consequences,…
OpenAI, the company that made ChatGPT and other groundbreaking AI models, has been testing out a new way for AI bots to work together in secret. In a way, it’s like a recipe for making AI systems that are strong and simple to understand. They call it Swarm. You can think of it as a…
When Anthropic added “computer use” to their newest model, Claude 3.5 Sonnet, it caused a big stir in the AI world. With this innovative feature, Claude can talk to computers in a way that looks and feels like talking to a person. Claude can now use digital interfaces, which means he is no longer limited…
Small language models (SLMs) represent a major change in the field of artificial intelligence since businesses are more and more emphasizing on building small yet effective models. Though giants like GPT-4 have been making news with their remarkable powers, a quiet revolution is under way in the field of what we refer to as Small…