recent post
A few weeks ago I wrote about how Anthropic uncovered where different ideas, and facts are stored inside a large language model. Well, last week they released the results of a follow up research where they show how an AI actually reasons and evidence that rather just writing text one token at a time, the AI actually plans ahead.
-
Uncovering AI's Mental Model
Posted on
×A few weeks ago I wrote about how Anthropic uncovered where different ideas, and facts are stored inside a large language model. Well, last week they released the results of a follow up research where they show how an AI actually reasons and evidence that rather just writing text one token at a time, the AI actually plans ahead.
-
5 AI Real-World Projects To Set Foot in The Door
Posted onDon’t just learn Data Science — do it! The best way to do Data science is to build real-world projects that spark your passion and resonate with you.
No matter where you are in your Data science journey, you can always roll up your sleeves, get your hands dirty and experiment with things. This helps you connect the dots and challenge your understanding.
×If you are new to the world of AI and LLMs and want to get your feet to the door, I think the following real-world projects (in order of complexity) are good gateways into the field. Even though prompt engineering is such an important aspect when working with (generative) AI models, we will skip it in this article.
-
Display highlighted PDFs in Streamlit
Posted onand make LLMs more trust-worthy.
×Hallucination which happens when an AI model makes stuff up is a heavily discussed topic. I think this is the #1 roadblock for companies to adopt LLMs in production since people can’t 100% trust the model output.
-
Where is AI headed? It is about agents.
Posted on“AI agent workflows will drive massive AI progress this year” — Andrew Ng
I recently watched Andrew Ng’s talk on AI agents, or what he calls agentic systems. Inspired by his insights, I would like to delve into understanding AI agents better. In this article, we will learn what agentic systems are and how to build a simple agentic system from scratch.
×What is an Agentic Workflow and why is it better?
The idea of agents has been around for a while. What’s new here? In his talk, Andrew Ng explains agentic systems that use design patterns such as reflection, tool use, planning, and multi-agent collaboration to outperform the results of zero-shot prompting.
-
Getting structured information out of images
Posted onUsing the latest and most advanced OpenAI’s model called GPT-4o
×OpenAI recently releases GPT-4o — which is claim to be the best OpenAI’s AI model at half price (as compared to GPT4)! This new model offers real-time multimodal capabilities in text, vision, and audio with same level of intelligence as GPT4turbo but is much more efficient. This means that it has lower latency, it generates text 2x faster and very importantly, is half the price of GPT4Turbo.
-
Working with PDFs: The best tools for extracting text, tables and images
Posted onLots of information comes from text data, for example in PDF documents. Handling PDFs can be particularly challenging, especially with tables and images.
×If you work with single modality language model, then you probably already know that it doesn’t have the ability to directly interpret or “read” documents. It is only capable of handling one type of input, such as text-only or image-only. If you need to analyse images or infographics from PDFs, for downstream tasks e.g question-answering, you would typically use specialised packages for parsing the document. These tools can convert the document, the images and tables found in the document into text formats that can be understood and analysed by the model .
-
Do You Understand Me? Human and Machine Intelligence
Posted onBy Lan Chu and Robert Jan Sokolewicz.
×Terminologies
In this article, we try to explore the notion of intelligence and what it means for computer programs to be intelligent. We will be dancing between different terminologies and concepts often discussed in the context of human cognition such as Understanding, awareness, intelligence, and consciousness. Even though the meaning of these terms is somewhat mysterious, we try to refer to them based on the normal usages:
-
GenAI’s products: Move fast and fail
Posted on
×In Autumn 2022, I was working on a cool project. Yes, you guessed it — finetuning a pre-trained LLM (Bert) using company-specific data.