-
A way to evaluate context windows of LLMs
I came across this competition in Kaggle that encourages users to stress-test the context window of the a newly released LLM model has a context of 1M tokens. One idea that came to me was to take long passages of text in different languages that are easy to detect, mix them up and place random…
-
Notes from Creativity, Inc.
Over the past week, I read the book Creativity, Inc. by Ed Catmull and I must say it was an excellent read. This is a book on the culture of Pixar, one of the most creative organizations in the world. I thought this is a book worth taking some notes on to revisit later. This…
-
Reading list
Over the last two years, I’ve accumulated a lot of books and reading multiple of them in parallel. Trying to keep track of them is starting to get difficult, so I thought I’ll make a list. This is my reading list, will be updated as I complete books. Corporate strategy/ Leadership Leaders eat last by…
-
Smart Embedded Systems design
I have been thinking about how “smart” IoT devices around us work these days and came up with a very high level picture of how things could work. Any system available commercially these days is a variation of the pattern below. You could breakdown this into finer details and design a system. Below is the…
-
Advent of Code 2023
A colleague of mine introduced me to the yearly advent of code challenge which is a challenge of 2 programming problems / day over a span of 25 days from December 1 to 25. I started off the challenge few days after it started. The problems in the first week were a bit easy, and…
-
Problem Solving with Python
I have been practicing with getting better at solving LeetCode style problems that require use of data structures and algorithms. As the difficulty of the problems start getting harder, the I notice, that very good fluency of programming languages is required to solve the problems in a short period of time. I used C++ as…
-
Problem Solving Practice
It’s been some time since I did proper coding and am getting rusty with C++. So, I decided to start solving LeetCode style problems where you need to solve programming challenges using various algorithmic techniques. As I practice I am also revising C++ topics, so I also noted down my learnings. I decided to document…
-
Book Notes – Deep Work
One of the best books that I recently read was a book called “Deep Work” by Cal Newport, a computer science professor with a degree from MIT. In this age of social media networking tools, we have become increasingly distracted with shortening attention spans. Our ability to concentrate is one of the greatest tools of…
-
Book Notes – Leaders Eat Last
One of the leadership books that was suggested to me by many people is Leaders Eat Last by Simon Sinek. I started this book during the Winter Holidays and recently finished it. It had some very useful insights and leadership lessons which I don’t want to forget, so I made almost a 7-page summary with…
-
Managing complexity
As I become more and more experienced in engineering, the more and more I realize keeping things simple are difficult, especially in terms of design, documentation and communication flows between teams. This is a realization that takes a lot of time to hit hard, but simple systems are easy to maintain while complex are not.…