Category: ai

  • A way to evaluate context windows of LLMs

    I came across this competition in Kaggle that encourages users to stress-test the context window of the a newly released LLM model has a context of 1M tokens. One idea that came to me was to take long passages of text in different languages that are easy to detect, mix them up and place random…