LLM Benchmarks

  • Sep. 16, 2025 / LLM Benchmarks

    Local LLM Models and Their Max Context Windows: A Reference Table

    When choosing a local LLM, one of the first specifications to check is its context window. The context size determines how many tokens you can feed into the model at once, which directly affects practical use cases like long-form reasoning, document analysis, or multi-turn conversations. For hardware enthusiasts running quantized models on limited VRAM, knowing...

    a table with context windows of different local llms

  • Sep. 10, 2025 / LLM Benchmarks

    Can Three RTX 3090s Really Run GPT-OSS 120B with Max Context? I Put It to the Test

    After testing the gpt-oss-20B model on a single RTX 3090, I had to push things further and see what the new heavyweight could do. In addition to the 20B model, OpenAI also released gpt-oss-120B, a massive 120-billion parameter open-weight Mixture-of-Experts (MoE) model with 5.1 billion active parameters. I first ran some experiments on an RTX...

    three rtx 3090 gpus connected for inference on llm
Previous