• hperrin@lemmy.ca
    link
    fedilink
    English
    arrow-up
    30
    ·
    2 days ago

    Hey Grok, take this one file out of the context of my 250,000 line project and give me that delicious AI slop!

    • Zetta@mander.xyz
      link
      fedilink
      arrow-up
      2
      ·
      edit-2
      23 hours ago

      Perfect, groks context limit is 256,000, and as we all know llm recal only gets better as context fills so you will get perfect slop that works amazingly

      /s and more info on quality drop with context increase here https://github.com/NVIDIA/RULER

      • hperrin@lemmy.ca
        link
        fedilink
        English
        arrow-up
        1
        ·
        22 hours ago

        250,000 lines is way more than 250,000 tokens, so even that context is too small.