I’ve tried coding and every one I’ve tried fails unless really, really basic small functions like what you learn as a newbie compared to say 4o mini that can spit out more sensible stuff that works.

I’ve tried explanations and they just regurgitate sentences that can be irrelevant, wrong, or get stuck in a loop.

So. what can I actually use a small LLM for? Which ones? I ask because I have an old laptop and the GPU can’t really handle anything above 4B in a timely manner. 8B is about 1 t/s!

    • interdimensionalmeme@lemmy.ml
      link
      fedilink
      English
      arrow-up
      1
      ·
      15 hours ago

      There is no expectation of privacy in public spaces. Participants to these streams which are open to all do not have a prohibition on repeating what they have heard.

      • kattfisk@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 hours ago

        Repeating what they heard is very different from automatically processing the chat to harvest personal information about the participants.

        Just because some data is publicly available doesn’t mean all processing of that data is legal and moral.

        • interdimensionalmeme@lemmy.ml
          link
          fedilink
          English
          arrow-up
          1
          ·
          3 hours ago

          It is qualitatively equivalent. Any single piece of information could have been copied, it is safe to assume it has all been copied.

          Although I would be onboard for supporting an expectation of pruvacy in public spaces and making private cctv recording illegal.

      • carl_dungeon@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        9 hours ago

        Right and what I was saying was even if it wasnt “public”, single party consent means the person recording can be that single party- so still a non-issue.