Altman also said that he thinks we’re in an AI “bubble.”
  • figjam@midwest.socialEnglish
    3·
    1 个月前

    Wouldn’t it make sense for an ai to provide a confidence level though?

    I’ve got 3 million bits of info on this topic but only 4 of them lead to this solution. Confidence level =1.5%

    • kadu@lemmy.worldEnglish
      23·
      1 个月前

      It doesn’t have “3 million bits of info” on a specific topic, or even if it did, it wouldn’t be able to directly measure it. It’s worth reading a bit about how LLMs work behind the hood, because although somewhat dense if you’re new to the concepts, you come out knowing a lot more about what to expect when using them, what the limitations actually are and how to use them better if you decide to go that route.

      • TechLich@lemmy.worldEnglish
        2·
        30 天前

        You could do this with logprobs. The language model itself has basically no real insight into its confidence but there’s more that you can get out of the model besides just the text.

        The problem is that those probabilities are really “how confident are you that this text should come next in this conversation” not “how confident are you that this text is true/accurate.” It’s a fundamental limitation at the moment I think.