LFM2.5 2.6B model competitive with 4x larger models

(huggingface.co)

30 points | by nateb2022 6 days ago

4 comments

  • lend000 1 hour ago
    I can't imagine who is using something like this for agentic coding, but I see exciting opportunities on the horizon when we can have hundreds of reasonably rational and conversational agents working on local machines to simulate emergent behavior (simulating crowds, markets, ecosystems, game NPCs, etc.)
    • trvz 38 minutes ago
      Agentic behaviour isn't just coding. In fact:

      > We recommend using it for agentic workloads, tool use, data extraction, RAG, and long-context workflows. It is not recommended for agentic coding and knowledge-heavy tasks.

      • touisteur 27 minutes ago
        Really curious about people's workflows with these agentic-but-not-for-coding workflows. Are there some interesting people to follow there or just good testbeds/environments to get an idea ?
  • Gecko4072 1 hour ago
    These LiquidAI models have never worked well for me in practice.
    • eurekin 58 minutes ago
      Care to share any details? I'm about to check the 2.6b lfm on document editing.
  • harshshah212003 27 minutes ago
    Will this work in i3/i5 laptops?
  • 0xbadcafebee 1 hour ago
    LFM's training/post-training is famously different than other models. They target reliable operation of tiny models in ways other model families don't (they aren't just scaling a larger model to a smaller size). If you're looking for good performance out of tiny models, LFM has the most advanced design.

    Note how they're much smaller than all other models in the comparison yet match or exceed them. This is for 2.6B params, but they have models as small as 230M. Nobody else designs models that small.

    • woadwarrior01 5 minutes ago
      > Note how they're much smaller than all other models in the comparison yet match or exceed them.

      There's a strong incentive to cherry pick in self-reported comparisons. If there is a model that's better, it gets left out. Have you seen Nanbeige4.2-3B or Ling-3.0-tiny?

      > Nobody else designs models that small.

      There are people building even smaller models.