GPT-5.6 Sol Ultra will be in Codex

(twitter.com)

74 points | by mfiguiere 1 hour ago

10 comments

  • andai 56 minutes ago
    For context:

    > Additionally, we’re introducing a new ultra mode that goes beyond the capabilities of a single agent by leveraging subagents to accelerate complex work.

    https://openai.com/index/previewing-gpt-5-6-sol/

    Can someone explain how this compares with Pro? I thought Pro was already something similar.

    • changoplatanero 37 minutes ago
      For pro mode the agents worked independently and only when they all finished did a new agent take a look at everything to merge the work into a single response. The new thing involves subagents that have been trained to cooperatively pursue a task and are allowed to communicate with each other along the way.
      • thomasahle 17 minutes ago
        Do you have a source for this, or just rumors?

        The responses I get from pro don't feel like ensembles. They are often very one directional.

      • dools 25 minutes ago
        I tried a pro model out the other day and thought there must have been a bug in Pi’s cost calculations. But no, it’s absolutely fucking insane. Wasn’t even any better at the task.
        • bombcar 17 minutes ago
          I really suspect that the models are basically the same below, it’s all in the prompt. The way I use them, surgically, they seem to perform about the same. Fable certainly hasn’t blow my socks off.
    • ludamad 49 minutes ago
      I imagine this is something like Anthropic's dynamic workflows where a JS file is created to make a little AI harness on the spot
  • throw394042 7 minutes ago
    I'm working in large US corporation. And I see that I already have access to 5.6-Sol Ultra on my corporate account.

    I haven't really used it yet.

    2 months ago management was showing us scoreboards, praising leaders who used most tokens. Last few weeks, we're getting weekly emails, telling us that whenever we can - we should use cheaper models, and that we should watch the page which shows our tokens usage.

  • postalcoder 1 hour ago
    I wonder if it's related that that OpenAI has found a way to cut inference costs by half, according to The Information.

    https://www.theinformation.com/newsletters/ai-agenda/openai-...

    • layla5alive 11 minutes ago
      https://archive.ph/NEwVz

      "However, these inference optimizations, which rival Anthropic refers to as “compute multipliers,” are a big focus for all the labs. Anthropic CEO Dario Amodei has been publicly talking about the concept since at least mid-2023, when he said on a podcast that the company limits “the number of people who are aware of a given compute multiplier” because it could give other AI labs a leg up if they were to be able to replicate them. (Compute multipliers can also refer to efficiency optimizations in the model-training phase.)"

      Yes, on a world with finite resources where your industry is singlehandedly siphoning ALL THE RESOURCES - hoard general efficiency optimizations and treat them as trade secrets - winning is all that matters, normal people and other species and the planet be damned.

      Everything I hear about Dario these days makes me like him less and less. He sure did seem to speed run the 'tech leader with scruples' to 'tech villain' path! I guess all the cycles are compressing as we approach the singularity..

    • minimaxir 0 minutes ago
      Semi-related, has anyone noticed their GPT 5.5 usage in Codex being cut in half as of a couple days ago? I got a lot more mileage out of my session usage yesterday for the same workload.
    • drivebyhooting 1 hour ago
      What’s the technique? And did they buy it from thinking machines?
      • turtleyacht 54 minutes ago
        Maybe cache similar answers from others. Surprised if this is not already being done.
        • wahnfrieden 50 minutes ago
          Like google search, this does not work because of how common long tail use is.

          And what use is similar query caching - so you (very often! if actually cost effective, maybe half the time) get a response to a query that was different from yours. Including for when you have a lot of context input already. You’re going to get trash.

          This might only work in constrained domains like customer service where there’s tolerance for generic answers. For technical work?

          • joegibbs 1 minute ago
            But there must be a ton of generic questions that people ask. Stuff like "What's the capital of country X?" - it's probably at least 10% of queries. Memories, custom instructions etc would invalidate them, but if you can return the answers basically free it's probably worth it.
          • turtleyacht 39 minutes ago
            Please pardon the pure speculation incoming. Yes, caching the answer doesn't seem useful. Caching the progression, the graph, may be. This is similar to making code changes with ed(1) instead of editing in vi.

            The transform script(s) are cached and can be played back or adjusted. Surely for some breadth of question inputs, they map more often to similar answers--but not static answers; instead, evented edits.

            It's nearly untenable for a human to keep private edit scripts to generate code changes. The extra steps for custom regex, essentially one-offs for a shared codebase, is inefficient. But maybe not to an LLM.

            • wahnfrieden 1 minute ago
              I don't understand how this fits LLM architecture at all
          • dools 24 minutes ago
            I would be very surprised if they hadn’t sorted out some form of shared KV caching
  • timcobb 9 minutes ago
    when will it be available? do we know? I don't have X, not sure if the thread mentions it.
  • asn0 22 minutes ago
  • behnamoh 36 minutes ago
    I still don't know why OpenAI doesn't put gpt-5.5-pro in Codex. It's one hell of a model and easily parallels Fable/Mythos. Sure, it'll use up your quota much faster but that's the price some users are willing to pay for absolutely high quality responses.

    I think gpt-5.5-pro runs 12x parallel gpt-5.5 agents behind the scene and uses OpenAI's secret sauce to synthesize their answers into one insanely good response.

    • aetherspawn 19 minutes ago
      Is it as good as Fable..? Fable is the first model that mostly writes without the AI slop format for me, and so I can comfortably actually copy and paste most of what it spits out.

      OpenAI models have always been the worst in my experience for verbose, slop formatted responses, with each generation increasing in sloppiness.

      • behnamoh 9 minutes ago
        > Fable is the first model that mostly writes without the AI slop format for me

        I'm not that impressed by Fable's writing to be honest, still has the AI giveaways like em dash.

  • lawgimenez 47 minutes ago
    No Twitter, what’s he responding to?
  • jquery 53 minutes ago
    Will individual subscribers have access?
    • AussieWog93 30 minutes ago
      I would assume yes - their goal is to capture consumer subscribers. Claude are going to take Fable away, and they're going to swoop in and give it to us.
      • kirubakaran 23 minutes ago
        This is why I don't think Fable will be taken away. Not for long anyway.
        • ashraymalhotra 7 minutes ago
          I love how competition is great for customers!
  • ChrisArchitect 44 minutes ago
    Related:

    Previewing GPT‑5.6 Sol: a next-generation model

    https://news.ycombinator.com/item?id=48689028

  • brcmthrowaway 51 minutes ago
    Gamechanger..