10 comments

  • _puk 2 hours ago
    The obvious fork is "can frontier models stack a dishwasher to my wife's exacting standards".

    I can't. So that would surely be proof of AGI.

    • mrweasel 2 hours ago
      "In every partnership, there is a person who stacks the dishwasher like a Scandinavian architect and a person who stacks the dishwasher like a raccoon on meth." - Someone online.

      At home I'm the architect, my wife's the raccoon. I don't actually believe that you can stack the dishwasher wrong as such, but you can make it hard for yourself to unload, if you don't sort the items correctly.

      • fxwin 2 hours ago
        > I don't actually believe that you can stack the dishwasher wrong as such

        There are definitely more and less correct ways, but personally i think it's "wrong" to load it in a way that leaves the arms blocked or (not) tilt pieces that get excessive water pooling on top

      • freecodeio 2 hours ago
        shouldn't stacking like a raccoon on meth be the most optimal way though? since if they're too well stacked you risk water being unable to enter tight places
      • embedding-shape 1 hour ago
        > I don't actually believe that you can stack the dishwasher wrong as such

        You most definitely can, they're not magic! The water must hit the right spots and obviously stacking three plates without any space between leads to stuff not getting properly cleaned.

        If you try to teach a kid to put the dishwasher you'll learn a ton of wrong ways of doing it! :)

        • notrealyme123 1 hour ago
          I think putting cups with the opening facing upward is very close to "technically correct, but very wrong"
    • ce4 1 hour ago
      You're already loading it perfectly according to The Oatmeal :-D

      https://theoatmeal.com/comics/dishwasher

    • jojogeo 2 hours ago
      Never have truer words been spoken, I too score poorly on DishwasherBench wife mode. Drives her up the wall.
      • teekert 2 hours ago
        At our place it's opposite, I guess when you do it often enough you get a preferred method though a relentless optimization loop, which in the end ensures it's all clean, the plates are well separated only in 1 particular order, the glasses are placed to the left so all small pans fit at the right, deep plates are placed half over cutlery rack so they are supported and more fit in, small plates in front so all lids fit before them... etc etc etc.
        • stoneman24 2 hours ago
          Yep, I have a more optimised model of stacking than my wife’s ideas. This has lead to “discussions” (still at a friendly level) and the dish washer being placed in my list of responsibilities.

          I think optimal configuration is very much a NP complete problem.

        • mvdwoord 2 hours ago
          Try explaining this to a raccoon.. on meth.

          I did, once ;)

    • AlecSchueler 1 hour ago
      Are our wives' standards impossible to reach or are our husbands weaponising incompetence?
  • mlukewizard 3 hours ago
    Inspired by Joma Tech's new YouTube video

    Stacked loads are run against a dishwasher simulation calibrated to my own Bosch dishwasher

    Playable by both humans and AI

    Currently a WIP, simulations need refining before running a full benchmark, but keen to hear some feedback!

  • dom96 1 hour ago
    I love these novel ways to benchmark LLMs. I created one myself, I figured creating a programming language designed to confuse LLMs would be a good test, and it does seem to be: https://bench.killswitch-lang.org/.

    I wonder if anyone has crafted a LLM benchmarks list website/github.

  • comrade1234 1 hour ago
    Years ago after my wife filled the dishwasher I commented that it looked like a 12-year-old filled it. I said it as a joke but it really hurt her and I still feel bad about it. That said, it no longer looks like that when she fills it...
  • judetechdevs 2 hours ago
    Both models’ loads came out 84-100% clean, so is the score mostly just how much they fit?
    • mlukewizard 1 hour ago
      Totally the opposite, there's a detailed dishwasher simulation under the hood: ray tracing, splash simulation, soak, heat, enzyme action

      I calibrated it against my actual dishwasher by doing some test runs with baked egg

      • judofyr 1 hour ago
        As we know from physics, even the most sophisticated mechanisms (e.g. friction) often ends up having a very simple model (proportional to the normal force).

        Sooo, the score is maybe mostly just how much they fit?

        • mlukewizard 1 hour ago
          Question for both: do you think that is also the case with a real-world dishwasher (it's mostly about getting stuff to fit), or do you think it's an issue with the current sim?

          The sim needs work, for sure

  • nastrofa 2 hours ago
    This is so cool!

    Imagine creating real simulated env for every physical task and using RL to train robots. That will be a game changer.

  • dist-epoch 2 hours ago
    The real story of how Navier Stokes was solved involved a dishwasher:

    https://www.youtube.com/watch?v=ofdMfljL360

    • kolinko 1 hour ago
      Came here to post this :)
  • walrus01 1 hour ago
    For added difficulty, have it 'stack' a 3D rendered volumetric plastic model of a pelican riding a bicycle, like if it were putting a child's toy in the dishwasher.
  • laruss5 1 hour ago
    [flagged]
  • l1n 2 hours ago
    [flagged]
    • mlukewizard 2 hours ago
      sure the code isn't hand-written and it's a work in progress, but it's designed to be modelled and calibrated around my own dishwasher so it's verifiably non-slop