Postgres isn't slow, your storage is

(clickhouse.com)

53 points | by saisrirampur 2 hours ago

6 comments

  • iancarroll 32 minutes ago
    Recently moved our RDS instances from r8g. to r8gd., which adds local NVMe, and I think the average I/O latency went from 1.0ms to 0.1ms. Adds up in big queries!
  • CodesInChaos 10 minutes ago
    I'd like clouds to offer NVMe with value-add features like atomic snapshots and asynchronous replication on top.
  • nasretdinov 37 minutes ago
    Honestly the network-attached storage only ever made sense with HDDs, it's ridiculous to have to pay 10x penalty for both iops and latency just for some "operational flexibility". You get way simpler and much more robust architecture if you just stick to local NVMe and replication -- not that you can forgo one in the (also replicated) network block storage solution anyway...
    • ngrilly 13 minutes ago
      Mostly agree, but then you have to take care of replication, failover, and backup. By using a replicated block storage, you can mostly externalize that problem.
      • jonatron 9 minutes ago
        I can't be the only one that always has to set up a separate backup system in addition to the RDS automatic backups, because it uses a weird format and is slow.
        • vasco 1 minute ago
          And because those backups lifecycle is usually tied to the instance itself. Someone deletes your instance and your backups are gone as well.
  • traceroute66 23 minutes ago
    Postgres isn't slow, your schema and queries are.

    There. Fixed it for you.

    Too many times I see people making the same avoidable mistakes time and time again.

    They get stuck in the dream of "portable" schemas and don't use their brain to design a database-specific schema.

    They have no clue how to write SQL queries (or again, have stupid dreams of "portable" queries). As a result performance suffers.

    Then they come to your desk complaining the databse is slow, and insisting that they absolutely MUST have a Redis caching layer.

    I'm sick and tired of people using databases as blackbox dumping grounds. If slow storage was always the problem, my life would be far less stressful. Since the prescription would be easier for the doctor to write. ;)

    • smolder 2 minutes ago
      Yeah, a lot of people can't figure out how to structure databases or what indices to add to them, but no, that is not the only problem just because it's the one you deal with.
    • CodesInChaos 18 minutes ago
      Which postgres specific schema/query features do you use to significantly improve performance?
      • traceroute66 0 minutes ago
        > Which postgres specific schema/query features do you use to significantly improve performance?

        Erm. Isn't this kind of a schema specific question ?

        I mean, sometimes I see schemas that are so goddam awful that the answer to your question would be "anything, literally anything".

        Other times its the old story of failing to use or misconfiguring indexes.

        And then, yes you end up on Postgres specific stuff.

        But the point is, I could probably count on one hand the number of times the problem has been "the storage" or "the database".

  • rfgplk 9 minutes ago
    Postgres (and similar DBs) are a byproduct of a pre-2023 era. Give me one reason why I shouldn't get my agents to write a use-case specific DB that is almost certainly going to be faster than a general-purpose DB?
    • dkdbejwi383 4 minutes ago
      There's a balance to be had between a highly specialised custom tool that does exactly what you need now, versus a generalist tool that does what you do today and more but is less optimised for your specific use-case today. That, and standing on the shoulders of giants, knowing why those fences are there, and so on.
    • esposm03 2 minutes ago
      Reliability. A general-purpose DBMS probably has multiple decades of battle-testing, your vibecoded DBMS doesn't.
  • amitpoonia19xyz 1 hour ago
    It feels jarring to see these LLM generated blog titles everywhere, cant bring myself to read the content of it even if I am interested.
    • dewey 1 hour ago
      That’s a pretty common title format for talks or blog posts long before LLMs existed.
      • TuningYourCode 54 minutes ago
        I support this claim. Also the title already includes everything relevant compared to „we made Postgres 20x faster“.

        On the other side if dev(ops) does not know that local storage is faster than network/cluster filesystems…

        • amitpoonia19xyz 26 minutes ago
          I feel its hard to prove that either way, but even the content of the article itself is full of LLM generated text, for e.g. here is one line from the conclusion "The bottom line is deliberately narrower than the title".
    • arethuza 52 minutes ago
      I'm starting to find complaints about AI generated content more annoying than the content being complained about.
    • joduplessis 54 minutes ago
      That's a load-bearing statement.
    • kaon_2 53 minutes ago
      Yes. My experience: "Oh interesting title". "Oh god... slop galore. Disappointment, sadness, dejection, a feeling of being dismissed and not taken seriously, alienation from the world", "OK close the link".

      Happy to still be here among my fellow humans. Hackernews the last bastion it feels like.

      Can we somehow filter out slop from the front page? That would be great :).

      • RugnirViking 43 minutes ago
        some kinda system running the linked page through pangram and then putting the result in a small font next to the submission time would be perfect I think. A small font to keep the idea that such things may potentially hold value while satisfying those who aren't interested. Nobody has to argue about it themselves then because it's unambiguous, and everyone can filter them out if you choose.
        • vidarh 27 minutes ago
          I'm generally very pro-AI, including for writing, as long as the "producer" (I wouldn't want to call the human responsible the author) has vetted it and will judge based on whether something reads well rather than on whether it feels AI-written.

          But using detectors to label so people can choose seems entirely reasonable to me even with a risk of false positives, and I think a lot of people who are generally pro-AI would feel that's fine.