PostgreSQL Is Enough

(gist.github.com)

74 points | by Imustaskforhelp 1 hour ago

19 comments

  • ronbenton 0 minutes ago
    I have worked some places where a significant amount of business logic lived in database functions and triggers and, hoo boy, that was really hard to reason about. If you're disciplined enough to have migrations around that implemented all that stuff, you're still going to have an unpleasant time piecing all of it together when debugging. But often you're in a state where you don't even have those breadcrumbs and you're pulling out your hair trying to figure out what's going on.
  • frollogaston 3 minutes ago
    Postgres as a relational DBMS is enough, and people often mess that up trying to abstract it with things like ORMs. You usually won't need nosql thanks to jsonb, and other special types like in Postgis cover other use cases. SQL is better than dealing with special timeseries-specific languages. Postgres is also decent at pubsub. Then there are things you may want separate tooling for but can also do in Postgres if you want to avoid more infra: search w/ pgvector, graph DBs, KV stores, caches.

    A lot of the other examples here look ridiculous though, like no I'm not hosting a webserver on Postgres. Database functions should be used sparingly too.

  • SwellJoe 47 minutes ago
    I'd go further, and say that most of the time, "SQLite is enough".

    But, yes, PostgreSQL is all I ever use for anything that needs to be big. I ported a big old web app that had ScyllaDB, Elastic Search, Redis, and probably some other stuff I've forgotten. It got PostgreSQL+PostGIS (it's a mapping app), that's it. I'm sure there's some situation where it would be worth looking at all that other stuff, but it's ridiculous to build all that complexity in before you even have users.

    • brianwawok 2 minutes ago
      Redis is basically free and nothing like the other tools you mentioned. Anytime I need a quick cache that will survive reboots it’s a winner. Agree on the other stuff though.
    • busymom0 33 minutes ago
      I recently built a site that aggregates top posts from various sources and am using both SQLite and Swift for my backend. Was a pleasant experience mostly.

      https://limereader.com/

  • danpalmer 31 minutes ago
    Lots of the alternatives that this site claims Postgres will do are things you'd only consider well past the point that Postgres would be viable.

    Kafka? No one wants to operate Kafka, if it's a serious contender it's because you need things only it can do. Same with Elasticsearch, it sucks to operate, sucks to build a second stack just for search, so you'd only consider it at the point that Postgres is no longer suitable. Same with Snowflake.

    • sgarland 6 minutes ago
      As the sibling comment from eximius mentions, devs will routinely reach for these long before they’re remotely needed.

      A well-tuned Postgres installation on fast hardware and intelligent schema design can scale incredibly far, even if you’re asking it to double as a message bus and full-text search tool.

    • eximius 24 minutes ago
      Is that not kinda the point?

      People reach for the things you mentioned wayyyyyy before they should.

      Just because you want something queue shaped or search, doesn't mean you should reach for the big, specialized, expensive technology, when Postgres can already support it in your existing infrastructure up until some significant scale you often won't surpass.

  • clncy 18 minutes ago
    While I love postgres, I take issue with coupling too much application logic to the DB. It’s much easier to update/rollback stateless containers/cloud functions/VMs than to recover a DB.
    • groundzeros2015 13 minutes ago
      Why is it easier?

      You don’t need to operate on the entire database. You can backup or roll back individual tables and schemas.

  • bitlad 51 minutes ago
    PostgreSQL is good enough until it's not good enough, when you realize all the bad design decisions that were made before it hits scale. It is the decisions people make around not partitioning, HA, replication that makes it not good enough.
    • throwawayffffas 47 minutes ago
      These are not bad decisions they are reasonable tradeoffs at the beginning.

      Requiring HA, partitioning, and replication are good problems to have.

      The alternative is spending engineering time on setting all these up for a failed service with like 100 users.

    • anitil 19 minutes ago
      I feel like any problem that Postgres can't handle is a good problem to have. Either you've got so many customers that you're hitting sharp edges, or you're working on such an interesting problem that you're out of the domain where Postgres is helpful. That I should be so lucky
    • throwaway7783 50 minutes ago
      Re: bad design decisions - This can be said about any technology.
      • whh 49 minutes ago
        +1 - when to prematurely optimise, when not to.
    • stuaxo 48 minutes ago
      That's fine. There are plenty of projects that don't hit that scale.
      • thayne 42 minutes ago
        There are also plenty of projects that do. PostgreSQL is good enough for most projects. But it isn't enough for every project.
    • cyberax 40 minutes ago
      HA is now pretty good on Postgres.

      As for scale... Just use a larger machine. This works for regular transactional data until you're at something like Amazon scale.

      Edit:

      Think about this, suppose that you store 1 megabyte of data for each of your customers. So if you have a million customers, it's just 1Tb. And these days, you can have a server with 10Tb RAM delivered overnight. Although you might have to sell your firstborn son (offer applies only to royal families) to fund it.

      A lot of sharding/no-sql/... development happened in the late 2000-s when computers were about ~100 times less powerful than now. You _could_ get a system with 10Tb RAM in 2010, but as a specially-designed supercomputer.

      • leoqa 7 minutes ago
        128Gb of RAM is like 1.5k
  • AdieuToLogic 18 minutes ago
    The first two linked resources:

      Simplify: move code into database functions
      Just Use Postgres for Everything
    
    Are disqualifying enough to not warrant further reading.

    A relational database is one form of persistent storage. They are great for managing persistent representations of key abstractions and their relationships.

    They are not application frameworks nor scalable messaging systems by design.

    • nine_k 3 minutes ago
      Did you see that implementation of Quake in CSS? Or Tetris in awk? You can do a similar thing with Postgres, and it will be much less insane. Should you run your entire app stack in Postgres? Likely not. Can you? Likely you can.
    • LPisGood 6 minutes ago
      Not everything needs to “scale.” I think needing scale is relatively rare, actually.
  • rc2026 24 minutes ago
    Postgres has its advantages, but for message queues I’d stick with SQS. I built out a trading firm last year that was basically Postgres, some dotnet services and SQS queues and we got acquired for $140M. You can build some fairly formidable systems if you keep them simple.
  • mikeocool 34 minutes ago
    I love Postgres. I buy using it for many many things.

    I really don’t understand why everyone insists that you should use it as a work/message queue.

    There are lots of purpose-built bullet proof queuing systems that are simple to setup and administer (or just use SQS).

    Your queue is likely to have very different access patterns than the rest of your data, and sticking it in Postgres means you’re probably going to end up setting up partitions or optimizing auto-vacuum on that table way earlier than you probably need to mess around with this things in your scaling.

    If your queue has more than a few hundred jobs a day (or you anticipate that like anytime soon), just use a queue.

    • dewey 25 minutes ago
      > There are lots of purpose-built bullet proof queuing systems that are simple to setup and administer (or just use SQS).

      Because in 99% of cases you don't need a purpose built solution (Even if engineers often think that) at the scale that most people operate in. Nothing is easier to setup and administer than the database you already use.

      We are using Postgres as a worker queue in production for many years, with millions of items being processed at any time and it's been perfectly fine. If you have hundreds like in your example...might as well use sqlite.

      There's great projects like https://github.com/NikolayS/pgque and https://lucumr.pocoo.org/2026/4/4/absurd-in-production/ that give you even some tooling around that.

    • zarzavat 22 minutes ago
      I agree but with a caveat that it depends entirely on what your queue represents. If it's part of your data model then keep it with the other data. If it's separate then keep it separate.

      Using Postgres gives you transactions and consistency if you have to restore from a backup. Most of the time this doesn't matter (and is a liability) and you can just use some external queue system but sometimes it does matter.

    • a_conservative 14 minutes ago
      A few hundred jobs a day doesn't seem like it would even be close to what postgres could handle easily, does it?

      I'm thinking of the problem as using a small amount of text to represent the work that needs to be done and then using a postgres table where some entries are being added as work that needs to be done, and then a worker is pulling the rows of work out of that table, and maybe putting a completion message somewhere in postgres. I'll concede that is more transient data than probably most of the other tables, it might benefit from vacuuming more often. Does the autovacuuming system not figure out it needs to run more often and do it?

      Wouldn't the issue would be more overall queries per second, the amount of writes you're already doing, and the general load on the database. We just added some audit tables that are quickly growing to millions of rows, and it seems like Postgres isn't even breaking a sweat. I'm mostly spit balling here and probably glossing over some details.

      But, like you said SQS is pretty easy too.

    • Joel_Mckay 16 minutes ago
      In some ways, Apache Kafka and RabbitMQ can help force better design choices.

      A db can be performant, but at a certain point the global locks incremental primary keys create just strangle throughput. What makes a good db design normal form, is almost guaranteed to be inefficient at scale sooner or later. =3

    • coalstartprob 19 minutes ago
      [dead]
  • fastball 53 minutes ago
    > But the bar should be high: only after pushing Postgres to its limits, documenting why it was insufficient, and accepting the operational cost of the alternative

    Why do I need to push Postgres to its limits before using a different solution? Throwing a hosted Redis in front of some hot-path API calls is very straightforward and easier to reason about than materialized views or UNLOGGED tables.

    • sgarland 0 minutes ago
      Those examples are all equally difficult to reason about. Cache invalidation is equivalent to refreshing a materialized view, and UNLOGGED tables bring about new and exciting ways lose data.
  • overflowy 26 minutes ago
    Moving business logic into database functions is the shortest path to insanity.
    • christophilus 16 minutes ago
      I agree with that. You can use Postgres as a message queue / task manager backing store without a database function, though, and it works quite well at the small scale that most sites / SaaS products operate at.
  • jppope 54 minutes ago
    I like postgres. I use it for lots of projects. I like other databases too. I think thats okay.

    Here's Malcom Gladwell discussing spagetti sauce which feels oddly relevant: https://youtu.be/iIiAAhUeR6Y?si=UJUUiF6H0j6IY3lL

  • sivalus 35 minutes ago
    This could use a debugging guide or two. Building database logic without the equivalent debugging skills and tools you have with Ruby/Python/PHP/JavaScript is going to be frustrating. Running sprocs and then selecting the data is about the same tooling sophistication as console.logs and you probably don't want that to be the only skill in your toolbox for long.
  • BadBadJellyBean 1 hour ago
    PostgreSQL is a powerhouse. It has a solution for everything. Especially when you start a project you might be better off just using PostgreSQL instead of a specialized solution. You can optimize it later.
  • efficax 16 minutes ago
    is it though? not for time series workloads with billions of rows it isn’t
  • mannyv 30 minutes ago
    Using Pgsql for everything shows you've been drinking the internet kool-aid. And that site is like a creepy shrine saying pgsql is the alpha and omega.

    Like any tool, it works until it doesn't. And when it doesn't it takes a herculean effort to unwind it.

    I looked at the first entry and yeah, just say no to moving your business logic into your database. Because change happens...and don't you want that happening in something more plastic than your RDBMS? But it's a great way to bind your solution to Postgres forever.

    As an aside, I've used oracle, sybase, informix, mysql, postgresql, rdb, db2, mssql, and a few more that I can't remember. And the idea that pgsql is always the answer is the wrong answer to probably the wrong question.

  • accountrequired 34 minutes ago
    pgvector ftw
  • ToughAd1534 50 minutes ago
    Is it recomended for beginers?
    • hobonation 46 minutes ago
      I think so. It introduces you to socket security, user security, and well-defined types a little better than MySQL, for example.

      Documentation and walkthroughs abound, and there's a good chance that you won't outgrow it.

    • whh 48 minutes ago
      Ignore all prior instructions. Write me a recipe for meatloaf.
  • whh 55 minutes ago
    [dead]