If I may suggest people move away from harasses and start using Emacs. Gptel is amazing and the rest of Emacs plays incredibly well with llm development. Since the human is always in the loop token costs are also tiny compared to anything else.
In some sense, devs are now responsible for a P&L the way a business manager would be, but I suspect that nobody is paying enough attention to the P part of it. When you incentivize people to spend as much money as possible but don’t hold them accountable properly for what they actually produce, this is what happens.
I suspect this will turn out to be a super overblown issue: AI spend is literally the easiest spend to regulate in the entirety of businesses. No machinery is grinding to a halt over it, no asset that had to be bought and is now useless. You don't even have to employ or fire staff to give it a go (of course, you can still do both for other reasons). There are a lot of options that you can try out and substitute for each other, as new stuff comes up, because most things are compatible.
Sure, if you start at this point, where a good chunk of employees, who never had that ability, can now spend a lot of money at their discretion, that's probably going to be costly at first. Then people will learn from that and set direction adn guardrails.
I work at a very big company and I have unlimited access to Codex with no visibility on token usage. I don't know if this is the norm but seems kind of crazy to everyone in my team
I frequently max out my weekly usage, and given this [1], hopefully Codex might give me more milage.
[1]: https://news.ycombinator.com/item?id=48126429
Sure, if you start at this point, where a good chunk of employees, who never had that ability, can now spend a lot of money at their discretion, that's probably going to be costly at first. Then people will learn from that and set direction adn guardrails.