Software Development in the Time of Strange New Angels

The biggest being that the only safe way to recycle feature flag names is to put ample time separation between the last use of the previous meaning for the flag and the first application of the new use. They did not. If they had, they would have noticed that one server was not getting redeployed properly in the time gap between the two uses.

They also did not do a full rollback. They rolled back the code but not the toggles, which ignited the fire.

These are rookie mistakes. If you want to argue they are journeyman mistakes, I won’t fight you too much, but they absolutely demonstrate a lack of mastery of the problem domain. And when millions of dollars change hands per minute you’d better not be Faking it Til You Make It.

Google generates a lot of revenue per employee not because the employees are good (though many of them are of course), but because they own the front door to the web. And the Knight Capital story has many nuances left out by that summary.

In both cases the author needed a hard hitting but terse example. But as I said, both the claims are true, so in the voice of the courtroom judge, "I'll allow it."

Because writing code has always been the easy part. A senior isn't someone who's better at writing code than a junior - they might well be worse at writing code. AI can now do the easy part, sure. What grounds does that present for believing that it's soon going to be able to do the hard part?

All I see from “excited” developers is denial that there is a problem. But why would it be a problem that you have to review code generated by a program with the same fine-tooth comb that you use for human review?

[1] Some things change fast, some things never change at all.

I've spent the bulk of my 30+ career in various in-house dev/management roles, and small to medium sizes digital agencies or IT consulting places.

I that time I have worked on many hundreds of project, probably thousands.

There are maybe a few dozen that were still in production use without major rewrites on the way for more than 5 years.

I think for a huge amount of commercial projects, "maintainability" is something that developers are passional about, but that is of very little actual value to the client.

Back in the day when I spent a lot of time on comp.lang.perl.misc, there was a well know piece of advice "alway throw away the first version". My career-long takeaway from that has been to always race to a production ready proof of concept quickly enough to get it in front of people - ideally the people who are then spending the money that generates the business profits. Then if it turns successful, re write it from scratch incorporating everything you've learned from the first version - do not be tempted to continually tweak the hastily written code. These days people call something very like that "finding product market fit", and a common startup plan is to prove a business model, and them sell or be acquired before you need to spend the time/money on that rewrite.

The downsides of code generation are only amplified with LLM code generation. Oh it’s just what I would have written. Now on the fifteenth iteration/rewrite. Generated idiomatic code for twelve years ago. squints oh yeah I would have written that back then... gosh it feels good to be in this exclusive club.

Now there are a few things I see that affect this

1. The only way Claude knew how to do this is because there was a stack of existing code, but its probably in C, so you could regard Claude as an expert programming language translator.

2. There is no way that Claude could integrate this into my current code base

3. Claude can't create anything new

4. It's often very wrong, and the bigger/more complex the code is, the wronger it gets.

So, what are the areas that Claude excels? it seems that CRUD web app/Web front end is the sweet spot? (not really sure about this - I don't do much web front end work). I write graphics Apps and Claude is handy for those things you'd have to look up and spend some time on, but thats about all.

An example - I asked it to make me some fancy paint brush code (to draw in a painterly style), this is hard, the code that it made was pretty bad, it just used very basic brush styles, and when pressed it went into crazy land.

So my point is - if something exists and its not too hard, Claude is great, if you want something large and complex, then Claude can be a good helper. I really don't see how it can replace a good dev, there are a lot of code monkeys around gluing web sites together that could be replaced but even then they are probably the same people who are vibe coding now.

If you really want some fun ask them to draw a circuit diagram for a simple amplifier, it's almost painful watching them struggle.

There's a great example of that in the linked post itself:

> Let's build a property-based testing suite. It should create Java classes at random using the entire range of available Java features. These random classes should be checked to see whether they produce valid parse trees, satisfying a variety of invariants.

Knowing what that means is worth $150/hour even if you don't type a single line of code to implement it yourself!

And to be fair, the author makes that point themselves later on:

> Agentic AI means that anything you know to code can be coded very rapidly. Read that sentence carefully. If you know just what code needs to be created to solve an issue you want, the angels will grant you that code at the cost of a prompt or two. The trouble comes in that most people don't know what code needs to be created to solve their problem, for any but the most trivial problems.

On your second point: I wouldn't recommend betting against costs continuing to fall. The cost reduction trend has been reliable over the past three years.

In 2022 the best available models was GPT-3 text-davinci-003 at $60/million input tokens.

GPT-5 today is $1.25/million input tokens - 48x cheaper for a massively more capable model.

... and we already know it can be even cheaper. Kimi K2 came out two weeks ago benchmarking close to (possibly even above) GPT-5 and can be run at an even lower cost.

I'm willing to bet there are still significantly more optimizations to be discovered, and prices will continue to drop - at least on a per-token basis.

We're beginning to find more expensive ways to use the models though. Coding Agents like Claude Code and Codex CLI can churn through tokens.

Not understanding that is something I've been seeing management repeatedly doing for decades.

This article reads like all the things I discovered and the mistakes the company I worked for made learning how to outsource software development back in the late 90s and early 2000s. The only difference is this is using AI to generate the code instead of lower paid developers from developing nations. And, just like software outsourcing as an industry created practices and working styles to maximise profit to outsourcing companies, anyone who builds their business relying on OpenAI/Anthropic/Google/Meta/whoever - is going to need to address the risk of their chosen AI tool vendor ramping up the costs of using the tools to extract all; the value of the apparent cost savings.

This bit matches exactly with my experience:

"The trouble comes in that most people don't know what code needs to be created to solve their problem, for any but the most trivial problems. Who does know what code would be needed to solve complex problems? Currently that's only known by software developers, development managers and product managers, three job classifications that are going to be merging rapidly."

We found that assuming the people you employ as "developers" weren't actually also doing the dev management and product management roles was wrong. At least for our business where there were 6 or 8 devs who all understood the business goals and existing codebase and technology. When we eventually;y got successful outsourced development working was after we realised that writing code from lists of tasks/requirements was way less than 50% of what our in-house development team had been doing for years. We ended up saving a lot of money on that 30 or 40% of the work, but 60 or 70% of the higher level _understanding the business and tech stack_ work still needed to be done by people who understood the whole business and had a vested interest in the business succeeding.

I wrote JavaScript in the corporate world for 15 years. Here is the reality:

* Almost nobody wants to do it. The people that get paid for it don't want to do it. They just want to get paid. The result is that everybody who does get paid for it completely sucks. Complete garbage, at least at work. There a lot of amazing people writing JavaScript, just not at work, and why would they try harder. Delivering quality at work far outside the bell curve just results in hostility aside for some very rare exceptions. My exception was when I was doing A/B testing for a major .com.

* Since everybody in the corporate JavaScript world completely sucks every major project eventually fails from a business perspective or stalls into lifeless maintenance mode. It just gets too expensive to maintain 5+ years later or too fragile to pivot to the next business demand. So, it has to get refactored or rebuilt. Sometime that means hoping the next generation framework is ready, and the business is willing to train people on it, and willing to go through growing pains. More often this means calling in outside parties who can do it correctly the first time. Its not about scale. Its about the ability to actually build something original and justify every hour productively. I was on both sides of that fence.

* The reason why the corporate overlords hire outside parties to fix problems from internal teams isn't just about talent. Keep in mind it's tremendously expensive. Yes, those people are capable of producing something that doesn't suck and do so faster. The bigger issue is that they will always deliver reliably, because they are executing under a contract with a work performance statement. The internal teams do not have a contract performance definition that will kill their careers or terminates their incomes. They just have to hope the business remains financial solvent so they don't get caught in a mass layoff. This breeds a lot of entitlement and false expectations that seem to grow on each other.

So, yes, in this case it really is about the ability to write code physically. Yes, you need to juggle client nonsense and have soft skills too, but those are layered on top of just being able to write the code. When your options are limited to a bunch of 0s that depend on copy/paste from predefined framework templates you need somebody who can actually justify their existence in a very practical solutions delivery way.

Energy. The new constraint is energy.

You're implying that people are selling inference at below cost right now. That's certainly not true for most third-party inference providers. I doubt API pricing at Anthropic or OpenAI is being solid below cost either.

The only place where you get what you're talking about are the fixed price plans OpenAI, Anthropic, Cursor, etc. sell.

Why would the ai model makers charge less than $149/hr ?

Why hasn't outsourcing attacked equal chunks of that $150/hr all these years now?

If companies dont realize that if an employee is required 1 hour per week, they still need a full salary that covers all the rising costs of housing/food/health/necessity... then most knowledge workers just die. Even more so in up and coming countries, its just massive world war and suffering if we dont change capitalism somehow. Why would AI employees keep working toward such destruction and death?

What if the 80/20 problem is more reality, machine learning and LLMs can never get that last 20 percent working right, but now nobody knows how to finish the last chunks? Seems more like the last 10% of coders that dont die, should be charging hundreds of times more $/hr. Even this doesnt fix the problem because the knowledgeable will die off and nobody hired juniors for years.

You think housing prices can sustain their value in this nonsense? Old people who are still in charge of everything and own everything will destroy all of this before it starts affecting their assets

So do you imagine that AI will reach the point that a business guy will say make me a web site to blah blah blah, and the AI will say sure boss and it will appear? Sort of what a dev/team of devs/testers/product managers/BA's would do now? the current batch is a long way from this afaik