AI Will Happily Design the Wrong Thing for You
Posted3 months agoActive3 months ago
antonsten.comTechstory
calmmixed
Debate
60/100
AISoftware DevelopmentDesign
Key topics
AI
Software Development
Design
The article discusses how AI can generate incorrect or suboptimal designs if not used carefully, and the discussion highlights the importance of human oversight and critical thinking when working with AI tools.
Snapshot generated from the HN discussion
Discussion Activity
Moderate engagementFirst comment
56m
Peak period
9
0-2h
Avg / period
3.6
Comment distribution18 data points
Loading chart...
Based on 18 loaded comments
Key moments
- 01Story posted
Sep 30, 2025 at 11:20 AM EDT
3 months ago
Step 01 - 02First comment
Sep 30, 2025 at 12:16 PM EDT
56m after posting
Step 02 - 03Peak activity
9 comments in 0-2h
Hottest window of the conversation
Step 03 - 04Latest activity
Oct 1, 2025 at 5:52 AM EDT
3 months ago
Step 04
Generating AI Summary...
Analyzing up to 500 comments to identify key contributors and discussion patterns
ID: 45426673Type: storyLast synced: 11/20/2025, 12:41:39 PM
Want the full context?
Jump to the original sources
Read the primary article or dive into the live Hacker News thread when you're ready.
You definitely can where someone has just vibe coded a thing in a weekend. When someone has actually taken a lot of care to use AI to build something well, using many iterations of small steps to create code that's basically what they'd have written themselves and to integrate good UX driven by industry-standard libraries (e.g. shadcn, daisy), then it looks pretty much exactly like any other MVP app... because that's what it is.
Also generated comments tend to explain how/what vs why, which is usually what I want to know.
Need to check three bits in a byte from a peripheral and populate them to telemetry?
Claude/GPT: Let's make a base struct with a virtual map function, then template a struct to hold the register with functions to extract bits, then make unique pointers to each register, then create a vector of pointers to map all the values, etc.
You can write a very clear, and long, prompt that explains not to do any of that and just pull the bits out of the byte, but writing the prompt takes more time than just writing the code. These tools seem to always reach for, what I would call, the pristine solution as their first attempt and I think many would call that gold-plating.
If you're using one of the coding agents like Claude Code or Gemini CLI, you should have a .md file (e.g. CLAUDE.md) for your project which contains those kinds of instructions, and any other useful context for the project.
https://www.anthropic.com/engineering/claude-code-best-pract...
I did not like the terse errors when parsing JSON. "invalid type: boolean `true`, expected a string", line: 3, column: 24
So I asked for Elm style friendly error messages that try to give you all the information to fix things right up front.
https://github.com/PeoplesGrocers/json-archive/blob/master/s... https://github.com/PeoplesGrocers/json-archive/blob/master/s...
And then since I had time, I asked for some documentation to show/explain the various edge case handling decisions I made.
https://github.com/PeoplesGrocers/json-archive/blob/master/d...
It's gold plating because no one wants or needs my little tool. If I spent that same hour iterating on the output format to be more user friendly while at work, I would be taken out behind the woodshed and shot. It's pure wasted effort.
It does if you let the AI generate lots of code at once. If you take small steps and build iteratively telling it what to do (following a plan that the AI generated if you want to) then it doesn't.
This isn't revelatory though. It's exactly the same as a developer would do - if you give a person a vague idea about what they should make and just leave them to get on with it they'll come back with something that does things you didn't want too.
AI can even get there, if guided by someone who knows what they're doing. We need more tutorials on how to guide AI, just like tutorials for photoshop used to walk amateurs through producing excellent logos, designs, and graphics. A whole generation of photoshop users learned to master the tools by following and sharing cookie cutter level instructions, then learning to generalize.
We should see the same thing happen with AI, except I think the capabilities will exceed the relevance of instructions too fast for any domain skills to matter.
If AI coding stagnates and hits a plateau for a couple years, then we'll see human skill differentiate uses of the tool in a pragmatic way, and a profusion of those types of tutorials. We're still seeing an acceleration of capabilities, though, with faster, better models with more capabilities appearing more frequently, ~every 3-4 months.
At some point there will be a practical limit to release schedules, with resource constraints on both human and compute sides, and there will be more "incremental" updates, comparable to what Grok is already doing with multiple weekly incremental updates on the backend, and 4-5 major updates throughout the year.
Heck, maybe at some point we'll have a reasonable way of calibrating these capabilities improvements and understanding what progress means relative to human skills.
Anyway - a vast majority of AI code feels very "cheap Ikea" at this point, with only a few standouts from people who already knew what they were doing.
- Looking at compiler errors and fixing them. Looking at program output and fixing errors.
- Looking for documentation on the internet. This used to be a skill in itself: Do I need the reference work (language spec), a stackoverflow, or an article?
- Typing out changes quickly. This goes a little bit deeper than just typing or using traditional "change all instances of this name"-tools, but its essence is that to edit a program, you often have to make a bunch of changes to different documents that preserver referential integrity.
All these things can be amazingly faster due to the agent being able to mix the three legs.
However, it doesn't save you from knowing what needs to be done. If you couldn't in principle type out the whole thing yourself, AI will not help you much. It's very good at confidently suggesting the wrong path and taking you there. It also makes bad choices that you can spot as it is writing out changes, and it's useful to just tell it "hey why'd you do that?" as it writes things. If you don't keep it in line, it veers off.
The benefit for me is the level of thinking it allows me. If I'm working on a high-level change, and I write a low-level bug, I will have to use my attention on figuring this out before coming back to my original context. The window of time during the day where I can attempt a series of low-level edits that satisfy a high-level objective is narrow. With AI, I can steer the AI when I'm doing other things. I can do it late at night, or when I'm on a call. I'm also not stuck "between save points" since I can always make AI finish off whatever it was doing.
Me: Hello AI, could you implement a solution for <problem>?
AI: Of course! Here you are: plonk.
Me: Is that a good solution?
AI: Absolutely not! Don't you dare solve it like this, you should do plonk...
This is how I use AI coding tools, but I've internally described it to myself as, "Use the tool to write code only when I am certain of what the expected output should be."
If there is something that needs to be done and some reasoning is required, I just do it myself.
Much less countless kids right now talking to these things for hours a day on their parent’s credit card