AI Is Probabilistic. Your Testing Can't Stay Deterministic
Posted4 months agoActive4 months ago
docs.futureagi.comTechstory
calmneutral
Debate
20/100
AI TestingProbabilistic SystemsCi/cd Pipelines
Key topics
AI Testing
Probabilistic Systems
Ci/cd Pipelines
The article discusses the challenges of testing AI systems due to their probabilistic nature, and a proposed solution for evaluating AI models in CI/CD pipelines. The discussion revolves around the implications of this for testing and validation.
Snapshot generated from the HN discussion
Discussion Activity
Light discussionFirst comment
20m
Peak period
1
0-1h
Avg / period
1
Key moments
- 01Story posted
Sep 22, 2025 at 4:50 AM EDT
4 months ago
Step 01 - 02First comment
Sep 22, 2025 at 5:11 AM EDT
20m after posting
Step 02 - 03Peak activity
1 comments in 0-1h
Hottest window of the conversation
Step 03 - 04Latest activity
Sep 22, 2025 at 6:18 AM EDT
4 months ago
Step 04
Generating AI Summary...
Analyzing up to 500 comments to identify key contributors and discussion patterns
Discussion (2 comments)
Showing 2 comments
ludovicianul
4 months ago
I remember calling non-deterministic tests "flaky" which was a bad thing.
sylware
4 months ago
That's why AIs should be able to use deterministic tools. New models?
View full discussion on Hacker News
ID: 45330720Type: storyLast synced: 11/17/2025, 1:06:43 PM
Want the full context?
Jump to the original sources
Read the primary article or dive into the live Hacker News thread when you're ready.