Open Prompt Pack for Testing AI Visibility Stability Across Assistants (v0.1
Posted2 months ago
acrobat.adobe.comTechstory
calmneutral
Debate
0/100
AI TestingLLM EvaluationAI Stability
Key topics
AI Testing
LLM Evaluation
AI Stability
A developer shares a prompt pack for testing AI visibility stability across assistants, sparking interest in the community about AI evaluation methods.
Snapshot generated from the HN discussion
Discussion Activity
Light discussionFirst comment
N/A
Peak period
1
Start
Avg / period
1
Key moments
- 01Story posted
Oct 31, 2025 at 11:50 AM EDT
2 months ago
Step 01 - 02First comment
Oct 31, 2025 at 11:50 AM EDT
0s after posting
Step 02 - 03Peak activity
1 comments in Start
Hottest window of the conversation
Step 03 - 04Latest activity
Oct 31, 2025 at 11:50 AM EDT
2 months ago
Step 04
Generating AI Summary...
Analyzing up to 500 comments to identify key contributors and discussion patterns
Discussion (1 comments)
Showing 1 comments
businessmateAuthor
2 months ago
I am sharing a small open artifact for researchers looking at AI mediated discovery. It is a standardized prompt pack for testing visibility stability, preference anchoring, and challenger substitution across major assistants.
This is not a leaderboard and not a ranking tool. It is a diagnostic input set so that testing can be repeatable rather than ad hoc. The focus is on model mediated recommendation surfaces, not accuracy or safety.
The pack includes:
Ten category discovery prompts
Ten user preference continuation prompts
Ten substitution stress prompts
Logging guidance for reproducibility
Suggested variance interpretation ranges
Use case examples:
Weekly drift checks after model updates
Measuring whether user preferences are preserved
Observing when and how challenger brands appear
Research on model volatility in recommendation settings
I would appreciate community feedback. If the prompt set is incomplete or biased, happy to edit and version it. Contributions encouraged, especially around domain specific prompt modules and non English variants.
PDF: https://acrobat.adobe.com/id/urn:aaid:sc:eu:45de8fc5-97e8-47...
I will add a GitHub repo and CSV log template once feedback lands.
Purpose is simple: make visibility and substitution behavior measurable. Feel free to critique, fork, or improve.
View full discussion on Hacker News
ID: 45773436Type: storyLast synced: 11/17/2025, 8:10:58 AM
Want the full context?
Jump to the original sources
Read the primary article or dive into the live Hacker News thread when you're ready.