Are there AI chat interfaces for power users?

I feel chronically disappointed in the experience of using the chat interface for ChatGPT, Gemini, and other SOTA models. They all bring with them their own underwhelming UX. For example: I badly want to be able to "fork" a convo into a different thread (like Slack threads) so it doesn't clutter the context. I want to "merge" (reference) existing threads into a convo. I want to be able to remove parts of a convo because they mess up the context and are influencing the model too much. I want to be able to tag convos or categorize them under multiple directories. Or create shortcuts, like they're documents. I want a search that isn't a basic text search from 2022 but an actual LLM searching over past convos. I want to go into "incognito mode" and then if I like the convo, move it out of incognito mode (most of my prompts start off in incognito mode). There's so many more ways I can see the chat experience being better. It seems like it should be its own product (ideally open source and lets me choose my own models, maybe multiple at the same time). CLIs and coding agents are kind of like this, but don't really have all these features, and are more code-oriented than I want. Are there any "power user" chat interfaces out there?