Not

Hacker

News!

Home

Hiring

Not

Hacker

News!

AI-observed conversations & context

Daily AI-observed summaries, trends, and audience signals pulled from Hacker News so you can see the conversation before it hits your feed.

LiveBeta

Explore

Home
Hiring
Products
Companies
Discussion
Q&A
Privacy Policy

Resources

Visit Hacker News
HN API
Modal cronjobs
Meta Llama

Briefings

Inbox recaps on the loudest debates & under-the-radar launches.

Connect

Not affiliated with Hacker News or Y Combinator. We simply enrich the public API with analytics.

RAG | Not Hacker News!

Not

Hacker

News!

Home
Products
RAG

Product Launch

anonymous

1 points

4 comments

Postedabout 2 months agoActiveabout 1 month ago

RAG

myclone.is

maturesaasdevelopers

Key Features

RAG latency optimizationembedding model migration

Tech Stack

Voyage embedding modelRAG

Not

Hacker

News!

AI-observed conversations & context

Daily AI-observed summaries, trends, and audience signals pulled from Hacker News so you can see the conversation before it hits your feed.

LiveBeta

Explore

Home
Hiring
Products
Companies
Discussion
Q&A

RAG optimizationMoE modelslatency reduction

Discussion (4 comments)

Showing 4 comments

jawnwrap

about 2 months ago

1 reply

Cool article, but nothing groundbreaking? Obviously if you reduce your dimensionality the storage and latency decreases.. it’s less data

jimmySixDOF

about 1 month ago

You are missing the point where accuracy stays the same

novoreorx

about 2 months ago

Great article! I always feel that the choice of embedding model is quite important, but it's seldom mentioned. Most tutorials about RAG just tell you to use a common model like OpenAI's text embedding, making it seem as though it's okay to use anything else. But even though I'm somewhat aware of this, I lack the knowledge and methods to determine which model is best suited for my scenario. Can you give some suggestions on how to evaluate that? Besides, I'm wondering what you think about some open-source embedding models like embeddinggemma-300m or e5-large.

sippeangelo

about 2 months ago

The biggest latency improvement I saw was switching off OpenAI's API that would have a latency anywhere between 0.3 - 6 seconds(!) for the same two word search embedding...

View on Hacker NewsHN ID: 46043354Mood: informative

Resources

Visit Hacker News
HN API
Modal cronjobs
Meta Llama

Briefings

Inbox recaps on the loudest debates & under-the-radar launches.

Connect

Not affiliated with Hacker News or Y Combinator. We simply enrich the public API with analytics.