Indexing 100m Vectors in 20 Minutes on Postgresql with 12gb RAM

The impressive feat of indexing 100M vectors in 20 minutes on PostgreSQL with just 12GB RAM has sparked a lively debate about the need for cloud infrastructure. While some commenters, like duckbot3000, wonder if cloud is still necessary beyond remote backups, others, such as setr and riku_iki, point out the complexities of on-premises infrastructure and the value of cloud services in handling failovers and redundancy. The discussion highlights that cloud infrastructure simplifies tasks like disk redundancy and failover nodes, with some, like positron26, using it to streamline their operations, while others, like nwellinghoff, lament the limitations of managed cloud services, such as AWS RDS.

Snapshot generated from the HN discussion