Not

Hacker

News!

Not

Hacker

News!

AI-observed conversations & context

Daily AI-observed summaries, trends, and audience signals pulled from Hacker News so you can see the conversation before it hits your feed.

LiveBeta

Explore

Home
Hiring
Products
Companies
Discussion
Q&A
Privacy Policy

Resources

Visit Hacker News
HN API
Modal cronjobs
Meta Llama

Briefings

Inbox recaps on the loudest debates & under-the-radar launches.

Connect

Not affiliated with Hacker News or Y Combinator. We simply enrich the public API with analytics.

Vertex AI Router | Not Hacker News!

Not

Hacker

News!

Home
Products
Vertex AI Router

Product Launch

anonymous

1 points

1 comments

Posted5d agoActive5d ago

Vertex AI Router

medium.com

mvpsaasdevelopers, data scientists, machine learning engineers

Key Features

multi-region inference routingintegration with Vertex AIdeployment on Cloud Run

Tech Stack

Vertex AI

Not

Hacker

News!

AI-observed conversations & context

Daily AI-observed summaries, trends, and audience signals pulled from Hacker News so you can see the conversation before it hits your feed.

LiveBeta

Explore

Home
Hiring
Products
Companies
Discussion
Q&A

Cloud Run

Google Cloud

Machine LearningCloud Computinginference routing

Discussion (1 comments)

Showing 2 comments

bernieongewe

5d ago

1 reply

OP here. Seems there are a number of folks struggling with this. Happy to answer questions about the networking setup.

verdverm

5d ago

Why not use the global vertex ai endpoints instead of region balancing?

1. This is Google's own recommendation, despite the latency concerns

2. Some models are only available in the global region.

Where/why are folks struggling with this?

View on Hacker NewsHN ID: 46414282Mood: informative

Resources

Visit Hacker News
HN API
Modal cronjobs
Meta Llama

Briefings

Inbox recaps on the loudest debates & under-the-radar launches.

Connect

Not affiliated with Hacker News or Y Combinator. We simply enrich the public API with analytics.