OAK 4 | Not Hacker News!

Discussion (12 comments)

Showing 12 comments

akouri

23 days ago

2 replies

Congrats on the launch! What kind of models can you run on the device?

aleshk

23 days ago

Thank you for your support! The device can run various AI and vision models; to get a grasp of what’s available, visit https://models.luxonis.com.

max_mclaughlin

23 days ago

You can run most standard CV models in parallel - including our own Neural Stereo depth estimation models (speed depends on the size you choose)

Here is a look at the performance of some standard models

YOLOv6 - nano: 830 FPS YOLOEv8 - large: 85 FPS DeepLabV3+: 340 FPS YOLOv8-large Pose Estimation: 170 FPS Depth Anything V2: 95 FPS

colbycook

23 days ago

1 reply

I’m familiar with zed an Realsense but new to this, what are the differences here? How far does the on-board computer get me?

CenekAlbl

23 days ago

Hi, there is too much more to OAK than Realsense or ZED so I will just try to tackle the Computer Vision/ML part. ZED and Realsense are basically 'simple' depth cameras, where ZED also requires external GPU to produce depth. With OAK 4 I can Use all sensor data (High-res images, Depth, IMU), run e.g. Object detection with YOLO, fuse it with depth to compute e.g. object distances and finally send those distance values out to my app/platform. You can use well established libraries like OpenCV, PyTorch and build your whole pipeline on-device so you save bandwitdth and do not need any host PC in most situations. OAK 4 is so powerful that you can run e.g. YOLOv8 Large at 85 FPS or DINOv3 at 40FPS. SImple models like Yolov6 and Text recognition or QR code decoding are running at 500+ FPS so there is plenty of room to combine them to get full vision stack.

tylrtrmbl

23 days ago

1 reply

What are some of the applications for this? I see a lot of agriculture and warehouse in the launch video but what problems does a stereo camera deliver value for?

CenekAlbl

23 days ago

1 reply

In agriculture the main ones are collision avoidance, human-machine safety - detecting and computing distance to an object nearby, then crop analysis - counting, measuring the dimensions and estimating ripeness. Warehouse adds use-cases such as inventory tracking, through volume estimation and barcode reading. Navigation (stereo VSLAM is more robust than mono), bin-picking, palletization, free-space estimation for cargo load. Those and many more require accurate depth estimation and strereo vision is the most universally applicable way of doing it, while being accurate and fast enough!

max_mclaughlin

23 days ago

Other verticals are smart cities, AMRs, manufacturing, security, and retail. Specific uses range from person detection, license plate recognition, demographic analysis, occupancy measurement, hazard zone monitoring, quality inspection, and street/road monitoring.

julienb0724

23 days ago

1 reply

Do users get root access? Can we build custom images?

matijater

22 days ago

Not for the OS at the moment, but we offer this option to some enterprise clients.

Otherwise, you can easily connect via SSH and install any dependencies. Alternatively, you can use our ecosystem to build and run custom containerized applications.

max_mclaughlin

23 days ago

Luxonis here - Incredibly proud of this launch. Use cases here are endless with the on-devie capability rivaling a Jetson Orin Nano. Excited to here how far and smart these devices can go.

Many more exciting launches coming soon - stay tuned for more on Neural Stereo

filipproch

23 days ago

disclaimer I work for Luxonis/ Exciting to see this here after all the work that went into this, curious what people will create with it

Resources