New 3D segmentation features, Gaussian splat labeling, and more

2 min read -
Avatar photo
- July 16th, 2024 -

Jump to section

Today, we’re introducing some powerful new features that will make your life easier when segmenting large point clouds and point cloud sequences. We’re also excited to announce that we now support Gaussian splats in our 3D labeling interfaces. Let’s dive in!

Merged point cloud mode for 3D segmentation

Point cloud segmentation labeling can be incredibly time-consuming, making it one of the most expensive label types.

In the Merged Point Cloud Mode, you now annotate static elements in the scene (e.g. road surface, buildings, parked cars) in a single pass instead of having to label them in each frame individually.

Limiting cuboid feature

Segmenting point clouds consisting of millions of points can put heavy requirements on your hardware. Not everyone has a powerful GPU, sometimes causing performance issues.

With our new Limiting Cuboid feature, you can restrict your segmentation labeling to a smaller subregion of the full point cloud, alleviating performance issues.

Read more

Gaussian splat labeling

Gaussian splats are a new technique for rendering 3D scenes. They’ve gained attention for their ability to create detailed, realistic 3D scenes with relatively low computational overhead.

We’re excited to announce that you can now upload, view, and label .splat files on Segments.ai. Check out our blog post, where we show exactly how you can label your Gaussian splats.

An example of a Gaussian Splat, with a chair and tables in the middle.

Other features and improvements

  • The limiting cuboid feature is also available in the 3D cuboid and vector datasets
  • The objects sidebar can now be resized: both the width and the individual sections
  • New “Local auto-save” toggle in 3D cuboid and vector datasets
  • A warning is displayed in the 3D interfaces when your GPU is not powerful enough
  • The objects sidebar now has options for searching, sorting and grouping objects by category.
  • New option in the settings sidebar to optionally reset the zoom upon frame change
  • In the Start Labeling/Reviewing workflow, the labeling time is now displayed
  • You can rotate camera images in the 3D interfaces and set a default rotation via the sample attributes

Inside .lumen: How they scaled their annotation process

Accurate and extensive annotated data is essential for training the models that power the .lumen glasses. The team trains about ten models weekly.

Get first-hands insights on scaling and optimizing an internal annotation team, experimenting with artificual classed and ensuring quality in data annotations

Read the .lumen case study

Software Tools For Robotics Landscape (2024)

Explore the landscape of software tools for robotics in 2024. From established companies to startups, and see how they can help speed up the development of robots and autonomous vehicles.

Read the article

Infographic titled 'Software Tools for Robotics Landscape (2024)', categorizing various companies under sections such as Calibration, Data Annotation, Localization & Mapping, Data Visualization, Data Management, and Simulation. Companies include Tangram Vision, Deepen, Segments.ai, Scale, Slamcore, rerun.io, Foxglove, Voxel51, Formant, GAZEBO, NVIDIA, Unity, and MuJoCo among others, showing a comprehensive view of the tools available in the robotics field.

Late vs early sensor fusion: a comparison

Multimodal fusion combines different types of data from various sources to improve prediction accuracy. Essentially, each data source provides unique and helpful information that complements the others.

There are two main approaches to multimodal fusion: late and early sensor fusion.

Comparative illustration of early versus late multimodal sensor fusion techniques. Late fusion shows separate processing of radar, video, and image data followed by a combined analysis. Early fusion combines these data inputs at the initial stage for integrated processing, both methods leading to visualization of vehicle and pedestrian detection in urban settings.