Skip to content

Improve 3D object detection evaluation - #8

Open
RaphvK wants to merge 19 commits into
mainfrom
3d-detection-eval
Open

RaphvK wants to merge 19 commits into
mainfrom
3d-detection-eval

Conversation

@RaphvK

@RaphvK RaphvK commented Oct 2, 2026

Copy link
Copy Markdown
Member

This pull request introduces support for optional ground truth inputs in the evaluation pipeline, making the evaluation node more flexible when working with datasets that may not publish all metadata or auxiliary information. The documentation and configuration have also been updated to reflect a more general evaluation naming scheme and improved clarity about supported datasets and tasks.

Key changes:

  • Updated the evaluation naming from nuscenes_lidar_object_detection to a more general object_detection_3d throughout the codebase and documentation, reflecting support for multiple datasets and a broader range of object detection tasks. [1] [2] [3] [4] [5] [6]
  • Improved documentation to clarify that evaluations can use established metrics across all supported datasets and that optional ground truth is handled gracefully. [1] [2]

Configuration enhancements:

  • Added environment variables in .env to select the system under test and dataset, improving configuration flexibility.

@RaphvK RaphvK self-assigned this Oct 2, 2026
@RaphvK
RaphvK marked this pull request as ready for review October 2, 2026 07:30
@TimoWoo
TimoWoo self-requested a review October 2, 2026 13:32
@RaphvK
RaphvK requested a review from cgeller October 6, 2026 08:11

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant