AV

Global Automotive OEM

Autonomous Vehicles

A Tier 1 global automotive manufacturer was scaling its ADAS validation program ahead of a planned regulatory submission. Their internal annotation team could handle research-scale volumes, but the production push required 50M+ LiDAR and camera annotations in under 6 weeks — far beyond their capacity.

50M+

Annotations delivered

99.7%

Accuracy achieved

5 weeks

Delivered ahead of schedule

  • 3D Cuboid
  • LiDAR
  • Sensor Fusion
  • Point Cloud

The Challenge

  • 50M+ annotations across fused LiDAR point clouds and RGB camera frames, requiring spatial consistency between modalities
  • 99.5% accuracy SLA was contractually required by the OEM’s regulatory partner — not a soft target
  • Annotators needed to distinguish between 23 object classes in dense urban scenarios, including occlusion cases
  • Strict data handling: all data stayed within a private cloud enclave with audit logging enabled

Our Approach

  • Deployed 120 full-time 3D annotation specialists with prior AV or robotics annotation experience
  • Built a custom sensor fusion review tool that overlaid LiDAR cuboids onto camera feeds for cross-modal consistency checks
  • Implemented a 3-stage review pipeline: annotator → domain reviewer → final QA — with inter-annotator agreement tracked per object class
  • Ran 24/7 coverage across US, EU, and APAC annotator teams to maintain velocity throughout the engagement

How We Executed

1


Kickoff & Calibration

2-day taxonomy alignment session with the client's perception team. We annotated 500 samples jointly and ran IAA scoring before approving any annotator for production.

2


Pilot Batch

10,000 annotation pilot reviewed by client's internal QA team. Client-side acceptance rate came back at 99.8% on pilot — green light for full production.

3


Full Production Ramp

Scaled to full team within 48 hours of pilot approval. Daily delivery cadence, with Monday/Wednesday/Friday client QA checkpoints.

4


Edge Case Queue

Separate priority queue for ambiguous scenarios (heavy occlusion, adverse weather, rare object classes) reviewed by our senior AV annotation leads.

5

Delivery & Handoff

Delivered 5 days ahead of the 6-week deadline. Final accuracy audit by the client's ML team came back at 99.7%, beating the contractual SLA.

The Outcome

The annotated dataset fed directly into the client’s ADAS validation suite, which passed regulatory review on the first submission. Their ML team reported a 12% improvement in pedestrian detection recall compared to their previous annotation vendor’s data. The engagement has since expanded to a rolling quarterly contract for new scenario coverage.

"Annotation.io is the only vendor we've found that can maintain 99.5%+ accuracy at this volume without us having to babysit the QA process."

Have a similar project?

Tell us about your annotation challenge. We'll put together a tailored approach and quote within 24 hours.

More customer stories

SC

Type your paragraph here

Sarah Chen

SC

Type your paragraph here

Sarah Chen

SC

Type your paragraph here

Sarah Chen