Virtusa worked with the organization to develop a first-of-its-kind genAI-enabled drone detection product for rack optimization, personnel optimization, compliance, inventory control, and overall warehouse management optimization.
The drones first mapped the site, acting as human inspectors. They flew the routes using an advanced AI-driven navigation system to capture images of bar codes, and LPNs and identify re-box candidates. Once the mapping was complete, each drone returned to its dock and securely uploaded the data. The drone footage is processed to extract frames, and the Segment Anything Model (SAM) from Meta is used to identify individual boxes from the frames.
The drone detection product uses Google’s transformer based BEiT vision model and Google’s Vision AI OCR model. The BEiT vision model has been trained to classify images of individual boxes as damaged, and Google’s Vision AI OCR model is used to extract barcode numbers from individual damaged boxes.
Replacement materials can be requested via the SKP API integration for re-boxing requests after the damaged boxes are identified.