AI People and Vehicle Detection: Metadata Search Integration
Last update: Jan 2025
Scenario:
This page describes how to integrate AI People Detection and AI Vehicle Detection with Milestone XProtect. This integration enables the search for people and vehicle attributes without i-PRO Active Guard.
- AI People Detection and AI Vehicle Detection configuration
- Management Client configuration
- Attribute Search in XProtect Smart Client
About AI People Detection and AI Vehicle Detection:
AI People Detection and AI Vehicle Detection are AI applications provided by i-PRO.
AI People Detection extracts and classifies human facial and clothing characteristics into useful categories such as gender, age, and clothing color.
AI Vehicle Detection extracts and classifies vehicle characteristics into useful categories such as type and color.
AI People Detection/AI Vehicle Detection/AI Face Detection | i-PRO Products
This feature is supported in the following versions.
- Camera Firmware: V2.80 or later.
- AI People Detection / AI Vehicle Detection: V2.11 or later.
- Milestone XProtect: 2024 R2 / Device Pack 13.4a or later.
<AI People Detection and AI Vehicle Detection configuration>
Update the AI People Detection and AI Vehicle Detection and check the necessary options.
1. Register the camera to XProtect.
Enable Metadata when registering the camera.
If the camera is already registered and Metadata is disabled, register the camera again with Metadata enabled.
2. Install or update the latest version of AI People Detection or AI Vehicle Detection.
For details, refer to the following manual.
AI People Detection / AI Vehicle Detection Operating Instruction
3. Ensure that the following option ("Give the ClassCandidate to Analytics Stream") is enabled for AI People Detection and AI Vehicle Detection. (Default: On)
This option is necessary for sending people and vehicle attributes effectively.
<Management Client configuration>
To enable the visibility of a search category or a filter in XProtect Smart Client, select the attribute on the Management Client.
1. Open Management Client and select [Metadata Use] - [Metadata Search].
Click [Search Categories] - [People].
Check the following search filters.
- Age
- Bag
- Bag color
- Clothing (lower) color
- Clothing (lower) type
- Clothing (upper) color
- Clothing (upper) type
- Face mask
- Facial hair: beard
- Gender
- Hair color
- Hair length
- Hat
- Shoe color
2. Click [Search Categories] - [Vehicle].
Check the following search filters.
- Color
- Vehicle type
The following are attributes supported by i-PRO.
Attribute options:
People Category
| Search filter | Options | i-PRO Compatibility |
|---|---|---|
| Age(years) | 0-120 | Supported |
| Bag | Show results for Bags | Supported |
| Bag category | Single shoulder bag / Backpack / Other | Not Supported |
| Bag color | Beige / Black / Blue / Brown / Grey / Green / Orange / Pink / Purple / Red / White / Yellow | Supported (except Beige / Grey) |
| Clothing (lower) color | Beige / Black / Blue / Brown / Grey / Green / Orange / Pink / Purple / Red / White / Yellow | Supported (except Beige) |
| Clothing (lower) pattern | Striped / Plaid / Solid color / Printed design / Other | Not Supported |
| Clothing (lower) style | Dress pants / Jeans / Other | Not Supported |
| Clothing (lower) type | Pants / Shorts / Skirt / Other | Supported (except Skirt / Other) |
| Clothing (upper) color | Beige / Black / Blue / Brown / Grey / Green / Orange / Pink / Purple / Red / White / Yellow | Supported (except Beige) |
| Clothing (upper) pattern | Striped / Plaid / Solid color / Printed design / Other | Not Supported |
| Clothing (upper) style | Tailor / Jacket / Sweater / Overcoat / Dress / Other | Not Supported |
| Clothing (upper) type | Long sleeves / Short sleeves / Other | Supported (except Other) |
| Face | Show results for Faces | Not Supported |
| Face mask | Show results for masks | Supported |
| Face mask color | Beige / Black / Blue / Brown / Grey / Green / Orange / Pink / Purple / Red / White / Yellow | Not Supported |
| Facial hair: beard | Show results for Beards | Supported |
| Facial hair: mustache | Show results for Mustaches | Not Supported |
| Facial hair: sideburns | Show results for Sideburns | Not Supported |
| Gender | Female / Male | Supported |
| Glasses | Show results for Glasses | Not Supported |
| Gloves | Show results for Gloves | Not Supported |
| Gloves color | Beige / Black / Blue / Brown / Grey / Green / Orange / Pink / Purple / Red / White / Yellow | Not Supported |
| Hair color | Black / Blond / Brown / Grey / Red / White | Supported (except Red) *The color detected as "Gold" by the camera is filtered as "Blond". |
| Hair length | Long / Medium / Short | Supported (except Medium) |
| Hat | Show results for Hats | Supported |
| Hat color | Beige / Black / Blue / Brown / Grey / Green / Orange / Pink / Purple / Red / White / Yellow | Not Supported |
| Height (cm) | 0-250 | Not Supported |
| Helmet | Show results for Helmets | Not Supported |
| Helmet color | Beige / Black / Blue / Brown / Grey / Green / Orange / Pink / Purple / Red / White / Yellow | Not Supported |
| Scarf | Show results for Scarfs | Not Supported |
| Scarf color | Beige / Black / Blue / Brown / Grey / Green / Orange / Pink / Purple / Red / White / Yellow | Not Supported |
| Shoe category | Leather shoes / Sneakers / Sandals / Slippers / Other | Not Supported |
| Shoe color | Beige / Black / Blue / Brown / Grey / Green / Orange / Pink / Purple / Red / White / Yellow | Supported (except Beige / Grey / Orange / Pink / Purple) |
Vehicle Category
| Search filter | Options | i-PRO Compatibility |
|---|---|---|
| Color | Beige / Black / Blue / Green / Grey / Red / White / Yellow | Supported *The colors detected by the camera are filtered as follows: "Brown" is filtered as "Red", "Purple" as "Grey", and "Pink" as "Beige". |
| License plate | Free text field | Not Supported |
| License plate country code | Free text field | Not Supported |
| License plate issuing entity (state) | Free text field | Not Supported |
| License plate type | Standard / Police / Diplomatic / Temporary | Not Supported |
| Vehicle brand | Free text field | Not Supported |
| Vehicle model | Free text field | Not Supported |
| Vehicle speed (km/h) | 0-250 | Not Supported |
| Vehicle type | Bus / Car / Truck / Bicycle / Motorcycle / Bike | Supported (except Bicycle / Bike) |
<Attribute Search in XProtect Smart Client>
Attribute search for People and Vehicle is available in the Search tab of the Smart Client.
1. Open the Smart Client and click the [Search] tab.
2. Select the search period.
3. Click [Select camera] and select the target camera.
4. Click [Search for...] and select "People" or "Vehicles" as the search category.
5. Filter the search results.
Click the filter icon to display the filter options.
The options set in "Management Client Configuration" are displayed.
Check the attributes you want to filter.
6. The search results are displayed.
Milestone XProtect Management Client 2024 R2 /DP 13.4a