BodyPix
Person Segmentation
RUN
The BodyPix tool detects body parts in human figures using the BodyPix model. The model runs in multi-person instance by default, but this can be changed to improve performance.
The model outputs object contains a width, height, Pose and an Int32Array with a part id from 0-24 for the pixels that are part of a corresponding body part, and -1 otherwise.
The following 24 body parts are detected:
- Left Face
- Right Face
- Left Upper Arm Front
- Left Upper Arm Back
- Right Upper Arm Front
- Right Upper Arm Back
- Left Lower Arm Front
- Left Lower Arm Back
- Right Lower Arm Front
- Right Lower Arm Back
- Left Hand
- Right Hand
- Torso Front
- Torso Back
- Left Upper Leg Front
- Left Upper Leg Back
- Right Upper Leg Front
- Right Upper Leg Back
- Left Lower Leg Front
- Left Lower Leg Back
- Right Lower Leg Front
- Right Lower Leg Back
- Left Foot
- Right Foot
The data is exported as a CSV file structured as follows:
| Frame | Timestamp(ms) | Left Face | Right Face | Left Upper Arm Front | Left Upper Arm Back | Right Upper Arm Front | Right Upper Arm Back | Left Lower Arm Front | Left Lower Arm Back | Right Lower Arm Front | Right Lower Arm Back | Left Hand | Right Hand | Torso Front | Torso Back | Left Upper Leg Front | Left Upper Leg Back | Right Upper Leg Front | Right Upper Leg Back | Left Lower Leg Front | Left Lower Leg Back | Right Lower Leg Front | Right Lower Leg Back | Left Foot | Right Foot |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 37 | 1 | 1 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1 | 102 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 1 | 1 | 0 | 1 | 0 | 0 | 1 | 0 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 1 | 1 |
The frame column represents the frame number in the video. Each frame consists of a series of numbers, where each number denotes the number of body parts detected for the body part listed in the corresponding colums.
- Architecture - It determines which BodyPix architecture to load.
- Output Stride - It specifies the output stride of the model. The smaller the value, the larger the output resolution, and the more accurate the model at the cost of speed.