Geometric Gesture Classifier

Real-Time Single Hand Gesture Recognition

RUN

This is a real-time hand gesture recognition tool, running entirely in your browser with no data leaving your device. It uses MediaPipe Hands to extract 21 3D landmarks per hand, then classifies the gesture from those landmarks with a simple, fast, rule-based classifier — no training or model download involved, it just checks finger geometry directly (which fingers are extended, and how far apart the thumb and index fingertip are) against a fixed set of rules for the 8 gestures below.

The following 8 gestures are recognised out of the box:

  1. Fist ✊
  2. Open Hand ✋
  3. Point ☝️
  4. Peace ✌️
  5. Thumbs Up 👍
  6. Rock 🤘
  7. Call Me 🤙
  8. OK 👌

The data is exported as a CSV file structured as follows:

frametimestamptaghand gestureconfidence joint_0_xjoint_0_yjoint_0_z … joint_20_xjoint_20_yjoint_20_z
421718000000baselineRight Peace0.913 0.5120.748-0.031 … 0.4210.302-0.089

Landmark coordinates are in MediaPipe's normalised image space (x, y ∈ [0, 1]). The z value is depth relative to the wrist (negative = closer to camera). Rows where no hand is detected are omitted.

Reference: Google. MediaPipe Hand Landmarker. developers.google.com/mediapipe/solutions/vision/hand_landmarker

Source Code