Tools

RTMW3D

Real-Time 3D Body Pose Estimation (Multi Person) JS

MoveNet MultiPose

Real-Time 2D Multi-Person Pose & Proxemics JS

BlazePose 3D

Real-Time 3D Body Pose Estimation (Single Person) JS

Body Emotion Recognition

Body Language & Context Emotion Detection JS

MobileGaze JS

Real-Time Gaze Estimation JS

WebEyeTrack

Calibrated Real-Time Eye Tracking JS

L2CS-Net

Real-Time Gaze Estimation JS

Sharingan

Real-time gaze following JS

Gesture Recognizer

Real-Time Multi-Hand Gesture Recognition JS

Speech to Text

Real-Time Whisper Transcription JS

Live Speaker Transcript

Real-Time Speech Transcription Attributed to the Speaking Face JS

Geometric Gesture Classifier

Real-Time Single Hand Gesture Recognition JS

RTMPose

Real-Time Multi-Person 2D Pose Estimation JS

rPPG-Toolbox (TS-CAN)

Contactless Heart Rate (Deep rPPG) JS

Tracking.js Color Tracker

Color Tracking JS

YOLOv10 Object Detector

Real-Time Object Detection JS

JS-Aruco Marker Detector

Fiducial Marker Detection JS

BodyPix

Person Segmentation JS

FaceMesh

Face landmark detection JS

Holistic

Pose, Hand Pose, and Face Landmarks All in One JS

Toxicity

Toxicity Classifier JS

Speech Emotion Recognition

Real-Time Vocal Emotion Recognition JS

WhisperX

Speech Recognition with Word-Level Timestamps & Diarization PY

ConvoKit

Conversational Feature Extraction (Turn-Taking, Politeness, Structure) PY

GCA Analyzer

Group Communication Analysis (Participation, Responsivity, Social Impact) PY

Discursis

Conceptual Recurrence & Topic Flow in Conversation PY

TalkMoves

Teacher & Student Talk Move Classification PY

CSCL Transcript Measures

Cohesion, Alignment, Hedging, Questions & Help-Seeking from Transcripts PY

PyFeat

Facial Landmarks + Emotion Recognition PY

pyannote.audio

Speech Activity Detection PY

InsightFace

2D&3D deep face analysis toolbox, PY

SpeechBrain

all-in-one speech toolkit based on PyTorch PY

MTGS

Mutual Gaze & Joint Attention Detection PY

Human Detection Counting

Human detection counting PY

PoseNet

2D Pose Estimation JS

HandPose

Single Hand Keypoints Detector JS

HandTrack.js

Hand Palm Detector JS

Multi-HandPose

Hand Keypoints Detector JS

Face-API.js

Emotion Recognition JS

WebGazer

Eye Tracking JS

GazeCloud

Eye Tracking JS

Heartbeat-js

Heart Rate Detection JS

Coco SSD Object Detector

Object Detection JS

jsLDA

Topic Modeling JS

OpenFace

Facial landmark detection PY

Whisper

Speech Recognition PY

OpenPose

Pose Visualization PY

DeepSpeech

Speech to Text PY

AlphaPose

Multi-person pose estimator PY