Skip to content
➜cat projects/handtracking-implementation-in-videocall/README.md
cd ../projects

Hand Tracking in Video Calls

A demo built for the Agora AllStars program that overlays real-time hand gesture recognition on top of a live video call. Uses Handtrack.js for browser-based ML hand detection and Agora SDK for the WebRTC video stream. Recognizes gestures like open palm and fist during an active call. This project led to the recommendation from Hermes Frangoudis at Agora.

// highlights

  • Overlays Handtrack.js gesture recognition on a live Agora video stream.
  • Built for the Agora AllStars program; led to a referral from Agora DevRel.
  • Pairs browser ML with WebRTC, relevant to interactive product demos.
JavaScriptHandtrack.jsAgora SDKWebRTC
github://view_repo (opens in new tab)
➜ repo: handtracking-implementation-in-videocall[lang: JavaScript, Handtrack.js, Agora SDK, WebRTC]