Next-Generation Interactive AI Video Tutoring & Digital Classroom Engine
Experience synchronized video avatars, live dynamic blackboard visualizations, voice-driven Q&A, and structured 10-step pedagogy.
AI Teacher Studio transforms traditional asynchronous courses into live, engaging 1-on-1 tutoring sessions. It pairs realistic video avatar presenters with real-time speech synchronization and synchronized digital whiteboard visualizations (including live SQL diagrams, code highlighting, and visual table intersections).
| Feature | Description |
|---|---|
| π¬ Live Video Avatar Stream | Switch seamlessly between high-definition presenter streams and a 60 FPS kinetic blackboard canvas. |
| ποΈ Synchronized Voice & Subtitles | Real-time speech synthesis with adjustable playback rates (0.75xβ2.0x) and interactive closed captions. |
| π Interactive Digital Blackboard | Live SQL schema join visualizers, syntax callout boxes, and synchronized code walkthroughs. |
| π©βπ« Multi-Persona Faculty | Choose from specialized instructors with unique voices, accents, and emotional delivery styles. |
| π£οΈ Voice-Driven Student Q&A | Ask questions via speech recognition or chat, receiving instant spoken explanations. |
| β‘ Zero-Cost Video Synthesis | In-browser 60 FPS video export pipeline plus Google Colab SadTalker integration guides. |
- Node.js 18.0 or higher
- npm, yarn, or bun
- A Google Gemini API Key
git clone https://github.com/your-username/ai-teacher-studio.git
cd ai-teacher-studio
npm installCreate a .env file in the root directory:
GEMINI_API_KEY=your_gemini_api_key_herenpm run devOpen http://localhost:3000 in your browser.
βββ server/
β βββ avatar_service.ts # Teacher profiles, audio synthesis & Colab pipelines
β βββ gemini.ts # Gemini API multi-tier fallback orchestration
βββ src/
β βββ components/
β β βββ AvatarStage.tsx # Synchronized video & interactive canvas theater
β β βββ AvatarTutorPage.tsx # Digital classroom with side-by-side blackboard
β β βββ VideoGenerator.tsx # In-browser WebCodecs video rendering engine
β βββ types.ts # Lesson, Persona, and Segment TypeScript types
β βββ App.tsx # Core application router and state management
βββ server.ts # Express + Vite development and production server
Distributed under the MIT License. See LICENSE for more information.