← Back to App

🏗️ System Architecture

Client UI
Gradio 6.0
→
Services
Python Backend
→
AI Models
Gemini + VoiceKit MCP

🎨 Frontend

Gr
Gradio 6.0.0

Python-based UI framework. Powers interactive web interface with voice input, real-time feedback, modals, and dynamic game state transitions.

Py
Python 3.11+

Client application language. Leverages type hints, async/await patterns, and modern Python features for clean, maintainable code.

Hx
HTTPX 0.28.1

Async HTTP client library for communicating with backend services and external APIs with full HTTP/2 support.

Js
Custom CSS/JS -

Custom styling with animated backgrounds, modal components, radar charts, and responsive design for optimal user experience.

⚡ Backend Services

Py
Python Services 3.11+

Modular service architecture including voice analyzer, hint generator, database layer, and game state management with async/await support.

Pd
Pydantic 2.0+

Data validation and settings management with type safety, automatic serialization, and schema validation.

Ay
Asyncio Built-in

Native Python async library for concurrent operations, enabling efficient handling of multiple voice analysis requests.

Dv
Python-dotenv 1.0.0

Environment variable management from .env files for secure API keys and configuration settings.

🗄️ Database

Pg
PostgreSQL 16-alpine

Production-grade relational database. Stores user sessions, game history, daily puzzles, attempt statistics, and score analytics.

Ps
psycopg2 2.9+

PostgreSQL adapter for Python. Provides efficient database connections and query execution with connection pooling.

Dk
Docker Volume -

Persistent data storage with Docker volumes ensuring database persistence across container restarts.

🤖 AI / Machine Learning

Gm
Google Gemini 2.0 Flash

Multimodal AI model powering intelligent hint generation, contextual feedback, and adaptive difficulty based on player performance.

11
ElevenLabs 2.24.0

Advanced text-to-speech API with voice cloning. Generates partial audio hints with reference voice matching for natural gameplay experience.

Np
NumPy 1.26.4

Numerical computing library for audio signal processing, feature extraction, and statistical analysis of voice patterns.

Pd
Pandas 2.2.3

Data analysis library for processing game statistics, tracking user progress, and generating performance insights.

🔌 Model Context Protocol (MCP)

MC
MCP Client 1.22.0

Model Context Protocol client for seamless AI model integration. Manages sessions, tool calling, and context sharing across AI services.

Vk
VoiceKit MCP HuggingFace

Voice analysis MCP server providing voicekit_analyze_voice_similarity tool. Compares user recordings with reference audio for pronunciation scoring.

SS
SSE Client MCP

Server-Sent Events client for real-time MCP communication. Enables streaming responses and bidirectional tool invocation.

🎵 Audio Processing

Pd
PyDub 0.25.1

Audio manipulation library for format conversion, normalization, compression, and audio file editing with effects processing.

FF
FFmpeg via ffmpy

Multimedia framework for audio encoding/decoding. Handles format conversion and compression for optimal file sizes.

B6
Base64 Built-in

Audio data encoding for API transmission. Converts binary audio to base64 strings for MCP tool parameters.

Af
Aiofiles 24.1.0

Async file operations for non-blocking audio file I/O. Enables concurrent file processing without blocking the event loop.

🛠️ DevOps & Tools

Dk
Docker Latest

Containerization platform providing consistent development and deployment environments across all systems.

DC
Docker Compose Latest

Multi-container orchestration for managing PostgreSQL database service with volume persistence and networking.

Ev
Environment Config -

Secure configuration management with .env files for API keys (Gemini, ElevenLabs, VoiceKit) and sensitive settings.

Sh
Shell Scripts Bash

Automated deployment scripts (start.sh, stop.sh) for streamlined application lifecycle management.

Hf
HuggingFace Hub

Deployment platform hosting VoiceKit MCP server and application demos with integrated spaces for testing.

Lg
Logging Built-in

Comprehensive logging system for debugging, monitoring API calls, tracking errors, and performance analysis.