My Projects

Real projects I've built and deployed in production

πŸ€– AI Agent● Live

Tamil AI Receptionist

AI Agent

Live2025

A fully autonomous Tamil AI receptionist that speaks and understands Tamil natively using Sarvam AI. Built for Indian businesses who want 24/7 customer coverage without hiring staff. The agent answers calls in Tamil, collects lead information (name, phone, service needed, budget), and instantly notifies the business owner via WhatsApp with a structured summary. All leads are stored in Supabase for CRM tracking.

24/7
availability
Tamil
language
Auto
lead Capture
Instant
alerts
Supabase
storage
Live
status

Technologies Used

Sarvam AIFastAPIPythonTwilioSupabasengrokWhatsApp API

Key Features

βœ“Tamil Speech to Text (Sarvam STT) β€” native Tamil understanding
βœ“AI Brain with natural Tamil conversation flow
βœ“Auto lead capture β€” Name, Phone, Service, Budget
βœ“Instant WhatsApp summary alerts to business owner
βœ“Supabase database storage for all leads
βœ“24/7 uptime β€” never misses a customer call
βœ“Multi-turn conversation with context memory
βœ“Handles interruptions and clarifications naturally

Architecture Highlights

Sarvam AI for Tamil STT/TTS
FastAPI async backend
Twilio Voice & WhatsApp API
Supabase PostgreSQL database
ngrok for webhook tunneling
Multi-turn conversation state machine
Real-time WhatsApp notifications

System Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚          Tamil AI Receptionist                   β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                β”‚ Incoming Call / WhatsApp Message
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚   Twilio              β”‚
    β”‚   Voice & WhatsApp    β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                β”‚
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚   Sarvam AI           β”‚
    β”‚   Tamil STT + AI      β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                β”‚
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚   FastAPI Backend     β”‚
    β”‚   Conversation Logic  β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
            β”‚
    β”Œβ”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚   Supabase    β”‚    β”‚  WhatsApp Alert  β”‚
    β”‚   Lead Store  β”‚    β”‚  to Business     β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
πŸ€– AI Agent● Live

WhatsApp AI Bot

AI Agent

Live2025

A production-ready WhatsApp AI bot built for Tamil-speaking businesses. The bot automatically handles incoming customer messages 24/7, responds intelligently in Tamil, extracts lead information from the conversation, and instantly notifies business owners with structured summaries. Features multi-user session management to handle hundreds of simultaneous customers without confusion.

WhatsApp
platform
Tamil
language
Multi-user
sessions
Real-time
alerts
Supabase
storage
Live
status

Technologies Used

FastAPITwilioSarvam AISupabasePythonWhatsApp API

Key Features

βœ“24/7 automated Tamil replies via WhatsApp
βœ“Smart lead extraction from conversation context
βœ“Multi-user session management (hundreds simultaneously)
βœ“Real-time WhatsApp alerts to business owner
βœ“Conversation history stored in Supabase
βœ“Handles follow-up questions and clarifications
βœ“Graceful handoff when human response is needed
βœ“Business hours awareness and auto-responses

Architecture Highlights

FastAPI webhook handler
Twilio WhatsApp Business API
Sarvam AI language model
Supabase for session & lead storage
In-memory session management
Async message processing
Webhook signature verification

System Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚          WhatsApp AI Bot                         β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                β”‚ Customer WhatsApp Message
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚   Twilio Webhook      β”‚
    β”‚   WhatsApp Business   β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                β”‚
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚   FastAPI + Sarvam AI β”‚
    β”‚   Session Manager     β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
            β”‚
    β”Œβ”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚   Supabase    β”‚    β”‚  Real-time Alert  β”‚
    β”‚   Sessions    β”‚    β”‚  to Owner        β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

ATHENAS SAP System

Enterprise ERP Platform

Live in Production2024

Enterprise-grade ERP system built from scratch in 2 months. Features include multi-tenant architecture, AI-powered HR with face recognition, GST-compliant finance module, ML demand forecasting, real-time dashboards, and React Native mobile apps. Currently live in production on Hostinger VPS serving multiple companies.

95,000+
code Lines
2 months
development Time
<200ms
response Time
1,000+
concurrent Users
99.5%
accuracy
85%+
test Coverage

Technologies Used

Django 5.2.6ReactReact NativePostgreSQLRedisCeleryTensorFlow 2.17OpenCVNginxJWT Auth

Key Features

βœ“Multi-tenant architecture with company data isolation
βœ“AI-powered face recognition attendance (99.5% accuracy)
βœ“GST-compliant finance module with automated tax calculations
βœ“ML-based demand forecasting for inventory
βœ“Real-time dashboards with WebSocket + Redis
βœ“React Native mobile apps (iOS & Android)
βœ“Role-based access control (RBAC)
βœ“Automated background tasks with Celery
βœ“150+ normalized database tables
βœ“RESTful API with <200ms response time

Architecture Highlights

Microservices-ready monolith
Nginx load balancer
Django WSGI/ASGI deployment
PostgreSQL with connection pooling
Redis caching & session store
Celery task queue
Horizontal scaling ready

System Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚   React Native  β”‚    β”‚   React Web     β”‚    β”‚   Admin Panel   β”‚
β”‚   Mobile Apps   β”‚    β”‚   Dashboard     β”‚    β”‚   (Django)      β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”˜
         β”‚                      β”‚                      β”‚
         β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                                β”‚
                    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
                    β”‚   Django REST API     β”‚
                    β”‚   + JWT Auth          β”‚
                    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                                β”‚
                β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
                β”‚               β”‚               β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β” β”Œβ”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β” β”Œβ”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”
        β”‚ PostgreSQL   β”‚ β”‚   Redis   β”‚ β”‚   Celery    β”‚
        β”‚ (150+ tables)β”‚ β”‚  (Cache)  β”‚ β”‚  (Tasks)    β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                                β”‚
                        β”Œβ”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”
                        β”‚  TensorFlow    β”‚
                        β”‚  (AI Models)   β”‚
                        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

AgencyFlow

Enterprise Business Management Platform

Production Ready2024

Comprehensive business management platform with 10+ modules achieving 10/10 production readiness. Built with Django Channels for real-time features, React PWA for offline collections, and immutable ledger for financial integrity. Includes staff management, vehicle tracking, attendance with salary processing, e-way bill management, and real-time collections with automatic reconciliation.

10+
modules
<100ms
api Response
<50ms
ws Latency
10,000+
concurrent Users
99.9%
uptime
100%
data Integrity

Technologies Used

Django 5.0.8Django REST FrameworkDjango Channels 4.0React 18.2TypeScript 5.2Vite 5.0PostgreSQLRedisCelery 5.3.4WebSocketsPWAIndexedDBTailwindCSSZustandReact Query

Key Features

βœ“Progressive Web App with offline-first architecture
βœ“Real-time WebSocket notifications (10,000+ concurrent connections)
βœ“Immutable financial ledger with 100% data integrity
βœ“Automated daily reconciliation with conflict resolution
βœ“Staff management with encrypted sensitive data
βœ“Attendance tracking with automatic salary calculation
βœ“Vehicle & fuel tracking with analytics
βœ“E-way bill management with bulk Excel upload
βœ“Collections PWA with denomination entry
βœ“Real-time sync with retry logic and conflict logging

Architecture Highlights

Django Channels + WebSockets
Daphne ASGI + Gunicorn WSGI
PostgreSQL with 15+ strategic indexes
Redis for caching & task queue
Celery Beat for scheduled tasks
Service workers for offline PWA
IndexedDB for offline storage

System Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚   React PWA     β”‚    β”‚  Admin Panel    β”‚
β”‚   (Offline)     β”‚    β”‚  (Dashboard)    β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”˜
         β”‚                      β”‚
         β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚  Django Channels       β”‚
        β”‚  WebSocket Server      β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚  Django REST API       β”‚
        β”‚  + JWT Auth            β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚               β”‚               β”‚
β”Œβ”€β”€β”€β–Όβ”€β”€β”€β”€β”   β”Œβ”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”   β”Œβ”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”
β”‚ PostgreSQLβ”‚   β”‚   Redis   β”‚   β”‚  Celery  β”‚
β”‚ (10+ mods)β”‚   β”‚ (Pub/Sub) β”‚   β”‚  Beat    β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜   β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜   β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Stock Market Expert App

Stock Market Analysis Platform

Production Ready2024

Full-stack stock market analysis platform enabling admins to manage teams, assign stocks, and facilitate collaborative analysis. Features include automated email notifications, buddy comparison system, RAG status indicators for buy opportunities, profile management with camera capture, and real-time stock tracking. Built with FastAPI backend and React TypeScript frontend with 100+ NSE stocks pre-loaded.

100+
stocks
Unlimited
users
Real-time
updates
10 max
featured
10+20
pool Size
httpOnly
security

Technologies Used

FastAPIReact 18TypeScriptPostgreSQLSQLAlchemyPydanticJWT AuthZustandAxiosTailwindCSSGmail SMTPAlembicBcrypt

Key Features

βœ“httpOnly cookie authentication with XSS protection
βœ“Admin panel for team & stock management
βœ“Automated email delivery of credentials via Gmail SMTP
βœ“Buddy system for collaborative stock analysis
βœ“RAG (Red-Amber-Green) status indicators (0-3%, 3-11%, 12-99.9%)
βœ“Editable analysis fields (Best Buy Price, TradingView URL)
βœ“Real-time stock price updates with animations
βœ“Profile photo upload with live camera capture
βœ“Smart stock filtering (prevents buddy conflicts)
βœ“100+ NSE stocks with featured stocks system

Architecture Highlights

FastAPI async operations
PostgreSQL with connection pooling
SQLAlchemy ORM with lazy loading
JWT with refresh tokens
Zustand state management
Alembic database migrations
RESTful API design

System Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚  React Frontend β”‚    β”‚  Admin Panel    β”‚
β”‚  (TypeScript)   β”‚    β”‚  (Management)   β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”˜
         β”‚                      β”‚
         β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚   FastAPI Backend      β”‚
        β”‚   + JWT (httpOnly)     β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚   SQLAlchemy ORM       β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚               β”‚               β”‚
β”Œβ”€β”€β”€β–Όβ”€β”€β”€β”€β”   β”Œβ”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”   β”Œβ”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”
β”‚PostgreSQLβ”‚   β”‚   Redis   β”‚   β”‚  Gmail   β”‚
β”‚(100+ NSE)β”‚   β”‚  (Cache)  β”‚   β”‚  SMTP    β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜   β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜   β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Industrial Equipment Monitoring System

Real-time Industrial IoT Platform

Production-Ready Demo2024

Comprehensive industrial monitoring platform with real-time synchronization between field technicians and management. Features include daily equipment inspections, automated meter reading calculations, interactive building layouts with clickable equipment hotspots, multi-shift support, and role-based dashboards. Built with FastAPI backend and React TypeScript frontend with WebSocket for instant updates.

30+
companies
10+
api Endpoints
90%
optimization
WebSocket
real Time
2
roles
Global
deployment

Technologies Used

FastAPIReactTypeScriptAnt DesignWebSocketSQLAlchemySQLite/PostgreSQLJWT AuthPythonSVG Graphics

Key Features

βœ“Real-time WebSocket updates between technicians and managers
βœ“Daily operation dashboard for equipment inspections
βœ“Executive dashboard for real-time monitoring
βœ“Interactive building layout with clickable equipment hotspots
βœ“Automated electricity meter reading calculations (9:00 AM logic)
βœ“Equipment checklists for pumps and chillers
βœ“Multi-shift tracking and coordination
βœ“Role-based access control (Technician/Manager)
βœ“90% API call reduction via WebSocket optimization
βœ“Responsive design for industrial tablets

Architecture Highlights

RESTful API with FastAPI
WebSocket bidirectional communication
SQLAlchemy ORM
JWT authentication
SVG-based visual layouts
PostgreSQL production-ready
Multi-tenant architecture

System Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚  Technician     β”‚    β”‚  Manager        β”‚
β”‚  Dashboard      β”‚    β”‚  Dashboard      β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”˜
         β”‚                      β”‚
         β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚   WebSocket Server     β”‚
        β”‚   (Real-time Sync)     β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚   FastAPI Backend      β”‚
        β”‚   + JWT Auth           β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚   SQLite/PostgreSQL    β”‚
        β”‚   (Equipment Data)     β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

AI Video Call Assistant

Real-time Communication Platform

Hackathon Demo2024

Innovative video calling platform built for a school hackathon project. Combines WebRTC video communication with real-time speech-to-text transcription using Web Speech API. Features include room-based connections, SSL-secured local network communication, continuous speech recognition with auto-restart, and cross-platform compatibility.

1-to-1
connection
Real-time
transcription
Cross-OS
platforms
SSL/HTTPS
security
Continuous
recognition
Hackathon
type

Technologies Used

ReactTypeScriptWebRTCFastAPIWebSocketWeb Speech APISSL/HTTPSPython

Key Features

βœ“WebRTC peer-to-peer video communication
βœ“Live speech-to-text transcription in real-time
βœ“Room-based 1-to-1 connections
βœ“SSL-secured local network communication
βœ“Continuous speech recognition with auto-restart
βœ“Manual MediaStream construction for reliability
βœ“Chrome autoplay policy compliance
βœ“Cross-platform (Linux, Windows, mobile browsers)

Architecture Highlights

WebRTC peer-to-peer architecture
WebSocket signaling server
FastAPI backend with room management
Web Speech API integration
Self-signed SSL certificates
Manual MediaStream construction
Auto-restart speech recognition

System Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚   Browser A     β”‚    β”‚   Browser B     β”‚
β”‚   (Peer 1)      β”‚    β”‚   (Peer 2)      β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”˜
         β”‚                      β”‚
         β”‚    WebRTC P2P        β”‚
         │◄────────────────────►│
         β”‚                      β”‚
         β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚  FastAPI Signaling     β”‚
        β”‚  WebSocket Server      β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚  Web Speech API        β”‚
        β”‚  (Speech-to-Text)      β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜