Data de referencia: Marco 2026
- Assistive Profile
- AAC Board
- Voice Module
- Gesture Module
- Communication History
Frontend
Next.js + React
↓
Gesture Engine
MediaPipe (browser)
↓
Voice Engine
Web Speech API
↓
API Gateway
Node.js
↓
Data Layer
PostgreSQL
Regra de arquitetura:
- AI engine nunca exposto diretamente ao client.
Modelo central de personalizacao da experiencia.
Campos principais:
type AssistiveProfile = {
id: string;
userId: string;
displayName: string;
communicationModes: string[];
voiceEnabled: boolean;
gestureEnabled: boolean;
aacEnabled: boolean;
preferredLanguage: string;
voiceSpeed: number;
voicePitch: number;
motorLimitations?: string;
speechLimitations?: string;
cognitiveLevel?: string;
};Funcao:
- Adaptar UI e interacoes por perfil assistivo.
Componentes:
- Categories
- Phrases
- Quick phrases
- Prediction engine
Funcao:
- Permitir comunicacao rapida com suporte a gesto e voz.
Funcao:
- Text to speech
- Speech to text
Stack inicial:
- Web Speech API
Evolucao planejada:
- Whisper
- Google Speech
Tecnologia:
- MediaPipe Hands
Gestos iniciais:
- Open hand
- Closed fist
- Point
Fluxo:
Camera
→ Gesture detection
→ Action trigger
→ Phrase output
Dados armazenados:
- Phrase
- Timestamp
- Communication mode
- Context
Objetivo:
- Melhorar predicao
- Suportar analise terapeutica
User communicates
↓
System learns patterns
↓
Predictions improve
↓
Communication becomes easier
↓
More usage
Nenhuma feature nova entra sem passar por:
- Backlog
- Priorizacao
- Validacao com roadmap e regras de governanca