Skip to content

feat: add voice coaching and hands-free voice commands during exercise execution - #28

Open
DecodeX15 wants to merge 57 commits into
AOSSIE-Org:mainfrom
DecodeX15:Voice_instruction_and_command_pipeline
Open

feat: add voice coaching and hands-free voice commands during exercise execution#28
DecodeX15 wants to merge 57 commits into
AOSSIE-Org:mainfrom
DecodeX15:Voice_instruction_and_command_pipeline

Conversation

@DecodeX15

@DecodeX15 DecodeX15 commented Aug 30, 2026

Copy link
Copy Markdown
Member

PR Description:

Addressed Issues:

Fixes #(issue number) N/A

Screenshots/Recordings: N/A

image

Additional Notes:

Voice Coaching (TTS):

  • Exercise instructions are spoken sequentially via TTS during the workout phase
  • Flow: 2s delay → Instruction 1 → wait for completion → 3s gap → Instruction 2 → ...
  • Instructions play as many as time allows — no instruction is cut mid-sentence
  • TTS stops on pause, skip, phase change, and session finish

Hands-Free Voice Commands (STT):

  • Users can control workout with voice: pause/stop/wait/hold, start/resume/play/go, skip/next
  • STT runs in a continuous auto-restart loop throughout the session
  • STT automatically stops while TTS is speaking (avoids speaker-to-mic audio leak) and restarts 500ms after TTS finishes
  • TTS speaks a short confirmation after each command ("Paused", "Resuming", "Skipping")
  • Physical buttons remain fully functional as fallback

Known Limitation:

  • Voice commands are not processed while TTS is actively speaking instructions (hardware limitation — phone speaker audio leaks into mic). Commands work during gaps between instructions and after all instructions finish.

Checklist

  • My code follows the project's code style and conventions
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings or errors
  • I have joined the Discord server and I will share a link to this PR with the project maintainers there
  • I have read the Contributing Guidelines

⚠️ AI Notice - Important!

We encourage contributors to use AI tools responsibly when creating Pull Requests. While AI can be a valuable aid, it is essential to ensure that your contributions meet the task requirements, build successfully, include relevant tests, and pass all linters. Submissions that do not meet these standards may be closed without warning to maintain the quality and integrity of the project. Please take the time to understand the changes you are proposing and their impact.

… adding loading screen and storing embeddings
@coderabbitai

coderabbitai Bot commented Aug 30, 2026

Copy link
Copy Markdown

Important

  • 🔍 Trigger review

This repository does not receive automatic reviews because it has fewer than 10 stars.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Pro Plus

Run ID: 26a68fee-244b-4335-8e34-89c1f70318b2


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@github-actions github-actions Bot added no-issue-linked PR is not linked to any issue backend Changes to backend code ci-cd CI/CD pipeline changes configuration Configuration file changes documentation Changes to documentation files github-actions GitHub Actions workflow changes javascript JavaScript/TypeScript code changes python Python code changes tests Test file changes size/XL Extra large PR (>500 lines changed) repeat-contributor PR from an external contributor who already had PRs merged needs-review labels Aug 30, 2026
@DecodeX15 DecodeX15 added the gsoc Part of Google Summer of Code Season label Aug 30, 2026
@DecodeX15 DecodeX15 self-assigned this Aug 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend Changes to backend code ci-cd CI/CD pipeline changes configuration Configuration file changes documentation Changes to documentation files github-actions GitHub Actions workflow changes gsoc Part of Google Summer of Code Season javascript JavaScript/TypeScript code changes needs-review no-issue-linked PR is not linked to any issue python Python code changes repeat-contributor PR from an external contributor who already had PRs merged size/XL Extra large PR (>500 lines changed) tests Test file changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant