[Video] Video Component split audio from video

[ShihChun-H]

Issue Description

Current State

• The Video Component can only:

1. Subsample Video - Subsample video into a new video
2. Subsample Video Frames - Subsample video into frames

Why We Want to Change?

• Videos often come with audio but currently we cannot extract this for processing.

Proposed Change

• Add a task to extract the audio from video

Recipe proposal

"TASK_EXTRACT_AUDIOS": {
"instillShortDescription": "Extract audios from a video",
"input": {
"description": "Parameters to consider for extracting from the video",
"instillEditOnNodeFields": [c
"audio",
],
"instillUIOrder": 0,
"properties": {
"video": {
"description": "The input video",
"instillAcceptFormats": [
"video/",
"application/octet-stream"
],
"instillUIOrder": 0,
"instillUpstreamTypes": [
"reference"
],
"title": "Video",
"type": "binary"
},
"time-windows": {
"description": "Time windows for extracting videos in the format [[start time, end time], …], where the time is in the format hh:mm:ss",
"instillAcceptFormats": [
"array:array:string"
],
"instillUIOrder": 1,
"instillUpstreamTypes": [
"reference",
"value"
],
"title": "Time windows",
"type": "array"
},
},
"required": [
"video",
"time-windows"
],
"title": "Input",
"type": "object"
},
"output": {
"instillUIOrder": 1,
"properties": {
"audios": {
"description": "Extracted audios",
"instillFormat": "array:audio/",
"instillUIOrder": 0,
"items": {
"type": "binary",
"title": "Audio"
},
"title": "Audios",
"type": "array"
}
},
"required": [
"audios"
],
"title": "Output",
"type": "object"
}
}

---

Rules for the Component Hackathon

• Each issue will only be assigned to one person/team at a time.
• You can only work on one issue at a time.
• To express interest in an issue, please comment on it and tag @kuroxx, allowing the Instill AI team to assign it to you.
• Ensure you address all feedback and suggestions provided by the Instill AI team.
• If no commits are made within five days, the issue may be reassigned to another contributor.
• Join our Discord to engage in discussions and seek assistance in #hackathon channel. For technical queries, you can tag @chuang8511.

---

Component Contribution Guideline | Documentation | Official Go Tutorial

[Fustigate8933]

I'm interested in working on this one

[ShihChun-H]

Hi @Fustigate8933, the issue has been assigned to you 🙌🏻