analyzing-videos

Video Analysis

Analyzes video content for understanding and extracts highlight clips using AI multimodal analysis.

When to Use

Use this skill when:

• Analyzing video content for summary
• Extracting highlight/exciting moments
• Generating video keywords and tags
• Creating trailers from longer videos
• Understanding plot and storyline
• Finding viral-worthy moments

Analysis Capabilities

• Visual Analysis: Scene detection, object recognition, action identification
• Audio Analysis: Speech recognition, music detection, sound effects
• Language Understanding: Dialogue analysis, sentiment detection
• Multimodal Fusion: Combines all modalities for comprehensive understanding

Workflow

Step 1: Get Source Video

Obtain the video URL to analyze.

Step 2: Submit Analysis Task

Call submitAideoTask with appropriate prompt:

• For understanding: "Analyze and summarize this video"
• For highlights: "Extract the most exciting moments"

Step 3: Poll for Results

1. First check: Wait 210 seconds after submission

2. Subsequent checks: Wait 30 seconds between polls

3. Call getAideoTaskStatus to check progress

Step 4: Timeout Handling

Maximum wait time: 20 minutes

If task exceeds 20 minutes, report as timeout failure.

Step 5: Return Results

Results vary by task type:

• Understanding: Summary, keywords, plot analysis (JSON)
• Highlights: Array of highlight clip URLs

Examples

Example 1: Extract Highlights

User request: "Create a 30-second highlight reel from this video"

submitAideoTask:
  prompt: "Extract the most exciting moments from this video to create a 30-second highlight compilation"
  multiInputs: ["source_video.mp4"]

Example 2: Video Understanding

User request: "Analyze this video and give me a summary"

submitAideoTask:
  prompt: "Analyze this video content and generate: summary, keywords, and plot analysis"
  multiInputs: ["video.mp4"]

Example 3: Create Trailer

User request: "Make a trailer from this long video"

submitAideoTask:
  prompt: "Extract the most engaging and exciting moments to create a compelling trailer"
  multiInputs: ["long_video.mp4"]

Example 4: Find Viral Moments

User request: "Find the best clips for social media"

submitAideoTask:
  prompt: "Identify and extract the most viral-worthy moments from this video for social media"
  multiInputs: ["content_video.mp4"]

Output Types

Highlight Extraction

• Returns array of clip URLs
• Each clip contains exciting/engaging moment
• Clips can be used directly or further edited

Video Understanding

• Summary: Brief description of video content
• Keywords: Relevant tags and topics
• Plot Analysis: Story structure and key events

Important Notes

• Maximum video length: 2 hours
• Maximum wait time: 20 minutes
• Highlight extraction returns multiple clip URLs
• Understanding returns JSON with summary, keywords, plot
• Processing time: ~10 minutes per 1-minute video