how to use this model with video as input?
#14
by
himasai9711
- opened
so i have been trying to do video analysis and feature extraction, how can i do it?@0ctal
You would probably need to break apart your video into individual frames and process them individually, rather than input video for inference.
Hi,
Yes that's correct if you would like to provided the image as an input to the model you could directly provide it in the prompt by using the chat template provided in the model card section, however if you would like to do the video analysis you have to pass the frames as an input to the model in an iterative manner to analyze it.
To know more about how to do the videos analysis with Gemma models please visit the following page.
Thanks.