Conversation
jarkko

Jarkko Sakkinen

Edited 18 days ago

Video detection in ReadSeek will be based on a storyboard.

Qwen3-VL-2B processes only images; it does not understand videos. In other words, a video must translated into a meaningful set of images.

A storyboard is a tiled composite image generated from a fixed number of down-scaled video frames. Let’s mark this with N, and further constrain that N>2.

Algorithm:

  1. Use two frames of the frame budget for start and end timestamp frames.
  2. Place the remaining N-2 timestamps initially even distances from each other.
  3. Shift the timestamps within 50% range of their initial distance with some yet to be defined best effort strategy. maximizing the difference between the frames.

Note that timestamps positions form a O(2^N) problem as the timestamps affect each other as a system.

This idea could be taken out of the domain to an imaginary movie studio. What if you wanted back-engineer a storyboard to already shot material? A previous might be lost, or sometimes might not even exist.

Figuring out the answer to this question provides an optimal answer to the problem in my original domai

0
0
0
About social.kernel.org

Terms of service

  1. Please do not use this service in violation of the Linux Kernel Code of Conduct. Doing so will result in your account suspension with the referral of the matter to the CoC committee.

  2. "Repeating"/"boosting" someone else's status on this platform will be treated as endorsement and will fall under rule #1.

  3. You are encouraged to use this platform to promote your work on the Linux Kernel, but there is no restriction on permitted topics (with the exception of anything covered by #1 above).

  4. There is no requirement to post in English, but it should be considered the primary language of communication on this platform.

Privacy notice

The admins of this service have access to all posted statuses. They aren't looking, but if it's something they shouldn't know about, then you should not post it on this platform.

Please see the Linux Foundation Privacy Policy, which applies to this platform as well.

Getting your own account

If you would like an account on this instance, please check that the following applies to you:

  • You are listed in MAINTAINERS or CREDITS

  • OR: You have a kernel.org account or email address

  • OR: You have a long and established history of involvement with the Linux Kernel

If the above is true and you agree with the Terms of Service and Privacy Notice listed above, please use these instructions to request an account: