I am likely going to create a simple program that allows users to create real time effects on using one or more source video files, and am requesting comments before I start. I'd like to know what other cross platform (Mac/Windows/Linux/Pi) programs exists that work as I am going to describe, and am also open to suggestions.
Use case scenarios:
Fun video effects to display on a large home theater screen.
Any other idea you have to either manipulate video and audio in real time, or forward data from video/audio to other external APIs such as Raspberry Pi GPIO pins.
Here are the details of what I am thinking about its operation:
Purely text based input.
The program creates a full screen video player given input from the script file.
The script file can then alter the video and audio in real time as it plays. It can add effects such as mosiac, posterization, ascii matrix, mirroring/3D transforms, overlay text, color substitution or chroma key, etc. It can also put effect on audio track.
The script can load other script files, and call subroutines.
Your own custom GLSL fragment shaders implement the actual pixel operations.
Multiple video, image, and audio sources can be composited to one final video/audio stream.
The program will include may pre fabricated scripts with reusable subroutines and examples.