Mobile Video Processing on the Fly
Real-time video processing may require some significant smartphone processor power. This means that you need to use vetted algorithms to achieve the best possible performance, building a highly optimized application.
Even a basic video recording task becomes non-trivial when it comes down to applying filters or watermarks and adding objects to the video. We crafted the ultimate solution, which uses the GPU (Graphics Processing Unit) power to process the videos in real-time. This algorithm leverages time markers to synchronize the edited video and audio buffers.
This smart approach allows for increasing the application performance for both iOS and Android applications. While keeping the desired high frame rate of the resulting video, we managed to decrease the battery usage compared to the straight video processing approach, which leverages the smartphone’s CPU.
Improving the built-in mobile OS video editing and processing features, we can easily customize our highly optimized and secure solutions to meet your application goals.
Using remote cameras
Remote cameras may come in handy for the fun and games industry: you can attach the compatible device to drones or other radio controlled toys and control them using a live view from the remote camera.
We used the common Real Time Streaming Protocol (RTSP) to build an application prototype, which allows for watching live video from the smartphone’s camera on the screen of a connected device. Using the RTSP server with video and audio codecs allows us to bring the sound into the broadcast.
Our RTSP solution supports direct video broadcast and doesn’t require an intermediate server. In fact, the streaming device automatically becomes the server.
We implemented a small buffer to make the video broadcast smooth. This buffer brings a small time lag (around 2-3 seconds) into the broadcast, but at the same time, it ensures that the users would not see any artifacts even if the Wi-Fi connection speed is slow. Contact us to learn how we can customize this proven solution to build a video streaming application to meet your goals.
In the video editing application, you may use existing pictures stored on your device or in the cloud account, or utilize the live camera pictures straight from the mobile app. Then we apply different filters to the video in real-time, recording the content already with the filters applied, while you can track changes of the live video stream on the smartphone’s screen.
Of course, we provide you with the ability to add or change the soundtrack, making the video output really impressive.
Here’s the shortlist application features that we can implement in this application:
- awesome video collages with various effects
- dedicated music overlay
- adding memes, drawings or stickers
- pinch and zoom for detailed placement and editing
- animated tickers overlay.
Then we can add news feeds, videos search, private messages and user profile modules to your application, turning it into a fully functional social network, built specially to suit your needs.
And with the instant integration of the world’s most popular social networks, you can share the brightest video editing results with your friends in just a couple of clicks.
Being the pioneers of mobile video editing solutions, we created our own framework to leverage various video editing tasks in mobile applications. Now the DB Best teams can use this solution to develop cost-effective applications for your video production business in a short period of time.
Check out some of our blog posts that highlight our mobile video processing experience.