Gyroflow: Video stabilization using gyroscope data

(github.com)

104 points | by nateb2022 3 days ago ago

18 comments

  • mikae1 2 hours ago ago

    I use this for near 100% of my video projects at work (with Sony cameras) and it's absolutely amazing. Sony is not exactly class leading when it comes to stabilization (like Panasonic). There's a Premiere and Resolve plugin-in these days.

    Fast guide:

    * Be sure to turn off any in camera stabilization in Sony cameras.

    * Be sure to take the added crop into account when composing.

    * The faster shutter speed, the better. Forget about 1/50 for 25p. There will be the most horrible artifacts. For 25p, use 1/100 or preferably use 1/200. For 50p, use 1/200 or preferably 1/400 etc.

  • hdersch 5 hours ago ago

    I wonder how this compares to purely vision-based systems which use nothing but the images themselves for stabilization. Here are some quite old results of stabilization using image-based 3d-reconstruction of the scene which I wrote more than 10years ago, compared with other stabilization programs of that time (Deshaker, Adobe After Effects, Youtube). With todays improved hardware and progress in 3d-algorithms you may not need any additional gyroscopic data.

    https://www.youtube.com/watch?v=-m3fwhx3Z5g

    • _flux 2 hours ago ago

      I think gyroscopic data still can have the edge if it has higher sampling rate than the video: then it could be used for removing blur from individual frames.

      I also expect purely gyroscopic approach to be much lighter compute-wise.

  • matsemann 4 hours ago ago

    Haven't really used much other stabilization in post after modern gopros have gotten so good. Especially with the 360 variants (MAX and now MAX 2), it's buttery smooth (and infinite FOV means no cropping). Sometimes too smooth, I want to show how rough the cycling trail really was!

    • greatgib 3 hours ago ago

      With very good daylight, Hypersmooth of Gopro is ok, but as soon as the conditions are a little bit less than ideal, watching the videos that we get out of the Gopro makes nauseous very fast.

  • FrostKiwi 5 hours ago ago

    So So useful <3 Stabilization = you have to zoom-in, loss of FOV. Depending on Action Cam and undistortion parameters, this can be different, sometimes too little, sometimes too much. Gyroflow allows you to dial it in. Lot's Stabilization in a particularly shaky spot and widest FOV everywhere else, smoothed between to be unnoticeable.

  • po1nt 6 hours ago ago

    As a drone pilot I used this before davinci studio implemented something similar. I highly recommend.

  • rixed 6 hours ago ago

    How is this different from usual sensor stabilisation techniques? Is it because it can adjust for a wider range of motion?

    • Gigachad 6 hours ago ago

      Normal sensor stabilization only moves a tiny amount, It's more useful for photography for reducing micro jitters to get sharp photos. For video you need much more aggressive cropping and warping to undo the massive shake of walking with the camera.

  • Gigachad 8 hours ago ago

    I wanted to try this but sadly it seems my A7 iii doesn't record gyro data.

    • Zanfa 6 hours ago ago

      There are external devices that can be attached to the camera to record gyro data, e.g https://docs.gyroflow.xyz/app/advanced-usage/using-external-... I just ordered one a few weeks ago and haven't received it yet, so can't talk about personal experience, but there's no technical reason it couldn't work well.

      • JosephRedfern an hour ago ago

        Out of curiosity - how do you sync gyro data with video timecode?

    • nnevatie 6 hours ago ago

      My a7CR seems to be supported - will try this out later.

      • tecleandor 3 hours ago ago

        Some months ago I tested footage of my A7C2 on Gyroflow expecting to do visual stabilization, and found my camera has a gyro (didn't know about it) and automatically adds that info to the videos.

        The result was pretty good and it was super easy to do it.

        • mikae1 an hour ago ago

          Just be sure to turn off any in camera stabilization to get the best results.

  • RicoElectrico 2 hours ago ago

    What's the deal with mdk-sdk? It is closed source, so there must be a very good reason to use it.

    For context, the webpage: https://www.qtav.org/blog/new-sdk.html

  • jauntywundrkind 7 hours ago ago

    That this also helps so much with rolling shutter correction is wild! Epic.

  • nerderloo 7 hours ago ago

    Such a fine piece of software.