Transforming 2D Images into 3D Metric Point Clouds with Depth Anything

Поделиться
HTML-код
  • Опубликовано: 10 сен 2024

Комментарии • 18

  • @lgcondados
    @lgcondados 23 дня назад

    thanks for the great work Bohdan!

  • @eswar9255
    @eswar9255 22 дня назад

    Thanks, brother

  • @NicolaiAI
    @NicolaiAI 2 месяца назад +2

    Been waiting on this!

    • @BohdanVodianyk
      @BohdanVodianyk  2 месяца назад +1

      hehehe, thank you! I am preparing many new cool things, so in the future check out many great things here

  • @thegigasurgeon
    @thegigasurgeon 19 дней назад

    Great work! I was wondering if we can use it on a video? For example, run DepthAnythingV2 on every frame and then generate a consistent 3d point cloud.

    • @cooohooo
      @cooohooo 16 дней назад

      You can go from RGB-D video to point cloud with e.g. SFM or SLAM algorithms.

  • @devanjanmishra676
    @devanjanmishra676 2 месяца назад +1

    Great work Bohdan, i am also working on something similar, but wanted to understand how to get rid of points b/w object which appears to be flying when the objects are at different depth

    • @BohdanVodianyk
      @BohdanVodianyk  2 месяца назад +1

      Thank you! If you mean a "gradient" point when we have a change in depth, you could use simple outliers removing filters - it will be helpful in most cases

  • @samtaymsproductions
    @samtaymsproductions 2 месяца назад +1

    How about real time semantic segmentation with pcd for next video topic?

    • @BohdanVodianyk
      @BohdanVodianyk  Месяц назад +2

      Really great idea! I have already started preparation for this video. I want to combine depth estimation and segmentation in 2d/3d, so stay here for new videos!

  • @phamminhvuong8985
    @phamminhvuong8985 2 месяца назад +1

    which version of depth anything do you apply in your code to reconstruct the point cloud?

    • @BohdanVodianyk
      @BohdanVodianyk  2 месяца назад +1

      For metric depth estimation, I have used pre-trained models (indoor and outdoor) that are based on Depth Anything v1

    • @phamminhvuong8985
      @phamminhvuong8985 2 месяца назад

      @@BohdanVodianyk Thanks for your response. I tried to test on my camera with the indoor checkpoints but the error of measuring the distance is quite high. So, can we train the Depth any model on a custom dataset? or do we have any other way to reduce the error?

    • @MDAsadullahShibli
      @MDAsadullahShibli 2 месяца назад

      @@phamminhvuong8985i have the same question

    • @BohdanVodianyk
      @BohdanVodianyk  2 месяца назад +1

      @@phamminhvuong8985 Of course, you could train your own model! Here is the source page of metric depth anything github.com/LiheYoung/Depth-Anything/tree/main/metric_depth It will be super useful if you want to really deeply use this technique. Also, errors in depth could be very sensible to the camera parameters and light conditions, so be sure you have enough light as in my video for example

    • @phamminhvuong8985
      @phamminhvuong8985 2 месяца назад +1

      @@BohdanVodianyk Coud you share a tutorial video about training depthany model on custom data?