Angjoo Kanazawa
Angjoo Kanazawa
  • Видео 10
  • Просмотров 76 402
Creative Horizons with 3D Capture October 2023
Talk recorded at Stanford's HAI Fall Conference: New Horizons in Generative AI: Science, Creativity, and Society on October 24, 2023.
Please see hai.stanford.edu/events/new-horizons-generative-ai-science-creativity-and-society for the Q&A and other talks!
Просмотров: 3 164

Видео

nerfstudio SIGGRAPH 2023 Trailer
Просмотров 7 тыс.Год назад
🥳 We will be presenting nerfstudio at SIGGRAPH 2023 as a conference paper 🎉 arxiv.org/abs/2302.04264 Myself and many of the nerfstudio team will be attending the conference! Looking forward to meeting the @ACMSIGGRAPH community 🙂 nerf.studio/ nerfstudioteam?lang=en
GTC 23 Nerfstudio: A Modular Framework for Neural Radiance Field Development
Просмотров 9 тыс.Год назад
Doc: nerf.studio Neural radiance fields (NeRFs) are rapidly gaining popularity for their ability to create photorealistic 3D reconstructions in real-world settings, with recent advances driving interest from a wide variety of disciplines in academia and industry. However, due to the flux of papers, consolidating code has been a challenge, and few tools exist to easily run NeRFs on user-collecte...
Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Image
Просмотров 23 тыс.4 года назад
We introduce the problem of perpetual view generation-long-range generation of novel views corresponding to an arbitrarily long camera trajectory given a single image. This is a challenging problem that goes far beyond the capabilities of current view synthesis methods, which work for a limited range of viewpoints and quickly degenerate when presented with a large camera motion. Methods designe...
Video for "Learning 3D Human Dynamics from Video"
Просмотров 7 тыс.5 лет назад
Project page: akanazawa.github.io/human_dynamics/
Learning Category-Specific Mesh Reconstruction from Image Collections
Просмотров 6 тыс.6 лет назад
Project url: akanazawa.github.io/cmr/
Human Mesh Recovery (HMR) Supplementary Video
Просмотров 19 тыс.7 лет назад
Supplementary video showing more results of Human Mesh Recovery(HMR). arXiv: arxiv.org/abs/1712.06584 Project page: akanazawa.github.io/hmr/
Eurographics '16 fastforward for the paper "Learning 3D Deformation of Animals from 2D Images"
Просмотров 8908 лет назад
link to the paper: www.umiacs.umd.edu/~kanazawa/papers/cat_eg2016.pdf
Learning 3D Deformation of Animals from 2D Images: Supplementary Material
Просмотров 7689 лет назад
Link to paper: www.umiacs.umd.edu/~kanazawa/papers/cat_eg2016.pdf Link ot code: github.com/akanazawa/catdeform
WarpNet: Weakly Supervised Matching for Single-View Reconstruction: Supplementary Video
Просмотров 5709 лет назад
CVPR 2016 Link to paper: www.umiacs.umd.edu/~kanazawa/papers/kanazawa_cvpr2016_warpnet.pdf

Комментарии

  • @daoshen
    @daoshen 3 месяца назад

    Thank you for sharing your work! <3

  • @jimj2683
    @jimj2683 7 месяцев назад

    We will never have data from the entire planet (unless be have robotic bee swarms in the billions that scan every nook and cranny ). Somehow one needs to build an AI model that is really good at guessing the missing data (essentially generative AI) for a certain place. Maybe the Earth digital twin could be populated by 3d avatars of all the people on facebook.

  • @jimj2683
    @jimj2683 7 месяцев назад

    I wonder how this will be in 10 years.

  • @jimj2683
    @jimj2683 7 месяцев назад

    The next step would be to use sensors to capture the physical interactions of objects. That could give the model a physics model of the real world and allow it to be used in games.

  • @jimj2683
    @jimj2683 7 месяцев назад

    When will Google Street View be made in 3d? I want to drive around and explore the world as if it is a game or simulator.

  • @larryabecid2819
    @larryabecid2819 9 месяцев назад

    Thank you so much!

  • @szczyglo74
    @szczyglo74 10 месяцев назад

    Amazing technology. Thank you. Maybe someday it will work in real time. I mean training based on prompts or other data. We will let the algorithms dream and we will have the ability to jump into their visions. It will be more than modern computer games or vr movies.

  • @0xabaki
    @0xabaki 10 месяцев назад

    so cool!

  • @suav1148
    @suav1148 11 месяцев назад

    アブちゃんすごい!💯🎉

  • @OnelineNight
    @OnelineNight 11 месяцев назад

    I love the work your team is doing with NerfStudio! Does it work in Mac computers?

    • @play4fun516
      @play4fun516 10 месяцев назад

      Mac too

    • @OnelineNight
      @OnelineNight 10 месяцев назад

      Are your sure? i cant find any information on the documentation...please send me the link with the info available@@play4fun516

  • @sama54664
    @sama54664 11 месяцев назад

    Wow that is amazing 😻 Thank you for sharing!

  • @PixelPulse168
    @PixelPulse168 11 месяцев назад

    😎

  • @grahamwebster8913
    @grahamwebster8913 Год назад

    The only downside to a web viewer is it’s not gonna fly in the DOD or government. Altho from my last look you can run it on a VM used as a sort of server which IT is a bit more okay with. Would be nice to have just a straight up local desktop viewer

  • @shania5214
    @shania5214 Год назад

    Thanks for this informative talk! Is there perhaps a tutorial on how to use the webviewer?

  • @naninano8813
    @naninano8813 Год назад

    nerfstudio turned out to be suitable for gaussian splats too

  • @OlliHuttunen78
    @OlliHuttunen78 Год назад

    Great presentation! I've certainly come across NeRF studio while researching this topic, but it's really great to hear what's behind it and who does it. Good luck with your project. We live in exciting times.

  • @jimj2683
    @jimj2683 Год назад

    Imagine if the future of Google Earth was like this and you could drive around and explore every place in great detail.

  • @FrenchDigitalProduction
    @FrenchDigitalProduction Год назад

    Congratulation!

  • @vveksuvarna
    @vveksuvarna Год назад

    So technically, could one use an image sequence and get a series of 3d models that could be rendered as an animation? This could make a huge difference in creature vfx workflows.

  • @mickipixel
    @mickipixel Год назад

    That was radical!!, well done and beautifully executed 👍👍

  • @zenbauhaus1345
    @zenbauhaus1345 Год назад

    great stuff!

  • @gbangetri
    @gbangetri Год назад

    great job🎉

  • @김수웅-d9g
    @김수웅-d9g Год назад

    impressive!!

  • @g-program-it
    @g-program-it Год назад

    cool

  • @li_tsz_fung
    @li_tsz_fung Год назад

    Hello, what do you think about the future of NeRF? I don't know anything about NeRF development, but I've seen a lot of related demos. I feel like there is a big difference between NeRF based on photos, and generated nerf. Performance-wise, it seems like NeRF can one day become a fully interactive environment. But we wouldn't be just creating interactions solely based on real life scenes and objects. I thought if Google and Apple reconstruct all their street view and Google earth source photos to NeRF (their new map release seems having), they can then train a network on top of that, and use it to generate scenes. But that would still be mostly buildings and cars.

  • @AikoBasicHula
    @AikoBasicHula Год назад

    英語はよくわからないですが、聞いてるだけで、ワクワク🎉します。❤❤❤❤

  • @dialectricStudios
    @dialectricStudios Год назад

    legends, all of you. I could see a future where there's a NeRF renderer built into blender... we're not there yet but the integration between the two apps right now is so awesome!!

  • @mooncop
    @mooncop Год назад

    based! cannot wait for these to be used for grounding foundation models in hyperreality 👁️‍🗨️

  • @zzzzzzz8473
    @zzzzzzz8473 Год назад

    fantastic overview , really exciting developments in NeRF , thanks !

  • @RKreview8371
    @RKreview8371 2 года назад

    Is there any software for doing this online

  • @sangouda1645
    @sangouda1645 2 года назад

    very interesting, is this going to be productized? when MVP will be released ?

  • @smaran.m
    @smaran.m 2 года назад

    Has this been tested on datasets other than landscape photography? Was thinking this could yield really interesting results when applied to fantasy or science fiction art!

  • @praveenkumar-vx3kw
    @praveenkumar-vx3kw 3 года назад

    amazing.. I need in blender format

  • @PlushTrapEditz
    @PlushTrapEditz 3 года назад

    3:34 That was very interesting.

  • @PlushTrapEditz
    @PlushTrapEditz 3 года назад

    Weird.

  • @thememeofwarzone3700
    @thememeofwarzone3700 3 года назад

    CAN I USE THIS ? AND TRY OUT?

  • @neosmith166
    @neosmith166 3 года назад

    How small windows did you think to put in here? It so hard to see and compare results.

    • @angjoo_kanazawa
      @angjoo_kanazawa 3 года назад

      Hi, what do you mean by "small windows"? the video from 2:55 shows comparison with prior work, you could slow down or pause to see the difference at various steps.

  • @zonesproductions
    @zonesproductions 3 года назад

    There definitely need to be more cat 3d models

  • @JoshJackson
    @JoshJackson 3 года назад

    This is exactly what flying in a dream feels like. The world being created as you move forward.

  • @DenTotino
    @DenTotino 3 года назад

    despacito

  • @idkartist
    @idkartist 3 года назад

    Very dream-like! Excited to see what amazing results global consistency would hold, will be keeping an eye on this for sure!

  • @gabrieleperf7248
    @gabrieleperf7248 4 года назад

    THIS MUSIC DRIVES ME CRAZY!

  • @sadface
    @sadface 4 года назад

    And unintentionally made some of the most exhilarating psychedelic visuals going

  • @pratikd5882
    @pratikd5882 4 года назад

    Wow this is an interesting topic, will surely go through your paper.

  • @noahtaylor7632
    @noahtaylor7632 4 года назад

    Now show me what my great-great-grandchildren will look like! Really cool stuff! Keep it up.

  • @programming_hut
    @programming_hut 4 года назад

    wow it's amazing

  • @virginiarinkel7544
    @virginiarinkel7544 4 года назад

    Absolutely amazing. Wow.

  • @dome8116
    @dome8116 4 года назад

    Amazing reaearch direction you opened up! I really wonder what it would look like having a long term memory. Also what are those pink "artifacts" at 4:30 in the bottom left video?

    • @angjoo_kanazawa
      @angjoo_kanazawa 3 года назад

      we think those are red roofs of European houses in the dataset :) (We tried to avoid structures but some are inevitable)

  • @xxgoblingbeast12321
    @xxgoblingbeast12321 4 года назад

    amazing

  • @ifire4899
    @ifire4899 4 года назад

    great job