Procedural Modeling of a Building from a Single Image (Eurographics 2018)

Поделиться
HTML-код
  • Опубликовано: 1 окт 2024
  • ADDITIONAL INFO: www.cs.purdue....
    ABSTRACT: Creating a virtual city is demanded for computer games, movies, and urban planning, but it takes a lot of time to create numerous 3D building models. Procedural modeling has become popular in recent years to overcome this issue, but creating a grammar to get a desired output is difficult and time consuming even for expert users. In this paper, we present an interactive tool that allows users to automatically generate such a grammar from a single image of a building. The user selects a photograph and highlights the silhouette of the target building as input to our method. Our pipeline automatically generates the building components, from large-scale building mass to fine-scale windows and doors geometry. Each stage of our pipeline combines convolutional neural networks (CNNs) and optimization to select and parameterize procedural grammars that reproduce the building elements of the picture. In the first stage, our method jointly estimates camera parameters and building mass shape. Once known, the building mass enables the rectification of the facades, which are given as input to the second stage that recovers the facade layout. This layout allows us to extract individual windows and doors that are subsequently fed to the last stage of the pipeline that selects procedural grammars for windows and doors. Finally, the grammars are combined to generate a complete procedural building as output. We devise a common methodology to make each stage of this pipeline tractable. This methodology consists in simplifying the input image to match the visual appearance of synthetic training data, and in using optimization to refine the parameters estimated by CNNs. We used our method to generate a variety of procedural models of buildings from existing photographs.
    AUTHORS: Gen Nishida, Adrien Bousseau, Daniel G. Aliaga.

Комментарии • 35

  • @mythomaniac9903
    @mythomaniac9903 2 года назад +2

    The link in the description is dead.
    Could you inform me where the content is now, if it still exists?
    Thank you.

  • @snrnwl13
    @snrnwl13 5 лет назад +5

    This can definitely be used in VFX studios to generate massive amount of building models for digital matte painting. Amazing work!

  • @gogopet
    @gogopet 2 года назад

    Hi i would like ask cutom program
    Can you contact ?

  • @autochromes
    @autochromes 4 года назад +3

    please make an update on this, people are dying to try this but people aren't able to get it to launch. the project seems so promising!

  • @mehmetalpersahin86
    @mehmetalpersahin86 4 года назад +1

    Hi Gen Nishida, I tried to run this project yesterday but i had some .dll errors. How can i contact with you? If i will contact to you i will give all information about errors. This project is so important me.

  • @Mehrdad995GTa
    @Mehrdad995GTa 4 года назад +1

    where do all these techs go?? they get presented and vanished soon after.
    do you know how much money you can earn selling these to Big companies????
    wth is wrong?

  • @ericliu2238
    @ericliu2238 3 года назад +1

    Wow amazing work! I want to know, It's open source on github?

  • @tonybobay6276
    @tonybobay6276 5 лет назад +3

    Absolutely amazing. This would be incredibly useful in the commercial real estate world

  • @wurstpeter754
    @wurstpeter754 3 года назад

    The link doesn't work anymore. Is this still available anywhere else ?

  • @gogopet
    @gogopet 2 года назад

    hi i would like to concern your tool
    can i buy your tool

  • @sintesiz
    @sintesiz 5 лет назад +2

    Hi Gen, I downloaded the EXE I would like to know how exactly do you use this?

    • @DaveMbrr
      @DaveMbrr 5 лет назад

      Did you get the executable to launch? I got stuck with UI not regonizing qt windows plugin since i don't know which platform it is looking for and so on..

    • @jimgleaves
      @jimgleaves 5 лет назад

      @@DaveMbrr Hi, so far I have not been able to get this running either although my errors are different. The executable is looking for specific NVIDIA .dll files which are not in the package. I spent some time looking for these files online but the current NVIDIA installer has more recent versions which don't work with the executable. What errors were you seeing?

    • @LeagueOfLegendsPakistan
      @LeagueOfLegendsPakistan 4 года назад

      @Sba Stuff you need cuda 7 to fix cuda dll errors, im also stuck on QT, the folder have QT5 files, so i think it need QT5, I tired QT5.6.3 msvc and mingw but it didnt work. :(

    • @JohnSmith-oo8nf
      @JohnSmith-oo8nf Год назад

      do any of you have the exe still installed that you can send?

  • @kavehdadgar2720
    @kavehdadgar2720 6 лет назад

    Wow. It was fascinating. I don't know if i can make it with grasshopper or not.

  • @Mehrdad995GTa
    @Mehrdad995GTa 5 лет назад

    shot up and take my *money*
    a game changer here for studios

  • @tjoen1op1
    @tjoen1op1 6 лет назад

    Fantastic results so far, I must say!
    So is this using the alexnet that's in tensorflow?
    And what are your machine specifications, like what gpu graphics card?
    Kind regards,
    Theun

  • @ivovanroij
    @ivovanroij 6 лет назад

    すごいです!ありがとうございます!

  • @rkrishnasanka
    @rkrishnasanka 6 лет назад

    So I accidentally ended up seeing your video. Its interesting to see that you use ML to extract grammars from datasets. Is there a starting point for looking into this area: "Extracting grammar from datasets using datasets" ?

  • @gimmethevape
    @gimmethevape 2 года назад

    this is epic shit I've ever seen