Markov Chains: Simulation in Python | Stationary Distribution Computation | Part - 7

Поделиться
HTML-код
  • Опубликовано: 3 июл 2024
  • So far we have a fair knowledge of Markov Chains. But how to implement this? Here, I've coded a Markov Chain from scratch and I've mentioned 3 different ways of computing the stationary distribution!
    #markovchain #datascience #python
    Like my work? Support me -
    www.buymeacoffee.com/normaliz...
    For more videos please subscribe -
    bit.ly/normalizedNERD
    Notebook -
    github.com/Suji04/NormalizedN...
    Markov Chain series -
    • Markov Chains Clearly ...
    Join our discord -
    / discord
    Facebook -
    / nerdywits
    Instagram -
    / normalizednerd
    Twitter -
    / normalized_nerd

Комментарии • 40

  • @elenasmirnova2623
    @elenasmirnova2623 Год назад

    Absolutely great, useful and easy to follow. Many thanks!

  • @chinmayrath8494
    @chinmayrath8494 Год назад +2

    This is an absolutely great channel. i was reading page rank in the university and thought i understood markhov chains well, but upon watching your video i realised there was so much more intuitive things to learn, Thanks a lot!!!

  • @thanawutth
    @thanawutth 2 года назад

    Great Video! Thank you

  • @Mutual_Information
    @Mutual_Information 3 года назад +3

    Excellent! The eigenvector perspective is cool - shows how they, once again, reveal the most important characteristics of a system.

  • @folkertendtz2740
    @folkertendtz2740 Год назад

    Man your outro is awesome!

  • @mgetommy
    @mgetommy 3 года назад +2

    Lol just solved this problem for my code right before you posted this video! Your explanation would have saved me a decent amount of time

  • @facundofelix5918
    @facundofelix5918 3 года назад

    Great video! Greetings from Argentina

  • @JavierGaleano
    @JavierGaleano 3 года назад +1

    Great video!
    I have a doubt. I think the probability function should be divided by "len (seq)", do I?

  • @prod.kashkari3075
    @prod.kashkari3075 3 года назад +1

    How could I plot a graph of the random walk over each iteration?

  • @eduardoduarte9230
    @eduardoduarte9230 2 года назад

    Just a question. If I would like to find outlier sequences, say, the ones with a very low probability, it is clear that I just need to use your last example and calculate some kind of percentile threshold on my dataset of probabilities of chains to isolate the outliers. I am dealing with sequences of different length, so, bigger sequences will naturally tend to 0 due to the fact that probabilities are between 0 and 1. The question is... I am using geometric mean of the transitions, this is, after multiplying all the probabilities like you do, I calculate the nth root of that product, this to get a "better value" that is not affected by the chain length (in this case n where n can be between "a" and b" for some a,b) in order to be able to compare them, is this the correct approach for this problem ? Thanks

  • @angitd3766
    @angitd3766 3 года назад

    U r the best

  • @kartikeybisht1309
    @kartikeybisht1309 2 года назад +1

    can you make video on HMM practical implementation please

  • @xviruzz_platinum151
    @xviruzz_platinum151 Год назад

    Supose that we a huge A matrix (realy big dimension). Would be faster/cheaper to use the nontecarlo aproach rather than finding the eigenvectors?.

  • @marefatmansouri9289
    @marefatmansouri9289 7 месяцев назад

    Thank you for your Video, I just want to know some more details of the last part. In how many iterations of the Markov chain do you expect that see the specific random walk? As we know by increasing the iteration of random walks it would be more chance to appear spesific random walk. can you please clear this part?

  • @TheDunningKrugerEffectisReal
    @TheDunningKrugerEffectisReal Месяц назад

    To quote South Park:
    "Pizza, french fries, pizza, french fries....see? he should of done pizza instead of french fries."

  • @afk4dyz
    @afk4dyz 3 месяца назад

    How do you determine the probability of the transition matrix?

  • @anushaganesanpmp7602
    @anushaganesanpmp7602 2 года назад

    can you make practical implementation video on HMM please

  • @JohannesLippmann
    @JohannesLippmann 3 года назад +4

    Method 2 curls my nails a bit. Instead of of multiplying A many times you could just square A again and again, which will lead to A^(2^n) after n steps. That would be so much faster.

    • @simonmasters3295
      @simonmasters3295 2 года назад

      Good point, but at this level of matrix dimensionality it computes fast enough anyway...

  • @roc7880
    @roc7880 Год назад

    can you make a full course on stats and coding? i would be wiling to pay for the service. thanks for the content.

  • @mgetommy
    @mgetommy 3 года назад

    I don't know if you mentioned, but google's search algorithm uses these stationary distributions!!

    • @NormalizedNerd
      @NormalizedNerd  3 года назад +3

      Yeahh!...No, I didn't mention that in this video.

  • @kaushclar4189
    @kaushclar4189 3 месяца назад

    is it possible to trade NIFTY india using MARKOV chain ? mostly on the LONG side?

  • @divyanandlalsahetya9324
    @divyanandlalsahetya9324 2 года назад +1

    Is there a way of verifying the values of stationary state?

    • @simonmasters3295
      @simonmasters3295 2 года назад

      He's just shown you three methods. If they agree, no problem. In an earlier vid if the system is oscilatory the stationary state will not settle.

  • @SF-fb6lv
    @SF-fb6lv 2 года назад

    I can has Baum-Welch algo next pls?

  • @arichandranr3626
    @arichandranr3626 2 года назад

    Hi. How to do it for time series data?

    • @simonmasters3295
      @simonmasters3295 2 года назад

      Very good point, especially where the states have long lives or variation time between or in transition

  • @punyashreebasappa5661
    @punyashreebasappa5661 2 года назад

    How to run this

  • @gaurangmohta168
    @gaurangmohta168 3 года назад

    Hi. Awesome videos! Which college are you/were you from?

    • @NormalizedNerd
      @NormalizedNerd  3 года назад +2

      Kalyani Government Engineering College.

  • @mauriciobonatte8601
    @mauriciobonatte8601 3 года назад

    Why didn't you use FOR loops instead of WHILE loops?

  • @mayurdeo627
    @mayurdeo627 3 года назад +1

    Last time it was a hamburger and not a hot dog😂