Quarkus (Java) vs Fiber (Go): Performance Benchmark in Kubernetes

Поделиться
HTML-код
  • Опубликовано: 30 окт 2024

Комментарии • 479

  • @AntonPutra
    @AntonPutra  2 месяца назад +14

    ► What should I test next?
    ► AWS is expensive - Infra Support Fund: buymeacoffee.com/antonputra
    ► Benchmarks: ruclips.net/p/PLiMWaCMwGJXmcDLvMQeORJ-j_jayKaLVn&si=p-UOaVM_6_SFx52H

    • @ooijaz6063
      @ooijaz6063 2 месяца назад +1

      Are you sure that both apps are using same amount of connections in pool? Connection pool often makes most of the performance diff in this kind of benchmark. Quarkus defaults to 20 concurrent connections, and pgpool to 4 or runtime.NumCPU() from what I have read.
      Have you check performance for more than 20 connections in a pool?

    • @AntonPutra
      @AntonPutra  2 месяца назад +2

      @@ooijaz6063 I used the defaults, but for the next tests, I'll double-check how many connections are actually opened on the PostgreSQL side.

    • @111segasonic
      @111segasonic 2 месяца назад +1

      Perhaps you could also try helidon SE instead of quarkus. Helidon was built from the ground up by Oracle labs to use the latest java tech like virtual threads to serve requests

    • @AntonPutra
      @AntonPutra  2 месяца назад +1

      @@111segasonic thanks i'll try it out

    • @Comeyd
      @Comeyd 2 месяца назад

      I’d love to see Rust thrown into the mix as well!

  • @PanicAtProduction
    @PanicAtProduction 2 месяца назад +94

    A benchmark must be like this. State of art. Good job!

    • @AntonPutra
      @AntonPutra  2 месяца назад +1

    • @ChengPhansivang
      @ChengPhansivang 2 месяца назад

      What is state of art mean ?

    • @AntonPutra
      @AntonPutra  2 месяца назад

      @@ChengPhansivang i guess something that people can relate to :)

  • @avalagum7957
    @avalagum7957 2 месяца назад +247

    Wow, this is really good. The setup (kubernetes cluster, prometheus, grafana ...) deserves another video.

    • @AntonPutra
      @AntonPutra  2 месяца назад +33

      Thanks! Just in case, the source code with all of these components is in my GitHub: github.com/antonputra/tutorials/tree/main/lessons/201/monitoring.

    • @rajivkumar-ub6uj
      @rajivkumar-ub6uj 2 месяца назад +7

      Hey, can you make a video on how to setup this in local? May be with k8s supplied with docker desktop if relevant?

    • @AntonPutra
      @AntonPutra  2 месяца назад +6

      @@rajivkumar-ub6uj i think so, the easiest way is just package everything as docker compose or perhaps just use local minuke cluster. i'll think about it

    • @rajivkumar-ub6uj
      @rajivkumar-ub6uj 2 месяца назад +3

      @@AntonPutra yes, compose is the best way for larger audience. Would appreciate if you can share the compose config for this, thanks in advance

    • @AntonPutra
      @AntonPutra  2 месяца назад +1

      @@rajivkumar-ub6uj ok

  • @ДеянДелчев-ы9з
    @ДеянДелчев-ы9з 2 месяца назад +110

    I am go fanboy but I really like applications written in Quarkus. My first language was Java and it is mind-blowing how fast and light Quarkus feels compared to Spring

    • @AntonPutra
      @AntonPutra  2 месяца назад +13

      some people say it is slower than jvm based, I'll see if I can test it

    • @lufenmartofilia5804
      @lufenmartofilia5804 2 месяца назад +9

      You would be surprised how far spring came his way. With that being said, for long running app spring boot as none aot compiled would remain faster thanks to the jit compiler. Quarkus is really only good of you need fast startup or low ram consumption

    • @awesomesuprise9141
      @awesomesuprise9141 2 месяца назад

      @@lufenmartofilia5804 good point

    • @AntonPutra
      @AntonPutra  2 месяца назад +2

      @@lufenmartofilia5804 will test, when you say long running, how long?

    • @chrisfreel
      @chrisfreel 2 месяца назад +1

      @AntonPutra long running is at least 10,000 tx before you start measuring. In the real world, weeks or months...

  • @SeySvK
    @SeySvK 2 месяца назад +45

    Love these benchmark videos, nice work

  • @TweakMDS
    @TweakMDS 2 месяца назад +25

    This second test scenario is absolute perfection in testing real world applications. It's easy to get excited about a performance difference of like 400% (for example) in a synthetic benchmark, but by including database, storage and (de)serializing, it gives a much more nuanced picture of how it would actually scale and perform. In this case I would say both applications performed well and comparable. I'd be interested in a bit of a deeper dive in these applications by including opentelemetry and seeing what functions might bottleneck.

    • @AntonPutra
      @AntonPutra  2 месяца назад +4

      Thanks. Well, in some tests, I used OpenTelemetry clients with this Prometheus client in both Go and Java. I'm wondering what else you would instrument besides these function calls to S3 and the database. I might include it in the following videos.
      example - github.com/antonputra/tutorials/blob/main/lessons/201/go-app/images.go#L50-L62

    • @TweakMDS
      @TweakMDS 2 месяца назад

      @@AntonPutra Must have missed that detail, very well done and thanks for the reply!

    • @AntonPutra
      @AntonPutra  2 месяца назад

      @@TweakMDS thanks!

    • @GBXS
      @GBXS 2 месяца назад

      But it doesn't do that much. The programs doesn't change any data. It just uploads it.

    • @AntonPutra
      @AntonPutra  2 месяца назад +2

      @@GBXS I'm thinking about adding an additional test with Kafka consumer/producer and perhaps a simple ETL pipeline. Any suggestions?

  • @ninjaasmoke
    @ninjaasmoke 2 месяца назад +16

    Finally! A detailed comparison that just doesn’t test the /hello-world endpoint

  • @jorgetovar621
    @jorgetovar621 2 месяца назад +21

    This is definitely the best DevOps channel.

  • @GabrielPozo
    @GabrielPozo 2 месяца назад +11

    Love these benchmark videos, your work is amazing!

  • @renbangbprd7236
    @renbangbprd7236 Месяц назад +18

    Please do Java Spring Boot (Native) vs Spring Boot (JDK) VS Quarkus (Native) vs Quarkus (JDK)

    • @AntonPutra
      @AntonPutra  Месяц назад

      ntoed!

    • @stealth-350
      @stealth-350 13 часов назад

      And add Micronaut (Native & JDK) to this chain, plz

  • @cewa44
    @cewa44 Месяц назад +2

    From the whole video I have profited so much in percentails. You have clear so much

  • @RayAndrewsDev
    @RayAndrewsDev 9 дней назад

    I really admire the effort you put into describing why you chose your testing methodology as well as the testing itself

  • @DillPL
    @DillPL 2 месяца назад +28

    Interesting comparison, BUT:
    - the first tests does not test the startup time itself (should be

    • @AntonPutra
      @AntonPutra  2 месяца назад +16

      I try to improve each time I create benchmarks. Next time, I will definitely use the v2 Go SDK and apply some other recommendations from your side. Thank you for taking the time to leave this feedback.

    • @DillPL
      @DillPL 2 месяца назад +4

      @@AntonPutra glad I could help and you haven't taken it as a personal attack or something :D
      I really value your videos and open source code for every video!
      Looking forward to seeing more of them.

    • @AntonPutra
      @AntonPutra  2 месяца назад +8

      @@DillPL thank you! i actually implemented your suggested idea in the new video and reduced the size by 6 mb (45 -> 39) :) - ruclips.net/video/56TUfwejKfo/видео.html
      will try other tips next as well and finally update that sdk lol

  • @gasha1137
    @gasha1137 Месяц назад +2

    бро ты красавчик, ничего лишнего, все по делу, качество и битрейт на высоте, видосик красивый, респект!

  • @mayboroda
    @mayboroda 2 месяца назад +1

    First of all, this is the best content on youtube so far.
    Well done. Thank you!

  • @Serizon_
    @Serizon_ Месяц назад +1

    this is so professional!
    I love it!
    please do bun vs deno v2
    since deno has gotten npm compatibility , the only difference now between bun and deno (aside from being written in zig and rust) is the speed (I think , both have gotten very nice std library)
    please do a benchmark comparing everything!

  • @or1699
    @or1699 2 месяца назад +1

    Great video! The benchmarks were really helpful. Keep up the great work!

  • @siya.abc123
    @siya.abc123 2 месяца назад +69

    Would love to see C# vs Go

    • @krzysi3k-yt
      @krzysi3k-yt 2 месяца назад +5

      C# vs Go vs Java would be nice

    • @AntonPutra
      @AntonPutra  2 месяца назад +2

      any specific test scenarios? or the same

    • @krzysi3k-yt
      @krzysi3k-yt 2 месяца назад +6

      @@AntonPutra your current test scenarios are very good so I wouldn't change anything. Regarding C# I would use LTS version (dotnet 8) which is the fastest one amongst other versions according to Microsoft.

    • @AntonPutra
      @AntonPutra  2 месяца назад +8

      @@krzysi3k-yt ok, I'll maybe do it next

    • @1wsm1
      @1wsm1 2 месяца назад +3

      Rust - same tests

  • @ManuelMartinez-nl5cy
    @ManuelMartinez-nl5cy 2 месяца назад +2

    Great videos like the rest of what you do. I'm using your video sto improve my knowledge on cloud/kubernetes area.❤❤

  • @KhoaH11
    @KhoaH11 2 месяца назад +5

    Nice work! The explanation around the benchmark is easy to understand and full of information there. IMHO, you should start to build your own courses on Udemy :)

  • @Bourn77
    @Bourn77 2 месяца назад +10

    please do c# vs Java, use minimal api with AOT for c# and GraalVM or whatever AOT thing Java has.

  • @pi3ni0
    @pi3ni0 2 месяца назад +7

    Nice job, I would like to see Test 2, but with higher RPS

    • @AntonPutra
      @AntonPutra  2 месяца назад +3

      Okay, I might just include additional screenshots under lesson '201' in my GitHub repo

    • @pi3ni0
      @pi3ni0 2 месяца назад

      @@AntonPutra It would be great, thank you Anton!

  • @xelesarc1680
    @xelesarc1680 2 месяца назад +29

    Please test dotnet lastest 8 vs go thanks

    • @AntonPutra
      @AntonPutra  2 месяца назад +6

      ok, comming next

    • @metaltyphoon
      @metaltyphoon 2 месяца назад

      @@AntonPutraensure to use Minimal APIs and compile it AOT.

  • @marcwinner567
    @marcwinner567 2 месяца назад

    Love these benchmarks! 🎉

    • @AntonPutra
      @AntonPutra  2 месяца назад

      thanks! i try to add some extra

  • @mantovani96
    @mantovani96 2 месяца назад +1

    Loved the video, subscribed!

  • @harshwardhanparmar8258
    @harshwardhanparmar8258 2 месяца назад +1

    Amazing video, great job !!

  • @phyohtetpaing44
    @phyohtetpaing44 2 месяца назад +22

    There was a non-blocking Netty server implemented with Spring Reactive Web, which is more efficient.
    for databae approach use R2DBC the reactive nonblocking data repository.
    btw spring also support graalvm and it is not outdated.

  • @henryong7788
    @henryong7788 2 месяца назад +15

    Seems like Java 21 was used but Virtual threads wasn't used for the Quarkus application. Wasn't that the whole point to using newer Java version with the performance improvements and non-blocking reactivity APIs?

    • @AntonPutra
      @AntonPutra  2 месяца назад +7

      yeah, i used java 21. I'll make sure to test virtual threads next time, maybe try to compare different java frameworks as well

    • @henryong7788
      @henryong7788 2 месяца назад +2

      ​@@AntonPutrahey, thanks for making this video.
      Just that needed to point out the code looks to be done in a older/traditional method even though Quarkus has annotations that resolves traditional blocking calls that modern programming languages like Go probably already has underlying.
      Great detailed video as always!
      Maybe I'll try this out on my local machine to test out too!

    • @AntonPutra
      @AntonPutra  2 месяца назад +8

      @@henryong7788 I'll soon be comparing Quarkus with Spring Boot, and I'll make sure to use the latest language features.

    • @EricSouzarys
      @EricSouzarys 2 месяца назад +4

      Virtual Threads are not better in performance compared to fully reactive code.
      Quarkus fully reactive or Spring fully reactive will always beat virtual threads, both in performance and resources usage.

    • @AntonPutra
      @AntonPutra  2 месяца назад +1

      @@EricSouzarys good to know thanks

  • @oleksandrkovtunov
    @oleksandrkovtunov 18 дней назад

    The explanation why java reduces memory usage is pretty simple: gc

    • @framegrace1
      @framegrace1 17 дней назад

      Go has gc too...
      The explanation is because java uses a fixed heap. Normal java reserves the memory from the system upfront and you will see no change for all the run.
      The Quarkus optimizations makes the internal HEAP metrics visible to K8s. But the particularities of java are still visible in those behaviours as defaulting to reserve a lot of memory upfront.

    • @oleksandrkovtunov
      @oleksandrkovtunov 17 дней назад

      @@framegrace1 the java GC could be different at different jvm implementations. But basically it works by simple principle. The jvm perform gc then it see that heap is overused. It based on heap limit.
      So, in this case jvm application started and used some heap. The heap usage isn't reached the GC limit - so don't need to perform gc. When traffic comes to jvm application - it increases the count of created objects and as consequence - increased heap usage. And when heap usage limit is reached then jvm perform gc and all objects created at start of application has been deleted.
      I don't know how GO gc works and looks like it has partially different implementation.

  • @awesomesuprise9141
    @awesomesuprise9141 2 месяца назад

    Wonderful content Anton!

  • @igorgladun5009
    @igorgladun5009 5 дней назад

    Great video! Python vs Node plz with the same scenario :)

  • @Nick-yd3rc
    @Nick-yd3rc 2 месяца назад +5

    Interestingly, in your Test scenario 2, your Quarkus app is spiking in DB latency while having constant times in between, as if the Postgres client would be idling to gather the queries (or waiting on a lock?) and send them in bursts.

    • @nisem0no
      @nisem0no 2 месяца назад +1

      If this is indeed the case it does make the results a bit harder to pull conclusions from.

    • @AntonPutra
      @AntonPutra  2 месяца назад

      yeah, I noticed it

  • @humanardaki7911
    @humanardaki7911 2 месяца назад +5

    "There are no solutions. There are only trade-offs" Thomas Sowell
    servers are cheaper than developer time

    • @AntonPutra
      @AntonPutra  Месяц назад

      true

    • @andreipushkin_globant
      @andreipushkin_globant Месяц назад +1

      Not always true. Paying for each CPU cycle in the cloud you can easily get out of budget on scale. That is why optimization and algorithm knowledge is valuable again - it helps to save money.

  • @yangshijie
    @yangshijie 25 дней назад

    i like this working. You are so nice!!

  • @Gohel95
    @Gohel95 Месяц назад +1

    great demo. as Java dev it hurts seeing java losing even with quarks native build 😢😢

    • @AntonPutra
      @AntonPutra  Месяц назад

      I'll make some more with improved Java soon

  • @alvinxyz7419
    @alvinxyz7419 2 месяца назад +1

    this is very neat, i love it

  • @yuriimalikov9855
    @yuriimalikov9855 12 дней назад

    Love your videos! What tool do you use for creating those amazing animations and mounting videos?

  • @dweblinveltz5035
    @dweblinveltz5035 Месяц назад

    Very nice video! Seems like if cost-cutting is of great concern, you'd lean towards go to keep CPU utilization down. I would love to see a similar comparison video between Java and JavaScript/Node.js.

  • @robertomoreno7906
    @robertomoreno7906 9 дней назад

    Nice comparison! Though I wouldn't ever compare Go vs Java native for long time runners as this one. It is true that the metrics of java at startup time would be much (much) worst but bear in mind that java has been built thinking in the startup as an edge case scenario and the JVM does a lot optimisations while the program is running, it would be interesting if java is able to beat Go in the long run. In the short run I think that there is no possible discussion and Java Native is just a work around.

  • @alche8411
    @alche8411 Месяц назад +6

    Great job!
    But a few comments:
    Spring supports building native images as well, and they have maven/gradle plugins and a dedicated project Spring Native for this case. Actually, we are using it in production and building most of the Spring apps in native images.
    Summary: GO is faster, then JVM based stuff, well no surprise here :)
    In general, Quarkus doesn't give anything interesting compared to Spring, it's just a bit more modern and doesn't have much legacy stuff.
    What might be interesting to look at in this regard is Micronaout, because it does a fundamentally different Framework (compile-time and supports native images out of the box in comparison with runtime Spring with additional projects and layers for native support). Most likely Micronaout will show similar to GO numbers.

    • @AntonPutra
      @AntonPutra  Месяц назад

      thank you for your feedback. i'll get back to the java world soon, maybe next week, and make a few improvements

  • @robertoaraneda6006
    @robertoaraneda6006 Месяц назад +2

    thanks for sharing.. can you do it with nodejs :P?

  • @shamilAliyev92
    @shamilAliyev92 2 месяца назад +11

    Could you do the same test for Kotlin and Java ? Or Kotlin and Go. Please 🙏

    • @AntonPutra
      @AntonPutra  2 месяца назад +3

      ok let me see

    • @belkocik
      @belkocik 2 месяца назад +2

      ​@@AntonPutra Would love see a Quarkus and Kotlin benchmarks compared to Spring Boot and Kotlin

    • @AntonPutra
      @AntonPutra  2 месяца назад

      @@belkocik 🫡

  • @ramencombo
    @ramencombo Месяц назад +1

    Why does Java's memory usage is high when it is idle? Also will it also go high when it is idle after processing requests?

  • @Jollyrogger805
    @Jollyrogger805 2 месяца назад +1

    I work on both Java and go, your results are similar to my observations. Java consumes memory due to too much of autoconfigurations which involves hell lot of classes + some of jdk had garbage collection issue but if you develop an enterprise ready application in go with distributed tracing, logging, metrics, database writes heavy operation etc, their performance is almost equivalent. I had to manually write all those functionalities in go Lang due to lack of autoconfiguration and libraries

    • @nojerome497
      @nojerome497 Месяц назад +2

      Very good point. Java frameworks like Quarkus are doing a lot to make large scale application development easier. All of that stuff it's doing will affect runtime performance.

  • @havefun599
    @havefun599 2 месяца назад +2

    Like always you rock, can you make a video about database architecture for production like MySql Replication Group etc, Thank you

    • @AntonPutra
      @AntonPutra  2 месяца назад

      thank you! let me see

  • @jesulobajohn8468
    @jesulobajohn8468 Месяц назад

    I've been seeing these videos for a while ​and all I see is my railway bills

    • @AntonPutra
      @AntonPutra  Месяц назад

      😂 i have some aws credit

  • @hectors.1644
    @hectors.1644 2 месяца назад

    Very Nice! great analysis

  • @KushLemon
    @KushLemon 2 месяца назад

    Enjoyable video. Subscribed.

    • @AntonPutra
      @AntonPutra  2 месяца назад

      thank you! more to come

  • @S4ntia60
    @S4ntia60 4 часа назад

    JIT optimization are taken out in quarkus graalVM builds for obvious reasons. While the benefits of being lower level from Graal are great, JIT optimizations are not to be underestimated and they start to trigger later on the execution so they will be less visible at first

  • @yuryburkouski
    @yuryburkouski 2 месяца назад +1

    good test after previous tries ;) but I would not accentuate memory consumption at the start of compiled java, as it does not affect anything. Also it looks like cpu doesn't do anything, so no reason to seriously compare 3% with 5%. But latency values are valuable! PS: looking at the low cpu consumption test I got an idea to test cpu intensive application. Try to create something like a redis (hashmap is fast, lets use treemap and its concurrent versions), the app will add, update and get some data, for example count of values that are greater than received in a controller. PPS: interesting to see how regular java 21 works with virtual threads, but I heard that java file io on linux is synchronous and only 22 will be modern, so it could be a reason why you got these values in the current test. Also testing regular java in a container is tricky, it’s better to test different Xmx-Xms values first, I mean starting java under the memory limit of 500mb is not the same as with 2000mb (so using compiled java leaves that headache, but compiled has lower throughput and latency :) )

    • @AntonPutra
      @AntonPutra  2 месяца назад

      Thanks, I appreciate your feedback.

  • @Kessra
    @Kessra Месяц назад +1

    Small improvement suggestion: In Java you could use a record instead of a class. This shouldn't have a big impact on the test results but at least spares you a bit of typing.
    It would have been great to include a base Java and a Spring/Spring Boot comparison deployed into a java21 image container here as well just to see how much of an impact Quarkus and the native container optimization really yields. So far I couldn't convince anyone at our company to try out Quarkus.
    Just a question out of interest: Are you going to create a benchmark framework where similar tasks are done by various language implementations and then release your findings to the public? I just stumbled across an other video and then this one was recommended to me, and to me it looks like your videos basically doing that but just with a smaller and more comprehensible scope. So a combination of runtime analysis of different languages for various tasks would definitely be helpful, I guess

    • @AntonPutra
      @AntonPutra  Месяц назад

      thanks, yes i'll get to Java soon and I'll try to improve a few things

    • @MovinduLochanaWijethunge
      @MovinduLochanaWijethunge Месяц назад

      @@AntonPutra Can you try using both Spring Boot Native and Quarkus to see how much of a performance difference they have

    • @AntonPutra
      @AntonPutra  Месяц назад

      @@MovinduLochanaWijethunge yes will do

  • @helloworld7796
    @helloworld7796 Месяц назад

    Okay, you got me now. I will start trying prometheus and grafana. The question I have is which tools do you use for load testing? You are using word "client" for this. I assume you use some kind of tools, like jmeter, k6 or?

  • @zeroows
    @zeroows 2 месяца назад +1

    Add rust and javascript to the mix. Thank you for your channel

    • @AntonPutra
      @AntonPutra  2 месяца назад

      will do, i'm thinking about webassembly vs js, what do you think?

  • @ChristopheDCPM
    @ChristopheDCPM 5 часов назад

    what does Java needs to have request coming in to lower its memory consumption ?

  • @nabeelmemon6852
    @nabeelmemon6852 Месяц назад

    Interesting. These tests could be extended to compare Hotspot VM, Generational ZGC and a few other switches. Can you make a video of your entire testing setup (focusing on docker, kubernetes, prometheus and grafana) from scratch? I think it's totally worth it.

  • @HeyItsSahilSoni
    @HeyItsSahilSoni Месяц назад

    Thia is all good, checking how well it performs, but if its not throttling, anything is fine as long as client latency is not out of whack.
    I think some stress testing will also give good comparision, like you did with node and go

    • @AntonPutra
      @AntonPutra  Месяц назад +1

      'll come back to java soon with improved benchmarks

  • @bonk1463
    @bonk1463 2 месяца назад +1

    hey good test! can you test with go-chi instead of Fiber? go-chi is more optimized in terms of memory usage so that might explains why Java was using less memory in that first test.
    Overall, good video! Keep it up

    • @AntonPutra
      @AntonPutra  2 месяца назад

      Thank you! I used Chi for one of my projects, but I think memory usage doesn’t play a major role in the user experience, such as client latency etc..

  • @samsurya283
    @samsurya283 Месяц назад

    Woow amazing effort Man, how about Rust vs Go ?

  • @kamurashev
    @kamurashev 2 месяца назад +4

    It would be interesting to see what happens if you push requests to the limits and how high that limits are.
    Additionally for the Java it can be build to native image with spring boot as well. It sometimes not that smooth though but honestly I expect it to perform better with spring boot.

    • @ooijaz6063
      @ooijaz6063 2 месяца назад +5

      Idk, native image crashes randomly and have lower performance than jited code atm. It's good only (if not crashes) for low traffic applications on serverless.

    • @kamurashev
      @kamurashev 2 месяца назад

      @@ooijaz6063 I haven’t loaded my test app extensively but for me it worked ok and had better performance.

    • @ooijaz6063
      @ooijaz6063 2 месяца назад +2

      It may change though with strong adoption of virtual threads in next few years and servlet api will be good again.

    • @AntonPutra
      @AntonPutra  2 месяца назад

      I have the same limits for both: github.com/antonputra/tutorials/blob/main/lessons/201/deploy/java-app/deployment.yaml#L27-L33, and I run them on dedicated nodes using the ESXi Hypervisor.

    • @kamurashev
      @kamurashev 2 месяца назад +5

      @@AntonPutra I do understand, what I wanted to say is what happens if you push client requests higher and higher. The load seemed to be not that high, so the light load conditions were tested but what would happen under high load? It can be really detrimental in real world.

  • @namila007
    @namila007 2 месяца назад +1

    great video!!

  • @GreenVanGeek
    @GreenVanGeek Месяц назад

    Nice video. One comment. Scale up/down is increase or decrease the machine resources like CPU and memory. Scale in/out y horizontal scaling ;)

  • @bernhardbaumgartner4702
    @bernhardbaumgartner4702 День назад +1

    What’s the explanation for the memory profile of Quarkus, can someone explain this?

    • @AntonPutra
      @AntonPutra  День назад

      i'll run some more tests in near future

    • @bernhardbaumgartner4702
      @bernhardbaumgartner4702 18 часов назад

      I’m just wondering why the memory usage goes up and up and up at the beginning, and at some point (reaching a threshold or something?) something like an aggressive GC seems to kick in never letting memory usage go up again.

  • @larryliang6748
    @larryliang6748 Месяц назад

    How much memory was allocated to each program? the vidoe focused on showing the difference but I wanted to know say is a 25% usage of what. thx

    • @AntonPutra
      @AntonPutra  Месяц назад

      256Mi - github.com/antonputra/tutorials/blob/main/lessons/201/deploy/java-app/deployment.yaml#L32

  • @gabrielmartinez2455
    @gabrielmartinez2455 2 месяца назад

    C# vs Go would be amazing to see. Maybe add to test 2 some simple reads from the database, and maybe add test 3 with some simple data structure or general purpose calculations to see how well each language performs. Amazing content. I am currently writing a high performance C# application for the government with .Net 8 and it is incredibly fast. I wonder if .net 8 has been improved so much that might even beat Java at this point.

    • @AntonPutra
      @AntonPutra  2 месяца назад

      Can you elaborate on using simple data structures or general-purpose calculations to evaluate how well each language performs? I don't really want to run fibonacci anymore lol

    • @gabrielmartinez2455
      @gabrielmartinez2455 2 месяца назад

      @@AntonPutra You can try to implement 3 different types of algorithms (In addition to the 2 tests you already did in your previous video).
      1- Searching Algorithms (linear search) - ex: Create a List of 1 million objects (person: {Id, Name} - Id: must be unique integer 1 to 1,000,000. Name: generate random string. Populate your list with 1 objects (Person). Test: Generate a random Int value from 1 to 1million and find the Person object (by ID) using the random generated Int, and get the Name, then find the object in the list (by Name) compare and validate both ID match
      2- Sorting Algorithms (sort the entire 1 million object (person) by name.
      3 - File I/O Operations - generate random Int value from 1 to 1 million, find the Person in the List, write the Person's name to the first line in a file, if file already contains a line replace with the new name.
      Leverage ChatGPT to create the code for you in both languages. Just some ideas, lol

    • @AntonPutra
      @AntonPutra  2 месяца назад +1

      @@gabrielmartinez2455 thanks! i'll try it

  • @dukim632
    @dukim632 2 месяца назад

    this is a great video! tnx!

  • @ugurata
    @ugurata 7 дней назад

    Java runtimes were historically designed to consume the resources of the whole VM so may be you can compare a Java app running on a JVM (not a native image but a hotspot JVM) on a VM with 4 cores and 4 GB RAM vs a go app running on Kubernetes using that same VM

  • @john33john33
    @john33john33 2 месяца назад +2

    a good indeed comparison.
    only one thing wanna further look into,
    how do same test behave at high throughput like 500 / 1000+ req/s

    • @AntonPutra
      @AntonPutra  2 месяца назад

      Thanks, I may include screenshots or just improve my tests in the future.

  • @madmasontv7254
    @madmasontv7254 2 месяца назад

    Thanks for you video! I really like it. Could you do the same tests for Spring vs Quarkus?

    • @AntonPutra
      @AntonPutra  2 месяца назад +1

      thanks, will do, but first rust vs go

  • @germandavid2520
    @germandavid2520 2 месяца назад +2

    Would be cool to see in a future video the framework web for Kotlin called Ktor.

  • @furylao8107
    @furylao8107 18 дней назад

    really nice approach to monitoring performance. can you make a similar video but with java profiling tool to detect which specific part of the code must be reworked?

  • @esatozturk5439
    @esatozturk5439 2 месяца назад

    Perfect work 👍

  • @r1nlx0
    @r1nlx0 Месяц назад

    Is this using graalvm oracle or graalvm community edition ? very interest on comparing graalvm oracle AOT & JVM based vs golang

    • @AntonPutra
      @AntonPutra  Месяц назад

      it should be the community version. i'll make some more java content in the near future.

  • @muray82
    @muray82 Месяц назад

    It would be good to change a bit what the application is doing. In our company we have a piece of code that is meant to validate if we don't have any delays in network stack. To do so we tell the app to generate random 1000 bytes and sent that to client. With that nothing is cached.

  • @alexanderv5975
    @alexanderv5975 Месяц назад

    Hi. Nice video indeed. Can you explain why Java uses significantly less memory under load then in idle run?

  • @vishnugovindan8550
    @vishnugovindan8550 Месяц назад +2

    What about micronaut? Would love some benchmarks on this 😊

    • @AntonPutra
      @AntonPutra  Месяц назад

      ok, i'll take a look, i'll get back to java soon

  • @kentra-io
    @kentra-io Месяц назад +1

    Very informative!
    How about comparing performance of java vs python stream processors in Apache Flink?

    • @AntonPutra
      @AntonPutra  Месяц назад

      thanks, yes, i was thinking about spark/flink and different apis: python, java, scala, etc.

  • @ionutale1950
    @ionutale1950 2 месяца назад +1

    nice comprarison, this could work great on a batch.
    how is it going to compare on an app, that has peaks during a specific time of the day?

    • @AntonPutra
      @AntonPutra  2 месяца назад

      Thanks! There is a very small difference in terms of scalability; both are small with a fast startup time. I think Go is a little more efficient, so potentially you would need fewer compute resources.

    • @ionutale1950
      @ionutale1950 2 месяца назад +1

      ​@@AntonPutra the way java is using memory with GraalVM is very smart, is like observing the needs, then optimise the RAM needs.
      This could suggest that we could provision the JAVA container with a smaller POD in term of RAM.
      My concern is: how well does java handle random peaks?
      if we have 200 req/s, than right after the RAM stabilises suddenly we get 500 req/s, how well does JAVA handle that peak?
      is java going to panic and ask for wayyyy more memory than it actually needs?
      if this is the case, than the JAVA app may actually crash for insuficient container memory.
      Does it make any sense, what i've just said?

    • @AntonPutra
      @AntonPutra  2 месяца назад

      @@ionutale1950 yes, it does. i'll try to configure the client next time to simulate such spikes when I compare spring boot with quarkus

  • @ПавелАвдеев
    @ПавелАвдеев 2 месяца назад +4

    I'd be interesting to compare Hotspot (various GC) vs GraalVM(Quarkus, SpringBoot)

    • @AntonPutra
      @AntonPutra  2 месяца назад +1

      ok let me see

    • @terribleprogrammer
      @terribleprogrammer 2 месяца назад

      It would be interesting to test long term throughput in this comparison.

    • @AntonPutra
      @AntonPutra  2 месяца назад

      @@terribleprogrammer how long? day, 2, a week?

    • @terribleprogrammer
      @terribleprogrammer 2 месяца назад

      @@AntonPutra one week would be interesting. You can also mix up jvm, graalvm and go Lang in a single video

    • @AntonPutra
      @AntonPutra  2 месяца назад

      @@terribleprogrammer ok, i'll see if it makes any difference and if it does i'll make something

  • @Nephtys1
    @Nephtys1 2 месяца назад +2

    Can someone explain the extreme drop in memory usage for Java here?
    Under Hotspot JIT I would assume something similar, but this is running on SubstrateVM instead of JVM. Sadly I have little experience with Native Image and Substrate, so an explanation eludes me.
    What is happening here with memory usage?

    • @AntonPutra
      @AntonPutra  2 месяца назад +2

      I'm not an expert in Java, and I hope to get feedback from someone who is, but it looks like it optimizes for the load that is given to the application.

    • @EricSouzarys
      @EricSouzarys 2 месяца назад +1

      probably because of garbage collections (graalvm stills have a simple GC). The GC learns what objects need to be cycle e and what does not need.
      Missing JIT actually affects CPU usage. You can easily test this by running a benchmark against native code and JVM. You will see that under high load JVM version uses less CPU

    • @AntonPutra
      @AntonPutra  2 месяца назад +1

      @@EricSouzarys i'll be testing quarkus vs jvm spring boot soon, any suggestions?

    • @EricSouzarys
      @EricSouzarys 2 месяца назад +2

      @@AntonPutra I think that you Just need to be careful to not compare orange and apples.
      I think you can compare these combinations if the tests are going to be applied to an I/O bound app:
      1. Quarkus Blocking vs Spring Blocking
      2. Quarkus fully reactive vs Spring Fully reactive (with webflux)
      3. Quarkus with virtual threads vs Spring with virtual Threads.
      An extra combination could be Quarkus Fully Reactive vs Spring with Virtual Threads as virtual threads with Spring is more used than with quarkus.
      A comparison between reactive quarkus against Spring (without virtual threads) would not be fair

    • @AntonPutra
      @AntonPutra  2 месяца назад +2

      @@EricSouzarys ok noted!

  • @sarabwt
    @sarabwt 2 месяца назад +1

    It would be interesting if you compare go vs java non native, as non native should have better performance than native. You compile java to native only if you are building a CLI or a lambda, when you need fast startup.

  • @helloworld7796
    @helloworld7796 Месяц назад

    I do think you should do some kind of load testing on the cheap 5$ instances. For example how many requests these cheap vps can handle before they crash, using golang, rust, php etc.

  • @pauluslestyo7646
    @pauluslestyo7646 2 месяца назад +2

    It's great if you can benchmark framework from bun runtime like Hono and ElysiaJS

  • @rolandbayor4444
    @rolandbayor4444 2 месяца назад +1

    I run some tests a while ago just benchmarking algorithms with different languages. To my surprise Java always run them faster than GO

    • @AntonPutra
      @AntonPutra  2 месяца назад +2

      Well, when you deploy to Kubernetes, you have cgroups and other constraints that could affect performance. But as soon as I find a use case where Java performs better, I'll make an updated video-maybe something like a Kafka consumer/producer data pipeline. I'll see.

  • @k1zmt
    @k1zmt 10 дней назад

    It would be interesting to add C, Rust, NodeJS and Python to the mix.

  • @ugurata
    @ugurata Месяц назад

    A native image of a Java app would use less memory but the throughput will be worse than a JVM version. So for CPU and latency comparison you should compare with a JVM not a native app

  • @bibahbibah5108
    @bibahbibah5108 2 месяца назад +2

    i wona see spring boot native image vs Quarkus vs go
    spring native is framework like Quarkus so it's nice to compare this 2 framework

  • @antonkuranov
    @antonkuranov 25 дней назад

    Java native images give slower performance at runtime than normal jars because of the lack of hotspot optimizations at runtime. To achieve a similar performance it should be optimized through a previous profiling process.

    • @AntonPutra
      @AntonPutra  25 дней назад

      Thanks for the feedback, someone already mentioned that. I'll run some tests in the near future

  • @vivekchaudhary5728
    @vivekchaudhary5728 2 месяца назад +1

    can you please do a GO vs node.js Lambda testing? with cold start time, memory usage and other metrics

    • @AntonPutra
      @AntonPutra  2 месяца назад

      ok i already have some lambda benchmarks in that playlist but i'll refresh it soon

  • @a.nk.r7209
    @a.nk.r7209 2 месяца назад +1

    How to create this setup of k8s + grafana + promethues .
    Please create a video of this setup

    • @AntonPutra
      @AntonPutra  2 месяца назад +2

      well i use esxi hypervisor to host my Kubernetes at home, i have some steps to reproduce it with metalb if you are interested - github.com/antonputra/kubernetes-on-premise
      Also to deploy monitoring stack (prometheus & grafana & cadvisor & kube-state-metrics etc) i use terraform with yaml
      tf - github.com/antonputra/tutorials/tree/main/lessons/201/terraform
      yaml - github.com/antonputra/tutorials/tree/main/lessons/201/monitoring

    • @a.nk.r7209
      @a.nk.r7209 2 месяца назад

      @@AntonPutra thanks! 🫱🏻‍🫲🏼

  • @alienmars2442
    @alienmars2442 18 дней назад

    If those java containers are converted into graalvm native code, I wonder what the comparation will be ?

  • @acasualviewer5861
    @acasualviewer5861 Месяц назад

    By default (depending on your garbage collector choice) java will reserve a big block of memory to manage but then clean. I'm not sure how Go does it, but you can probably configure Java to "use" less memory by setting the min and max differently and other configurations.

    • @AntonPutra
      @AntonPutra  Месяц назад

      thanks, i'll try to optimize it more next time

  • @picatchumm64
    @picatchumm64 2 месяца назад

    Hi, Nice job, thank you.
    idea for next benchmark test : Kubernetes vs K3s

    • @premierde
      @premierde 2 месяца назад

      They are platform so how would you like to compare?. If I have some nodes & VMs then I will stick to K8s, otherwise K3s.

    • @AntonPutra
      @AntonPutra  2 месяца назад +1

      ok, I'll see if it makes sense. I'll create some benchmarks or maybe just make comparisons.

    • @picatchumm64
      @picatchumm64 2 месяца назад

      @@AntonPutra I was thinking about CPU and memory benchmarks on the NODE, i.e. what Kubernetes vs K3s eats of the Node performance.
      Otherwise, I just discovered the ClickHouse and meilisearch databases, it seems really good. (sorry for my English)

    • @AntonPutra
      @AntonPutra  2 месяца назад

      @@picatchumm64 ok, got it, basically infrastructure test, how well both can handle load etc, and which one is more efficient/cost effective

  • @RiccardoPasquini
    @RiccardoPasquini Месяц назад +1

    I would also compare compile time of quarkus native and go executables....

  • @laurentperez8632
    @laurentperez8632 2 месяца назад +4

    This video is good but really is not a fair comparison if you used GraalVM CE. You're comparing apples to oranges.
    GraalVM EE has PGO which allows the native build to benefit from, well, profiling, so it'd map and optimize the call tree among other things.
    Obv. EE is not free. This is the whole point, Oracle would not freely distribute optimizations to the CE edition.

    • @AntonPutra
      @AntonPutra  2 месяца назад +1

      thanks, noted

    • @rajivkumar-ub6uj
      @rajivkumar-ub6uj 2 месяца назад +1

      +1 and use jdk 22 with virtual threads enabled

    • @AntonPutra
      @AntonPutra  2 месяца назад +1

      @@rajivkumar-ub6uj thanks, I'll use virtual threads next time, but for some reason, jdk 22 isn't available for ubuntu yet

  • @LawZist
    @LawZist 2 месяца назад

    Great Benchmark! can you share the promQL for the metrics? is it some plugin or you wrote it by yourself? thanks

    • @AntonPutra
      @AntonPutra  2 месяца назад +1

      thanks! it's just open source and i actually have dedicated youtube tutorials how to measure, cpu/memory/vpc etc..
      here is a dashboard and promql queries for this specific video - github.com/antonputra/tutorials/blob/main/lessons/201/dashboard.json
      java metrics - github.com/antonputra/tutorials/blob/main/lessons/201/java-app/src/main/java/com/antonputra/ImageResource.java#L51-L59
      golang metrics - github.com/antonputra/tutorials/blob/main/lessons/201/go-app/metrics.go#L13-L27

    • @LawZist
      @LawZist 2 месяца назад

      @@AntonPutra is there any reason to prefer summary over histogram? And can you please share the link for your measure tutorials? Thanks a lot!

    • @AntonPutra
      @AntonPutra  2 месяца назад +1

      @@LawZist use summary in edge cases when you have a single instance of the app and you can only scale vertically, cause it's not possible to aggregate them over multiple instances, for example to get p90 percentile for 5 replicas of your app. With summary prometheus compute p90 on the client itself. Use histogram in all other cases
      ruclips.net/video/WUBjlJzI2a0/видео.html
      ruclips.net/video/VjFFzGFyVlY/видео.html
      ruclips.net/video/dMca4jHaft8/видео.html
      ruclips.net/video/ff_XHm96PKQ/видео.html

    • @LawZist
      @LawZist 2 месяца назад

      @@AntonPutra thanks!!

  • @kawin-vir
    @kawin-vir 2 месяца назад +2

    Would be nice to see Go (Fiber) vs Bun (Elysia)

  • @richarmunicosamaniego8216
    @richarmunicosamaniego8216 2 месяца назад +1

    and what will happend with Quarkus vs SpringBoot

    • @AntonPutra
      @AntonPutra  2 месяца назад +3

      interesting, i'll test it soon

  • @sanchitwadehra
    @sanchitwadehra Месяц назад

    Dhanyavad

  • @ZzooD
    @ZzooD Месяц назад +1

    It would be interesting to see a test to failure, who and under what load will start throttling

    • @AntonPutra
      @AntonPutra  Месяц назад

      yes will do with improved java next time

  • @rikschaaf
    @rikschaaf Месяц назад

    Looks like the s3 implementation isn't very optimized yet in Java. I do think that the test is a bit skewed, because the overall latency is mostly impacted by the task that took the longest. The S3 task took an order of magnitude longer than the SQL task, so therefore it's mostly the S3 task that determined the overall latency scores. The SQL task only had a negligible impact.
    I'm interested to see several other task and see how they compare. Because of what I described above, you'd probably also want to scale the difficulty of each task so that the time for the fastest language to complete the task is the same for all tasks, so that they all contribute evenly to the total latency. That, or you could just use percentages for each task and show a total or average percentage for all tasks, instead of your total latency graph.

    • @AntonPutra
      @AntonPutra  Месяц назад

      thanks for the feedback, i'll get back to Java soon