A Better JNI: Project Panama
HTML-код
- Опубликовано: 16 мар 2024
- An airhacks.fm (airhacks.fm) conversation with Paul Sandoz (@paulsandoz ( / paulsandoz ) ) about:
Paul previously appeared on "#277 Project Babylon" (airhacks.fm/#episode_277) ,
article about Automatic differentiation of Java code using code reflection (openjdk.org/projects/babylon/...) ,
using Project Babylon (openjdk.org/projects/babylon) for automatic differentiation,
emulating C# LINQ (learn.microsoft.com/en-us/dot...) in Java (www.java.com/en/) ,
writing Triton (github.com/openai/triton) programs in Java for GPU execution,
using Project Panama (openjdk.java.net/projects/pan...) for native interoperability with C/C++ libraries,
JExtract (github.com/openjdk/jextract) tool for generating Java bindings from C headers,
memory management with Panama memory segments and arenas,
advantages of Panama over JNI,
integrating Java with ONNX (onnx.ai/) models,
persistent memory and object storage
Paul Sandoz on twitter: @paulsandoz ( / paulsandoz ) Наука
Please share th link on loading llama in java
Sure: 👉github.com/mukel/llama2.java Thanks for listening!