Scale Forem

Scale YouTube
Scale YouTube

Posted on

Devoxx: ONNX Based Generative AI LLMs in Java with Project Babylon by Adam Sotona

ONNX in Java? You bet!

Ever thought Java was too stiff for AI? Adam Sotona’s talk flips that script, showing how ONNX—your go-anywhere model format—can be driven straight from Java instead of the usual Python frameworks.

With Project Babylon’s nifty code reflection, you’ll see a live demo of building a generative LLM in pure Java, exporting it to ONNX, and firing it up for inference—all without touching a Python interpreter.

Watch on YouTube

Top comments (0)