Scale Forem

Scale YouTube
Scale YouTube

Posted on

Devoxx: ONNX Based Generative AI LLMs in Java with Project Babylon by Adam Sotona

ONNX-Based Generative AI LLMs in Java with Project Babylon

Project Babylon flips the script on typical Python-only AI workflows by showing how Java can actually produce ONNX models instead of merely consuming them. Adam Sotona walks you through using Babylon’s nifty code-reflection magic to build a simple LLM in pure Java, then export it in the universal ONNX format for cross-platform execution.

In a live demo, you’ll see the full pipeline: write your AI logic in Java, transform it into ONNX, and watch it run anywhere ONNX is supported—no Python or heavyweight frameworks required. It’s a neat proof-of-concept that brings Java back into the AI game.

Watch on YouTube

Top comments (0)