Livnium Labs · Model collection

Three trained models. Built from scratch. Measured in public.

Livnium's vector-collapse program has produced working systems for semantic embeddings, compact text generation, and natural-language inference. Each model has a real checkpoint, a runnable path, and a measured result.

The achieved models

One mechanism, three working systems.

These are the strongest trained results in the Livnium repository. They are presented as completed engineering achievements with their evaluation boundaries kept visible—not as abandoned experiments.

Trained · Grade A02 / GENERATION

Premise Generator

A compact conditional language model that turns a hypothesis and NLI label into a contextual premise using learned semantic attractors.

~6 msmedian CPU latency per short reply
Parameters
5,975,042
Vocabulary
20,000 words
Token accuracy
52.71%
Architecture
No self-attention
Trained · Grade A−03 / NLI

Supervised Collapse NLI

A 3-way natural-language-inference classifier whose learned geometry moves sentence-pair representations toward entailment, neutral, and contradiction attractors.

68.92%SNLI test accuracy
Parameters
~12.9M
Clears hyp-only
+7.42 points
Classes
All 3 predicted
Encoder latency
0.33 ms CPU

What was achieved

Each model crossed a different technical threshold.

The work is not one all-or-nothing claim. It is a sequence of concrete results: semantic geometry, fast conditional generation, and learned-attractor classification above strong simple baselines.

01

Meaning emerged in the geometry.

Noun Collapse learned semantic neighborhoods with one well per word and no separate neural output head, reaching 0.3616 on the noun subset of SimLex-999.

02

Generation ran locally at interactive speed.

The 5.98M-parameter Premise Generator produced contextual short replies in roughly 6 ms median on CPU.

03

Collapse NLI cleared the artifact bar.

At 68.92% SNLI accuracy, the model beat the 61.5% hypothesis-only artifact by 7.42 points and the 60.7% GloVe-average baseline by 8.22 points.

Benchmark context

Strong numbers, stated precisely.

The headline results stand on their own. The remaining controls define the next research questions without erasing what the trained checkpoints already demonstrate.

Noun Collapse0.3616 ρ662 of 666 noun pairs covered; random same-shape control averages about 0.022.
Premise Generator52.71% token accuracyContextual generation works; stronger and more consistent label control is the next target.
Collapse NLI68.92% SNLIBeats linear, bag-of-words, GloVe-average, and hypothesis-only reference bars.
Next research stepMatched ablationsEnd-to-end multi-seed comparisons will isolate how much of the NLI gain comes uniquely from collapse dynamics.

Beyond the model collection

The research program keeps moving.

Active work extends the same emphasis on inspectable mechanisms and reproducible measurements into language, vision, dynamics, and combinatorics.

Active researchLANGUAGE

Chat Brain

A character-to-word-to-conversation ladder exploring longer contextual reading and response generation.

Inspect the program →
Active researchVISION

Vision Collapse

An investigation of attractor dynamics over image data, with every pixel represented as an attractor.

Inspect the program →
Verified toolingMATHEMATICS

Ramsey & rotation tools

Solvers, independently checked witnesses, and group-action constructions with reproducible verification.

Inspect the program →

Explore the work

Use the models. Inspect the mechanism.

The code, model cards, evaluation records, and published Noun Collapse checkpoint are open for builders and research collaborators.

Explore all three models →