LIVNIUM.

LIVNIUM.

Client services, independent research, and Livnium products.

LIVNIUM LABS / OUR INDEPENDENT RESEARCH

Hire us for a business project

Language. Vision.
Memory. Geometry.

We develop our own AI models, computing tools, and research prototypes. Explore what each system does, its current stage, and the results recorded so far.

Explore the trained models
3 TRAINED LANGUAGE MODELS / 6 RESEARCH AREASExplore the public repository

TRAINED RESEARCH MODELS

What the models actually do.

Word representations, short-text generation, and sentence-pair classification. Each model has a specific input, output, and evaluation.

01 / WORD REPRESENTATIONS

Noun Collapse

Turns words into numeric representations that can be compared by meaning. It learns the relationships between nouns from Wikipedia text using one geometric representation per word.

INPUT
A word or a sequence of words.
OUTPUT
Word vectors and similarity scores for comparing words.
0.3616Word-similarity score · SimLex-999 noun Spearman ρ
Vocabulary
100,001 words
Vector size
256 dimensions
Noun targets
23,758
Training signal
94.75M occurrences

Trained research model

02 / TEXT GENERATION

Premise Generator

Generates a short premise from a supplied hypothesis and relationship label. This is a compact language model trained on sentence pairs from SNLI.

INPUT
“A person is walking a dog.”
OUTPUT
“a person walking down a street with a black dog.”

Recorded output from a local checkpoint run.

5.98MParameters · a compact model trained from scratch
Vocabulary
20,000 words
Token accuracy
52.71%
Recorded CPU latency
~6 ms / short reply
Architecture
No self-attention

Trained research model

03 / SENTENCE CLASSIFICATION

Supervised Collapse NLI

Compares two sentences and predicts whether the second follows from the first, contradicts it, or cannot be determined from it.

INPUT
A premise and a hypothesis: two sentences to compare.
OUTPUT
Entailment, contradiction, or neutral—with a score for each class.
68.92%Reported accuracy on the SNLI sentence-pair test
Parameters
~12.9M
Output classes
3 relationships
Above hypothesis-only
+7.42 points
CPU encoder latency
0.33 ms

Trained research model

Technical evaluation & benchmark comparisons

Noun Collapse

The 0.3616 noun-similarity result covers 662 of 666 noun pairs in SimLex-999. The model trained on roughly 7.5% of Wikipedia; a random same-shape control scores about 0.022. This is a lexical-similarity evaluation. Equal-corpus, multi-seed training comparisons remain future work.

Premise Generator

The recorded token accuracy is 52.71%. The roughly 6 ms CPU measurement applies to short replies in the recorded setup. The model generates contextual text; improving consistency with the requested relationship label remains an active task. The example above is a recorded model output, not a live response.

Supervised Collapse NLI

Reported SNLI results: GloVe average 60.70%, hypothesis-only 61.50%, collapse 68.92%, and a stronger frozen-embedding MLP probe 70.13%. Matched end-to-end comparisons across multiple seeds are needed to isolate the contribution of collapse dynamics. The 0.33 ms figure measures already-tokenized encoder latency.

Read model records and evaluation details

THE WIDER RESEARCH PROGRAM

More than language models.

Livnium’s research also covers memory, images, geometric data structures, simulation, and mathematical search. Current stages are shown below.

LANGUAGE

Chat Brain

Research prototypes

A language-learning pipeline that progresses from characters to words and conversation, with experiments in contextual reading and reply generation.

Explore the code

VISION

Vision Collapse

Research prototypes

Experiments that encode pixel position and colour into geometric representations, then reconstruct images or compare them with caption words.

Explore the code

MEMORY

Nova Memory & Native Pile

Research prototypes

Memory systems for storing and retrieving information, recording changes, checking retrieval quality, and testing reversible read and write operations.

Ask about this research

GEOMETRIC COMPUTING

Core & collapse dynamics

Packages + research

Reversible cube operations and configurable vector dynamics, including experiments in word order, relationships, and exact-gradient updates.

Explore the code

SIMULATION

Cortex & quantum research

Software research

Geometry-controlled circuit simulation, state-vector and tensor-network experiments. These are software simulation projects with separate implementations and tests.

Ask about this research

MATHEMATICS

Ramsey & rotation tools

Verified tooling

Graph-search tools and independent checkers for Ramsey witnesses, alongside experiments using cube rotations and conserved quantities.

Explore the code

WORK WITH OUR RESEARCH TEAM

Discuss a model or research project.

Model use, reproduction, technical collaboration, and research enquiries.

Contact Livnium Labs