research
Alethic
Language-model architecture research, from controlled small-model experiments to a planned ~1B Phase I.
alethiclanguage-modelsresearch
Independent researcher & engineer
BekhruzSuleyman.
Exploring how intelligence works.
Building the systems to understand it.
Follow the story
UZBEKISTAN / INDEPENDENT
01 / ResearchSmall questions.
Small questions.
Deeper possibilities.
My research explores language models and the structures behind them. From controlled experiments to open model artifacts, this archive brings together the questions, methods, and limitations.
Selected investigationsAll research
research
SGCA
Sin-Gated Control Attention: separating attention retrieval from learned residual control.
sgcaattentiongating
research
SinGatedLM
Parameter-matched small language-model experiments with a sinusoidal attention gate.
experimentslanguage-modelsgating
Ideas, with their evidence attached.Historical experiments and model artifacts are presented with source links. Planned work, hypotheses, and measured results stay distinct.
02 / Engineering
All projects Ideas into systems.
project
AiOS
Experimental x86_64 operating-system work, from kernel bring-up to rootfs integration.
systemsoperating-systems
project
Flang-Lite
A language with a compiler frontend, NASM code generation, and a bytecode virtual machine.
compilerslanguagessystems
project
ArzoMarket
Commerce search and aggregation for Uzbek and regional product discovery.
productengineeringdatasets
03 / Notebook
Writing & notes Thinking out loud.
Why separate retrieval from control?
The SGCA research question, residual update, and requirements for a fair comparison.
What the small SinGated experiments actually show
A careful reading of parameter-matched Tiny Shakespeare results and their limits.
Planning a 1B language-model experiment independently
Architecture targets, constrained compute, and infrastructure for an inspectable run.
The Stack v3: a packing snapshot
A supplied Python-data preparation record, separate from training progress.
Phase I uses 8,240 tokens
The current context decision, separate from earlier long-context curricula.
I’m Bekhruz Suleyman, an independent researcher and engineer from Uzbekistan.
Have a question, an interesting problem, or a project to discuss?