Projects
The list of my open sourced projects
LyCORIS
Lora beYond Conventional methods. Comprehensive PEFT library for neural networks, published at ICLR 2024.
KohakuTerrarium
General purpose AI agent framework with built-in tools, sub-agents, persistent sessions, TUI and web UI. Comes with kt CLI and package marketplace.
KohakuTPU [WIP]
AI accelerator implementation with Xilinx FPGA. Built on KohakuAccel, an open platform for building FPGA accelerators.
KohakuGBC
Togeari based implementation of Graph-Based Captioning (GBC). Builds graph annotation of each image (entities, regions and their relations) with VLM, OWLv2/SAM 3 and EmbeddingGemma, on one GPU, many GPUs or other nodes.
Togeari
Out-of-order dataflow machine for KIR graph programs (Turing complete). Runs thousands of KIR jobs at once on pluggable engines, batches calls across jobs to keep every engine busy, checks recorded runs against the reference interpreter.
TT-VidT
Decoupling the Temporal Axis for Efficient Motion-Centric Video Pretraining. Self-supervised video encoder for motion, published at NeurIPS 2026.
TIPO
Text to Image with Text Presampling for Prompt Optimization. Published at ICLR 2026, related models got over 3M downloads.
HDM
Home-made Diffusion Model. Training quality text-to-image models on consumer-level hardware. Tech report on arXiv.
PixelOE
Detail-Oriented Pixelization based on Contrast-Aware Outline Expansion.
KohakuMossTrainer
Finetuning framework for MOSS-Image. All LyCORIS algorithms and full finetune at native resolutions, from 6GB cards to multi-GPU nodes.
KohakUnlock
Experimental research on NVIDIA tensor-compute unlocks. RTX 2080Ti FP16 MMA with FP32 accumulate from 59.9 to 111 TFLOPS, also RTX 4090 and 3090 results.
KohakuHub
Self-hosted HuggingFace alternative, fully compatible with HuggingFace Hub, Transformers and Diffusers.
KohakuRAG
#1 in Wattbot2025. Hierarchical RAG framework with context-aware search and single-file SQLite storage. Paper on arXiv.
KohakuRiver
Lightweight cluster manager that turns a small fleet of nodes into one powerful computer using Docker. Supports QEMU/KVM VM, VXLAN overlay network and GPU passthrough.
KohakuNodeIR
KIR: a text-based intermediate representation for visual programming. Captures control flow and dataflow in one file, round-trips between text and graph, runs on any conforming backend.
KohakuHPO
Unified black-box optimization system for hyperparam tuning. Reference implementation of S3-TuRBO with from-scratch baselines (CMA-ES, GP-BO, HEBO, TuRBO).
KohakuVault
Single-file key-value/columnar store built on SQLite with Rust. Supports full-text search, vector search and auto msgpack.
KohakuBoard
Self-hosted W&B alternative with async logging, efficient storage and fast visualization frontend.
HakuLatent
A comprehensive codebase for training and finetuning Image <> Latent models. Supports EQ-VAE regularization.
KohakuBoardGame
Board game engine with NNUE neural network evaluation and PVS search. Supports MiniChess, MiniShogi, and Gomoku.
KohakuEFDA [WIP]
KohakuLayout: netlist to placed-and-routed grid layout framework. KohakuEFDA: factory planner for Arknights: Endfield built on it.
monotone-kvm
Triton kernels for Key-Value Means (KVM) attention with hand-written backward. Also a scheduler playground for monotone bucket schedules.
SenseCraft
Unified Perceptual Feature Loss Framework. LPIPS, ConvNeXt/DINOv3 feature loss, frequency domain loss and PSNR/SSIM metrics.
KohakuEngine
All-in-Python config and execution engine for RD workload. Run existing scripts with different configs without modifying the code.
KohakuClip
Stateless Rust+pyo3 video loader tailored for fast, memory-efficient PyTorch pipelines.
S3impleClient
Simple, fast and robust async S3/HTTP downloader and uploader with pipelined parallel transfers. Can patch huggingface_hub for faster transfer.
z-tipo-extension
A sd-webui/ComfyUI extension for utilizing TIPO or DanTagGen to "upsample prompts".
a1111-sd-webui-lycoris
An extension for stable-diffusion-webui to load LyCORIS models.
HakuBooru
text-image dataset maker for anime-style images.
Kohaku-NAI
A Novel-AI client with more utilities built in it.