← all repositories

Adamdad/kat

A PyTorch implementation of Kolmogorov-Arnold Transformer (KAT), replacing MLP layers in Vision Transformers with KAN layers for image classification.

849 stars Python Computer VisionML Frameworks
kat
Velocity · 7d
+1.3
★ / day
Trend
steady
star history

This repository provides a PyTorch implementation of KAT, a novel transformer architecture that integrates Group-Rational Kolmogorov-Arnold Networks (GR-KANs) for large-scale vision tasks. It replaces the standard MLP layers in Vision Transformers with learnable spline-based activation functions. The implementation includes CUDA-optimized rational base functions and grouped weight sharing for efficiency. The model achieves competitive performance on ImageNet classification.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.