← all repositories

yandex-research/rtdl-num-embeddings

PyTorch implementation of a paper on using learned vector embeddings for continuous features to improve tabular neural network performance.

413 stars Python ML Frameworks
rtdl-num-embeddings
Velocity · 7d
+0.3
★ / day
Trend
steady
star history

This repository contains the official implementation of a NeurIPS 2022 paper exploring how transforming scalar continuous features into vector embeddings before mixing them in the backbone can improve tabular deep learning models. The approach is applicable to conventional backbones like MLP and Transformer. The authors demonstrate that simple MLPs with embeddings can rival heavier Transformer-based models with better efficiency.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.