BaseModels

This module provides foundational classes and architectures for Mambular models, including various neural network architectures tailored for tabular data.

Modules	Description
BaseModel	Abstract base class defining the core structure and initialization logic for Mambular models.
TaskModel	PyTorch Lightning module for managing model training, validation, and testing workflows.
Mambular	Flexible neural network model leveraging the Mamba architecture with configurable normalization techniques for tabular data.
MLP	Multi-layer perceptron (MLP) model designed for tabular tasks, initialized with a custom configuration.
ResNet	Deep residual network (ResNet) model optimized for structured/tabular datasets.
FTTransformer	Feature Tokenizer (FTTransformer) model for tabular tasks, incorporating advanced embedding and normalization techniques.
TabTransformer	TabTransformer model leveraging attention mechanisms for tabular data processing.
NODE	Neural Oblivious Decision Ensembles (NODE) for tabular tasks, combining decision tree logic with deep learning.
TabM	TabM architecture designed for tabular data, implementing batch-ensembling MLP techniques.
NDTF	Neural Decision Tree Forest (NDTF) model for tabular tasks, blending decision tree concepts with neural networks.
TabulaRNN	Recurrent neural network (RNN) model, including LSTM and GRU architectures, tailored for sequential or time-series tabular data.
MambAttention	Attention-based architecture for tabular tasks, combining feature importance weighting with advanced normalization techniques.
SAINT	SAINT model. Transformer based model using row and column attetion.

• mambular.base_models