This is the official implementation of our ICML 2024 paper "MultiMax: Sparse and Multi-Modal Attention Learning""
-
Updated
Aug 19, 2025 - Python
#
activation-function-exploration
Here are 9 public repositories matching this topic...
This repository features hands-on Jupyter Notebooks, covering everything from fundamental concepts to advanced neural network architectures.
python machine-learning deep-learning neural-networks from-scratch neural-networks-from-scratch activation-function-exploration
-
Updated
May 8, 2025 - Jupyter Notebook
We introduce two novel hybrid activation functions: S3 (Sigmoid-Softsign) and its improved version S4 (Smoothed S3)
python science machine-learning research deep-learning neural-networks sigmoid softsign activation-function-exploration
-
Updated
Nov 4, 2025 - Python
This is a Fake and AI image prediction using Transfer Learning
-
Updated
Apr 21, 2025 - Python
Linear and Non Linear Activation Functions : Linear, ReLU, Sigmoid, Softmax, Tanh
-
Updated
Jul 16, 2025 - Jupyter Notebook
This is a custom-built neural network that detects handwritten numbers from image inputs. It uses ReLU activation in the hidden layers and a softmax activation function in the output layer for classification. The model is trained using backpropagation with a loss function to minimize prediction errors, achieving over 99% accuracy when predicting
-
Updated
Apr 11, 2025 - Python
Graph by matplotlib
-
Updated
Nov 7, 2025 - Jupyter Notebook
A Benchmark for Activation Function Exploration for Neural Architecture Search (NAS)
neural-network vgg nas bert-model nas-benchmark training-free-nas activation-function-exploration nafbee rbflex-nas
-
Updated
Jun 3, 2025 - Python
Improve this page
Add a description, image, and links to the activation-function-exploration topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the activation-function-exploration topic, visit your repo's landing page and select "manage topics."