information-bottleneck

Here are 20 public repositories matching this topic...

NVlabs / FAN

Official PyTorch implementation of Fully Attentional Networks

deep-learning corruption backbone imagenet image-classification coco object-detection semantic-segmentation visual-recognition cityscapes information-bottleneck self-attention pre-train out-of-distribution vision-transformers visual-grouping

Updated Mar 31, 2023
Python

1Konny / VIB-pytorch

Star

Pytorch implementation of Deep Variational Information Bottleneck

machine-learning deep-learning pytorch classification variational-inference information-bottleneck

Updated Mar 22, 2018
Python

invoker-LL / WSI-finetuning

Star

This is the official repository for our CVPR 2023 paper 'Task-Specific Fine-Tuning via Variational Information Bottleneck for Weakly-Supervised Pathology Whole Slide Image Classification'.

end-to-end mutual-information breast-cancer wsi computational-pathology fine-tuning information-bottleneck cervical-cancer

Updated Apr 16, 2024
Python

burklight / nonlinear-IB-PyTorch

Star

Pytorch Implementation of the Nonlinear Information Bottleneck

deep-learning pytorch representation-learning compression-algorithm information-bottleneck information-bottleneck-theory

Updated Jul 25, 2024
Python

cjx96 / CDRIB

Star

[ICDE 2022]Cross-Domain Recommendation to Cold-Start Users via Variational Information Bottleneck

information-bottleneck cross-domain-recommendation

Updated Dec 7, 2022
Python

zichuan-liu / TimeXplusplus

Star

[ICML'24] Official PyTorch Implementation of TimeX++

deep-learning time-series interpretability information-bottleneck explainable-ai xai perturbations explainability

Updated Nov 6, 2024
Python

nec-research / microbiome-mvib

Star

Microbiome-based disease prediction with multimodal variational information bottlenecks, Grazioli et al., PLOS Computational Biology 2022

machine-learning information-theory microbiome variational-inference information-bottleneck

Updated Apr 12, 2022
Python

mohith-sakthivel / mine-pytorch

Star

Implementation of Information Bottleneck with Mutual Information Neural Estimation (MINE)

pytorch mine mutual-information information-bottleneck mutual-information-neural-estimator infomax mutual-information-estimators mutual-information-estimation mi-estimation

Updated Jun 18, 2021
Python

ChocoWu / MRE-ISE

Star

About Codes for ACL 2023 paper: Exploiting! Multimodal Relation Extraction with Feature Denoising and Multimodal Topic Modeling.

topic-modeling information-bottleneck multimodel-relation-extraction

Updated Jun 25, 2024
Python

ChenLiu-1996 / DiffusionSpectralEntropy

Star

[ICMLW 2023, IEEE CISS 2024] Assessing Neural Network Representations During Training Using Noise-Resilient Diffusion Spectral Entropy

entropy deep-learning neural-network manifold-learning mutual-information diffusion information-bottleneck information-bottleneck-theory mutual-information-neural-estimator entropy-estimation neural-representation neural-manifold icml-2023

Updated Jan 7, 2025
Python

zerohd4869 / SPC

Star

The official repository for AAAI 2024 Oral paper "Structured Probabilistic Coding".

representation-learning natural-language-understanding information-bottleneck pretrained-language-models probabilistic-machine-learning information-theoretic-methods

Updated Sep 7, 2024
Python

fbao-fudan / DVIB

Star

DVIB is an information bottleneck method that tries to disentangle multiview data into shared and private representations.

variational-inference multiview-learning information-bottleneck

Updated Sep 28, 2022
Python

genema / TECOS-LVM

Star

[NeurIPS] Temporal Conditioning Spiking Latent Variable Models of the Neural Response to Natural Visual Scenes

computational-neuroscience spiking-neural-networks information-bottleneck cognitive-computational-neuroscience sensory-neuroscience sensory-circuit-modeling noisy-spiking-neural-models

Updated Mar 8, 2024
Python

A Python library for calculating and visualizing mutual information in neural networks. This repository includes methods to calculate mutual information using various techniques (binning, KDE, Kraskov) and tools to train neural networks and plot information plane dynamics.

entropy deep-learning neural-network information-theory mutual-information information-bottleneck

Updated Jul 18, 2024
Python

farukalpay / information-bottleneck-beta-optimization

Star

This repository hosts a progressive series of implementations (Code_v1, Code_v2, and beyond) for deterministic β*-optimization in the Information Bottleneck framework. Includes symbolic fusion, multi-path inference, and Alpay Algebra–driven critical point validation (β* = 4.14144).

statistical-inference mutual-information machine-learning-theory phase-transition information-bottleneck symbolic-algebra alpay-algebra beta-optimization deep-theory ib-framework

Updated May 15, 2025
Python

antiingel / information-bottleneck-BCI

Star

Information Bottleneck as Optimisation Method for SSVEP-Based BCI

information-theory bci optimisation ssvep information-bottleneck

Updated Aug 17, 2022
Python

angrysky56 / synth_thalamus

Star

Synthetic Thalamus is a biologically-inspired neural attention mechanism that mimics the brain's thalamic circuits. This project implements a selective information bottleneck with phase-based synchronization, contrastive learning, and recurrent feedback loops.

neural-attention thalamus information-bottleneck phase-synchronization selective-attention contrastive-learning transformer-enhancement