Stars
[CVPR 2025] Adaptive Keyframe Sampling for Long Video Understanding
A collection of tasks to probe the effectiveness of protein sequence representations in modeling aspects of protein design
Official code repository for the paper "ProteinNPT: Improving Protein Property Prediction and Design with Non-Parametric Transformers"
[CVPR2023] Blur Interpolation Transformer for Real-World Motion from Blur
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Raising the Cost of Malicious AI-Powered Image Editing
Code for Neurips 2024 paper "Shadowcast: Stealthy Data Poisoning Attacks Against Vision-Language Models"
[AAAI'25 (Oral)] Jailbreaking Large Vision-language Models via Typographic Visual Prompts
[CVPR2023 Highlight] GRES: Generalized Referring Expression Segmentation
A universal time series representation learning framework
code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)
[IJCAI-21] "Time-Series Representation Learning via Temporal and Contextual Contrasting"
PyTorch code for CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecasting (ICLR 2022)
Code and materials for the paper "Regional Image Perturbation Reduces Lp Norms of Adversarial Examples While Maintaining Model-to-model Transferability" (ICML 2020, UDL).
A family of diffusion models for text-to-audio generation.
[NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
The code for paper "The Good and The Bad: Exploring Privacy Issues in Retrieval-Augmented Generation (RAG)", exploring the privacy risk on RAG.
Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.
Python package for measuring memorization in LLMs.
This is an official repository for Practical Membership Inference Attacks Against Large-Scale Multi-Modal Models: A Pilot Study (ICCV2023).
Quick scripts to calculate CLIP text-image similarity