Publications
You may also find my recent articles on Google Scholar.
Preprints
Over-parameterised shallow neural networks with asymmetrical node scaling: global convergence guarantees and feature learning
François Caron, Fadhel Ayed, Paul Jung, Hoil Lee, Juho Lee, Hongseok YangHybrid generative-contrastive representation learning
Saehoon Kim, Sungwoong Kim, Juho LeeLearning to pool in graph neural networks for extrapolation
Jihoon Ko, Taehyung Kwon, Kijung Shin, Juho LeeDeep amortized clustering
Juho Lee, Yoonho Lee, Yee Whye Teh
A preliminary version of this work has been accepted to NeurIPS 2019 Sets & Partitions workshop as an oral presentation.Adaptive network sparsification with dependent variational beta-Bernoulli dropout
Juho Lee, Saehoon Kim, Jaehong Yoon, Hae Beom Lee, Eunho Yang, Sung Ju Hwang
Journals
Deep neural networks with dependent weights: Gaussian process mixture limit, heavy tails, sparsity and compressibility)
Hoil Lee, Fadhel Ayed, Paul Jung, Juho Lee, Hongseok Yang, François Caron
Journal of Machine Learning Research, September 2023A unified construction for series representations and finite approximations of completely random measures
Juho Lee, Xenia Miscouridou, François Caron
Bernoulli, August 2023The Normal-Generalised Gamma-Pareto process: A novel pure-jump Lévy process with flexible tail and jump-activity properties
Fadhel Ayed, Juho Lee, François Caron
Bayesian Anaylsis, December 2022Benefits of stochastic weight averaging in developing neural network radiation scheme for numerical weather prediction
Hwan-Jin Song, Soonyoung Roh, Juho Lee, Giung Nam, Eunggu Yun, Jongmin Yoon, Park Sa Kim
Journal of Advances in Modeling Earth Systems, October 2022
Conferences
Safeguard text-to-image diffusion models with human feedback inversion
Sanghyun Kim, Seohyeon Jung, Balhae Kim, Moonseok Choi, Jinwoo Shin, Juho Lee
To appear in ECCV 2024Variational partial group convolutions for input-aware partial equivariance of rotations and color-shifts
Hyunsu Kim, Yegon Kim, Hongseok Yang, and Juho Lee
To appear in ICML 2024A simple early exiting framework for accelerated sampling in diffusion models
Taehong Moon, Moonseok Choi, EungGu Yun, Jongmin Yoon, Gayoung Lee, Jaewoong Cho, and Juho Lee
To appear in ICML 2024Learning to explore for stochastic gradient MCMC
Seunghyun Kim, Seohyeon Jung, Seonghyeon Kim, and Juho Lee
To appear in ICML 2024Fast ensembling with diffusion Schrödinger bridge
Hyunsu Kim, Jongmin Yoon, and Juho Lee
ICLR 2024Sparse weight averaging with multiple particles for iterative magnitude pruning
Moonseok Choi, Hyungi Lee, Giung Nam, and Juho Lee
ICLR 2024Lipsum-FT: Robust fine-tuning of zero-shot models using random text guidance
Giung Nam, Byeongho Heo, and Juho Lee
ICLR 2024Enhancing transfer learning with flexible nonparametric posterior sampling
Hyungi Lee, Giung Nam, Edwin Fong, and Juho Lee
ICLR 2024Self-supervised dataset distillation for transfer learning
Dong Bok Lee, Seanie Lee, Joonho Ko, Kenji Kawaguchi, Juho Lee, and Sung Ju Hwang
ICLR 2024Spear and shield: adversarial attacks and defense methods for model-based link prediction on continuous-time dynamic graphs
Dongjin Lee, Juho Lee, and Kijung Shin
AAAI 2024Function Space Bayesian pseudocoreset for Bayesian neural networks
Balhae Kim, Hyungi Lee, Juho Lee
NeurIPS 2023Probabilistic imputation for time-series classification with missing data
SeungHyun Kim*, Hyunsu Kim*, Eunggu Yun*, Hwangrae Lee, Jaehun Lee, Juho Lee
(*: Equal Contribution)
ICML 2023Traversing between modes in function space for fast ensembling
Eunggu Yun*, Hyungi Lee*, Giung Nam*, Juho Lee
(*: Equal Contribution)
ICML 2023Regularizing towards soft equivariance under mixed symmetries
Hyunsu Kim, Hyungi Lee, Hongseok Yang, Juho Lee
ICML 2023Scalable set encoding with universal mini-batch consistency and unbiased full set gradient approximation
Jeffrey Ryan Willette*, Seanie Lee*, Bruno Andreis, Kenji Kawaguchi, Juho Lee, Sung Ju Hwang
(*: Equal Contribution)
ICML 2023Martingale posterior neural processes
Hyungi Lee, Eunggu Yun, Giung Nam, Edwin Fong, Juho Lee
ICLR 2023 (Notable top 25%)Decoupled training for long-tailed classification with stochastic representations
Giung Nam*, Sunguk Jang*, Juho Lee
(*: Equal Contribution)
ICLR 2023A simple yet powerful deep active learning with snapshot ensembles
Seohyeon Jung*, Sanghyun Kim*, Juho Lee
(*: Equal Contribution)
ICLR 2023Self-distillation for further pre-training of transformers
Seanie Lee, Minki Kang, Juho Lee, Sung Ju Hwang, Kenji Kawaguchi
ICLR 2023Exploring the role of mean teachers in self-supervised masked auto-encoders
Youngwan Lee*, Jeffrey Ryan Willette*, Jonghee Kim, Juho Lee, Sung Ju Hwang
(*: Equal Contribution)
ICLR 2023On divergence measures for Bayesian pseudocoresets
Balhae Kim, Jungwon Choi, Seanie Lee, Yoonho Lee, Jung-Woo Ha, Juho Lee
NeurIPS 2022Set-based meta-interpolation for few-task meta-learning
Seanie Lee, Bruno Andreis, Kenji Kawaguchi, Juho Lee, Sung Ju Hwang
NeurIPS 2022Improving ensemble distillation with weight averaging and diversifying perturbation
Giung Nam, Hyungi Lee, Byeongho Heo, Juho Lee
ICML 2022
CodeSet based stochastic subsampling
Bruno Andreis, Seanie Lee, A. Tuan Nguyen, Juho Lee, Eunho Yang, Sung Ju Hwang
ICML 2022Scale mixtures of neural network Gaussian processes
Hyungi Lee, Eunggu Yoon, Hongseok Yang, Juho Lee
ICLR 2022Sequential Reptile: inter-task gradient alignment for multilingual learning
Seanie Lee, Hae Beom Lee, Juho Lee, Sung Ju Hwang
ICLR 2022Meta learning low rank covariance factors for energy-based deterministic uncertainty
Jeffrey Ryan Willette, Hae Beom Lee, Juho Lee, Sung Ju Hwang
ICLR 2022Diversity matters when learning from ensembles
Giung Nam*, Jongmin Yoon*, Yoonho Lee, Juho Lee
(*: Equal Contribution)
NeurIPS 2021
CodeMini-batch consistent slot set encoder for scalable set encoding
Bruno Andreis, Jeffrey Ryan Willette, Juho Lee, Sung Ju Hwang
NeurIPS 2021A multi-mode modulator for multi-domain few-shot classification
Yanbin Liu, Juho Lee, Linchao Zhu, Ling Chen, Humphrey Shi, Yi Yang
ICCV 2021Adversarial purification with score-based generative models
Jongmin Yoon, Sung Ju Hwang, Juho Lee
ICML 2021
CodeLearning to perturb word embeddings for out-of-distribution QA
Seanie Lee, Minki Kang, Juho Lee, Sung Ju Hwang
ACL 2021SetVAE: learning hierarchical composition for generative modeling of set-structured data
Jinwoo Kim, Jaehoon Yoo, Juho Lee, Seunghoon Hong
CVPR 2021
CodeBootstrapping neural processes
Juho Lee*, Yoonho Lee*, Jungtaek Kim, Eunho Yang, Sung Ju Hwang, Yee Whye Teh
(*: Equal Contribution)
Code
NeurIPS 2020Neural complexity measures
Yoonho Lee, Juho Lee, Sung Ju Hwang, Eunho Yang, Seungjin Choi
Code
NeurIPS 2020Cost-effective interactive attention learning with neural attention processes
Jay Heo, Junhyeon Park, Hyewon Jeong, Kwang Joon Kim, Juho Lee, Eunho Yang, Sung Ju Hwang
ICML 2020Deep mixed effect model using Gaussian processes: a personalized and reliable prediction for healthcare
Ingyo Chung, Saehoon Kim, Juho Lee, Sung Ju Hwang, Eunho Yang
AAAI 2020Beyond the Chinese restaurant and Pitman-Yor processes: statistical models with double power-law behavior
Fadhel Ayed*, Juho Lee*, and François Caron
(*: Equal Contribution)
ICML 2019 (long oral presentation)Set transformer: a framework for attention-based permutation-invariant neural networks
Juho Lee, Yoonho Lee, Jungtaek Kim, Adam R. Kosiorek, Seungjin Choi, and Yee Whye Teh
Code
ICML 2019Learning to propagate labels: transductive propagation network for few-shot learning
Yanbin Liu, Juho Lee, Minseop Park, Saehoon Kim, Eunho Yang, Sung Ju Hwang and Yi Yang
ICLR 2019A Bayesian model for sparse graphs with flexible degree distribution and overlapping community structure
Juho Lee, Lancelot F. James, Seungjin Choi, and François Caron
AISTATS 2019 (oral presentation)
CodeUncertainty-aware attention for reliable interpretation and prediction
Jay Heo*, Hae Beom Lee*, Saehoon Kim, Juho Lee, Kwang Joon Kim, Eunho Yang, and Sung Ju Hwang
(*: Equal Constribution)
NeurIPS 2018Dropmax: adaptive variational softmax
Hae Beom Lee, Juho Lee, Saehoon Kim, Eunho Yang, and Sung Ju Hwang
NeurIPS 2018
CodeBayesian inference on random simple graphs with power law degree distributions
Juho Lee, Creighton Heakulani, Zoubin Ghahramani, Lancelot F. James, and Seingjin Choi
ICML 2017
CodeFinite-dimensional BFRY priors and variational Bayesian inference for power law models
Juho Lee, Lancelot F. James, and Seungjin Choi
NIPS 2016Tree-guided MCMC inference for normalized random measure mixture models
Juho Lee and Seungjin choi
NIPS 2015
CodeBayesian hierarchical clustering with exponential family: small-variance asymptotics and reducibility
Juho Lee and Seungjin Choi
AISTATS 2015Incremental tree-based inference with dependent normalized random measures
Juho Lee and Seungjin Choi
AISTATS 2014Online video segmentation by Bayesian split-merge clustering
Juho Lee, Suha Kwak, Bohyung Han, and Seungjin Choi
ECCV 2012
Workshops
Early exiting for accelerated inference in diffusion models
Taehong Moon, Moonseok Choi, EungGu Yun, Jongmin Yoon, Gayoung Lee, Juho Lee
ICML 2023 workshop on Structured Probabilistic Inference & Generative Modeling, 2023Function space Bayesian pseudocoreset for Bayesian neural networks
Balhae Kim, Hyungi Lee, Juho Lee
ICML 2023 workshop on Structured Probabilistic Inference & Generative Modeling, 2023Towards safe self-distillation of internet-scale text-to-image diffusion models
Sanghyun Kim, Seohyeon Jung, Balhae Kim, Moonseok Choi, Jinwoo Shin, Juho Lee
ICML 2023 Workshop on Challenges in Deployable Generative AI, 2023Modeling uplift from observational time-series in continual scenarios
Sanghyun Kim, Jungwon Choi, NamHee Kim, Jaesung Ryu, Juho Lee
AAAI23 Bridge on Continual Casality (oral presentation), 2023Fine-tuning diffusion models with limited data
Taehong Moon, Moonseok Choi, Gayoung Lee, Jung-Woo Ha, Juho Lee
NeurIPS 2022 Workshop on Score-Based Methods, 2022Adaptive strategy for resetting a non-stationary Markov chain during learning via joint stochastic optimization
Hyunsu Kim, Juho Lee, Hongseok Yang
Third Symposium on Advances in Approximate Bayesian Inference, 2021Towards deep amortized clustering
Juho Lee, Yoonho Lee, Yee Whye Teh
NeurIPS 2019 Sets & Partitions workshop (contributed talk), 2019Graph embedding VAE: a permutation invariant model of graph structure
Tony Duan, Juho Lee
NeurIPS 2019 Graph Representation Learning workshop, 2019