Michael Rubinstein

DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation

2023-06-01 · 1940 citations

Large text-to-image models achieved a remarkable leap in the evolution of AI, enabling high-quality and diverse synthesis of images from a given text prompt. However, these models lack the ability to mimic the appearance of subjects in a given reference set and synthesize novel renditions of them in different contexts. In this work, we present a new approach for “personalization” of text-to-image diffusion models. Given as input just a few images of a subject, we fine-tune a pretrained text-to-i…

Physiology and pathophysiology of human airway mucus

Physiological Reviews · 2022 · 318 citations

secretory rates to maintain mucus hydration in health. In disease, mucus becomes hyperconcentrated (dehydrated). Multiple mechanisms derange the ion transport pathways that normally hydrate mucus in muco-obstructive lung diseases, e.g., cystic fibrosis (CF), chronic obstructive pulmonary disease (COPD), non-CF bronchiectasis (NCFB), and primary ciliary dyskinesia (PCD). A key step in muco-obstructive disease pathogenesis is the osmotic compression of the mucus layer onto the airway surface with…

Molecular Characterization of Polymer Networks

Chemical Reviews · 2021 · 314 citations

Polymer networks are complex systems consisting of molecular components. Whereas the properties of the individual components are typically well understood by most chemists, translating that chemical insight into polymer networks themselves is limited by the statistical and poorly defined nature of network structures. As a result, it is challenging, if not currently impossible, to extrapolate from the molecular behavior of components to the full range of performance and properties of the entire p…

Idempotent Generative Network

arXiv (Cornell University) · 2023-11-02 · 4 citations

We propose a new approach for generative modeling based on training a neural network to be idempotent. An idempotent operator is one that can be applied sequentially without changing the result beyond the initial application, namely $f(f(z))=f(z)$. The proposed model $f$ is trained to map a source distribution (e.g, Gaussian noise) to a target distribution (e.g. realistic images) using the following objectives: (1) Instances from the target distribution should map to themselves, namely $f(x)=x$.…

Unbounded: A Generative Infinite Game of Character Life Simulation

arXiv (Cornell University) · 2024-10-24 · 2 citations

We introduce the concept of a generative infinite game, a video game that transcends the traditional boundaries of finite, hard-coded systems by using generative models. Inspired by James P. Carse's distinction between finite and infinite games, we leverage recent advances in generative AI to create Unbounded: a game of character life simulation that is fully encapsulated in generative models. Specifically, Unbounded draws inspiration from sandbox life simulations and allows you to interact with…