Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
-
Updated
May 8, 2025 - Python
#
multimodal-generation
Here are 25 public repositories matching this topic...
🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
text-to-speech multimodality text-to-image text-to-audio text-to-video text-to-music multimodal-models aigc large-language-models llm text-to-3d multimodal-generation mllm text-to-sound large-vision-language-models multimodal-large-language-models lvlm
-
Updated
Apr 4, 2025 - HTML
OmniVCus: Feedforward Subject-driven Video Customization with Multimodal Control Conditions (NeurIPS 2025)
-
Updated
Sep 1, 2026 - Python
Official implementation of the ICASSP-2022 paper "Text2Poster: Laying Out Stylized Texts on Retrieved Images"
deep-learning image-processing pytorch artificial-neural-networks object-detection image-retrieval banner-generator banner-advertisements encoder-decoder-architecture image-text-retrieval aigc layout-design multimodal-generation poster-generation geneative-creation
-
Updated
Dec 18, 2023 - Python
[ISMIR 2025] A curated list of vision-to-music generation: methods, datasets, evaluation and challenges.
-
Updated
Aug 9, 2025
A unified audio-video variational autoencoder with cross-modal alignment for joint reconstruction and generation
audio video representation-learning audio-video variational-autoencoder dit video-generation vaes audio-generation multimodal-generation audio-video-generation
-
Updated
Sep 17, 2026 - Python
[NeurIPS 2025] HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation
-
Updated
Sep 19, 2025 - Python
[ICLR 2024] Contextualized Diffusion Models for Text-Guided Image and Video Generation
-
Updated
May 24, 2024 - Python
[CVPR 2025 Highlight] Official repository for CoMM Dataset
-
Updated
Dec 31, 2024 - Python
[CVPR '23] Unite and Conquer: Plug & Play Multi-Modal Synthesis using Diffusion Models
imagenet text-to-image semantic-segmentation plug-and-play face-generation multimodal celeba-hq-dataset multimodal-deep-learning face-synthesis text-to-image-synthesis diffusion-models ffhq-dataset text-to-image-generation multimodal-generation text-to-image-diffusion
-
Updated
Mar 31, 2024 - Python
[NeurIPS 2025] GuideFlow3D: Optimization-Guided Rectified Flow For Appearance Transfer
-
Updated
Mar 20, 2026 - Python
High-performance runtime for real-time multimodal generation and world models—streaming inference, stateful sessions, and distributed GPU execution.
pytorch wan diffusion inference-engine video-generation aigc multimodal-generation world-model qwen streaming-inference lingbot-world lingbot-world-v2 minimax-h3
-
Updated
Sep 15, 2026 - Python
The code used to train and run inference with MMDocRAG
information-retrieval multimodal-generation large-language-model vision-language-model retrieval-augmented-generation multimodal-retrieval-augmented-generation
-
Updated
Nov 6, 2025 - JavaScript
A Survey of Multimodal Retrieval-Augmented Generation
multimodal-retrieval large-language-models llms multimodal-generation multimodal-large-language-models retrieved-augmented-generation mllms multimodal-retrieval-augmented-generation
-
Updated
Nov 3, 2025
Generative Models for Real-World Sensor Time Series
time-series generative-models diffusion-models generative-ai multimodal-generation time-series-generation flow-matching autoregressive-generation
-
Updated
Jul 15, 2026 - Python
NeurIPS 2025 D&B | RAG-IGBench: benchmark for RAG-based interleaved image-text generation.
benchmark rag open-domain-qa datasets-and-benchmarks multimodal-generation neurips-2025 interleaved-generation
-
Updated
Jun 10, 2026 - Python
映雪｜面向 AI 影视与短剧创作的一体化工作台：在自由画布中完成故事策划、分镜编排、多媒体生成、素材沉淀与任务协作。
-
Updated
Sep 8, 2026 - TypeScript
Unofficial PyTorch reproduction for Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling.
pytorch image-generation reproduction vision-language multimodal-generation janus-pro unofficial-implementation
-
Updated
Jul 2, 2026 - Python
Unofficial PyTorch reproduction for OmniGen2, instruction-aligned multimodal generation and editing.
-
Updated
Jul 2, 2026 - Python
Unofficial PyTorch reproduction for DiffSensei: Bridging Multi-Modal LLMs and Diffusion Models for Customized Manga Generation.
computer-vision pytorch diffusion diffusion-model multimodal-generation mllm manga-generation cvpr-2025 unofficial-implementation
-
Updated
Jul 2, 2026 - Python
Add this topic to your repo
To associate your repository with the multimodal-generation topic, visit your repo's landing page and select "manage topics."