Innovate Futures @ Benji posts
Posts: 709
Files: 875
How To Use AuraFlow And AuraSR In ComfyUI - An Open Source Image Generation Model
Video : https://youtu.be/rV82nRzz3_4AuraFlowhttps://huggingface.co/fal/AuraFlow/tree/mainAuraSRhttps://huggingface.co/fal/AuraSRAuraSR Upscalerhttps://github.com/fal-ai/aura-srhttps://github.com/ZHO-ZHO-ZHO/ComfyUI-AuraSR-ZHO
Stable Diffusion ControlNet - Tile Diffusion To Upscale An Image
Video: https://youtu.be/lrhGnfELeRQIn this video, we'll explore how to avoid memory issues and ensure consistent output by using the tile control net. We'll also discuss the benefits of using SDXL models and the ComfyUI Tile Diffusions custom node. With these tools, we can easily upscale images and generate ultra-large outputs without compromising quality. Throughout the video, we'll walk you through a step-by-step workflow using custom nodes and control nets. You'll learn how to encode and decode with the VAE, configure the til...
v2v-LivePortrait for KJ edition
Previously we have v2v-LivePortrait using shadowcz007/comfyui-liveportraithttps://www.patreon.com/posts/liveportrait-in-107936153In this post, I update another new version of LivePortraitKJ working for v2v.Please check the attachment below.Have fun :)
[Paper Time] 3 Awesome AI Models For Animation - MotionFollower , UniAnimate , EasyAnimate
Video : https://youtu.be/2c_-okJ-uooIn today's video, we're thrilled to introduce you to three groundbreaking AI models for video editing: MotionFollower, EasyAnimate, and UniAnimate. These models are set to revolutionize the way we create and enhance videos, bringing a whole new level of creativity and realism to our projects.MotionFollower: AI-Powered Video Motion Editinghttps://francis-rings.github.io/MotionFollower/Have you ever wished you could transfer motion from one video to another seamlessly? MotionFollower is here to make you...
Same Motion In Difference AI Models
That was the demo of my AnimateDiff workflow in one of the previous workflow contest in OpenArt.Another one is Mimic Motion.Same dance movement.
LivePortrait In ComfyUI Create Video2Video And Multi-Face Animation
Video : https://youtu.be/q816HyZiw18In this video, I am going through the process of setup your ComfyUI running LivePortrait with v2v and multi-face animation.PatreonMembers Goodies : https://www.patreon.com/posts/liveportrait-in-107936153Custom Node Packs You Need:https://github.com/shadowcz007/comfyui-liveportrait/tree/mainhttps://github.com/shadowcz007/comfyui-mixlab-nodes
LivePortrait In ComfyUI Create Video2Video And Multi-Face Animation - Members Goodies
Video: https://youtu.be/q816HyZiw18In this video, I'll guide you through the setup process so you can harness the power of multi-face and video2video capabilities. Custome Node To Create V2V Liveportrait In ComfyUI https://github.com/shadowcz007/comfyui-liveportrait/tree/mainhttps://github.com/shadowcz007/comfyui-mixlab-nodesAttached the setup step document.And also the example workflow, in case you missed it.
Testing Testing! LivePortrait V2V!
Coming up long form video.
FoleyCrafter - Add Sound Effects to Your Videos With Just A Click!
Video : https://youtu.be/xG7JG3K_UvEIn this video, I will walk you through the process of using the FoleyCrafter AI model to bring your silent videos to life. You'll witness how this text-based video-to-audio generation tool can seamlessly add synchronized sound effects to your video clips, creating a more immersive experience for your audience.Stable Diffusion ComfyUI Workflow - Using Multimodal Pipeline To Create AI Videohttps://youtu.be/EgM4OGRj2OQKling AI Videohttps://youtu.be/_MC-Vx0IsWERunwayml Gen 3 Alphahttps://youtu.be/XDnGK4lgYdoI...
Minic Motion Workflow V2 (Update) - For Patreon Members
Workflow based on the V1 : https://www.patreon.com/posts/mimicmotion-v1-107525816Add reference image group to handle multiple situations.you can use your existing images by file pathor Img2img from reference video frame and restyle it (Refer to V1 post)Handle Resize Image for both ref_image and ref_video
Image To LivePortrait Workflow
This workflow contain 3 groups.Basically, create portrait image, LivePortrait , and upscaling group.I try to make it simpler workflow (not going to be complex like AnimateDiff)So play around with it, and have fun! :)Please let me know if you have question.Thanks,Ben
SDXL ControlNet Test Lab - For Supporter+ Members
Here is the workflow for SDXL CN All-In-One Model testing workflow that I use in the tutorial.Tutorial : https://youtu.be/QtqxaxZT3jsSDXL ControlNet++ Model Download : https://huggingface.co/xinsir/controlnet-union-sdxl-1.0Please find the attachment for go through the tutorial test for All In One Controlnet for SDXL.
Stable Diffusion ControlNet All In One Model For SDXL - Best Ever Life Saver
Video: https://youtu.be/QtqxaxZT3jsAll-new ControlNet++ All-in-one models specifically designed for Stable Diffusion's XL models.Huggingface Download : https://huggingface.co/xinsir/controlnet-union-sdxl-1.0With the ControlNet++, you can now use one ControlNet file and collaborate with different ControlNet preprocessors like open pose, line art, depth map, Scribble, and more. It's a game-changer that allows you to handle various input image preprocessors with ease.In this video, I'll demonstrate how to use the ControlNet conditioner...
LivePortrait In ComfyUI - A Hedra AI Alike Talking Avatar In Local PC
Tutorial Video : https://youtu.be/aFcS31OWMjEIn today's video, we are diving into the use of LivePortrait In ComfyUI, an AI model that brings your photos to life with realistic movements. With LivePortrait, you can create animated portraits that resemble those magical moving pictures from the Harry Potter series.In this tutorial, I'll explain how LivePortrait works, utilizing implicit keypoints to understand and animate important parts of your face. We'll explore how it learns from real videos, allowing your photo to mimic the motio...
Minic Motion went up to this Frame number
pretty cool experimentnext , I will be testing difference setting. And try with multiple character workflow with difference action scenes.
MimicMotion_workflow_img2img-RestyleFrame-v1 (For Patreon Supporters)
This is a tutorial and workflow for Patreon Supporter and Above membership level.Based on the Youtube video on the public : ComfyUI Create AI Influencers Dance Video Wtih Minic Motion. https://youtu.be/oQT5AwReRgMWe have talked about how to use the basic workflow from MimicMotion.This Tutorial , we are going to more advance and customizable features, by using MimicMotion to create a character motion video.So the workflow are divided in 5 groups.Reference loader - Load in your reference video, it can be a normal video or a DWPose stick man video...
ComfyUI Create AI Influencer Dance Video With Mimic Motion
Video : https://youtu.be/oQT5AwReRgMWe are diving into the fascinating world of ComfyUI and exploring how to create AI influencer dance videos using their Mimic Motion framework. If you want to take your dance videos to the next level and achieve that perfect synchronization with your favorite anime characters or any other source videos, then this video is for you.Throughout this tutorial, I'll guide you through the installation process of the ComfyUI Minimic Motion wrapper and its dependencies. We'll also download the necessary files, ...
Another Experiment With Motion
Coming up tutorial. Well, not only for Tiktok dance. But we can make a movie with it 😜
Nope, this is not Animate Anyone :)
Enjoy ! :) content about this soon.
Stable Diffusion ComfyUI Workflow - Using Multimodal Pipeline To Create AI Video
Video : https://youtu.be/EgM4OGRj2OQIf you need to setup Local Ollama to host your local LLM with ComfyUI.Here's previous tutorials :1 - https://youtu.be/EQZWyn9eCFE2 - https://youtu.be/yR2Y9G71w6EWe'll be exploring how to create stunning AI videos with the help of a multimodal pipeline.Conceptual Diagram (Current Version)As we all know, AI video models have been evolving rapidly, and now we have companies like Kling AI, Luma AI, and the latest Gen-3 AI video models from RunwayML. Although Runway Gen-3 is currently available only for te...
Create Story Sence Workflow - ComfyUI + LLM (Patreon Only)
Using Multimodal Pipeline To Create AI VideoTutorial Video : https://youtu.be/EgM4OGRj2OQThis workflow are going to be the ver.1.0 of it. I believe once we have more AI Video Models release on the market. We will able to know what to enhance in order to make a streamline of workflow as a whole video creation process.But so far, this workflow create scene by scenes of a story and fulfill the basic.If you need to setup Local Ollama to host your local LLM with ComfyUI.Here's previous tutorials :1 - https://youtu.be/EQZWyn9eCFE2 - https://youtu...
AI Diffusion Models From Static to Dynamic - AutoStudio, MOFA-Video, and ViewDiff
Video : https://youtu.be/WCQtYPUHf9kThis is another video, I want to share about difference diffusion models, framework projects that are new and potentially release ComfyUI custom node as tool.We should keep looking for other alternatives. And personally, I don't like to stick with only one, especially in tech stuffs.From image, video animation and 3D object generated by AI, I made a list in this video.
AI Video Story - 2 Good Friends Shattered Innocence
Create scenes with Kling AI , and some with Stable Diffusion. Haven't editing much, just try to put a story into text 2 video, and images. Next, will get a workflow make characters consistent.Just want to test how the whole processing workflow can be using AI tools to create short story.https://youtu.be/t3jUpxwdVoc
Streamer-Sales AI Agent Help eCommerce Businesses Become Live Stream Host 24x7
Video: https://youtu.be/9OBIiXyGHakWe're diving into the world of Streamer-Sales, an advanced AI model designed to revolutionize the eCommerce experience. This AI model acts as a live-stream sales host, stimulating user purchasing intent through detailed and engaging product descriptions. In this video, we'll explore the technical specifications and capabilities of Streamer-Sales. We'll discuss its base model, deployment using LMDeploy for accelerated inference, and key features like KV Cache + Turbomind, RAG (Retrieval-Augmented Ge...
Benji-AnimateDiff-Vid2Anime_FullVersion -Update- Version 20240626
Related Video: https://www.patreon.com/posts/106877649Based on the AnimateDiff-Vid2Anime_FullVersion - Version 20240528https://www.patreon.com/posts/benji-vid2anime-105079998?utm_medium=clipboard_copy&utm_source=copyLink&utm_campaign=postshare_creator&utm_content=join_linkUpdate:New added group for green backdrop effect.Simplify the ControlNet groupMinor edit on sampler setting.
Stable Diffusion ComfyUI And Diffutoon - Full Video
For Patreon Supporters onlyRelated Video : https://www.patreon.com/posts/106877649Attached ComfyUI workflow in case you missed it from the Github. And I add some nodes for the Smooth Video img2img workflow as well, show in this full video.
Stable Diffusion ComfyUI And Diffutoon Create Deflickering Videos - Domo AI Alternative?
Video : https://youtu.be/dGdUNZGKQYQStable Diffusion Animation - ComfyUI And Diffutoon Create Deflickering Videos - Domo AI Alternative?We're diving into the world of Stable Diffusion's animation and exploring a fascinating new project called Diffutoon. This project takes video-to-video transformations to a whole new level by turning dance videos into anime or cartoon-style videos.Throughout this video, I'll be explaining how Diffutoon functions as a pipeline, linking up various diffusion models like ControlNet and AnimateDiff Motio...
ComfyUI With Florence 2 Vision LLM - This Is Not Just A Segmentation Model
Video : https://youtu.be/BRST8-yPD5AComfyUI With Florence 2 Vision LLMIn this video, I delve into a new LLM - Florence 2, an extraordinary vision foundation model developed by Microsoft. Join me as I discuss its features, demonstrate its capabilities, and guide you through the installation process.Florence 2: An Image-to-Text Prompt Large Language ModelFlorence 2 is trained with the massive FLD-5B dataset, making it one of the most accurate and detailed text generation models for images. In this video, I'll showcase two custom nodes that co...
