Comfyui face swap workflow. Use IP Adapter for face. mudman13. The workflow can generate an image with two people and swap the faces of both individuals. Forget face swap. K12sysadmin is open to view and closed to post. Nov 29, 2023 · IPAdapter offers an interesting model for a kind of "face swap" effect. ComfyUI IPAdapter plus for face swapping; Impact Pack for face detailing; Cozy Human Parser for getting a mask of the head; rgthree for seed control; If you need the background generation and face swap parts of the workflow, we recommend downloading Realistic Vision v6. It might even prompt you to install ComfyUI if you haven’t already…Probably the simplest wor Add a load image node, select a picture you want to swap faces with, and connect it to the input face of the ReActor node. We'll cover installation, model selection, and how to You need work with logic node (like rgthree nodes) or picker node (like image chooser node) to solve 2 problems: 1. Updated: 5/15/2024. Before you download the workflow, be sure you read “9. Back to your question - do a VAE Encode with image resulted from your Roop and run it throu a low denoise KSampler. In either case, you must load the target image in the I2I section of the workflow. Pick which source face you want to use and then which faces to replace (index starts from 0 and is comma seperated). \python_embeded\python. onnx," "retinaface_resnet50," and "codeformer. You can take a look at the paper HS-Diffusion. Drag and Drop the 4_0) LipSync Swapper workflow and It should have the above 4 inputs. To start the face swap process, add the Face Swap Custom Note after the VAE decode in your text-to-image workflow. however, I also have this option that you suggested, and I modified it for ip_adapter, so it’s good when there are more ways and possibilities. json file as well as a png that you can simply drop into your ComfyUI workspace to load everything. May 2, 2024 · For additional guidance, refer to my previous tutorial on using LoRA and FaceDetailer for similar face swapping tasks here. Additionally, create a load image node for the source image in the Reactor Face Swap. And I mean low (0. You can apply loras to this KSampler. Feb 27, 2024 · ComfyUI Mixlab Nodes have been adapted to support the latest version of ComfyUI, as well as Python 3. put the right preference face to Ipadapter node. although compfyui is great for other stuff. And above all, BE NICE. It starts with setting up essential custom nodes in ComfyUI, followed by configuring a sequence of operations including loading checkpoints, detecting faces, and executing the face swap using specialized nodes like "Eff. Usage. The idea is very reasonable and easy to reproduce. Dependencies:The Cozy SAL-VTON node for swapping clothes;Image Resize for ComfyUI for cropping/resizing;WAS Node Suite for removing the background;ComfyUI Essentials for the mask preview and remove latent mask nodes;ComfyUI Nov 9, 2023 · Nov 9, 2023. An initial image is generated, the faces are automatically recognized, and a face swap is performed with Reactor. Reload to refresh your session. If you want to play with parameters, I advice you to take a look on the following from the Face Detailer as they are those that do the best for my generations : Welcome to the unofficial ComfyUI subreddit. Github View Nodes. 1. Dec 1, 2023 · Using the Face Restore with Model Node 5. It is a 2 minute video. Any face that is larger than 128p will be fuxxored. Then, the faces are enhanced with two face Face Swapper. 5 refined model) and a switchable face detailer. Ideally, it does the following: Step 1: Generates a hyper realistic face as a reference image (or could be imported as a single image, or an image batch file) Step 2: Can use a Lora for the body references. ComfyUI Workflow – SDXL Face swap with Reactor; 10. Dec 16, 2023 · If you love face-swapping, you’ll love this workflow for ComfyUI. ComfyUI Workflows are a way to easily start generating images within ComfyUI. Does anyone have an img2img workflow? Because the one in the other thread first generates the image and then changes the two faces in the flow. You need to download insigtface Swap face, pass it through restore. 0” in the image. Optionally we also apply IPAdaptor during the Nov 5, 2023 · In this video, I'll walk you through the process of creating flawless faceswaps using the ReActor node. It can be a little intimidating starting out with a blank canvas, but by bringing in an existing workflow, you can have a starting point that comes with a set of nodes all ready to go. pth" for accurate face detection and replacement. 顔検出、顔交換、顔復元を容易にするために、複数のモデルを活用しています。. Create and Swap – ComfyUI Workflow; 11. Set a close up face as reference image and then input your text prompt as always. We keep the motion of the original video by using controlnet depth and open pose. Alternatively, you can download the JSON version of the AP Workflow and load it via ComfyUI Manager. Old Photo Reimagine – Restoration Feb 28, 2024 · Workflow: https://github. UltraUpscale; 12. Does anyone know of a "head swap" workflow - not just face, but entire head. Jul 31, 2023 · Assuming ComfyUI is already working, then all you need are two more dependencies. Comfyui ReActor の主な機能. Showing how to do video to video in comfyui and keeping a consistent face at the end. As another person stated quality is determined by inswapper but they still look okayish after face restore. 5 Workflow For Created by: Ning: What this workflow does 👉 Solve the problem of face mismatch when using ReActor node. AIアニメーション愛好家の皆さん、こんにちは！. It also works with img2img given a high denoise. The only adjustable parameter is the one used to adjust the similarity to the source image. LoRAs ( 0) Generate unique and creative images from text with OpenArt, the powerful AI image creation tool. This ComfyUI workflow is designed for swapping faces with high similarity using a trained LoRA model. Please keep posted images SFW. This one has pretty thorough comments so I won't say too much Oct 28, 2023 · The whole workflow is based on img2img and reactor, aiming to perform stylized portrait face-swap of characters. I gave up using any face swapping using comfyui; the result are always weird or innacurate; or it's just that i'm too retard, anyway. Updated: 2/18/2024 · 4. No Lora or Extension required. Feel free to customize the fidelity value to your preference; I’ve initially set it to a default of 1. For general upscaling of photos go: remacri 4x upscale. Please refer to my Youtube channel for the specific principles: ComfyUI风格化换脸的再思考. Belittling their efforts will get you banned. This functionality extends to both individual and multiple 36. May 2, 2024 · Step 2: Execute, Evaluate, and Optimize the Face Swap. 2. ComfyUI IPAdapter Plus; ComfyUI InstantID (Native) ComfyUI Essentials; ComfyUI FaceAnalysis; Comfy Dungeon; Not to mention the documentation and videos tutorials. y Y about 2 months ago. In this workflow, transform your faded pictures into vivid memories involves a three-component approach: Face Restore, ControlNet, and ReActor. Extract the zip files and put the . Sep 8, 2023 · Any Img2Img workflow? #20. 1️⃣ Install InstantID: Ensure the InstantID node developed by cubiq is installed within your ComfyUI Manager. com/cubiq/ComfyUI_InstantID (ComfyUI/custom_nodes/) instantid model . ComfyUI face swappingの世界への刺激的な旅に出発します。. Loader SDXL", "KSampler SDXL", and "FaceDetailer". choose the right person in base image to swap face (I think "picker SEGS node" in Impact pack will work) y. 3 MAX). You can also find other workflows I shared in GitHUB: ChaosFlow. mins read. SDXL ControlNet/Inpaint Workflow; 8. This Method can will keep 100% of the face details in very high quality. 4) Then you can cut out face and redo-it with IP Adapter. protobuf import reflection. Pros and Cons of the Face Restore Node; Face Swapping with the Reactor Fast Face Swap Node 6. 2) Input the path of the Refined Images (Renders) of the Video here. Apr 30, 2024 · 1. Add a FaceSwapNode, give it an image of a face (s) and an image to swap the face into. 2+cu121. *ComfyUI Workflow* - https://drive. onnx files in the folder ComfyUI > models > insightface > models > antelopev2. Authored by Gourieff. Basic Setting: Soiurce Image: Throw a portrait into it ComfyUI Face Swap Workflow (Leave a comment if you have trouble installing the custom nodes/dependencies, I'll do my best to assist you!) This simple workflow consists of two main steps: first, swapping the face from the source image to the input image (which tends to be blurry), and then restoring the face to make it clearer. py. Example Workflows Full inpainting workflow with two controlnets which allows to get as high as 1. If you want to have roop and reactor nodes installed at the same time, You may need to add two lines at main. exe -s -m pip install matplotlib opencv-python. Be prepared to download a lot of Nodes via the ComfyUI manager. resize down to what you want. comfyui workflow. It utilizes nodes such as "ReActorFaceSwap," incorporating models like "inswapper_128. Extension: ReActor Node for ComfyUI. Welcome to the Character Face Swap workflow! It is specialized for your target character face swap. 4 alpha 0. Restoring Blurry Facial Features 5. A lot of people are just discovering this technology, and want to show off what they created. If you want to post and aren't approved yet, click on a post, click "Request to Comment" and then you'll receive a vetting form. Welcome to the unofficial ComfyUI subreddit. ここで、ComfyUI Reactorワークフローを紹介します。. 1. 5 stable diffusion model, but often faces at a distance tend to be pretty terrible, so today I wanted to offer this tutorial on how to use the F My workflow of photomaker allows for more control of your generation and you are able to squeeze out more detail early on and have better likeness with less tweaks and runs. 0 denoise strength without messing things up. Please share your tips, tricks, and workflows for using this…. Mar 10, 2024 · 2024-03-10 - Added nodes to detect faces using face_yolov8m instead of insightface. Perfect for artists, designers, and anyone who wants to create stunning visuals without any design experience. In this workflow, you will experience how SUPIR restores and upscales images to achieve photo-realistic results. (You need to create the last folder. ReActor. 000. •. Download the antelopev2 face model. Adaptation to new custom nodes December 15, 2023. It operates through nodes like "ReActorFaceSwap," leveraging models such as "inswapper_128. google. Face Swapper. You can swap the face of one or more subjects in any image with the face of choice. 3 days ago · ComfyUI ReActor は、ReActor SD-WebUI 顔交換拡張機能の能力を活用した、高速でシンプルな顔交換拡張ノードを導入します。. To add content, your account must be vetted/verified. Hidden Faces. Whether you're a fan of video games, anime, or photorealistic, swap face with your favorite characters in a realistic and seamless manner. Provide a source picture and a face and the workflow will do the rest. Optionally we also apply IPAdaptor during the generation to help Welcome to the unofficial ComfyUI subreddit. Sep 7, 2023 · I love the 1. Firstly, a mask is automatically generated which controls the respective deviation IP adapter. Then decode and save. Apr 24, 2024 · This ComfyUI workflow is designed for advanced face swapping in images, videos or animations. The node emits outputs from 1-N, but the index of load image batch expects 0-N, so you have to insert a dummy 0th image. Reply reply. Face Restore sharpens and clarifies facial features, while ControlNet, incorporating OpenPose, Depth, and Lineart, offers For example, doing a hairstyle with my option will turn out to be more realistic and more beautiful than the one you suggested. During Reactor Node phase, it is Swap / analyzing each frame for about 1~2 seconds. GFPGAN. The generated character should have the face of the reference. Then restart ComfyUI. com/Gourieff/comfyui-reactor-node?tab=readme-ov-file. Where's the catch? https://github. Apr 26, 2024 · 1. Made with 💚 by the CozyMantis squad. To help with its stylistic direction, you can use IPAdapters to control both style and face of the video output. You can chain the nodes to replace multiple faces in a scene. Overall goal is keeping the face/looks (duh) I lover tinkering woth ComfyUI. ComfyUI SUPIR for Image Resolution | ComfyUI Upscale Workflow. Explore Clothes Swapping technology within ComfyUI. Use LoRA and embeddings to enhance character concept in stable diffusion. Reply. 0 and its inpainting version, and placing them in your models/checkpoints Mar 25, 2024 · The zip file includes both a workflow . The highlight is the Face Detailer, which effortlessly restores faces in images, videos, and animations. 👍🏼. com/dataleveling/ComfyUI-Reactor-WorkflowCustom NodesReActor: https://github. 4️⃣ Run the Face Swap Operation: With the setup complete, initiate the face swap process once more to observe the enhancements made by the IP-Adapter. . We also have some images that you can drag-n-drop into the UI to have some of the Apr 5, 2024 · This workflow at its core is optimized for using LCM rendering to go from text to video quickly. The idea here is that I make a face, make a body, then that is used as a reference later on for generating all of the images. But still: For some things I need to get a look at an existing and working workflow to integrate it into my "chaos". ControlNet Depth ComfyUI workflow. The first method is to use the ReActor plugin, and the results achieved with this method would look something like this: Setting up the Workflow is straightforward. Drag it inside ComfyUI, and you’ll have the same workflow you see below. Dec 9, 2023 · Here’s another fun one for you face swapping fans!In this video, we delve into the fun and exciting world of face swapping revealing tips and tricks on how t Usage. Any issues or questions, I will be more than happy to attempt to help when I am free to do so 🙂 You signed in with another tab or window. Works great unless dicks get in the way ;+} Absolutely. Search about IPAdapter plus face, IPAdapter Full face and IPAdapter Faceid, they capture the whole aspect of the face, including head format and the hair. Feb 7, 2024 · In this video, we will see how to face swap in a video using ReActor. I'm sure that someone knows of such a workflow. Video to Video with Face Swap in ComfyUI; 15. これにより、ビデオ内の1つの顔または複数の Extension: ReActor Node for ComfyUI. Instant face-swap. But for the online version, users cannot simplify it, resulting in a long running time, and some steps are not necessary. ) Restart ComfyUI and refresh the ComfyUI page. Question: 3 days ago · ComfyUI ReactorによるVideo Face Swappingガイド. Carefully compare the initial reference image with the newly generated face swap image to assess the improvement in similarity. If not, you are looking at a cached version of the image. AnimateDiff Video to Video; 14. 25-0. Users of the workflow could simplify it according to their needs. Generates backgrounds and swaps faces using Stable Diffusion 1. You have to Choose From A or B which you want to enhance further in 4_1) Face Fix workflow. Sample workflows are in the repo. May 2, 2024 · In this ComfyUI video, we take the images from the 2nd part of this series and add details in batchThis is part 3 of 3Workflow: https://pastebin. ControlNet Workflow. Swapping Multiple Faces in an Image Animation using ComfyUI Workflow by Future Thinker generate 15fps video with detailer+face_swap upscaled video to 1024x1536x30fps using Davinci Resolve + Flowframes 1. **Hi everyone, I just got into faceswap and have a quick question on time taken to do a video face swap. com/Gourieff/comfyui-reactor-nodeVideo Helper Suite: ht ComfyUI IPAdapter plus for face swapping; Impact Pack for face detailing; Cozy Human Parser for getting a mask of the head; rgthree for seed control; If you need the background generation and face swap parts of the workflow, we recommend downloading Realistic Vision v6. The only way to keep the code open and free is by sponsoring its development. Does anyone have a solid way of swapping two faces in one image in a single workflow? I am playing around with bounding boxes etc. 0 and its inpainting version, and placing them in your models/checkpoints face swap two subjects. The Fast and Simple 'roop-like' Face Swap Extension Node for ComfyUI, based on ReActor (ex Roop-GE) SD-WebUI Face Swap Extension. ComfyUI Workflow: Face Restore + ControlNet + Reactor | Restore Old Photos. It's equipped with various modules such as Detector, Detailer, Upscaler, Pipe, and more. 6K. On mac, copy the files as above, then: source v/bin/activate pip3 install matplotlib opencv-python Oct 24, 2023 · Create AI images with a PERFECT FACE. How to use this workflow 👉 Simply click "Queue Prompt" after loading the image. Below is my setup on comfyUI. py#L1 ) import onnx from google. Merging 2 Images together. Finally ReActor and face upscaler to keep the face that we want. Any image, any human face. This tool allows for swapping faces on both single and multiple Jan 15, 2024 · DM/comment for question or your experiential needs. Using LoRA's. Tips about this workflow 👉 It is not perfect and can be generated again if it doesn't work well the first time Feb 1, 2024 · 7. Choosing the Face Detection Method. Create animations with AnimateDiff. Finally, add a save image node and connect it to the image of the ReActor node. 包括的なノードシステム K12sysadmin is for K12 techs. instantid node: https://github. You can use ver Welcome to the unofficial ComfyUI subreddit. Detailed ComfyUI Face Inpainting Tutorial (Part 1) 22K subscribers in the comfyui community. Please share your tips, tricks, and workflows for using this software to create your AI art. Oct 14, 2023 · Details. Feb 17, 2024 · Deep Dive into the Reposer Plus Workflow: Transform Face, Pose & Clothing. Apr 18, 2024 · Put it in the folder ComfyUI > models > controlnet. ComfyUI Txt2Video with Stable Video Diffusion; 13. Check my ComfyUI Advanced Understanding videos on YouTube for example, part 1 and part 2. 3. pth" for precise face detection and swapping. Try to pre-crop your images to a square and 1024x1024 with the face close to center for best results. Add a Comment. #shorts #comfyui #faceswap Extension: MTB Nodes NODES: Face Swap, Film Interpolation, Latent Lerp, Int To Number, Bounding Box, Crop, Uncrop, ImageBlur, Denoise, ImageCompare, RGV to HSV, HSV A ComfyUI Workflow for swapping clothes using SAL-VTON. You switched accounts on another tab or window. This workflow use the Impact-Pack and the Reactor-Node. 5 checkpoints. Feb 25, 2024 · This ComfyUI workflow excels in executing advanced face swaps across images, videos, or animations. Translated nodes summarized This simple workflow consists of two main steps: first, swapping the face from the source image to the input image (which tends to be blurry), and then restoring the face to make it clearer. Simply type in your desired image and OpenArt will use artificial intelligence to generate it for you. The first method is to use the ReActor plugin, and the results achieved with this method would look something like this: Setting up the Workflow is I would love to see if I can do a complete head swap with that same concept! I do it using comfyui with reactor plus loadvideo and savevideo in the n-suite plugin and standard load image for the face to insert. If your source image has multiple faces, you can target the desired one via an index value. I have read the instruction carefully; I have searched the existing issues; I have updated the extension to the latest version; What happened? I created a simple workflow with face swap using a face model and source image. file in the comfyui root directory (like: main. ComfyUI, combined with stock or your own videos, can transform your storyboarding and video projects. 1) Input the path of the Original Frames of the video here. Now with controlnet, hires fix and a switchable face detailer. Selecting Reference Images 6. Dec 15, 2023 · (This template is used for Workflow Contest) What this workflow does 👉 Workflow with integrated automation and translation, expanded to include various face optimizations Many built-in automations, various options for face optimization and face swapping. Face Replacement Using Existing Images 6. To run the whole grid, press the "queue full grid" button. In the last issue, we introduced how to use ComfyUI to generate an App Logo, and in this issue we are going to explain how to use ComfyUI for face swapping. Or any suggestions as to how to marry a head and a body would be greatly appreciated. Version 3:0. Face Restore sharpens and clarifies facial features, while ControlNet, incorporating OpenPose, Depth, and Lineart, offers Oct 13, 2023 · How To Use Stable Diffusion ReActor FaceSwap Custom Node In ComfyUI (Tutorial Guide)In today's tutorial, we're going to walk through the Stable Diffusion Fac LoRAs ( 1) Generate unique and creative images from text with OpenArt, the powerful AI image creation tool. ComfyUI Face Swap Workflow; 9. You signed out in another tab or window. Step 4: Run the workflow However, the previous workflow was mainly designed to run on a local machine, and it's quite complex. Add the following code to the header of the main. py of root folder of comfyui. Priorities are consistent images following my description and a reliable face swap that doen't change the generated image too much. sharpen (radius 1 sigma 0. This ComfyUI Upscale workflow utilizes the SUPIR (Scaling-UP Image Restoration), a state-of-the-art open-source model designed for advanced image and video enhancement. but still not getting great results. Integrating and Configuring InstantID for Face Swapping Step 1: Install and Configure InstantID. If you used the portable standalone build of ComfyUI like I did then open your ComfyUI folder and:. Below is the log with timeline:**. These custom nodes can help you transform workflows into Web APPs and… Img2Img ComfyUI workflow. com/raw/ank メリットと特徴 Unlimited length videos can be generated with the Vid2Vid AnimateDiff workflow Feb 22, 2024 · The SDXL workflow includes wildcards, base+refiner stages, Ultimate SD Upscaler (using a 1. For this example we use IPAdapters to control the clothing and the face. Generate unique and creative images from text with OpenArt, the powerful AI image creation tool. 11and torch 2. Upscaling ComfyUI workflow. You can swap faces in individual images or all images in a directory. Connect the VAE code as the input image and the image output to the save image node. Reactor will gove airbrushed looks because the resolution of reactor is 128p. Image Input and Upscale Model 5. Feb 22, 2024 · First, confirm. com/file/d/1EMAuVgPnOLXr2VFm5zW-Yh_yfFecNNFl/v Cozy Portrait Animator - ComfyUI Nodes & Workflow To Animate A Face From A Single Image: Cozy Clothes Swap - Customizable ComfyUI Node For Fashion Try-on: Cozy Character Turnaround - Generate And Rotate Characters and Outfits with SD 1. Only the face is redrawn, areas outside the face remain unchanged. 5, SV3D, and IPAdapter - ComfyUI Workflow: Cozy Character Face Generator - ComfyUI SD 1. Prerequisites (Custom Nodes): Apr 24, 2024 · The ComfyUI Impact Pack serves as your digital toolbox for image enhancement, akin to a Swiss Army knife for your images. 2. The workflow is provided. Di Oct 14, 2023 · This is a ComfyUI workflow to swap faces from an image. And since I find these ComfyUI workflows a bit complicated, it would be interesting to have one with a simple face swap with a facerestore. Inpainting workflow. We use animatediff to keep the animation stable. rp on zk gj ub tq kf cd ws fr