0:02 Getting consistent characters in your AI
0:05 videos is one of the most challenging
0:08 aspects of the creative AI process. But
0:11 luckily for you, I've gone in and tested
0:14 every single AI character creation
0:17 workflow, and I have what I think is the
0:19 very best way to get consistent
0:22 characters that actually look accurate
0:24 again and again. So, in this video, I'm
0:26 going to break down the entire process
0:29 and give you a few helpful tips along
0:31 the way. I'm super excited for this one.
0:33 Let's hop in. Welcome to Curious Refuge.
0:35 So, first things first, we need to
0:38 create our base images. And when it
0:41 comes to creating the very best and most
0:44 cinematic images possible, the best tool
0:46 out there is MidJourney. There's all
0:48 sorts of advanced features, including
0:50 iteration and style reference, that make
0:53 MidJourney an incredible tool. and you
0:55 can create a lot of images really
0:57 quickly. So, the tool is incredible to
0:59 use. So, in order to use MidJourney, all
1:01 you have to do is go to the Midjourney
1:03 website and there's the explore page
1:06 which has a ton of really inspiring
1:08 photos, but we're going to ignore that
1:11 for now. And let's go ahead and go to
1:13 our prompt window here. So, for our
1:14 prompt, I'm going to keep things pretty
1:18 simple. We'll say a cinematic still of a
1:22 man in a sci-fi film. Of course, that's
1:24 very generic, right? Like you probably
1:26 want to go in and prompt for the
1:30 specific composition, the lens
1:32 qualities, the location, what the
1:34 character is wearing, all of those
1:36 things. But for our example, I'm going
1:38 to keep things really, really simple.
1:40 Now, before I hit render, first things
1:42 first, we need to bring in our
1:44 character. So, for our example, I'm
1:47 going to use a picture of me in the
1:50 studio here. And I should note that it's
1:52 usually best if you have a bunch of
1:54 pictures of your subject. You can have
1:56 everything from just their face to the
1:59 actual clothing that you want to see in
2:01 the final result. It really depends on
2:03 if you just want the character's face to
2:05 be consistent, their clothing, or
2:06 basically everything that they're
2:09 wearing. It's entirely up to you, and it
2:11 will change from project to project. For
2:13 this project, I'm going to pretend like
2:16 I want that exact same clothing and
2:18 character again and again. And so you
2:19 can see what I'm wearing here. It's like
2:23 a denim jacket. It has a a brown emblem
2:26 on the pocket. And then the hair is, you
2:27 know, gray and swoopy. And we'll just
2:29 ignore the fact that his mustache,
2:30 eyebrows, and hair are completely
2:32 different colors. So we have our subject
2:34 here. And all you have to do inside of
2:37 MidJourney is just drag and drop it to
2:39 the upload file section. So we're good
2:41 to go there. And make sure that you are
2:44 in image mode. Right now I'm in video
2:46 mode. We'll select image. So, instead of
2:48 keeping this image in the image prompt
2:51 section, I'm going to drag this over to
2:53 omnireence, which is basically like
2:56 character reference. And one last thing,
2:59 we're going to add in a code to generate
3:01 multiple iterations of this prompt. So,
3:04 we'll do d-r,
3:05 and then you can type in any number you
3:08 want all the way up to, I believe, 40.
3:09 But for ours, we'll just do five. You
3:11 know, that gives us 20 images. It's
3:12 really quick. And you do have the
3:15 ability to upload style references,
3:17 image references, which will create
3:20 compositional references that will try
3:21 to put the character in the same
3:24 location. And you also have the ability
3:26 to use mood boards inside of MidJourney
3:29 to get consistency when it comes to the
3:32 lighting and style and just any other
3:33 stylistic elements that you want. again
3:35 and again. This video is not going to
3:37 cover those things, but you'll find a
3:39 link below this video to a few resources
3:41 that will show you how to use those
3:42 things. Okay, cool. So, let's go ahead
3:45 and hit render and see our results.
3:47 Okay, and after about 30 seconds, we
3:49 have a few images here. Let's take a
3:53 look. And you can see that that looks a
3:55 lot like me, but it's not exactly me. It
3:58 did a pretty good job. But if we want to
3:59 get a more consistent character,
4:01 especially in the clothing, there's
4:02 going to be a few other steps that we
4:04 need to take. And we have this shot
4:06 here, which kind of looks like me. It's
4:08 pretty close, but it's not quite right.
4:10 If we're working on a film or
4:12 advertising project and we had multiple
4:14 shots with this character, there might
4:16 be inconsistencies. And then I should
4:18 note that totally looks like an AT-AT
4:20 mixed with an X-wing, which is uh pretty
4:22 cool. We have this shot here. Again, the
4:24 beard is completely different. The
4:27 clothing is inconsistent. This person is
4:29 not me. The clothing is close, but you
4:31 get the idea. So, working with
4:32 consistent characters inside of
4:35 Midjourney can be tricky. You can turn
4:37 up the omni reference slider all the way
4:40 to 1,00 and you're still going to have
4:42 problems getting the character and the
4:44 clothing again and again. But that's
4:46 okay. I have a workflow that I want to
4:48 show with you. So, let's take a look at
4:50 three different examples. All of these
4:52 images I generated from midjourney using
4:55 the method that I just showed you a few
4:57 seconds ago. So we have shot number one
5:00 here, shot number two, and shot number
5:01 three. Let's set the stage. Basically,
5:04 let's say that for shot number one, I
5:06 want to have the character be, of
5:07 course, me. And then I want them to be
5:10 wearing the denim jacket from the other
5:12 photograph. We'll do the same thing for
5:14 shot number two. And for shot number
5:16 three, I actually like the clothing that
5:17 this character is wearing, but of
5:20 course, the character is not exactly me.
5:21 They have different facial hair and
5:23 their face is just a little off. A lot
5:25 of times when you watch video tutorials
5:27 showing you how to do consistent
5:28 characters, they'll use the most generic
5:30 AI looking character that you've never
5:32 seen before and it'll generate the
5:34 character again and again, but you don't
5:36 know that person and ultimately it's not
5:38 actually doing a very good job. So, this
5:40 method actually will do a good job. So
5:43 the next thing that we need to do is hop
5:46 over to a really impressive tool called
5:49 Idoggram. Ideoggram is an online tool
5:51 that can do everything from generating
5:54 images to batch generations. There's a
5:55 bunch of other editing tools that are
5:57 really interesting. But for this
5:59 specific example, I'm actually going to
6:02 go over to our canvas section here. And
6:04 you can see that we have a canvas with
6:06 our images. It's actually really easy to
6:08 use this canvas. All you do is just drag
6:10 and drop the image and it drops it in
6:11 there. You can just arrange them however
6:14 you want. So, we have our three images.
6:17 Now, it's time to swap the face of these
6:20 characters. So, what I'm going to do is
6:22 I'll select this first one here. We'll
6:24 zoom in. And we want to swap just the
6:26 face. Again, for this specific image, I
6:28 don't want the clothing to change. So,
6:30 we're going to go to a little tool on
6:33 the left called Magic Fill. I think that
6:36 this is one of the most underutilized
6:39 and appreciated tools in the entire AI
6:41 creative ecosystem. So, let's go ahead
6:44 and select our character's head. And
6:46 we'll be mindful not to select too much
6:47 because, of course, we don't want the
6:49 background or the clothing to change
6:51 here. And we'll go ahead and select
6:54 next. So, you can see we have our magic
6:57 fill box here. We're defining that we
6:59 want to change the head. And then let's
7:01 go ahead and select character here. So
7:04 now it's time to go to a new character
7:06 and go ahead and click upload. Okay, so
7:08 now comes the fun part. Let's go ahead
7:11 and select a face that we want to bring
7:14 into the generation. So I have a bunch
7:16 of different faces here of me looking
7:19 around. We'll say we want to bring in
7:21 this one here. So we'll go ahead and
7:23 bring him into ideoggram. And for our
7:25 prompt, you don't have to be hyper
7:27 specific, but let's go ahead and direct
7:28 what we want our character to be doing.
7:31 We'll say, "A man in a sci-fi film looks
7:33 to the left." So, really simple. And
7:35 then we'll also go ahead and set up a
7:38 magic prompt so that it basically goes
7:40 in and expands the prompt to be as
7:41 specific as possible. It's very helpful.
7:43 And we'll go ahead and select magic
7:45 fill. Okay, let's take a look at our
7:47 results here. We have shot number one. I
7:48 think he's looking the wrong way. Shot
7:51 number two, basically perfect. It did an
7:53 amazing job. That looks like me. It even
7:55 has like my cowl hair like pointing up
7:56 to the side. Really good. Number three,
7:58 not the best. And then number four,
8:00 again, it did a really, really good job.
8:02 I think number two is just balling. That
8:05 is like crazy photorealistic. That's
8:07 great. But we're not done yet. So, we'll
8:09 go ahead and download that to our
8:11 computer. And let's go ahead and do one
8:13 more example. Okay. So, we're back here
8:16 in the canvas. Let's go ahead and select
8:20 this image here. We'll go to magic fill.
8:23 Select their lasso. Just grab that guy.
8:26 Boop. Just like that. You can select
8:29 more if you want or less. It's entirely
8:31 up to you. Go ahead and select next. And
8:33 again, we need to select our character.
8:35 I have found that whenever you are
8:37 uploading your reference images, you
8:39 could totally just use one image where a
8:40 person's looking forward with flat
8:42 lighting. That's totally fine. If you
8:44 have a wider variety of images so you
8:46 can pick and choose the right one with
8:48 the right orientation, that's also very
8:50 helpful. Again, really flat lighting. If
8:51 you have your character standing in
8:53 front of a window or a large soft box,
8:56 that gives you as much lighting as you
8:57 need. It doesn't have to be like really
8:59 dynamic or match the lighting of the end
9:02 result. So, I'm going to deselect that
9:04 character. Let's go over here to the
9:07 character button and we will go to new
9:09 character. So, for this example, I'm
9:11 going to go ahead and select upload and
9:13 let's pick a shot of our character where
9:16 he's a little more facing forward since
9:18 this shot uh is not him looking off like
9:20 crazy to the side. So, we'll go ahead
9:25 and look through our training data here.
9:27 Try to find a good shot. Just kind of normal.
9:34 Okay, that's fine. That's like slightly
9:36 uh stoned looking, Caleb, but we we'll
9:38 take it. So, we'll go ahead and bring
9:40 that into ideoggram. And for our prompt,
9:42 we'll say, "A man in a sci-fi film looks
9:45 up and to the right." And go ahead and
9:47 click magic film. And while we wait on
9:49 this generation, I just want to let you
9:52 know about our AI courses at Curious
9:55 Refuge. We train artists at every major
9:59 studio and in 172 countries around the
10:01 world on the latest AI film making,
10:04 advertising, animation, documentary, and
10:06 VFX concepts, and we would love to have
10:09 you inside of the program. Our artists
10:11 go on to land full-time jobs in the
10:13 industry, create featurelength films,
10:15 and just frankly, they're awesome and
10:18 doing amazing things. We would love to
10:19 support you on your creative journey.
10:21 Okay, cool. Let's take a look at our
10:23 images here. So, we have shot number
10:26 one. Wow, it put a helmet on me. That's
10:28 pretty interesting. Shot number two
10:30 looks really, really good. Shot number
10:33 three. And then we have shot number
10:35 four. I think that like three or four
10:37 looks pretty good. Not too shabby. So,
10:38 it's kind of hard to pick here between
10:39 three and four. They're both pretty
10:41 good. I'll just download three and go
10:43 ahead and download that to your
10:45 computer. Okay. So, now that we've
10:47 swapped the face, and it looks pretty
10:49 darn good, it's time to swap the
10:52 clothing. Now, there are a lot of AI
10:55 clothing swap tools out there. And if
10:57 they ever allow you to swap clothing,
10:58 but you don't have the ability to
11:00 actually upload a reference image,
11:03 that's not very helpful for a film
11:06 making project. However, there are a few
11:08 tools out there that do allow you to
11:11 contextually edit your photos using
11:14 reference imagery and prompts. So, a few
11:17 of the most popular are Frames, Nano
11:20 Banana, and Seeddream. Now, we've tested
11:22 all of these tools, and there are pros
11:25 and cons to using them, but ultimately,
11:28 I think that Seeddream is the best tool
11:30 for doing clothing swaps. whenever you
11:32 need to have this conversational
11:34 experience to art direct what your
11:36 character is actually wearing. And I
11:38 think the easiest tool that allows you
11:42 to use seedream is freepic.com. So if
11:45 you go to freepic.com, go to generate
11:48 image and for our image reference, we're
11:50 going to bring in our image from the
11:52 previous example. So we have this shot
11:55 here of me wearing this jacket. Let's go
11:58 ahead and drag and drop that into image
11:59 reference. And now we need to bring in
12:01 an image of our character wearing the
12:03 clothing that we want them to wear. So
12:05 again, it's a very specific denim
12:07 jacket. You'll notice the little patch
12:09 on the pocket here. And we'll go ahead
12:12 and drag and drop that into image
12:14 references. And on the left, make sure
12:16 that under model, you're going to
12:20 Seedream and then going to Seeddream for
12:23 4K. So it's the best quality version of
12:25 Seeddream that we have at this time. So
12:27 we'll go ahead and select that and then
12:29 make sure that the iteration is as high
12:32 as possible. At time of recording that
12:34 is two, but I like getting as much as I
12:36 can because more iteration just gives
12:38 you more options. And for our aspect
12:41 ratio, we'll do 16x9. So we have our
12:43 face swapped image as image number one.
12:46 And then image number two here has the
12:48 clothing that we want to swap. So we'll
12:51 say change the clothes
12:54 in at image one. So you see we have this
12:56 little box here. So it's going to
12:58 reference image number one. We'll say to
13:01 match the clothes from image number two.
13:05 Keep the original composition
13:08 of image number one. And when you're
13:10 ready, go ahead and hit generate. Now
13:11 you may be wondering why aren't we using
13:13 the character feature here inside of
13:15 Freepic? The short answer is it's just
13:17 the quality is not as good as using
13:19 ideoggram. Okay, so I generated four
13:22 results. Let's take a look. So, here's
13:24 result number one. Again, look at the
13:26 clothing. It's exactly the clothing that
13:29 I was wearing in the original image. It
13:31 even has the overlapping like white
13:33 t-shirt that's kind of peeking through
13:35 here. Pretty good. Number two, kind of
13:37 changed the composition and the lighting
13:39 a little bit. Number three, not the
13:42 right composition. And then number four,
13:44 again, it's looking at the camera. It's
13:46 not looking off to the side like we
13:48 want. So, I think number one is the one
13:50 that we want to use. and we'll go ahead
13:53 and download that to our computer. In
13:56 most of your creative projects, you
13:57 probably would just be able to download
13:59 that image. You could upres you could go
14:01 into Photoshop and edit it if you wanted
14:04 to. But I do think that we can go one
14:06 step further and help the character to
14:09 be more composited into the final
14:11 result. You'll see that in this image,
14:13 it almost seems like the character is
14:15 lit by completely different lighting
14:17 than the ambient lighting inside of the
14:19 environment. So, how do we composite
14:21 this character to make it look like the
14:24 lighting and environment is just more
14:26 natural? Well, we're going to use a
14:28 feature inside of Photoshop and
14:31 specifically the beta version of
14:33 Photoshop. So, if you're not already
14:36 familiar, go to your Creative Cloud
14:38 application if you have a subscription.
14:40 I think it's worth it. And go over to
14:43 the apps section, click beta, and you'll
14:45 see there's a Photoshop beta version.
14:47 You can go ahead and download that to
14:49 your computer, update it, do whatever
14:52 you need to do in order to have this
14:54 specific application on your machine.
14:57 So, I have Photoshop beta open on my
14:59 computer. We'll go ahead and select
15:02 open. And let's go ahead and select that
15:04 image from Freepick, which again looks
15:06 awesome. That is definitely me wearing
15:09 the exact same clothes in this cinematic
15:11 environment, but I think that we can
15:13 composite it a little bit better. So,
15:15 first things first, let's go ahead and
15:17 select the layer on the right side. Hit
15:19 command J to duplicate the layer. I'm
15:21 going to turn off the eyeball for the
15:23 top layer. And now select the bottom
15:25 layer. So, we have only the bottom layer
15:28 selected. And let's go ahead and select
15:30 the subject. So, it's cool cuz it's an
15:32 AI tool. Can basically outline your
15:33 subject. You don't have to do that by
15:35 hand, which is frankly amazing. And go
15:38 ahead and select remove. And that will
15:40 remove the character from your image.
15:42 So, there you go. We have a blank
15:44 background. And I'm going to go ahead
15:47 and select that new layer here. So, we
15:48 have this eyeball that's basically
15:51 covering up the character in the
15:53 background. I'll select the bottom
15:55 layer. Hit command E to combine those
15:58 layers. So, now we have a background
16:00 layer here. So, background layer. And we
16:03 have the layer on top here, which is the
16:05 original character. And let's go ahead
16:08 and select the remove background button.
16:10 And it removed the background. So we
16:11 turn the eyeball on and off. You can see
16:14 we have our character isolated from the
16:16 background. Now in some use cases, let's
16:19 say you have multiple characters or you
16:21 need to have just certain elements of
16:23 the foreground also brought into that
16:24 layer. You may have to go in basically
16:27 by hand to edit. But luckily for us in
16:29 this example, we're able to use the AI
16:31 tools. And I should note that the
16:34 character swap feature using ideoggram
16:36 also works with multiple characters. You
16:37 just select their face and you could
16:39 swap them very easily. Okay, cool. So,
16:40 the final thing that we're going to do
16:43 is select that top layer. We're going to
16:45 hit this brand new harmonize button. So,
16:48 go ahead and select that. And basically,
16:50 Photoshop will go in and automatically
16:52 composite the lighting and the color
16:54 grading to help the character blend a
16:55 little bit more. So, let's take a look
16:58 at a few of the final results here.
16:59 Again, these are only slight
17:01 differences, but I think these small
17:02 differences really can help elevate your
17:04 work. We have shot number one, number
17:08 two, and number three. I think number
17:11 three is the best. Again, very slight
17:12 difference. And we'll go ahead and hit
17:14 file, export, and we'll just quick
17:18 export as a PNG to our computer. So,
17:19 there you go. That's how to get a
17:22 consistent character with clothing
17:24 utilizing AI tools. Of course, if you
17:26 want to learn the latest creative AI
17:28 techniques, be sure to go over to
17:30 Curious Refuge, hit that little blue
17:32 button in the top right corner, and you
17:34 can subscribe to our email newsletter.
17:37 We curate the very best creative news
17:39 for you each and every week and we'll
17:42 even give you a free intro to AI
17:44 filmmaking course just for joining our
17:46 community. And of course, you can like
17:48 and subscribe here on YouTube to get the
17:51 latest tutorials and AI news directly
17:53 here on the platform. Thank you so much
17:56 for watching this video and best of luck