Channel Masking in Photoshop: Cut Out Any Complex Subject
64.4K views 1,298 likes 48 comments
Jump to a step in the video (10)
Click a time to play the video from there.
Your choices stick across every tutorial on this device.
Channel masking in Photoshop is a way to cut out a subject that selection tools cannot handle.
Instead of drawing a selection, you let the image separate itself. Every color image already contains three black-and-white maps of light, and one of them almost always divides your subject from its background better than any tool can.
This is for anyone who has clicked Remove Background on a tree, a fence, or flyaway hair and watched the fine detail turn to mush.
By the end, you will know two methods. The first takes about ten seconds. The second is what you use when the first one fails.
Key Takeaways
- Blend If hides pixels, but it does not create transparency. Convert the layer to a Smart Object to bake in the transparency.
- The only channel worth using is the one that provides the most contrast between your subject and background.
- Remove Background thickens thin branches, fills the gaps between them, and leaves a colored fringe. A channel mask does none of that.
- When no single channel separates everything, Calculations blends two channels into a new one.
- Every pixel in a channel is a number from 0 to 255. Add pushes the result toward 255; Subtract pushes it toward 0.
- The Offset slider does not brighten your sky. It lowers the value each pixel has to reach before it clips to pure white.
Table of contents
- What You’ll Learn
- Requirements
- Keyboard Shortcuts
- What Channel Masking in Photoshop Actually Does
- Method 1: Channel Masking with Blend If
- Turn the Blend Into Real Transparency
- Channel Masking vs the Remove Background Button
- Method 2: Channel Masking When No Single Channel Works
- How Add and Subtract Actually Work
- Push the Offset Slider
- Clean Up the New Channel with Burn and Dodge
- Load Your Channel Masking Result as a Selection
- Frequently Asked Questions
- Channel Masking in Photoshop Is One Decision
- Related Links
What You’ll Learn
- How to read the Channels panel and pick the channel with the most contrast
- How to cut out a subject with Blend If and split the slider for a soft edge
- How to lock a Blend If result into real transparency
- How to blend two channels into a brand-new one with Calculations
- How to clean a channel with the Burn Tool and the Dodge Tool
- How to load any channel as a selection with a keyboard shortcut
Requirements
Before you start
- The latest public release of Photoshop
- Any photo with a clear brightness difference between subject and background
Practice Files
Download the images used in this tutorial and follow along step by step.
Keyboard Shortcuts
| Action | Windows | macOS |
|---|---|---|
| Split a Blend If slider | Alt click | Option click |
| Load a layer as a selection | Ctrl click thumbnail | Command click thumbnail |
| Deselect | Ctrl D | Command D |
| Save the Smart Object | Ctrl S | Command S |
| Fill with background color | Ctrl Backspace | Command Delete |
| Invert | Ctrl I | Command I |
| Swap foreground and background colors | X | X |
| Load channel 6 as a selection | Ctrl Alt 6 | Command Option 6 |
What Channel Masking in Photoshop Actually Does
Open the Channels panel and click through Red, Green, and Blue.
Each one is a black-and-white representation of light. Bright areas show where that color is strong. Dark areas show where it is missing.
On a photo of a tree against a blue sky, the Blue channel is the interesting one. The sky reads as almost pure white. The tree reads as almost black.
That gap is everything. Channel masking in Photoshop works by finding the channel with the widest gap between what you want to keep and what you want to hide, then turning that gap into transparency.
Red Channel
Green Channel
Blue Channel
There is no single correct channel. It changes with every photo. A green subject on a red wall will separate on a different channel than a tree against a sky.
Note: Before you touch anything, look at all three channels and pick the one with the most contrast. Every method below runs on that one decision.
Method 1: Channel Masking with Blend If
Double-click the empty space to the right of the layer name to open the Layer Style window, then look at the Blend If section at the bottom.
Blend If hides pixels based on brightness. Set the dropdown to Blue, then drag the white point on the This Layer slider to the left.
The sky disappears. It is the brightest thing on the Blue channel, and that slider hides the brightest pixels first. For a full breakdown of both slider rows, see How to Use Blend If in Photoshop.
Right now the edge is a hard cut, which looks bad on branches. Hold Alt (Windows) or Option (macOS) and click that white point to split it in half.
Spread the two halves apart. The hard cut turns into a smooth falloff, and the fine branches keep their soft edges.
Press OK when you like the result.
Tip: Before you experiment, go to Window > History, then click the camera icon in the History panel to save a snapshot. Double-click it to rename it. You can jump back to your Blend If result at any point without redoing it.
Add a gray Solid Color fill layer at the bottom of your layer stack so you can actually see what you have.
Turn the Blend Into Real Transparency
What you are looking at is not a cutout. It is a blend, and it is calculated live.
Right-click the layer and choose Convert to Smart Object. Watch the layer thumbnail. The checkerboard pattern that appears means real transparency.
Here is why that step matters. Blend If reads the Blue channel as it is right now, so any change in brightness affects your cutout.
Add an Exposure adjustment layer clipped to a normal layer and push it. The blend shifts immediately, and pixels you had hidden come back.
Do the same thing to a Smart Object, and nothing moves. The transparency is baked in, and the adjustment cannot reach it.
You do not lose editability either. Double-click the Smart Object thumbnail to open it in its own tab, change the Blend If sliders, press OK, then save with CtrlS (Windows) or CommandS (macOS). Close the tab, and the update is waiting in your main document.
Channel Masking vs the Remove Background Button
Photoshop has a one-click button for this. It is worth seeing exactly where it gives up.
Click Remove Background on the same tree. You get a decent selection of the trunk and canopy, and you lose the ground entirely. The full beginner workflow for that button lives in How To Remove a Background In Photoshop.
Then zoom in on the branches.
| What happens at the edge | Remove Background | Channel mask |
|---|---|---|
| Thin branches | Thickened | Kept at true width |
| Gaps between twigs | Filled in | Left open |
| Edge color | Blue fringe where the sky bled through | No fringe |
To be fair to Remove Background, it gets you most of the way there on plenty of jobs, and sometimes that is enough. It stays in the toolkit.
But when the background is a color you can attack with a channel, the channel wins. All three of those problems show up the second you drop the cutout onto a new background.
Method 2: Channel Masking When No Single Channel Works
Now for the image where method one falls apart.
Take a tree with a mountain range behind it. Unlock the layer, open Layer Style, choose Blue, and drag the white point left.
The sky starts to go, and so do the mountains and the grass. Those areas also have bright pixels in the Blue channel, so Blend If cannot distinguish them from the sky. Cancel out.
Check the Channels panel, and the problem is confirmed. The Blue channel still gives the best tree separation, but where the mountain range meets the sky, there is barely any difference at all.
The Red channel is the opposite. It cleanly separates the mountains but handles the tree poorly.
Neither channel can do the job. So you build one that can.
Go to Image > Calculations.
Calculations takes two channels, blends them with a blending mode, and drops the result into a new channel. Think of it as building the channel Photoshop never gave you. For a second worked example of the same tool, see Insanely Difficult Masks MADE EASY with Calculations in Photoshop.
Set Source 1 to the Red channel and Source 2 to the Blue channel. These are the two channels you already identified as useful.
Then pick a blending mode. You can hover over the list to preview them, but two do the heavy lifting here.
How Add and Subtract Actually Work
Every pixel in a channel is a number between 0 and 255. Black is 0, white is 255, and everything else is a gray in between.
That makes this a math problem. To force an area to black, its number has to land on 0. To force it white, it has to reach 255.
| Mode | What it does | Result moves toward |
|---|---|---|
| Add | Adds the two channel values together | 255, white |
| Subtract | Takes the Source 1 value away from Source 2 | 0, black |
Photoshop cannot go past either end. A result of -20 displays as black, and 300 displays as white. That clipping is what turns a soft gray edge into a hard black-and-white mask. If blending modes in general are new to you, Blending Modes Explained covers how each one calculates.
Your goal is a bright sky and a dark everything-else, so choose Subtract.
Where blue is higher than red, the result is positive, and some brightness survives. Where red is higher, the math goes negative and clips to black.
That gives you great separation between the tree and the sky, and destroys it everywhere else.
Fix it with one click. Under Source 1, check Invert.
You are now subtracting an inverted red from blue, and the tree, the mountains, and the sky all separate at once.
Tip: Try the Green channel too once the dialog is set up. The sky may look brighter, which is tempting, but check the mountain range before you commit. In this image, the separation gets worse.
Push the Offset Slider
The Offset slider adds or subtracts the same number from every pixel in the result. It only appears when Add or Subtract is selected.
Drag right and the result brightens, because you are pushing pixels toward 255. Drag left, and it darkens.
Set it to 80 and every pixel climbs by 80. That means a pixel only needs to reach 175 on its own to reach 255 and clip to pure white.
You are not brightening the sky. You are lowering the bar those off-white areas have to clear.
The trade-off is that the foreground gets the same lowered bar, so it brightens too. That is fixable in a moment.
Set Result to New Channel and press OK. Photoshop creates a brand-new channel from the blend, and nothing you do to it affects your original image.
Clean Up the New Channel with Burn and Dodge
From here, the job is simple. Dark pixels go fully black, bright pixels go fully white.
Start big. Grab the Rectangular Marquee Tool, select the bottom half of the image, and fill it with black using CtrlBackspace (Windows) or CommandDelete (macOS).
For the mountain range, use the Burn Tool. In the Options Bar, set Range to Shadows so your brush only darkens pixels that are already dark.
That setting lets you paint loosely without touching the sky.
Press CtrlI (Windows) or CommandI (macOS) to invert, so the tree reads white and the sky reads black. Black is what gets excluded from the selection.
Keep burning over the sky, including the gaps between the branches.
For stubborn spots, switch to the Brush Tool and paint straight black or white. Tap X to swap your foreground and background colors as you go.
The Dodge Tool does the reverse. Set Range to Highlights and paint the near-white areas to push them to full white.
Finish the open sky with the Lasso Tool. Draw a loose selection that includes the dark areas around the tree, run it out to the edges of the canvas, and fill with black.
Warning: Go slowly on the boundary between your subject and the background. Everything else can be filled in seconds, but that edge is the entire mask.
Load Your Channel Masking Result as a Selection
Two ways to do this.
Hold Ctrl (Windows) or Command (macOS) and click the channel thumbnail.
Or use the shortcut. For this channel, it is CtrlAlt6 (Windows) or CommandOption6 (macOS).
The 6 comes from the number Photoshop lists next to the channel. Adding Alt or Option loads it as a selection instead of just switching to it. The same trick works on any channel. Swap the number.
With the selection active, click RGB to get your colors back, return to the Layers panel, and click the Add Layer Mask icon.
Drop a gray Solid Color fill layer at the bottom of the stack and zoom in. Every branch is separate, the gaps are open, and there is no fringe.
That is the whole idea behind channel masking in Photoshop. You are not selecting anything. You are finding, or building, the version of the image that has already done the separating for you.
Frequently Asked Questions
Channel masking uses the Red, Green, or Blue channel of an image as the basis for a mask. Each channel is a grayscale map of light, and one usually separates your subject from the background better than a selection tool can. You load that channel as a selection and turn it into a Layer Mask.
The one with the most contrast between your subject and your background. Click through Red, Green, and Blue in the Channels panel and compare. For a blue sky, the Blue channel is usually the answer, because the sky reads bright and the subject reads dark.
No. Blend If hides pixels with a live calculation, so the layer thumbnail still shows a full rectangle. Right-click the layer and choose Convert to Smart Object to bake the transparency in. The checkerboard pattern in the thumbnail confirms it worked.
Because Blend If reads brightness in real time. An Exposure or Curves layer changes brightness, so the blend recalculates and your hidden pixels come back. Converting to a Smart Object first locks the result so adjustments cannot reach it.
Calculations blends two channels together with a blending mode and saves the result as a new channel. You use it when no single channel separates everything you need, which is common on images with several bright areas. Find it under Image, then Calculations.
Add adds the two channel values together, so results climb toward 255 and go white. Subtract takes the Source 1 value away from Source 2, so results fall toward 0 and go black. Photoshop clips anything outside 0 to 255, and that clipping is what hardens the mask.
It adds or subtracts a fixed number from every pixel in the result, and it only appears with Add or Subtract selected. An offset of 80 means a pixel only needs to reach 175 on its own to clip to pure white. It lowers the threshold rather than brightening the image.
For fine detail, yes. Remove Background tends to thicken thin branches, fill the gaps between them, and leave a colored fringe from the old background. For a clean subject on a simple background, it is often good enough and much faster.
Channel Masking in Photoshop Is One Decision
Channel masking looks intimidating because it lives in a panel most people never open. It is really one decision repeated: find the channel with the most contrast, and if none of them has enough, build one that does.
Blend If handles the easy version in seconds. Calculations handles the version that would otherwise cost you an hour with the Pen Tool.
Watch the full tutorial above to see both methods in real time, including the burn and dodge cleanup that is hard to describe in writing.
Selections and Masking Mastery
Complete course includes 2.5 hours of step-by-step lessons, 6 structured modules, downloadable practice files, and custom Photoshop brushes. Everything you need to master selections and masks in one place.
Keep going
Want to master every generative and color AI tool in Photoshop? My Photoshop AI Mastery course covers it all.
For a complete foundation in the channels, masks, and Blend If workflows used in this tutorial, take a look at Selections and Masking Mastery.
And if you are new here, subscribe on YouTube for a new Photoshop tutorial every week.
Related Links
Final Image
Drag the slider to see before and after
