The upcoming Adobe Cloak uses content awareness to seamless remove unwanted elements from your footage.
At the Adobe MAX event earlier this week, the company unveiled some upcoming technology that could potentially make post-production clean-up work a lot easier.
Research Engineer Geoffrey Oxholm demonstrated how the Adobe Cloak tool can be used within After Effects to easily remove unwanted elements from your video. Rather than rotoscoping and masking, Cloak uses content awareness to imagine how the footage would look without the offending element, yielding impressive results.
As you can see in the video above, Adobe Cloak successfully removes a lamp post that crosses between the moving camera and a building – a shot whose correction would otherwise prove challenging to automate due to parallax. Cloak is also used to remove a small strap on a backpack that a subject is wearing, demonstrating how the tool can recreate pixels that were never in shot in the first place – such as the fabric on the man’s t-shirt – even under changing light conditions. Impressively, the same tool can be used to easily remove the subjects from the background altogether, even with a moving camera.
It is not difficult to imagine the possible uses of Adobe Cloak. Of course, you could remove things like boom poles or light stands that manage to creep into a shot, but this tech could in theory make the production process a lot easier. Don’t have the budget or resources to close off a street? Just remove the background passers-by in post!
There is no mention of how or when this new tech will be implemented, but rest assured: we will be eagerly waiting for it and will report as soon as we know more.
Could any of your recent work have benefitted from a pass of Adobe Cloak? Let us know how in the comments below!