Blin.gy puts you inside your favorite music video – TechCrunch
A green-screen effect, or chroma keying, is nothing new. The technologyÂ was first used in Hollywood as early as the 1930s, and is still used today in movies, sports broadcasting and, of course, weather shows. But itâs not reallyÂ consumer technology â mainly because of the need for an actual green screen, a static camera and studio-quality lighting.
But being able to haveÂ a live video background behind you is cool â especially if you can use it to createÂ unique social content to share with your friends.
Meet Blin.gy, a new app thatâs figured out how to achieve a âmobile green-screen effectâ without the need for a full studio environment.
Thereâs some background behind Blin.gy â the team had previously builtÂ Chosen, an American Idol-style app where you could create and share short video clips showcasing your talents. The startup partnered withÂ The Ellen Show and gained some traction âÂ but it soon became apparent that theirÂ key demographic, teenagers, were more into apps likeÂ Musical.ly,Â where music was the focus of the content they created.
So the team took a step back and went heads-down with the goal of buildingÂ a tool to create content that would letÂ young people express themselves in a way that hasnât been done before.
Essentially, they wanted to create a new type of content that would be unique to Blin.gy. Musical.ly has fast-motion videos with overlaid songs, Snapchat has filters and AR-style effects, Instagram has Boomerang â you get the point.
Eventually, the team came up with the idea to put users inside a music video, using a mobile green-screen effect. And while youâd think that with todayâs technologyÂ it would be easy to just port old-school chroma keying to mobile, itâs actually more complicated than that.
The teamâs patent-pendingÂ algorithm (they wrote a white paperÂ going into more detail) essentially combines old-school chroma keying with new technologies, like object class detection, edge detection, color manipulation and other computer vision technologies. In short,Â they dynamically prioritize and combine these different techniques depending on the environment in which the video is being recorded.
So while a technology like Appleâs Photo Booth effect would be totally messed up the second you move your cameraÂ (and distort the background), Blin.gyâs tech allows you to use a non-stabilized camera that can actually be moving while you record the video.
Of course, computer vision technology isÂ still young (and limited by how powerful our phones are), so Blin.gy still recommends you do things like record your video in front of a plain background in order to achieve the most realistic result.
This meansÂ not all of the videos are perfect â scrolling through the main feed shows videos on all ends of the spectrum â some are great and look as if done in front of a ârealâ green screen, while in other videos the effect barely works.
But the startup explained that some of these videos are coming from lower-powered Android phones that donât have the processing power to fully support the effect. Thereâs also an instructional component the first time you use the app that shows you how to pick a good background and lighting, and by nature of having a young audience (most current users are teenagers), they donât always follow the directions, which results in sub-parÂ videos.
Right now the app features tens of thousands of music video clips to choose from â all 15 seconds long. Eventually Blin.gy hopes to work with labels to get customized content designed for their app â like a version of a music video where thereâs an empty spot next to Drake that a Blin.gy user can dance in. Theyâve already experimented with this â the app has a special editÂ of Migosâ Bad and Boujee video that contains footage with open spaces and no jump cuts â making it look more realistic when someone uses it as a background.