Tech Talk

Digitalsmiths Raises Bar on Video Search

Relying on a “skin detection algorithm” and other new technology, Digitalsmiths plans to launch a new video search engine today that allows Web surfers to search TV series and movies for everything from nude scenes to specific dialogue in a video clip.

Digitalsmiths executives say the company isn’t looking to compete with Google Video, AOL’s Truveo, Blinx, and other sites that market a video search engine directly to consumers. Instead, the company hopes to license its technology to major Hollywood studios, TV networks, and Web publishers that are looking to improve video search results on their sites.

“Everything we do, we like to say, is to build your audience,” said Digitalsmiths CEO Ben Weinberger. “How do we get more people to watch video for a longer time?”

While the search engines on Hulu and most other video sites only allow viewers to run queries based on program titles and brief descriptions, Digitalsmith’s new VideoSense 2.0 product allows users to run searches based on actor names, characters, locations, specific dialogue, and objects within the scene.

Weinberger said the firm’s content management system allows studios and TV networks to add meta tags from more than 60 “tracks.” Much of the system is automated, including a “skin detection algorithm” that allows content owners to add meta tags to individual nude scenes in a TV program or movie.

VideoSense also contains facial recognition technology, and it can also run speech analysis for every scene in a video clip, Weinberger added.

In an online demo Digitalsmiths ran for us last Thursday, Weinberger showed how a search conducted on the Warner Bros. content management system would add more detailed results with the addition of VideoSense technology.

When he ran a search for “Rachel at the beach” on the Warner Bros. site, it returned a scene from teen drama The O.C. featuring actress Rachel Bilson in a bikini. [Ed. note: If only Judd Apatow and his cohorts had this technology in the film Knocked Up when they tried to create the fictional Website fleshofthestars.com.]

Weinberger said VideoSense would also allow fans of The Ellen DeGeneres show to easily search for the scene in the 2006 episode where DeGeneres dances with Tom Cruise.

VideoSense is split into four separate products. Its MetaFrame tool automatically assigns meta tags to content, detailing characters, actors, dialogue, and location. The VideoSense Asset Manager handles the physical management of videos.

The VideoSense Intelligence product powers the user-facing search engines on a content owner’s site, and its Publisher product helps manage scheduling and distribution of content.

Digitalsmiths is beginning to pitch VideoSense to new and existing customers. Its client list includes Warner Bros., TMZ, Essence magazine, and AOL’s momlogic.

Weinberger said he expects some Digitalsmiths customers to begin rolling out the new VideoSense technology on their sites within the next few weeks. Others may take a few months, he added.

Written by Steve Donohue

Leave a Reply

Search