Tag Archive for: search technology

You are here: Home / search technology

Posts

Google Labs

Can Google Lose its Labs Without Losing The Values That Helped them Succeed?

Sep 2011/in , /by

I had hoped that my second blog post for FirstRain wouldn’t, once again, be about Google (you’d think that we’d all be sick of hearing about Google 24×7? And we may be, but sick in that ‘I-still-must-tune-in-and-see-what-is-happening-kind of way’ …). Still, I found myself captivated by their announcement this summer that they would phase out a major program called Google Labs by the end of September. And as we’re now approaching that shutdown date, it’s gotten me thinking again about this interesting decision.

For the most part, I’ve always been quite impressed by Google.  I am a long term Gmail user (Gmail has its own Labs, as does Google Maps) and I am still a firm advocate that Google+ will eventually be big (especially after seeing all the complaints of Facebook’s new design on my Facebook newsfeed the past two weeks). Google has launched so many winning products over the years that I was shocked to hear that such a successful and interesting part of Google was to be phased out.

For those unfamiliar with Google Labs, it was a playground for users who are interested in trying Google prototypes and providing feedback directly to Google Engineers. It allowed the public to freely experiment with pre-released Android apps, Google Maps experiments, Google Search betas and much more. Although, not all of these prototypes prove to be effective, it is still a nice way to get the public involved in ‘designing’ and evaluating some of Google’s most popular ideas.

So exactly why has Google decided to pull the plug on this program, when it seemed so many people (albeit, adventurous tech people) were benefiting from it? According to Bill Coughran, Google’s Senior VP for Research and Systems Infrastructure, Google is now beginning to prioritize their product efforts more strictly. And although some of their biggest products had started in Google Labs, they’re now focusing much more of their efforts into dominating the products already in progress, such as Google+. Google has decided that ultimately there are too many ‘small’ projects and they want to channel the company’s focus on the larger and, *cough*, more lucrative options.  By simplifying and focusing Google’s product line, Coughran said, more “extraordinary opportunities are ahead”.

The Google Labs decision is more than just phasing out a neat program, however. The last few years were spent testing potential golden projects. And they did this successfully. Google beat out competitors like AOL and Yahoo in numerous departments such as search, smartphones and Email (does anyone use AOL for email anymore?). And Google Labs has significantly helped develop some of these platforms. But the need is no longer necessary as the trial period is officially over.  What’s interesting is what a signpost this is for where Google is in their lifecycle as a company. Instead of the fun, pioneering tech startup playing in many sandboxes, looking for ideas and doing no evil, they’ve now evolved into a focused and mature company that—for the most part—knows its market, where the money is, and is coalescing around key products like Search, Gmail and Google+.

Now that the deadline is upon us, I was curious to check out the status of Google Labs, especially since I haven’t come across much recent news about the Google Labs termination. If you go to GoogeLabs.com, they inform users directly (no sugarcoating) that the Google Lab’s program is being phased out.  Also, it is obvious that many of the experiments have been visibly shut down.

Not all of Google Labs’ programs will completely disappear. Google claims that they will be integrating some of their better prototypes into many of their already existing experiments but the actual “Labs” name will be retired. The real question for Google now, is how they can retain the spirit of Google labs—that open sense of valued community feedback in a beat environment, now that their flagship vehicle for those values has been lost.

data

Quality of (re)search – it’s all about the Metadata

Apr 2009/in /by

Your average search engine user has the patience of a toddler – they expect to leverage one or a few keywords to get the answer they are expecting and they’ll only try once or twice before giving up. If the results are bad, they’re not likely to try again – you’ve lost a user, or customer.

This is a hard problem to solve when the user is a senior professional looking for business information about a competitor – or the market trend behind a stock’s movement.

FirstRain is all about only the highest quality, high precision results for professional users and a critical piece of our system behind our results is our rich Metadata library. To put it simply, Metadata is data about data; for us, it’s the information architecture that captures what the documents in our system are about – and they can be about any number of concepts drawn from the thousands we’ve modeled. They can be literal (this is about Apple Computer) or they can be crossed by any number of building blocks (this is about layoffs at Motorola in Illinois).

The base layer of FirstRain is the categorization engine that identifies and tags what an article is about – a company, a market trend, an event. Since these tags determine what users see when doing research in our system (and remember – no patience with poor results), the rules that go into identifying them need to be spot on. For example, it’s necessary to ensure a new video game launch from a company like Electronic Arts is tagged appropriately, but a blog about how to reach new levels in one of their games is ignored. A single web document may have any number of tags reflecting the content in it. The article about Electronic Arts could also mention other relevant information about competitors and partners, as well as trends like video game sales; and it’s important to identify and tag each appropriate facet.

But just tagging the data to the right topics is only half the magic. Imagine what you can do if you can also analyze the frequencies of the Metadata. Keep in mind we have millions of documents in FirstRain, each containing numerous tags telling us what it’s about and where it’s from. Go back to the Electronic Arts example: FirstRain can identify the number of times EA is mentioned in conjunction with any related topic, such as new products, or any other company. We highlight spikes in these counts for our users and so show up emerging trends in number of mentions above or below their competition. These counts can give great insight into what a company is doing, or is about to do.

By treating the Metadata as a database in itself, and analyzing it for spikes and patterns we can identify emerging trends for users that they simply could not see from even the highest quality individual search results.

FirstRain selected by Newssift

FirstRain selected by Newssift of the Financial Times Group

Apr 2009/in /by

Last month’s announcement by Newssift (part of the Financial Times Group) of its meaning-based vertical search engine was an important new way to look at search for business professionals – you can quickly see how it’s different if you try it at www.newssift.com.

This morning, Newssift and FirstRain announced that FirstRain’s technology provides the business-relevant content: news, blogs, and other original, authoritative pieces of web content that Newssift consumes. We drive business content into the Newssift search application – here is the press release.

Why does this matter to Newssift? Well at the heart is the quest for quality of search results. If you’ve ever tried to use Google for business research you know how nearly impossible it is. You just get too many old and junky results back so you can’t sort the good from the bad – and so you can’t solve your research problem. In contrast, FirstRain has built its name providing highly relevant finance and market research information, extracted and analyzed from the web, to professional investors and corporate users. This matters because some of the smartest people in the world manage money. They run hedge funds, they manage billions of dollars of assets in mutual funds and pension funds – and they have a lower tolerance for junk or irrelevant data than any other group of users in the world. They have driven us to produce only the highest level of quality of research from the web.

As a result of our user’s demands, we’ve built considerable expertise in the quality of the content coming in which we are now making available to Newssift. The quality and classification of the sources, sorting out useful and authoritative blogs from junky promotional ones. Sorting out the highest quality journalism sources from countries all over the world. And now that content is flowing into Newssift so if you use Newssift you’re getting access to the first stage of the FirstRain advantage.

Newssift has led the way, and other media leaders now have a template. We read daily of publishers of every stripe struggling to build and retain their online audience. Whether it’s a technology trade journal, a leading voice of the blogosphere, an investing website, or a major metro newspaper, new tools are coming up to make the web useful for business research in the new generation of publishing that’s emerging. And Newssift won’t be the last.

Exciting times ahead.

print press

Technology, not War, is the solution to publishing

Apr 2009/in /by

The global publishing giants have declared war on the new technology generation of content distributors – but they have lost sight of what consumers value and how they want to get to the value. It’s time to separate content creators from distributors. It’s time for a new business model which requires technology understanding and leadership to develop – and one that new generation search applications like Google News and Digg for the consumer, or FirstRain for the professional investor, can sign up for to get the right news to the right people at the right price for them.

Local publications like The Boston Globe are teetering on the edge of bankruptcy, others such as The Seattle Post-Intelligencer are moving exclusively online after 146 years in print and global giants like the Associated Press and Wall Street Journal are trying to fight back. But the reality is this is too little, too late and effectively going to war with your customers is a fatal strategy as Arianna Huffington posted a few days ago.

Face it – the consumers of news have changed – dramatically. We no longer read multiple news sources on the hope that we’ll find something interesting, most of the younger of us don’t take a daily physical newspaper and as services like Facebook, Digg and Twitter have shown, we expect the most interesting news to find us. It’s not that we believe news should be free – clearly there is discovery, research and production cost, but it should be allowed to roam freely across the many channels the web enables and still maintain proper attribution.

Our customers at FirstRain have shown us over the past three years that the authoritative news is no longer only found in the WSJ, FT et al. Instead it’s media like the DailyKos, Gizmodo, Consumerist, and In the Pipeline that are increasing the size of the news market pie and creating a huge demand for such obscure, on-the-edge news. In addition, the value of each piece of news varies by who’s reading it and what they plan to do with it. What a college student reads about Apple, Inc. on an obscure blog may be informative and help him plan on his next iPhone purchase, but to a portfolio manager at a Hedge Fund, that same information may be the bit of news he’s been looking for to insert into his model and make a multimillion-dollar trading decision. In both cases the news has value but the value, the search technology to find and rank the news and the delivery model is different in each case.

The critical issue still stands though – original investigative reporting is a public service that we, as a society, cannot do without. Journalists are our educators and our whistleblowers , our eyes and ears on the ground.

The news industry needs to find a recovery path through innovation and collaboration. As Scott Karp points out in his article in Publishing 2.0, this is a technology issue that is outside the comfort zone of traditional publishers. Here are three steps the AP and its 1,500 U.S. daily newspaper members and the Newspaper Association of America (NAA) need to consider in creating a viable business model for themselves and their customers:

* Protect the original content creators: Grant original content producers the opportunity to file as nonprofits under the same laws and protections offered to the Public broadcasting companies as supported by Senator Benjamin Cardin, of MD.

* Track the content: Work with aggregators like Google News, Yahoo, MSN, as well as NYT, WSJ, and the like on developing a new HTML standard that can be inserted into the original news articles to enable the tracking of news throughout its lifecycle.

* Develop a fee-sharing business model: Work with content distributors on an appropriate fee-sharing model to enable the distribution of originally published news through the various niche channels as diverse as Google News, Bloomberg, FirstRain, and even a locally-published community paper.

These options would give content producers multiple channels to sell through, and the ability to charge a real market price based on each distributor’s reach and depth, while at the same time providing an opportunity for smaller players writing original content to distribute their content through major channels for added revenue, outside of Google Adwords.

Then the AP and NAA would create a competitive environment and a generation of startups through which news is distributed to consumers and business professionals. And better yet, this would drive the separation of content creation from distribution – and set up a long term sustainable business model which is what the publishing industry so badly needs.

back to top
MENU