Widget this blog
Take this blog with you. Add it as a widget to your page:
Or copy the embed script code below and paste it on your website.
Embed code:
If you copy and use this Widget code for use on your website(s), you agree to the following terms and conditions found here.
Get this feed

March 14, 2008

NewsGator's 2.5 Billion RSS Articles

Microsoft published a case study about our use of SQL Server 2008. It's a pretty good summary of our how much "stuff" we have to manage.

NewsGator makes life easier for individuals and companies by aggregating Really Simple Syndication (RSS) data feeds from across the Web to provide users with customized content delivery, enabling everyone to essentially create their own electronic newspaper. The company, which also provides Software as a Service to more than 50 media outlets including CNN and USA Today, stores some 2.5 billion RSS articles totalling about 4 terabytes on clustered databases running Microsoft® SQL Server® database Software. NewsGator is upgrading its database infrastructure to SQL Server 2008 Enterprise Edition (64-bit) running on the Windows Server® 2008 for 64-Bit Systems operating system to take advantage of a number of new features, including enhanced Database Mirroring for high availability, Backup Compression to reduce storage needs, and Resource Governor for allocating processing resources.

November 13, 2007

OpenSocial Developer Journal : Have We Met Before?

NewsGator is all about presenting the right view of your content when and where you want it. An important part of that concept in our RSS readers is synchronization. If I mark a post read on my mobile NewsGator Go! reader, that post is marked read everywhere else. We do this by tieing all of the user activity to a NewsGator account.

Now suppose I were to add Didja Hear (our OpenSocial application) to Plaxo where my user ID might be based on my NewsGator email address. I set some content preferences so Didja Hear only shows videos about movies, television, and music. I start sending videos to friends, making comments, getting videos from them, etc. Later on, I add Didja Hear to Orkut where I log in with my gmail address.

As an application developer, this scenario raises some questions. Should we prompt the user whenever they add our application to see if they have added it before? If we do that, we could link the two accounts. Then we can provide a benefit of keeping the same preference information.

We could take it a step further though as well. In my scenario above, I could possibly see a video sent from a friend on Orkut while viewing Didja Hear in Plaxo. That sounds like a nice benefit for the user – wherever you look at Didja Hear, you see all of your content and interaction from friends. But in addition with us needing to ask the user to connect the dots and the user feeling comfortable with connecting the two accounts, we have another couple of issues.

If my friend Sue in Orkut puts a comment on a video she sent to me, we show that as “Sue says: …”. We don’t store Sue’s actual name in our database. We store her Orkut ID. Now if I’m looking at Didja Hear in Plaxo, the only way we could show “Sue says: … “ is if we store that information. The alternative is for us to display the considerably less social message “Somebody said: … “.

Facebook has an explicit policy forbidding the storage of a user’s personal data for more than 24 hours, and I could see different container sites creating different usage policies around personal data. As an application developer, it would be ideal if there were some standard restrictions that could be applied to profile and friend data consistently from all container sites. For example, a user setting that says “Share my first name only in views outside this site” would be very helpful piece of information.

One small twist remains to be explored in this story, but that’s a subject for a future post. In the meantime, we need to get back to some real OpenSocial development.

November 07, 2007

OpenSocial Development Journal – Know Your Friends


At NewsGator, we’re happy to have been selected as one of the early developers in the OpenSocial program. It’s been exciting to build our Didja Hear!? application, and we wanted to share some of our thoughts on social networking and the opportunities, questions and challenges of OpenSocial from the application developer point of view. This is the first in a series of posts that cover the issues we are currently addressing.
 
One of the OpenSocial API’s lets us ask who are the friends of a user. This is a powerful and basic capability of any social networking solution. The primary challenge for us as a developer is understanding what a container site really means when they tell us who are the user’s friends.  
 
Imagine you asked ten random people to name all their friends. Each of them is likely to use different criteria in defining what a friend really is.  Some people might answer the question with a statement like, “Well, I only have two really close friends, but I stay in touch with fifty people.”  
 
Within a single social networking site, the answer is likely to be very consistent. But different sites may choose to answer the question differently. When we were building the Didja Hear application, the rule for Orkut’s answer to the question  “Who are Bob’s friends?”, was to respond with Bob’s friends who already have Didja Hear installed! If we contrast this with Facebook, we can get a list of all of a user’s friends and the information about whether or not they have our application installed.  
 
From the point of view of viral distribution, it’s much harder to prompt Bob to send Sue an invitation to add Didja Hear if we don’t know that Sue even exists.  We’ll have a bit more to say about invitations in upcoming posts…
 
The filter that Orkut was considering around providing friend names is just one example. If we are working with a social network that allows more granular concepts than “friend” or “not a friend”, how will they answer when Didja Hear asks? The most precise answer would be for the site to send us the users along with extended data that indicates how close they are (best friend, friend, business associate, friend of a friend, etc). But if every container site does this, it could be overwhelming to deal with the complexity.
 
OpenSocial is very cool and very powerful. It is already making an impact. But underneath powerful, open concepts there are always important details that need to get ironed out. Over the next several posts, we’ll show you more of the questions we’re considering right now.

-- Brian Kellner is VP Products for NewsGator

Tags: , , ,

November 01, 2007

OpenSocial, Didja Hear!? and Enterprise 2.0

Some days I imagine the internet must want to take a deep breath and just rest for a while. With Google announcing OpenSocial, a huge stream of blog posts have been pouring down the "pipes".

Within the flood of blog posts, you might have seen NewsGator's name bobbing along with something called Didja Hear!? We were very pleased when Google asked us if we would like to be an early participant in this program, and we used the power of our Widget Framework and our experience from building NewsFriends for Facebook to create Didja Hear!? which pulls the best video and graphic content out of the seven million posts we process each day and makes it easy for users to share these videos and their comments. Here's how it looks in Orkut:

Didjahear_nov1_2


This application ends up being something like the Web 2.0 equivalent of a water-cooler chat with a great conversation starter. We recommend content in categories like movies, music, sports, celebrities, televesion, and gadgets and users send them on to friends or reply to videos and podcasts shared by their friends. So we leverage NewsGator's back end to select great content, and we leverage your social network to highlight the content that is most compelling for you.

So what does all this have to do with Enterprise 2.0? In some ways, Didja Hear!? has more in common with our Social Sites for SharePoint than it does with NewsFriends for Facebook. Just as Social Sites allows for an administrator to select content to make the experience more compelling, Didja Hear!? uses our editor's tools from the Widget Framework to get the best content by automatically filtering and sorting the content. We can also promote specific stories and eliminate unwanted ones.

But the real power happens when user behavior and relationships are added to the mix. The explicit actions of my friends to share content are the most powerful and accurate filters available. But we also take advantage of less explicit feedback. By tracking user actions including clicking links, forwarding articles, saving articles, etc, we can improve relevance. Even if my friends don't actually send me a story, the fact that they spent time interacting with it suggests that it's more valuable to me.

This is true in both consumer and enterprise applications. OpenSocial exposes information about a user, her friends, and her activities. This is exactly the same kind of information that is available in SharePoint or Connections. We leverage that information to provide the best content for a user, and we extend that information by adding in the reading, tagging, subscribing, saving, and other attention data to provide better connections of people and content.

This same story applies in our Syndication Services business where we leverage the same social content intelligence in our platform to provide the best possible widget experiences.

At the end of the day, all of this "2.0" stuff comes down to taking advantage of data that users provide for their own benefit to produce more benefit for them and others. Social and content consumption data are both extremely powerful - combined they produce a truly exceptional value in both business and individual user scenarios. And after the flood of posts has subsided and the "pipes" of the internet groan in relief, getting real value from OpenSocial will be the center of attention.

Brian Kellner
VP, Product Management

P.S. If you want to understand OpenSocial better, read Marc Andreesen's post. He gives a great overview of the technology as well as broader thought about its impact.


January 22, 2005

Podcasting Goes Corporate???

What do you think about Rubel’s point?

Two signs point to rising corporate interest in podcasting. First, Frederik Wacka points to the American Association of Petroleum Geologists' first official corporate podcast. Meanwhile down under, Cameron Reilly says that over the last couple of days he has been having a very interesting conversation with a senior manager from a tier one US company who is interested in engaging his services to help produce an internal podcast for a certain segment of their staff around the world. Anecdotally, I have heard about other companies looking at podcasting. This year not only will podcasting increasingly become a popular tool for corporations, but also for celebrities and musicians who want to stay in regular touch with their fans.

[Micro Persuasion]

And, via Russ Mayfield, link to a thorough piece on what podcasting is all about... (and why it's good...)

December 22, 2004

Check this out...

Over on the right, the new frame (we'll prettify it soon) called News of Note.

I'm using NewsGator's headline publishing tool to keep a folder of clippings directly from NewsGator, which are then posted directly to the blog.  I can place them anywhere here, and manage how much is excerpted, how many show up, and how long they stay on the site.

Cool tool worth communicating about...

December 20, 2004

Searching for ....

Highlights from the Chicago Search Strategies show last week...  Search atomization, click fraud, and a plethora of tools.  More ways to market more efficiently than ever...

Track everything search-ish on searchenginewatch.com....  Jupiter notes that Microsoft is v. serious about search....