Google Information Blog: 2011

Thursday, September 22, 2011

Official Google Blog

The Fox News/Google Debate live tonight on YouTube: GOP candidates answer your questions

Posted: 22 Sep 2011 05:47 AM PDT

Since we announced the Fox News/Google Debate on September 1, people across the country have submitted more than 18,000 questions to the Fox News YouTube channel on topics ranging from immigration reform, to health care, to foreign aid to social security. Tonight, the Republican presidential candidates will answer those questions in the Fox News/Google Debate, which will be live-streamed on YouTube and broadcast on Fox News Channel starting at 9pm ET. We'll also have an online pre-debate show starting at 8:30pm ET, featuring Fox News's Shannon Bream and Chris Stirewalt, and Steve Grove, YouTube's Head of News and Politics.

Even if you're watching on TV, you can visit youtube.com/foxnews during the debate to vote on real-time polling questions and submit live commentary. Throughout the evening, we'll share Google politics-related search trend information and public data that will provide context to the issues discussed. Fox News moderators will ask specific questions that were submitted by citizens through YouTube, and we'll be looking at overall trends that emerge from the questions in aggregate. To give you an idea, here's a look at the most popular words people used in their submissions (the bigger the word, the more often it was used).

Flex your democratic muscle and tune in to youtube.com/foxnews tonight at 8:30pm ET for a political debate that puts you in the driver's seat of the discussion.

Posted by Ramya Raghavan, YouTube news and politics manager

A 67-year reunion of wartime survivors, inspired by Google Books

Posted: 21 Sep 2011 10:24 AM PDT

(Cross-posted on the Inside Google Books blog)

From time to time, we invite guests to post about items of interest. We're pleased to have James Keeffe, III, author of the award-winning Two Gold Coins and a Prayer: The Epic Journey of a World War II Bomber Pilot and POW, tell us an amazing story about how Google Books helped reunite a Holocaust survivor and a World War II veteran. -Ed.

Last year, my distributor Epicenter Press uploaded my book, Two Gold Coins and a Prayer: The Epic Journey of a World War II Bomber Pilot and POW, to Google Books. The book is a memoir of the WWII experiences of my father, James H. Keeffe, Jr., as told to me. He was an American B-24 bomber pilot who, on his fourth mission during the war, was shot down over Southern Holland and taken in by the Dutch Underground. He spent the next five months evading capture by staying in several safe houses in Rotterdam. In one of the homes, owned by a Dr. Jappe-Alberts, a Jewish family—father, mother and eight-year-old daughter—hid up in the attic.

About six months ago, I received an email that sent shivers up my spine. It was from the same Jewish family's daughter, now called Helen Cohen-Berman:

Dear Sir,

I've found this book a few day ago at the internet. I am the little girl from the Cohen family who was hidden together with Jim at the Jappe-Alberts family. I was 8 years old. I've read a part of the book already on the net and my son in the USA ordered it. It's unbelievable to find all this after so many years... We are now living in Israel since 1978. I would like to leave a note with these information for the writer and his father as a sign of life. Can you give me an email-address? Forwarding is another possibility!

With regards,
Helen Cohen-Berman

Imagine my surprise! All my dad knew about the Cohens at this point was that they had eventually been captured by the Nazis, who also shot Dr. Jappe-Alberts and sent his family to prison.

Left: Photo of 19-year-old James from October 1942, Right: Photo of 9-year-old Helen from 1945

Helen, my father and I began emailing each other quite often. Helen, now 76 years old, told us that after all these decades, it had been time for her to come to grips with her memories of the war. Her daughter suggested that she search for the name "Jappe-Alberts" and the place "Rotterdam" on Google. Two results of import came up. The first was a memorial to 10 men shot by the Nazis on a country road south of Rotterdam, including Dr. Jappe-Alberts. The second was the portion of my book on Google Books that had the name Jappe-Alberts in it. Helen began to read that part of the book and, lo and behold, realized she was reading about herself as a young girl and her family.

She told us that, though her family had been sent to Westerbork, a transit/concentration camp in North Holland, after being captured, they survived the war. The rail system in the Netherlands by that time was so damaged that the Nazis could not move any more people from transit camps like Westerbork to the death camps of Germany and Poland. Westerbork—along with the Cohens—was eventually liberated by the Canadians.

Six months after Helen's email to me, after much planning, Helen flew to Seattle and was reunited with my father on September 13, 2011. Sixty-seven years had passed since last they saw each other. It was a very moving experience—all possible because of Google Books.

After 67 years, Helen and James were reunited in James' Seattle home

I was greatly honored to have been able to bring my father and Helen together again. Helen said the reunion was a "closing of a circle" and a healing time for her as she was finally able to talk about some of the events she had endured. For my father, the reunion was a joyful occasion. Meeting Helen allowed him to fill in some gaps, and find out the details of her family's capture and imprisonment. He was very happy to see Helen and quite sad when it was time to say goodbye.

At their reunion, I kept looking at them both, now in their later years, trying unsuccessfully to imagine what it must have been like when they were young and living under the fist of the Nazi occupation. Always the threat of instant and often cruel death weighed heavily on them, yet they both survived—and 67 years later were standing side by side, telling each other, and us, their stories.

Photo taken at the VFW Hall in Redmond, Washington, where James attends POW meetings. Credit: Book It Northwest

Posted by James H. Keeffe, III, author of Two Gold Coins and a Prayer: The Epic Journey of a World War II Bomber Pilot and POW

Tuesday, September 20, 2011

Official Google Blog

Google+: 92, 93, 94, 95, 96, 97, 98, 99... 100.

Posted: 20 Sep 2011 09:27 AM PDT

For our international readers, this post is also available in Chinese, French, German, Italian, Portuguese, Russian and Spanish (Latin America, Spain). - Ed.

The Google+ project has been in field trial for just under 90 days, and in that time we've made 91 different improvements (many of which are posted here). Google+ is still in its infancy, of course, but we're more excited than ever to bring the nuance and richness of real-life sharing to software. Today we're releasing nine more features that get us that much closer.

+Hangouts: more places, more people, more to do

Hangouts uses live video to bring people together, face-to-face-to-face. And from day one, the community has shaped and stretched the feature in amazing ways—from cooking classes to game shows to music concerts. We're determined to keep this momentum going, and to keep providing new ways to communicate in-person, so we hope you enjoy this week's round of Hangouts improvements.

92. Hangouts on your phone
In life we connect with others in all sorts of places, at all different times. And the connections you make unexpectedly are often the ones you remember the most. We think Hangouts should keep pace with how you socialize in the real-world, so today we're launching it on the one device that's always by your side: your mobile phone. To get started, simply find an active hangout in the Stream, and tap "Join":

Hangouts on your phone: Stream View (left), Green Room (center), Portrait Mode (right)

Hangouts currently supports Android 2.3+ devices with front-facing cameras (and iOS support is coming soon). The new mobile app is rolling out to Android Market today, so you can start hanging out at any time, from just about anywhere.

93. Hangouts On Air
Google+ users already use Hangouts to create intimate onscreen experiences—with family members, prayer groups, even people with certain medical conditions. But sometimes you want to speak to a large audience, or alternatively, view as a spectator. In these cases a public broadcast is what's needed, so today we're introducing Hangouts On Air.

The setup is simple enough: just start a normal hangout, and you'll have the option to broadcast and record your session. Once you're "On Air," up to nine others can join your hangout (as usual), and anyone can watch your live broadcast:

Hangouts On Air: Stream View (left), Full-screen Mode (right)

We're starting with a limited number of broadcasters, but any member of the Google+ community can tune in. In fact: we'll be hosting our very first On Air hangout with will.i.am on Wednesday night, September 21. For more information visit will.i.am's or my profile on Google+.

94, 95, 96, 97. Hangouts with extras
Spending time together goes hand in hand with actually doing things together. Dinner with family can easily turn into movie night at the local theater, for instance. And running into old friends can inspire anything from photo sharing to vacation planning. Hangouts has always included a basic set of in-room actions (like group chat and co-viewing of YouTube videos), but we want to make it easier to do a lot more. That's why we're previewing some extras, including:

Screensharing: for when you want to show off your vacation photos, your high score, your lesson plan or whatever else is on your screen
Sketchpad: for when you want to draw, doodle, or just scribble together
Google Docs: for when you want to write, plan or present something with others
Named Hangouts: for when you want to join or create a public hangout about a certain topic (like fashion or music or sports...)

Hangouts with extras: Screensharing (left), Sketchpad (right)

Hangouts with extras: Docs (left), Named Hangouts (right)

The extras are still under construction, but we wanted to preview these features and get your feedback sooner versus later. So start a hangout, click "Try Hangouts with extras" in the green room, and let us know what you think.

98. Hangouts APIs
If field trial has taught us anything about Hangouts, it's that the community is overflowing with creative individuals. So in the wake of last week's Google+ API launch, we're also releasing a basic set of Hangouts APIs. If you're a developer who wants to build new kinds of apps and games (and who-knows-what-else), then you can find more details on the Google+ platform blog.

+Search: find the people and posts you care about

99. Search in Google+
You've been asking for it, and we've been busy building it, so today we're bringing Google's search expertise to Google+. Just type what you're looking for into the Google+ search box, and we'll return relevant people and posts, as well as popular content from around the web.

If you're into photography, for example, then you'll see other enthusiasts and lots of great pictures. If you care more about cooking, then you'll see other chefs and food from around the globe. In all cases, Google+ search results include items that only you can see, so family updates are just as easy to find as international news.

Search in Google+: photography (left), cooking (right)

With more than 1 billion items shared and received every day, we're excited to see how search will connect people through their posts on Google+.

+Everyone

100. Anyone can sign up for Google+—no invitation required.
For the past 12 weeks we've been in field trial, and during that time we've listened and learned a great deal. We're nowhere near done, but with the improvements we've made so far we're ready to move from field trial to beta, and introduce our 100th feature: open signups. This way anyone can visit google.com/+, join the project and connect with the people they care about.

Over the next day we'll be rolling out all of these features globally. In the meantime, you can check out what's next in Google+.

Posted by Vic Gundotra, Senior Vice President of Engineering

Launching Google Wallet on Sprint and working with Visa, American Express and Discover

Posted: 19 Sep 2011 01:25 PM PDT

In May we announced Google Wallet—an app that makes your phone your wallet—with Citi, MasterCard, Sprint and First Data. With Google Wallet, you can tap, pay and save using your phone and near field communication (NFC).

We've been testing it extensively, and today we're releasing the first version of the app to Sprint. That means we're beginning to roll out Google Wallet to all Sprint Nexus S 4G phones through an over-the-air update—just look for the "Wallet" app. Here's a demo of Google Wallet in action:

Google Wallet enables you to pay with your Citi MasterCard credit card and the Google Prepaid Card, which can be funded with any of your existing plastic credit cards. As a thanks to early adopters, we're adding a $10 free bonus to the Google Prepaid Card if you set it up in Google Wallet before the end of the year.

When we announced Google Wallet, we pledged a commitment to an open commerce ecosystem. We appreciate Citi and MasterCard for being our launch partners. And today, Visa, Discover and American Express have made available their NFC specifications that could enable their cards to be added to future versions of Google Wallet.

Our goal is to make it possible for you to add all of your payment cards to Google Wallet, so you can say goodbye to even the biggest traditional wallets. In fact, we've got a video of our first customer, someone who is ready to replace his famously over-stuffed wallet. We hope Google Wallet gives him "serenity now."

This is still just the beginning, and while we're excited about this first step, we look forward to bringing Google Wallet to more phones in the future. You can learn more about Google Wallet at google.com/wallet.

Posted by Osama Bedier, Vice President of Payments

Friday, September 16, 2011

Official Google Blog

Time, technology and leaping seconds
Saying thanks—in person—to our Google Top Contributors
A search insights lesson for back-to-school
New tools to help publishers maximize their revenue

Time, technology and leaping seconds

Posted: 15 Sep 2011 01:00 PM PDT

Google's Site Reliability team is responsible for keeping Google's services and data centers up and running 24/7. In this post, you'll hear about a project our Site Reliability Engineers took on to make sure that the fluctuations of time don't adversely affect Google's products and services. If you like this (detailed) glimpse at the tech behind the scenes, come back for more about this team's work in the future. -Ed.

Have you ever had a watch that ran slow or fast, and that you'd correct every morning off your bedside clock? Computers have that same problem. Many computers, including some desktop and laptop computers, use a service called the "Network Time Protocol" (NTP), which does something very similar—it periodically checks the computers' time against a more accurate server, which may be connected to an external source of time, such as an atomic clock. NTP also takes into account variable factors like how long the NTP server takes to reply, or the speed of the network between you and the server when setting a to-the-second or better time on the computer you're using.

Soon after the advent of ticking clocks, scientists observed that the time told by them (and now, much more accurate clocks), and the time told by the Earth's position were rarely exactly the same. It turns out that being on a revolving imperfect sphere floating in space, being reshaped by earthquakes and volcanic eruptions, and being dragged around by gravitational forces makes your rotation somewhat irregular. Who knew?

These fluctuations in Earth's rotational speed mean that even very accurate clocks, like the atomic clocks used by global timekeeping services, occasionally have to be adjusted slightly to bring them in line with "solar time." There have been 24 such adjustments, called "leap seconds," since they were introduced in 1972. Their effect on technology has become more and more profound as people come to rely on fast, accurate and reliable technology.

Why time matters at Google

Having accurate time is critical to everything we do at Google. Keeping replicas of data up to date, correctly reporting the order of searches and clicks, and determining which data-affecting operation came last are all examples of why accurate time is crucial to our products and to our ability to keep your data safe.

Very large-scale distributed systems, like ours, demand that time be well-synchronized and expect that time always moves forwards. Computers traditionally accommodate leap seconds by setting their clock backwards by one second at the very end of the day. But this "repeated" second can be a problem. For example, what happens to write operations that happen during that second? Does email that comes in during that second get stored correctly? What about all the unforeseen problems that may come up with the massive number of systems and servers that we run? Our systems are engineered for data integrity, and some will refuse to work if their time is sufficiently "wrong." We saw some of our clustered systems stop accepting work on a small scale during the leap second in 2005, and while it didn't affect the site or any of our data, we wanted to fix such issues once and for all.

This was the problem that a group of our engineers identified during 2008, with a leap second scheduled for December 31. Given our observations in 2005, we wanted to be ready this time, and in the future. How could we make sure everything at Google stays running as if nothing happened, when all our server clocks suddenly see the same second happening twice? Also, how could we make this solution scale? Would we need to audit every line of code that cares about the time? (That's a lot of code!)

The solution we came up with came to be known as the "leap smear." We modified our internal NTP servers to gradually add a couple of milliseconds to every update, varying over a time window before the moment when the leap second actually happens. This meant that when it became time to add an extra second at midnight, our clocks had already taken this into account, by skewing the time over the course of the day. All of our servers were then able to continue as normal with the new year, blissfully unaware that a leap second had just occurred. We plan to use this "leap smear" technique again in the future, when new leap seconds are announced by the IERS.

Here's the science bit

Usually when a leap second is almost due, the NTP protocol says a server must indicate this to its clients by setting the "Leap Indicator" (LI) field in its response. This indicates that the last minute of that day will have 61 seconds, or 59 seconds. (Leap seconds can, in theory, be used to shorten a day too, although that hasn't happened to date.) Rather than doing this, we applied a patch to the NTP server software on our internal Stratum 2 NTP servers to not set LI, and tell a small "lie" about the time, modulating this "lie" over a time window w before midnight:

lie(t) = (1.0 - cos(pi * t / w)) / 2.0

What this did was make sure that the "lie" we were telling our servers about the time wouldn't trigger any undesirable behavior in the NTP clients, such as causing them to suspect the time servers to be wrong and applying local corrections themselves. It also made sure the updates were sufficiently small so that any software running on the servers that were doing synchronization actions or had Chubby locks wouldn't lose those locks or abandon any operations. It also meant this software didn't necessarily have to be aware of or resilient to the leap second.

In an experiment, we performed two smears—one negative then one positive—and tested this setup using about 10,000 servers. We'd previously added monitoring to plot the skew between atomic time, our Stratum 2 servers and all those NTP clients, allowing us to constantly evaluate the performance of our time infrastructure. We were excited to see monitoring showing plots of those servers' clocks tracking our model's predictions, and that we were continuing to serve users' requests without errors.

Following the successful test, we reconfigured all our production Stratum 2 NTP servers with details of the actual leap second, ready for New Year's Eve, when they would automatically activate the smear for all production machines, without any further human intervention required. We had a "big red button" opt-out that allowed us to stop the smear in case anything went wrong.

What we learned

The leap smear is talked about internally in the Site Reliability Engineering group as one of our coolest workarounds, that took a lot of experimentation and verification, but paid off by ultimately saving us massive amounts of time and energy in inspecting and refactoring code. It meant that we didn't have to sweep our entire (large) codebase, and Google engineers developing code don't have to worry about leap seconds. The team involved in solving this issue was a handful of people, distributed around the world, who were able to work together without restriction in order to solve this problem.

The solution to this challenge drove a lot of thinking to develop better ways to implement locking and consistency, and synchronizing units of work between servers across the world. It also meant we thought more about the precision of our time systems, which have a knock-on effect on our ability to minimize resource wastage and run greener data centers by reducing the amount of time we must spend waiting for responses and rarely doing excess work.

By anticipating potential problems and developing solutions like these, the Site Reliability Engineering group informs and inspires the development of new technology for distributed systems—the systems that you use every day in Google's products.

Posted by Christopher Pascoe, Site Reliability Engineer

Saying thanks—in person—to our Google Top Contributors

Posted: 15 Sep 2011 12:00 PM PDT

"Oh, you're BlueQuoll!"

You heard a lot of enthusiastic cries of recognition at the Global Top Contributor Summit, as Googlers and members of our Top Contributor program got to leave their laptops behind and meet one another face to face. This two-day event held in and around our headquarters in Mountain View brought together some of our most prolific and knowledgeable users from the Google product forums for the first time.

Top Contributors are the folks you may know by "bkc56" in the Gmail forum, "Noisette" in the Google Earth forum and "theylmdl" in the German Webmaster forum—Google users who volunteer their time to help others with questions and troubleshooting issues. We began the program in 2005 to support this important group, and today there are more than 350 Top Contributors who are active in our forums. They also give Google teams important feedback to help shape the development of our products. In short, they're some of Google's most passionate users, and we wanted to take the time to share our appreciation.

TCs from the AdSense, Gmail and Webmaster forums hang out with Googlers (in red)

At the summit, more than 250 Top Contributors joined us from around the world, representing 40+ product forums in 20+ languages. To see just how global this amazing bunch is, check out the map we set up to showcase their hometowns:

At the event, our Top Contributors met with Google engineers who demo'ed upcoming features, giving them the unique opportunity to give feedback and ask questions. This was also an opportunity for our Top Contributors to meet each other, and make a new friend or two.

Bottom right: TC treebles, as he's known in the Maps and Places for business forums, talks with the custom maps team

We hope this summit gave our Top Contributors more insight into how Google works and expressed just how much we appreciate their help and dedication. In fact, they're such a dedicated bunch that some of the Top Contributors were even spotted during the summit answering forum questions. To see them in action, head on over to the Google product forums.

Find out about how you can become a Top Contributor in our Help Forum guide.

Posted by Brenna Robertson and Adrienne Ludwick, Global Top Contributor Summit co-organizers

A search insights lesson for back-to-school

Posted: 15 Sep 2011 11:08 AM PDT

(Cross-posted on the Inside Search Blog and the Retail Blog)

Time to sharpen those pencils: now that the back-to-school season is winding down and students are back at their desks, we thought we'd take a look at some popular searches from the last few weeks. Students across the U.S. are hitting the books—although, as we found, not all their back-to-school searches are academically inclined.

Overall, search interest in [back to school] is up about 10 percent from last year.

After a three-month hiatus, everyone wants to make a great impression on the first day of school. Searches related to starting fresh—like [kids shoes], [kids haircuts] and [healthy school lunches]—jump during the back-to-school season. People are also eager to sport just the right look—searches for [first day of school outfit] have increased 20 percent since the 2010 season.

A well-stocked locker is also top of mind for many at the start of the school year. Search interest for back-to-school staples like pencils, notebooks and backpacks routinely peaks during the season, as kids compare colors, styles and designs online. But tech-savvy students are seeking new essentials for the classroom. Searches for [tablet] exceeded searches for [backpack] for the first time in a July-September period. And with [etextbook] searches up 50 percent from September 2010, look for ereaders to slip into more backpacks in the future.

Crossing items off the back-to-school list is rewarding, but it's a lot more satisfying when there's a bargain involved. This year is no exception with shoppers scanning for deals before heading to stores. Searches for [back to school coupons] and [back to school sales] increased 10 and 25 percent, and searches for [printable coupons] jumped 45 percent from last year's season.

College-bound freshmen seem to be looking for ways to take charge of their finances. Searches for [bank account] and [open bank account] peak in August, and were up about 20 percent from last year's back-to-school season. Searches for [student credit card] are also highest during this time of year, along with searches for the means to pay a credit card bill: [campus jobs]. In recent years, securing a steady source of income has trumped on-the-spot spending. While searches for [student credit card] have decreased 30 percent since 2004, searches for [campus jobs] have steadily increased, up 50 percent in the same period.

Finally, we'll leave you with a few back-to-school essentials that might not have made your list. To avoid using the modern version of the old "my dog ate my homework" excuse, protect your computer with a [laptop lock]—searches regularly spike in in August. If you've been thinking about picking up an instrument, now's the time to jump on the bandwagon (pun intended), as searches for [flute], [cello], [violin] and [clarinet] jump every September. And for your mother's sake (and your roommate's), find a good [laundry service] on campus. Search interest peaks in September, though the clothes-washing learning curve lasts the entire year.

Posted by Julie Krueger, Industry Director, Retail

New tools to help publishers maximize their revenue

Posted: 15 Sep 2011 03:59 PM PDT

What do a celebrity blog, a video interview on a newspaper site and a cable channel's smartphone app have in common? They're all supported by advertising...and they're all examples of how the lines between media formats are blurring.

These increasingly blurry lines are not only resulting in highly engaging forms of content for users, but many new revenue opportunities for publishers. A wave of innovation and investment over the past several years has also created better performing ads, a larger pool of online advertisers, and new technologies to sell and manage ad space. Together, these trends are helping to spur increased investment in online advertising. We've seen this in our own Google Display Network: our publisher partners have seen spending across the Google Display Network from our largest 1,000 advertisers more than double in the last 12 months.

With all these new opportunities in mind, we're introducing new tools for our publisher partners—in our ad serving technology (DoubleClick for Publishers) and in our ad exchange (DoubleClick Ad Exchange).

Video and mobile in DoubleClick for Publishers
Given the changes in the media landscape, it's not surprising that we've seen incredible growth for both mobile and video ad formats over the past year: the number of video ads on the Google Display Network has increased 350 percent in the past 12 months, while AdMob, our mobile network, has grown by more than 200 percent.

Before now, it's been difficult for publishers to manage all their video and mobile ad space from a single ad server—the platform publishers use to schedule, measure and run the ads they've sold on their sites. To solve this challenge, we're rolling out new tools in our latest version of DoubleClick for Publishers that enable publishers to better manage video and mobile inventory. Publishers will be able to manage all of the ads they're running—across all of their webpages, videos and mobile devices—from a single dashboard, and see which formats and channels are performing best for them.

A handful of publishers have already begun using the video feature and it appears to be performing well for them: we've seen 55 percent month-over-month growth in video ad volume in the last quarter. In other words, publishers are now able not only to produce more video content, but to make more money from it as well.

Direct Deals on the DoubleClick Ad Exchange
Another way publishers make money is to sell their advertising via online exchanges, like the DoubleClick Ad Exchange, where they can offer their ad space to a wide pool of competing ad buyers. This has already proven to generate substantially more revenue for publishers, and as a result we've seen significant growth in the number of trades on our exchange (158 percent year over year).

However, publishers have told us that they'd also like the option of making some of their ad space available only to certain buyers at a certain price—similar to how an art dealer might want to offer a painting first to certain clients before giving it to an auction house to sell. So we're introducing Direct Deals on the Doubleclick Ad Exchange, which gives publishers the ability to make these "first look" offers. For example, using Direct Deals, a news publisher could set aside all of the ad space on their sports page and offer it first to a select group of buyers at a specific price, and then if those buyers pass on the offer, automatically place that inventory into the Ad Exchange's auction.

Looking back at that blog, news site and app, we'd like them to have one more thing in common—being able to advantage of new opportunities to grow their businesses even further. These new tools, together with the other solutions we're continuing to develop, are designed to help businesses like them—and all our publisher partners—do just that, and get the most out of today's advertising landscape.

Posted by Neal Mohan, Vice President of Display Advertising