Microsoft and NASA Bring Mars Down to Earth Through the WorldWide Telescope

Microsoft and NASA Bring Mars Down to Earth Through the WorldWide Telescope

Today, Microsoft Research and NASA are providing an entirely new experience to users of the WorldWide Telescope, which will allow visitors to interact with and explore our solar system like never before. Viewers can now take exclusive interactive tours of the red planet, hear directly from NASA scientists, and view and explore the most complete, highest-resolution coverage of Mars available.

Dan Fay, director of Microsoft Research’s Earth, Energy and Environment effort, works with scientists around the world to see how technology can help solve their research challenges. Since early 2009, he’s been working with NASA to bring imagery from the agency’s Mars and Moon missions to life, and to make their valuable volumes of information more accessible to the masses.

“We wanted to make it easier for people everywhere, as well as scientists, to access these unique and valuable images,” says Fay. “NASA had the images and they were open to new ways to share them. Through the WorldWide Telescope we were able to build a user interface at WWT|Mars that would allow people to take advantage of the great content they had.”

To create the new Mars experience in the WorldWide Telescope, Fay worked closely with Michael Broxton of the NASA Ames Research Center’s Intelligent Robotics Group (IRG). Broxton leads a team in the IRG informally called the Mapmakers, which applies computer vision and image processing to problems of cartography. Over the years, the Mapmakers have taken satellite images from Mars, the moon and elsewhere, and turned them into useful maps. Broxton says that getting the results of NASA’s work out to the public is an important part of his mission.

“NASA has a history of providing the public with access to our spacecraft imagery,” he says. “With projects like the WorldWide Telescope, we’re working to provide greater access so that future generations of scientists can discover space in their own way.”

It is the mission of Fay’s team at Microsoft to push the boundaries of technology in service of scientific discovery and advance the state of the art in computer science overall. He explains that the approach to the Mars WorldWide Telescope project was to provide information at your fingertips. As such, Fay says the WorldWide Telescope is as much a research project as a Web service — one that has resulted in a truly stellar experience for users.

“We were able to take the imagery from NASA, combine it with their elevation models and lay those onto the surface of the globe of Mars,” Fay says. “Now users of the WorldWide Telescope can zoom down and actually experience the surface-level detail of Mars. They can pan back and see the height of the craters or the depth of the canyons. The new Mars experience allows people to feel as though they’re actually there.”

In particular, there’s a new dataset from the University of Arizona’s High Resolution Imaging Science Experiment (HiRISE), a state-of-the-art, remote-sensing camera on NASA’s Mars Reconnaissance Orbiter. HiRISE collects incredible images of super high resolution — a quarter of a meter per pixel on average. Each HiRISE image is a gigapixel in size, containing 100 times as much information as a 10 megapixel off-the-shelf camera.

“Due to its size, the data set is too unwieldy for many people to work with,” notes Fay. “But that large data set is necessary to provide the most in-depth experience — the most beautiful images, which are full of information. We needed this immense level of data to even begin to attempt to create this unique Mars experience.”

To get those images out to the public in a new way, the team set an ambitious goal to take all of the HiRISE images, 13,000 or so, and stitch them onto a single coherent map. While HiRISE has only imaged about 1 percent of Mars, leaving vast regions of Mars still to be explored, all of the HiRISE images have now been geolocated on a single map, and correlated with other global Mars data sets. Dotted with HiRISE images acquired so far, this new coherent map is the highest-resolution map of Mars’ surface ever constructed.

“Not only is it going to be amazing for the general public to see, but it’s actually something that scientists have never been able to see before,” Broxton says. “This particular feat has never been attempted.”
Retrieving images from all over the world is as smooth as any experience on the Web today. The secret is a tiling system that uses the visitor’s desktop computer to process the imagery. With such a huge amount of information contained in one coherent tool, users are able to browse and zoom into interesting locations as they please. Visitors to the WorldWide Telescope can now have the experience of flying though a 3-D rendering of Victoria Crater and Olympus Mons — a low valley and the highest peak in our solar system — and can experience firsthand the extreme elevation and intricate features on the Martian surface.

“We take advantage of the computing power you have on your desktop to allow a smooth, 3-D experience,” explains Fay. “As you zoom in, it’s a really constant view of these images. You can now get a true sense for what the terrain looks like.”

Broxton says the 3-D effect is derived from information provided by an instrument called MOLA, the Mars Orbiter Laser Altimeter, which measured altitude along the surface of Mars from space from NASA’s Mars Global Surveyor orbiter. The team also combined that information with a stereo image-reconstruction process — taking two images from different angles and using that to build a 3-D model of the terrain.

“These images give you a particularly visceral impression of, for example, the Mars Exploration Rover landing sites,” Broxton says. “You can see what it’s like in the hills there or zoom into surface craters. It’s really amazing stuff.”

For scientists and hardcore hobbyists, Fay’s team at Microsoft has developed another feature that puts the image in the context of the mission from which it was collected. Users can right-click on some of the images and find their original Web pages at NASA with additional details on the HiRISE project.

“So it’s not just the imagery, but bringing it together with the context,” Fay says. “We think that capability will make this an exciting tool for scientists and educators.”

So what is the surface of Mars like? According to Broxton, part of what’s striking about Mars is its similarity to what we’re used to here on Earth. Mars shares many of the same Aeolian (wind), tectonic, volcanic and even water processes, the effects of which are visible on the planet’s surface.