At SDSU, Silicon Graphics Prism Now Processes and Serves NASA's Blue Marble: Next Generation Earth Image Data
Beginning with high-resolution satellite imagery of Banda Aceh, Indonesia, acquired before and after last year's tsunami, and continuing through this year's U.S. hurricane season with before and after imagery, especially of the devastation of Hurricane Katrina in the Gulf states, SGI(R) compute power and speed helps SDSU deliver 3D geospatial visualization to relief workers and government officials. The Silicon Graphics Prism(TM) visualization system is an integral part of the geospatial image processing pipeline for the many efforts at the Visualization Center at SDSU, including homeland security, remote sensing and environmental monitoring, global sharing of information and collaborative visualization.
NASA Blue Marble: Next Generation
Launched October 13, Blue Marble: Next Generation uses imagery from NASA's 18 Earth-observing satellites, down-linked at NASA Earth Observatory at NASA's Goddard Space Flight Center. SDSU both processes and serves out the images using a Silicon Graphics Prism system. Blue Marble: Next Generation offers a year's worth of monthly composites at a spatial resolution of 500 meters per pixel. These monthly images reveal seasonal changes to the land surface: the green-up and dying-back of vegetation in temperate regions such as North America and Europe, dry and wet seasons in the tropics, and advancing and retreating Northern Hemisphere snow cover, helping scientists in many disciplines to make more detailed observations of our world.
According to NASA's Web site, commenting on the upgrade from the original Blue Marble, "From a computer processing standpoint, the major improvement [in Blue Marble: Next Generation] is the development of a new technique for allowing the computer to automatically recognize and remove cloud-contaminated or otherwise bad data -- a process that was previously done manually."
Additional processing is accomplished using the GeoMatrix Toolkit from GeoFusion, Inc. ( http://www.geofusion.com ), which is the backbone of the Visualization Center's high-performance imaging and GIS environment. The scalable computing power and large memory of the Silicon Graphics Prism system allows researchers to use GeoMatrix tools to process data for serving in the GeoPlayer ActiveX web browser plugin.
Hurricane Katrina Disaster Response
By visualizing hundreds of gigabytes to many terabytes of geospatial data, the researchers at the Visualization Center at SDSU are able to continuously create up-to-date 3D fly-throughs that depict the changes wrought by a natural disaster. The Silicon Graphics Prism system is the heart of the process and is used to create the new datasets, routinely processing 500 or more image files up to 200MB in size each night to create mosaics of a terabyte or more. The Silicon Graphics Prism system at SDSU has 24GB RAM, 8 Intel(R) Itanium(R) 2 processors running GeoMatrix and OSSIM ( http://www.ossim.org ) open-source tools in the Linux(R) environment. This configuration allows conversion of all data into easily accessible, open-source format; the data is then stored back out to the servers at SDSC for public access on the Internet. In the case of Hurricane Katrina, WMS (web map server) data were served directly from the Silicon Graphics Prism system.
To create the mosaics and 3D fly-throughs that Red Cross and other relief workers would use to determine whether Katrina's victims had a house to return to, SDSU acquired data from a number of sources. Most of the imagery datasets of the affected Gulf states were taken by NOAA with its specially equipped airplane to rapidly acquire high-resolution imagery over the damaged area. Similar high-resolution photography, especially the before imagery was acquired from the USGS EROS Data Center and from other groups such as the Army Corps of Engineers. NASA satellites also provided before and after imagery, which are very good for a regional and multi-spectral perspective that can be combined with the high-resolution photography to provide location and context. The DigitalGlobe ( http://www.digitalglobe.com) satellite provided 60-centimeter imagery of before and after Katrina, which provided one of the first compelling views of the extraordinary impact of Katrina in both flooding and destruction. The high-resolution, color photography was acquired over and over again as the water drained to provide insight into the change of the water as levees broke and water flooded and receded.
"The Silicon Graphics Prism performed incredibly well," said Dr. Eric Frost, co-director of the Visualization Center, SDSU. "There were 5,000 aerial shots in the first batch of after-Katrina photos, and each photo was between 150 and 200MB. Then 2,500 more would come in the next day, and the next, and so on. An inherent aspect of the photos, especially with low-altitude photography, is that the scale is different from the center of the photo to the outside edge because the airplane is much closer to the center of the shot than it is to the outside. It's like taking a picture of someone when you're too close, where the nose looks bigger than the rest of the face. In order to put all those photos together into a mosaic and to add GIS data onto them, you actually have to process them in a way where you know exactly what the errors are and you can move all the pixels to the right place. So just to begin work on the first 5,000 photos, the team of experts that came together around the Silicon Graphics Prism system, color-balanced them and then geo-rectified them -- meaning that you're putting all the pixels where they actually are on the Earth. That normally would be weeks or months of processing, but there was a very special coalition of extremely talented image processors and computer scientists that worked together from a number of different institutions -- such as the extraordinary talent in the OSSIM open-source group, Norm Vine, an independent contractor working with the University of New Hampshire and the Woods Hole Oceanographic Institution, Chuck Stein from GeoFusion, and many others. Tom DeFanti at Calit2 ( http://www.calit2.net) at the University of California San Diego allowed us to tap into the CPUs of their Silicon Graphics Prism system-they all helped us draw up these data sets and put them together. They were all networked into our Silicon Graphics Prism at San Diego State, processing these data sets. Acquiring the data, getting it all processed and geo-rectified, put into the right formats and mosaiced together, that just takes huge processing power, which the Silicon Graphics Prism absolutely excels at."
Once the photos are geo-rectified, data on locations of roads, city boundaries, hospitals, schools, police stations, and fire stations are added. As more and more information comes in, other data sets are laid on: where the damage is; what assets belong to HUD; where the refineries are; where the gas stations are; and where hazardous waste materials are. SDSU also installed an address database for the entire U.S. using Schuyler Earle's http://geocoder.us/ . The US Census Bureau's Tiger data, which was linked to the imagery by Howard Butler of Iowa State University, enabling the Katrina relief team to also include something called "geo-coding." Geo-coding means that anyone working for the Red Cross at any shelter in the U.S. could type in an evacuee's address and the computer immediately flies through the 3D geospatial dataset or a flat map to where that address is -- or was -- on that particular city block or country road.
The U.S. Navy also came to the team for geo-coding. The Navy wanted to know how many of their personnel contractors and their dependants had been affected by the disaster. Chuck Stein simply took the address dataset as a database file and, using the GeoMatrix format, which turned the addresses into 3D icons, ran the data through GeoFusion and out of the Silicon Graphics Prism system to a monitor. The results: little yellow flags came up on the addresses of all 8,000 people and it was obvious that several thousand people had lost their homes or were likely evacuated because of the damage to, or location, of their home. Within one day, the Navy was able to narrow the search down to about a hundred people and then find almost all of them the next day.
Once the data is uploaded to SDSU's Web site, any number of researchers and government agencies, or the public can use it. One of the most powerful uses of the data was for locating toxicity and medical data onto the images; and helping interpret the ongoing stream of environmental and monitoring data that are currently being collected by many groups who are helping with the decision-making for the future of the region and people. Duke University Professor Marie Lynn Miranda, a specialist in children's environmental health, considers lead contamination levels one of the biggest issues in the recovery. Professor Miranda is leading the National Institute for Environmental Health and Safety (NIEHS) effort, and the Visualization Center at SDSU is providing the computation power on the Silicon Graphics Prism system for the work she and others are doing. Researchers at UCSD who work with NIEHS on Superfund site efforts, including Professors Bob Tukey and Mark Ellisman, connected SDSU and its imaging capabilities with Professor Miranda and her GIS expertise and strategic position in helping decision-makers understand what the problems were and what possible solutions might be. Researchers like Professors Miranda, Tukey and Ellisman are using the completed data sets, adding census data and on-going environmental measurements, to attempt to determine areas where people could move back to or sections where people -- especially children who are more likely to develop severe physical problems from exposure to high lead levels -- should never return. Being able to serve the terabytes of imagery and GIS data to researchers and field workers both in the affected area and in decision centers focused on helping the people of all the affected states will be something that should provide a significant service to the nation for many years to come as the long-term medical impacts of Katrina and other hurricanes come to light.
"To really do the right thing for the people ravaged by Katrina, it takes a massive amount of data fusion -- compositing the toxicity and damage data with imagery and then tracking the changes through time," said John Graham, the Visualization Center's Senior Research Scientist who helped lead the effort with processing and building the social network of specialists who made the Silicon Graphics Prism perform so remarkably. "When you're working with satellite and aerial photography, you can be dealing with multiple terabytes of data. This is where the Silicon Graphics Prism system really shows off the power of its shared-memory architecture, with its ability to take all the bricks and connect them to appear as one large computer with lots of memory. Then taking the geo-referenced imagery and 'cooking' it into GeoFusion OpenGL texture format and storing it on high-speed servers, allowing anybody with a Windows PC that has a OpenGL video card and Internet Explorer -- which almost all new machines do -- to use the ActiveX web browser plugin and fly through those terabytes of data. But it's SGI technology, processing the data on the backend, that is making this all possible."
Needed Now: 10GigE
While gratified by the huge amount of work by fellow scientists, researchers, and the numerous volunteers it took to deliver these data sets to help Katrina victims, including GeoFusion, who wrote code to help everything move even faster, Frost envisions much faster access to the original data, both through networks like the National Lambda Rail ( http://www.nlr.net), a dark-fiber grid used by universities, and by the addition of 10 Gigabit Ethernet (10 GigE) connections, especially at government facilities like the EROS Data Center and NASA's Goddard Space Flight Center, as well as numerous groups in the Washington, DC area such as the Navy Research Lab and the OSSIM researchers who were involved with the effort. SDSU's first source of Katrina data was the national center for data, the U.S. Geological Survey Center's Earth Resources Observation & Science (EROS) Data Center, in Sioux Falls, SD. When Graham first accessed EROS to download the data and FTP it, the screen said, "Estimated time: 218 hours" for one data set. All the datasets needed were eventually downloaded to disk and FedEx'ed or flown to SDSU.
"With National Lambda Rail, the fiber-optic network is mostly already there, including to places like Louisiana State University in the heart of the area that was impacted. The ideas and management are already there," concluded Frost, "as this is something that visionaries like Larry Smarr, Director of Calit2 and Principal Investigator for the OptIPuter project ( http://www.optiputer.net) have been working on for several years. If there were more 10 GigE boxes around, and the agreements in place before-hand, all the major SGI facilities could be connected, as well as the data sources, visualization facilities, and command-and-control centers for data fusion and decision support. People who have the right kinds of machines and the right software could immediately start making their CPUs available for ingesting the data, processing this data, and serving it out. We could make an incredible impact on our country's ability to be ready for natural disasters and continue to process and serve out data as it comes in, as cleanup continues to take place. That would be profoundly in the national interest. This same effort can be done internationally and fits with efforts such as iGrid 2005 ( http://www.igrid2005.org ), which was led by Tom DeFanti and Maxine Brown, two of the leading fiber and people networkers in the world. At iGrid last month, we showed off Katrina data running via SGI OpenGL Vizserver software over 15,000 km of fiber from San Diego to Chicago to Seattle to Tokyo with John Graham running the keyboard and mouse in the Calit2 building in San Diego. Similar sharing of resources internationally over 1 GigE and 10 GigE networks could revolutionize our ability to help people around the world and to have the world help the world."
"It is clear that scientific visualization has reached a new and powerful level to model, predict and plan for natural disasters," said Bob Bishop, chairman and CEO of SGI. "The Visualization Center at San Diego State University offers a clear demonstration of how this technology can be used to triumph over adversity."
See related November 1, 2005 press release: "Calit2 at UC San Diego Selects SGI Visualization and Storage Technology".
SILICON GRAPHICS | The Source of Innovation and Discovery(TM)
SGI, also known as Silicon Graphics, Inc., is a leader in high-performance computing, visualization and storage. SGI's vision is to provide technology that enables the most significant scientific and creative breakthroughs of the 21st century. Whether it's sharing images to aid in brain surgery, finding oil more efficiently, studying global climate, providing technologies for homeland security and defense or enabling the transition from analog to digital broadcasting, SGI is dedicated to addressing the next class of challenges for scientific, engineering and creative users. With offices worldwide, the company is headquartered in Mountain View, Calif., and can be found on the Web at www.sgi.com.
NOTE: Silicon Graphics, SGI, OpenGL, the SGI cube and the SGI logo are registered trademarks and OpenGL Vizserver, Silicon Graphics Prism and The Source of Innovation and Discovery are trademarks of Silicon Graphics, Inc., in the United States and/or other countries worldwide. Intel and Itanium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a registered trademark of Linus Torvalds. All other trademarks mentioned herein are the property of their respective owners.
MEDIA CONTACT Lisa Pistacchio Email Contact +1-650-933-5683 SGI PR HOTLINE +1-650-933-7777 SGI PR FACSIMILE +1-650-933-0283
CONTACT: media, Lisa Pistacchio of SGI, +1-650-933-5683, or
Email Contact; or SGI PR HOTLINE, +1-650-933-7777; or SGI PR