|
Posted: 18 Mar 2016 05:12 AM PDT
I often think about virtual reality and the prospect of immersive experience of distant worlds using data returned by our probes. But what of the state of virtual reality today, a technology that is suddenly the talk of the computer world with the imminent release of the Oculus Rift device? Frank Taylor is just the man to ask. He has worked with computer graphics since the 1970s, starting at the University of Arizona. He worked several years at aerospace companies in support of DoD and NASA including simulation and virtual reality technology in support of astronaut training at NASA JSC. Frank has also been a successful entrepreneur doing work with Internet and other computer technologies. His most notable recent accomplishment was the completion of one orbit of the Earth at 0 MSL – he and his wife left in 2009 and sailed around the world arriving back in the US in 2015. Frank is the publisher of Google Earth Blog since 2005. Have a look now at the surprisingly wide possibilities already opening up for VR.
by Frank Taylor
For most of us reading Centauri Dreams, we have lived out our lives dreaming about travel to other stars and planets. Many of us have tried to satisfy our dreams vicariously by enabling the various unmanned missions to our non-terrestrial, solar system-based planets, Sun, moons, asteroids, and comets. Last summer, we were all captivated by watching the fly-by of our most distant planetary-like neighbor Pluto and its moon Charon.
In addition, we have over four centuries of both terrestrial and space-based telescopic observations to thank for our measured observations of both local and interstellar astronomical objects as far as our science has allowed. But, our hopes and plans of visiting other stars and planets for more direct observation has continued to elude us. For well known reasons documented here on Centauri Dreams.
Image: My friend Frank Taylor, photographed here on the Indian Ocean island of Reunion during his recent circumnavigation, which is fully documented (and with spectacular photography) on his Tahina Expedition site.
Computer Simulations of Space
As a career computer graphics scientist, I have been fortunate to simulate space-based operations for training astronauts, simulate remote tele-robotic space operations, and create animations depicting some of our in-orbit and planetary missions. I have also thoroughly documented the use of Google Earth for enumerable Earth depictions as well as involved in developing its use for other planets and moons in our solar system. I’ve published the Google Earth Blog since 2005 with almost daily news and stories about that program and its uses.
Going back to 1991, while working under contract with NASA JSC, I discovered a demonstration program on a Silicon Graphics workstation that was developed by an engineer named Erik Lindholm. It depicted a 3D simulation of the known local star systems, our entire solar system, and even had a few science fiction objects like Ring World around another star. The amazing thing was that you could travel between objects at speeds far exceeding known physics. Measurements were at multiples of C (speed of light). I was entranced by this experience of finally traveling to another star, and it wasn’t necessary to wait an unreasonable amount of real time to get there. For years afterwards, I wondered why someone had not ported the application to a wider audience (possibly less than 500 people saw that early one) – especially with the rapidly improving computer graphics capabilities of the typical desktop computer that decade.
In the 1990s, there were numerous planetarium applications that let you simulate the night sky, and some even let you visit other planets. But, it wasn’t until early 2001 that a real interstellar travel 3D simulator became popular. A program many of you may have heard of called Celestia (Wikipedia) was released and available for free. It mostly focused on the solar system, but also modeled a fair number of known star positions and compositions, and even allowed you to see an approximation of our galaxy and visit 3D versions of neighboring galaxies (but, not individual stars and planets).
Image: Screenshot of Celestia loading data Version 1.6.1.
The developers ported Celestia to many operating systems (Windows, Mac, Linux, and even Amiga OS). An active community of fans contributed enhanced quality textures for planet surfaces, contributed ideas for educational tours, produced or converted 3D models of spacecraft (both real, design concepts, and fictional), and more.
For 10 years, Celestia was active. But, the developers stopped work by 2011. Celestia and community content is still available. Even if you have an older desktop or laptop, Celestia is likely to run well. Download Celestia here, and see the community content here. The caveat is that the graphics are based on older (circa 2000) generation products, and computer graphics cards have leaped ahead in quality in the last 15 years.
Current Generation Space Simulations
Recently, I was lamenting the lack of progress since Celestia, and discovered a link to an amazing Windows-based program calledSpace Engine (Wikipedia). This program is sure to make almost any astronomer, or Centauri Dreams fan, exclaim in awe and wonder for the opportunity to visualize and virtually experience interstellar destinations with almost artistic quality. Developed by a single programmer in Russia, whose name is Vladimir Romanyuk, with input from Russian astronomers and international scientists and fans, this program is amazing. In his own words Space Engine is described as:
Image: Screenshot of Space Engine loading Version 0.9.7.4 showing moon terrain and atmosphere in orbit around oceanic planet.
Space Engine uses publicly available astronomical databases to represent the known stars and planets. Then he goes on to generate a suitable composition of remaining stars, star clusters, and nebulae for galaxies. Next, the program extrapolates planetary systems based on best guesses for physical compositions using orbital distances, star temperatures and types, and other factors. Planet classifications include gas giants, ringed worlds, desert planets, oceanic, ice, and more. Then he procedurally generates 3D terrain, and – when physically viable – water bodies, craters, mountains, canyons, volcanoes, and other terrain. The application then colorizes and adds textures to make the surfaces look realistic. Atmospheres are rendered, when present, including colorization based on physical composition and star colors. Space Engine even calculates whether life could be present on planets with the right characteristics. Also, a great deal of effort has been put into rendering black holes and accretion disks.
Here is a YouTube video by a fan reviewing an older version of Space Engine (by ObsidianAnt):
Video: A high resolution video showing samples of views in Space Engine with review commentary. Credit: YouTube, ObsidianAnt.
In attempt to make the program have a game-like feel, you can also add 3D space ships (including interstellar traveling ships) and actually fly them using a variety of supported controlling devices. Personally, I have plenty of fun just exploring stars and planetary systems without the spacecraft simulations. But, some readers here might have fun putting their favorite interstellar spacecraft designs into Space Engine.
Image: Screenshot from Space Engine showing spacecraft in front of moon and gas giant with nebula in background.
Space Engine is available for free for Windows only right now, but you have to own (or have access) to a relatively recent desktop with recent high-end video card, or a high-end gaming laptop, to run this powerful program well. Recommended requirements are listed on the bottom of the home page for Space Engine. If you want to try it, the latest version can be found (in the forums)here. Vladimir is asking for donations to help fund further development and ports to Mac and Linux. I encourage those who enjoy the program to make a donation.
Space Engine attempts to be a mirror of the real universe as we know it. With the main exception being that travel times are greatly reduced. Would you believe there is yet another category getting even more development attention involving virtual interstellar travel?
Computer Games with Space Simulations
It is widely known that computer graphics’ rapid technological advancement in the past 40+ years was not solely due to scientific application pursuits. An even bigger factor has been the advancement and popularity of computer games. The same thing is happening to space-based simulations. There is an acceleration of interest in space-based games that is advancing the technology of space simulations. While Space Engine has been developing admirably during the past two years with a sole programmer of talented skills, a number of space games have been developed with modern gaming development budgets in the millions of dollars, and requiring dozens of game software engineers, artists, writers, physics modeling, simulation software, database engineers, and a business marketing budget equal to half the overall budget or more.
Some of these games involve interstellar travel and exploration and science fiction themes involving mostly commerce, and the inevitable gaming need of military action to protect interests. The typical gamer takes on jobs of space mining to build a fortune to acquire bigger and better space ships. Then they graduate to military ships and space battles ensue on a massive scale. For example, one massively online role playing game called Eve Online (Wikipedia) hosted last October a large scale space ship battle involving the loss of 1,165 ships (which equated to in monetary conversion to US $13,000) with 1600 gamers participating ( story here by Michael Bonnet, PC Gamer).
Image: Image of Eve Online orbital battle scene by CCP Games.
My interest lies in games that generate realistic visualizations of interstellar systems using spacecraft that we might build ourselves for exploration (if we can overcome the physics to get over the distance factors). The best space game simulation example I have seen is a game called Elite Dangerous (Wikipedia) by Frontier Developments based in Cambridge, UK. Frontier have created not only very realistic renderings of space and spacecraft, but have also added highly versatile surface recon vehicles (SRVs) that you can drive on the surface of planetary bodies (available in their latest season called Horizons).
Image: Image of Elite Dangerous – program developed by Frontier Developments Plc.
Elite Dangerous star systems and planets are quite well rendered in many ways similar to Space Engine. The graphics and lighting are astonishingly real, as is the physics of the simulations. Of course, because it is a game, situations can involve space battles with competing factions for space-based mining and other commercial operations. But, you can also just explore on your own as demonstrated in this YouTube video which shows a tour of our Solar System:
Video: A high resolution video showing a tour of a future version of our solar system from the game Elite Dangerous: Horizons. Credit: YouTube, ObsidianAnt.
Some of our planets have changed a bit due to human influences over the next thousand years of space development. You will note that fine simulation details such as the rendering of instrumentation on the pilot stations with working indicators of thrust, gravity, attitude, fuel, scanning of terrain when landing, and other ship and object conditions. Ships can be controlled with a number controllers such as those used for flight simulation, game controllers, or even mouse and keyboard.
Image: Screenshot of rover on moon near planet in Elite Dangerous from YouTube video above by ObsidiantAnt.
As you can see, the budget of big games has resulted in an astonishing amount of simulation detail. You also may note that the video above was produced by the same person who created the video I shared for Space Engine. People who like the idea of interstellar travel gravitate their way to these similar space simulations.
The New Age of Virtual Reality
A major new influence of computer graphics is excitement surrounding the recent introduction of consumerized virtual reality technology. Virtual reality usually refers to immersive multimedia using computer simulation, accomplished through a head mounted display system representing stereoscopic 3D, or other multimedia, display, renderings and stereo audio. The idea of virtual reality technology and its development go back nearly as far back as the first computer graphics. The first immersive display system was built by Ivan Sutherland in 1968. It involved a heavy suspended helmet system with an early development of miniaturized cathode ray tube displays. The system became known as “Sword of Damocles”.
Image: Photograph of first VR system designed by Ivan Sutherland in 1968. The system became known as “Sword of Damocles”. A head mounted three dimensional display”, Ivan Sutherland, 1968.
In the late 1980s excitement about virtual reality reached beyond the purview of computer graphics researchers. This happened when advances in 3D graphics machines, display systems, 3D positioning devices, and hand-tracking devices began enabling interaction and a sense of immersion.
Of personal interest was that NASA was quite involved in research in VR in the 1980s. NASA Ames Research Center formed the Virtual Environment Workstation (VIEW) lab and was headed by Scott Fisher. In the early 80s, I worked at NASA JSC on the space shuttle simulator computer graphics used for training the astronauts. In the late 1980s I was working with engineers in a robotics simulation lab at NASA Johnson Space Center and one project was a VR helmet system used initially for research in training astronauts for the Manned Maneuvering Unit (MMU) for space walks. Later (early 90s) this system was used for tele-robotic simulations I helped develop to explore controlling the robotic arms on the space station (which was still being designed at the time).
Science fiction books fed fuel to the VR fire, when William Gibson’s bookNeuromancer (1984) introduced the term “cyberspace” in the early 80s. Later, Neal Stephenson published Snow Crash (1992) which popularized a concept of a virtual reality rendered universe, which he called the “Metaverse”, which humans could visit and be represented through an avatar in a 3D world with shared defined places.
Hype about VR became widespread in the technology industry first in the late 80s. Then gaming companies in the early 90s announced VR systems that could be used in the popular video arcades. A movie called The Lawnmower Man(1992, Wikipedia) helped introduce the concept of VR to an even wider audience. Probably the most popularized science fiction concept of virtual reality was introduced in the late 80s in the form of Star Trek: The Next Generation (TV series, 1987, Wikipedia) with the “holodeck”. Of course, the holodeck is still the ultimate dream of a lot of VR enthusiasts.
Unfortunately, the capabilities used by researchers involved in VR in the 80s and 90s used very expensive computer graphics workstations and display devices. And, the displays were very crude at about 320×240 resolution at best. It was not yet possible to create cost effective, or realistic-looking systems at that time. The resulting game VR systems were crude and underwhelming when they came to market. Companies investing in the technology lost a lot of money and the concept’s popularity waned. I actually left NASA in 1992 intending to form a VR company, but my business planning fortunately revealed the impending dilemma and I instead started an Internet company. The impact of the burst of VR hype in that period of time, reduced interest in investment of consumer VR for the next 20 years. Far longer than I, or many other people, would have believed.
In 2012, an enterprising 19-year-old VR fan by the name of Palmer Luckey introduced the concept of building a new head mounted display (HMD) system using the now much more advanced computer graphics capabilities of desktop computers. Advances in display systems for mobile phones made possible much higher resolution displays for VR in a more lightweight HMD.
Palmer Luckey’s idea was an example of impeccable timing. He formed a company called Oculus to build his first system to be called the Oculus Rift. Within months, his company introduced the idea of raising funding through the crowdfunding site Kickstarter. He already had a large following in the gaming community because of an association with the most revered computer graphics gaming guru John Carmack. His goal was to raise $250,000. The concept was so popular that the goal was reached within four hours, and ended up raising nearly 2.5 million dollars instead. Although most of the contributors were gamers, the applications of VR reach a far wider range. Possibly the largest is entertainment as 360 filming has become practical and is very impressive.
By the end of 2013, Oculus had raised $75 million dollars in investment, headed by the leading technology investment broker Andreesen Horowitz. In March of 2014, Mark Zuckerberg announced on Facebook that they would be acquiring Oculus for $2 billion. Needless to say, this greatly raised attention to VR.
Even with the resulting flood of money, it would take two years to prepare the first Oculus Rift for consumer sales. However, Oculus also worked with Samsung to introduce an HMD called GearVR that works with top-end Samsung smartphones as the display device for only $100. It became widely available to consumers in 2015. The first Oculus Rift became available for pre-order in early January 2016. The first units are scheduled for delivery March 28, 2016. The difference between the GearVR and the Rift are greater fidelity and performance of computer graphics, better visual optics and positional tracking, 3D controllers and more versatility with a multi-tasking operating system. A competitor to Oculus from HTC called Vive started pre-orders on February 29, 2016. It has the ability to stand up and move around, and has two 3D hand-controllers for interaction.
Despite the delayed delivery to consumers, Oculus has reportedly shipped 200,000 units of prototype Oculus Rift units worldwide to software developers since early 2014. Numerous software products, in particular games, have introduced support for the Oculus Rift (and other Head Mounted Displays which have since been announced by other companies). And, over $2 billion in addition investments have gone towards the ecosystem of new VR companies in the last two years alone. Top analysts are predicting huge forecasts for adoption, but it’s a little early to say what the reaction will be until the new consumer products are on the shelves and real software ships.
Image: Oculus Rift pre-order entry page January 6, 2016 with photo showing the components in the Oculus Rift package. First deliveries were scheduled for March 28, 2016.
VR in Space Simulations Today
Both Space Engine and Elite Dangerous have support for VR. In Space Engine, you can both gaze in wonder at the beauty of the universe, but also sense the scale and grandeur of nearby planets, moons, nebulae, and stars. While the system works well for Space Engine, the sense of immersion and 3D effects are much more pronounced in Elite Dangerous due to the primary placement being in the pilot seat of the space craft used for exploration. Stereoscopic 3D immersion is much more noticeable for objects in close proximity due to parallax. Hence the views are even more immersive in Elite Dangerous and the simulations of landing on a planet are quite exciting. Needless to say, these space-based experiences are very gratifying to me as a long-time believer in VR, especially with actual VR experience dating back to 1990.
Meanwhile, NASA and aerospace companies have continued to use VR for space simulations throughout the past 20 years. Some of the very same engineers I worked with in the early 90s started a VR Lab at JSC and have been using VR to train astronauts ever since (see article by Erin Carson at Tech Republic).
One of the most talked-about space VR programs is an educational story about the Apollo 11 mission to the moon. You can watch elements from launch to the historic moment when Armstrong steps on the moon. The in-development product has already won awards because of the strong emotional impact it has had on its viewers, and videos and demos are available for viewing in VR. You can watch a 360 video trailer of the Apollo 11 VR produced by Immersive VR Education out of Dublin, Ireland here (if you have cardboard you can watch it in 3D):
The new consumer space simulations software like Space Engine and Elite Dangerous are the closest most of us or going to get today to experiencing the exploring distant interstellar worlds and places. However, it should be noted that the requirements for the new consumer VR HMDs does have even higher system requirements for faster processors, memory, and video cards.
Interstellar researchers and exploration dreamers take note. Your chance for travel to the stars is virtually here.
 |
Sharing the work and world of my fellow authors!
Monday, March 21, 2016
Centauri Dreams: Making Centauri Dreams Reality, Virtually
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment