Training and Simulation 

Software Used to Measure Value of Simulations 

12  2,009 

By Grace V. Jean 

The Defense Department is seeking better ways to determine whether expensive virtual training exercises are worth the investment.  

The Air Force Research Laboratory in Mesa, Ariz., is examining how to increase the effectiveness of the Air Force’s virtual flags. Those are training events in which airmen flying in simulators at their home bases are linked into a networked environment where additional friendly and enemy forces are generated by computers to battle in a simulated war. Tracking performance data in these exercises is a difficult and time-consuming process because of the sheer number of players and the variety and vintages of simulations involved, experts say.

In support of the lab’s research, a Woburn, Mass.-based company called Aptima is developing software that will be integrated with existing simulation assessment tools and pull in information from multiple sources, including simulator data, notes from observer-controllers who are monitoring the trainees and feedback from the trainees themselves.

“No one source of data can provide the full story,” says Mike Paley, executive vice president. “We’re trying to take all the existing data that’s out there and integrate them.”

STASH — the system for tracking, assessing and standardizing human performance — combines, converts and interprets the raw data streams from all of the participants and displays the information on a “dashboard” view.

In a car dashboard, the driver sees information about the vehicle’s performance. In the STASH, exercise officials will see information on different training objectives, such as communications coordination and weapons engagement.

The information will offer instructors an integrated picture of individual and team performance in such exercises, officials say.

For example, in a virtual training event in which four friendly fighters have to engage six enemy fighters in air-to-air combat, much of the training lies not in whether the enemy fighters were shot down, but whether the internal communications among the flight lead, the wingmen and the airborne warning and control aircraft crew was adequate, says Paley. Attaining that information can give trainers and the exercise designers a good idea of how well the training is going and what needs to be addressed in the future.

Aptima has received a phase II small business innovation research contract from the Air Force lab to continue developing the product.

“The innovation is the integration,” says Paley.

Parts of the tool have been employed at the research lab and at the combined air operations center at Nellis Air Force Base, Nev., which participates in virtual flag exercises run out of Kirtland Air Force Base, N.M.

In a separate program, the company also is looking to make its tools compliant with the Navy's aviation simulation master plan program, which is aiming to improve distributed mission training by standardizing tools and simulations. Aptima wants to be able to link into the system to pull data into their performance measurement system beginning with the Navy's submarine-hunting aircraft replacement program, the P-8 Poseidon multi-mission aircraft being built by Boeing.

Paley says the goal is to have STASH ready for implementation by next fall. It will deploy on a four-ship flight simulator at AFRL Mesa and eventually will migrate to the combined air operations center at Nellis.

“We’re all pretty excited about this particular project because we know this is what ultimately needs to happen to get broader use and application for these tools,” says Paley.                                       

Submit Your Reader's Comment Below
*Name
 
*eMail
 
The content of this field is kept private and will not be shown publicly.
*Comments
 
 
Refresh
Please enter the text displayed in the image.
The picture contains 6 characters.
*Characters
  
*Legal Notice

NDIA is not responsible for screening, policing, editing, or monitoring your or another user's postings and encourages all of its users to use reasonable discretion and caution in evaluating or reviewing any posting. Moreover, and except as provided below with respect to NDIA's right and ability to delete or remove a posting (or any part thereof), NDIA does not endorse, oppose, or edit any opinion or information provided by you or another user and does not make any representation with respect to, nor does it endorse the accuracy, completeness, timeliness, or reliability of any advice, opinion, statement, or other material displayed, uploaded, or distributed by you or any other user. Nevertheless, NDIA reserves the right to delete or take other action with respect to postings (or parts thereof) that NDIA believes in good faith violate this Legal Notice and/or are potentially harmful or unlawful. If you violate this Legal Notice, NDIA may, in its sole discretion, delete the unacceptable content from your posting, remove or delete the posting in its entirety, issue you a warning, and/or terminate your use of the NDIA site. Moreover, it is a policy of NDIA to take appropriate actions under the Digital Millennium Copyright Act and other applicable intellectual property laws. If you become aware of postings that violate these rules regarding acceptable behavior or content, you may contact NDIA at 703.522.1820.