The prototype of the Real Time Regional Gateway was designed by the military and intelligence contractorSAIC. Instead of storing all data in centralized databases, as was NSA's traditional approach, RT-RG uses distributed computing, which means hundreds or even thousands of individual computers work together on one task. This is managed by the Hadoop software, that was originally developed by Yahoo. The NSA created its own version, called Accumulo, which can manage extremely large data sets and also includes granular access controls. The successor of the Real Time Regional Gateway is named Nexus 7 and is now under development at the Defense Advanced Research Projects Agency At NSA the driving force behind the system was former NSA director Keith B. Alexander, who initiated a massive search for every piece of electronic information that could be found, after the Iraqi road side bombings reached an all-time high in 2005. Alexander's "collect it all" strategy is believed by Glenn Greenwald to be the model for the comprehensive worldwide mass collection of communications which NSA is supposedly engaged in.
Origins and deployment in Iraq
Under the secret interception programs that were started right after the September 11 attacks, which were codenamed STELLARWIND, the NSA got access to foreign communications at the switching points where international fiber-optic cables entered the United States. This enabled NSA not only to monitor many communications from Iraq, but also to initiate cyber attacks against Iraqi telephone and computer equipment. When the Iraq War troop surge of 2007 began, the NSA exported this all-encompassing way of intelligence gathering and analysing to Iraq. As its name describes, the Real Time Regional Gateway was a gateway through which all sorts of information related to one region became available to analysts and soldiers in real time and they could search the data similar to a search-engine like Google. The RT-RG derived its data from all kinds of sources, like raids, interrogations, and signal intelligence collected from ground sensors, as well as by airborne platforms like the RC-135 Rivet Joint and C-12 Huron aircraft, and SIGINT drones and satellites. With the RT-RG, field commanders and intelligence analysts in the field were for the first time able to directly access NSA databases, making that intercepted data were ten times faster available on the ground than in the past. On a screen they were provided with "every type of surveillance available in a given territory" and they could also "get back a phone number or list of potential targets". One of the developers of the RT-RG, was Pedro "Pete" Rustan from the US National Reconnaissance Office. In a 2010 interview he said that the system was designed to put together pieces from a different types of data sources, looking for patterns, and make this available directly to American warfighters on the ground. The Real Time Regional Gateway contributed to "breaking up Iraqi insurgent networks and significantly reducing the monthly death toll from improvised explosive devices by late 2008". According to journalist and author Shane Harris, the RT-RG was "a rare example of successful collaboration within the byzantine federal bureaucracy" and eventually the key for winning the war in Iraq.
Deployment in Afghanistan
In 2010, RT-RG refocused on Afghanistan, where it was used to fuse and analyze even more types of data. Besides the more traditional military intelligence information, this included for example road-traffic patterns, public opinion and even the price of potatoes, because changes in the latter could indicate potential conflicts. Initially these data were gathered and analyzed for 30-day periods, but later this was extended to 90 days, as adding more data appeared to give better results. A former US counterterrorism official described the RT-RG as "the ultimate correlation tool" adding that "It is literally being able to predict the future".
