In October 2007, Google and IBM announced a major research initiative to build large data centers that would enable students to program and research remotely. This initiative was termed “cloud computing.” Since then, cloud computing has became a hot new research topic within the IT industry. A cloud computing environment provides its users a distributed computing environment that can handle a massive amount of data and file sharing. Cloud computing environments are made up of a global distributed file system, MapReduce API, and distributed databases.
To insure network security within the cloud computing environment, an Intrusion Detection System (IDS) is included as a basic element of its IT infrastructure. Researchers at the NCHC are utilizing Hadoop and HBase (including Hadoop Distributed File System (HDFS), MapReduce API, and HBase distributed database) as a cloud computing platform. By integrating the well-known IDS analysis tool “snort” with Hadoop and HBase, the NCHC’s researchers have developed an IDS-log Cloud Analysis System (ICAS) which will reduce computing and I/O query times as well as increase the scalability and capability of the IDS log analysis system.