Abstract
The Internet of Things refers to the connection of everyday objects to the Internet. This allows humans to monitor and interact with these objects from anywhere in the world. With IoT, we can envision a future where everyday objects such as toasters, coffee makers, vacuum cleaners would be uniquely identifiable and controlled over the internet. With so many wide variety of devices connected to the Internet there is a need for a scalable, fault tolerant, distributed processing framework that can fetch, process, store, display, and analyzes such large amount of data generated by these devices. For this project, a system was built which can receive data from multiple devices and provide an unified framework to process, store, and display data from these devices in real time. The framework henceforth means collection of environment which we have built. To demonstrate the capabilities of this framework, an Intelligent Home system was simulated which monitors room temperature using a temperature sensor, connected via a Raspberry Pi. The Raspberry Pi acts as a gateway to fetch data from the sensors, which is processed by the framework in real time to show the room temperature trends on the UI. The framework was built using Apache Spark, a fast, distributed, scalable and general engine for large-scale data processing and Apache Cassandra, which is a free and open-source distributed NoSQL database management system designed to handle large amounts of data. Both Apache Spark and Cassandra are an ideal fit for processing large amounts of data since they provide excellent horizontal scalability, i.e. they can process every increasing amounts of data by adding more hardware capacity without the need to change any framework code.