A Proposed Technique for Conversion of Unstructured Agro-data to Semi-structured or Structured data

摘要

With the increase in the use of social media, agriculture data is growing rapidly thereby producing extensive amounts and vivid types of data each day. The same data can be accessed to be further examined and managed to deliver the useful information to address the needs. According to estimation of IDC (International Data Corporation) 90% of the data is unstructured which is the fastest growing data whereas the remaining is unstructured data and structured data which does not possess a predefined data type or may be the data that does not fit into traditional database for data access. The sources for this data may be IOT, sensors, satellites, emails etc. There are many techniques available for conversion of agriculture data from unstructured to semi-structured or structured data but there are some loop holes present in the existing approaches like they will work particularly for single text, and some work only with the cluster setup etc. This paper presents an approach to convert unstructured data into semi- structured or structured data using the NoSQL tool Couchbase. The Couchbase is the document database with distributed architecture which provides scalability, performance and availability.