Understanding Unstructured Data

Traditional databases (SQL) are designed for Structured Data—data that fits neatly into rows and columns (like an Excel sheet). However, the vast majority of Big Data is Unstructured.

Definition of Unstructured Data

Unstructured data is information that either does not have a predefined data model or is not organized in a predefined manner. It is typically heavy on text but may contain data such as dates, numbers, and facts as well.

Examples of Unstructured Data:

• Text Files: Word documents, PDFs, Emails, Spreadsheets.
• Social Media: Posts, comments, hashtags, and user "likes."
• Media: Digital photos, audio files, and video recordings.
• Mobile Data: Text messages, location pings, and app usage logs.

Comparing Data Structures

Real-World Examples of Big Data in Action

1. Google Search: Google processes over 3.5 billion searches per day. Each search involves analyzing trillions of web pages in milliseconds to provide the most relevant result.
2. Netflix Recommendation Engine: Netflix analyzes the viewing habits of over 200 million subscribers. It tracks when you pause, rewind, or fast-forward, using this "Big Data" to recommend your next favorite show.
3. Boeing Jet Engines: A single Boeing 787 engine generates 500 gigabytes of data per flight. This data is analyzed to predict maintenance needs before a part actually fails, ensuring passenger safety.
4. NASA Climate Modeling: NASA uses supercomputers to process satellite data, creating complex climate models that involve petabytes of oceanic and atmospheric readings.