Data Platform > CDC – Bigdata / Hadoop
Bigdata / Hadoop
Overview
The Hadoop is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures.
Objective
- Distributed processing to process structured and unstructured data, as data mining/machine learning engine
- As Data Lake where various of data consolidated
Objective
- Distributed processing to process structured and unstructured data, as data mining/machine learning engine
- As Data Lake where various of data consolidated
Benefits
- Advanced data analysis can be done in-house
- Organizations can fully leverage their data
- Run a commodity vs. custom architecture