Bluemetrix Data Manager (BDM) is a suite of data automation products and services, which simplify and expedite the data processing operations on a Spark platform. BDM utilizes Apache Spark as its core processing engine. On top of this engine, BDM has developed data automation tools that allow the following functionality to be carried out without writing any code (and using a GUI), and thus allows data pipelines to be created in minutes and hours rather than days and weeks: •Ingestion and normalization of data from any source •Validation and quality control of all data ingested •Transformation of the data •Tokenization of the data •Automatic generation and recording of Governance lineage data