The primary components of OneCloud Data Prep are:
Each Data Prep component utilizes a specification of the columns (fields) with which the application will interact. This specification is referred to as the Columns Definition. The columns definition specifies not only the name of the field but also the data type and its related detailed settings. For example, if a field is defined as a NUMBER data type, then the number of decimals, as well as the thousands and decimal separators, are specified in the columns definition.
The columns definition can be modified at any time to specify or update the data type for each of the Data Prep components. A field name can be updated in a Pipeline or Mapping Group columns definition but not in a sample file.
The columns definition allows fields to be related to one another across the various Data Prep components. This provides additional flexibility and reusability since field names do not need to align across data payloads, sample files, Pipelines, and Mapping Groups.
The following data types can be applied to a field:
Alphanumeric sequence of characters
Whole number, with or without a thousands separator
Number that includes decimals; can include/exclude a thousands separator
Time of day
Date and time
📓 Date, Time, DateTime Data Types supported formats can be derived from this guide.