A Pipeline is the collection of technical and functional transformations that are applied to data processed by OneCloud Data Prep.

Pipelines process a data payload and produce the transformed result. Pipelines provide a graphical representation of transformations that are defined. They allow the impact of an individual transformation to be previewed while defining a transformation.

Preview the impact of a Pipeline transformation

The technical transformations defined in a Pipeline are used to modify the data layout. Activities such as adding or removing columns, reordering columns, or inserting new columns are all examples of technical transformations.

Functional transformation is the process of building a relationship between the data models of the systems being integrated. Functional transformation is often referred to as mapping and is managed by OneCloud Data Prep Mapping Groups. Mapping Groups are applied within a Pipeline as a transformation step.


Did this answer your question?