Skip to content

InfinStor Transforms

Transforms are small pieces of python code (usually from a single cell in your jupyter notebook) which process data - perhaps transforming from raw data to a pandas data frame, or raw data to tf.data.Dataset. There are also transforms that process data on a file by file basis or directory by directory basis.

Developing Transforms

InfinStor includes support for developing transforms from provided templates or by modifying existing Transforms

Running Transforms

Transforms can be executed in the following locations:

  • Inline in the jupyterlab environment
  • In a Single VM in the cloud
  • In an Elastic Map Reduce cluster in the cloud

Transforms Supported

  • infin_transform_one_object
  • infin_transform_dir_by_dir

User Interface

The primary Graphical User Interface to the transforms functionality is through the InfinStor Jupyterlab Sidebar

See the InfinStor Jupyterlab Sidebar Transforms documentation for more details