InstallationBusiness AnalyticsCToolsData CatalogData QualityLLMs

Hitachi Content Platform

Object Storage ..

This workshop refers to the PDI/PBA + PDO/PDC + HCP Skytap environment.

Hitachi Content Platform (HCP) is an object-storage solution designed for efficient and secure data management. It allows organizations to store, protect, and retrieve vast amounts of unstructured data with ease.

HCP integrates seamlessly with various applications and provides advanced features such as data deduplication, compression, and encryption. Its scalable architecture and robust governance capabilities make it suitable for both on-premises and cloud environments, ensuring data integrity and accessibility.

HCP Solution

HCP stores objects in a repository. Each object permanently associates data HCP receives (for example, a document, an image, or a movie) with information about that data called metadata.

Metadata

In PDI, you can query the metadata to locate and access HCP objects. The HCP object consists of a read-only file, a unique URL, system metadata properties, and custom metadata annotations.

A VFS (Virtual File System) connection allows you to integrate and manage different storage systems within PDI, abstracting the complexities of underlying protocols. It provides a unified interface to access a variety of storage backends like Amazon S3, Azure Data Lake, Google Cloud Storage, and more.

Create a VFS connection

Perform the following steps to create a VFS connection in PDI:

  1. Start the PDI client (Spoon) and create a new transformation or job.

  2. In the View tab of the Explorer pane, right-click on the VFS Connections folder, and then click New. The New VFS connection dialog box opens.

  3. In the Connection name field, enter a name that uniquely describes this connection. The name can contain spaces, but it cannot include special characters, such as #, $, and %.

  4. In the Connection type field, select from one of the following types:Amazon S3 / MinIO:/HCP (Default):

    • Simple Storage Service (S3) accesses the resources on Amazon Web Services.

    • MinIO accesses data objects on an Amazon compatible storage server.

    • HCP uses the S3 protocol to access HCP. See Access to HCP REST for more information.

x

x

x

Last updated