HPE Machine Learning Data Management Software is designed to help data engineering teams automate complex data pipelines. It features a cost-effective architecture that supports sophisticated data transformations across various data types. Key functionalities include auto-scaling, parallel processing, data versioning, and lineage tracking, enabling teams to handle new data incrementally without unnecessary reprocessing.

The software includes several important features such as data-driven pipelines that trigger automatically upon detecting changes, immutable data lineage, data version control, and deduplication. It also supports parallel processing through Kubernetes, allowing for efficient resource utilization and scalability. Additionally, it provides a web-based console for visualizing pipelines and managing data.

There are two main editions available: the Pachyderm Community Edition, which is open source and suitable for small teams, and the HPE Machine Learning Data Management Software, which is available under a commercial license. The commercial edition offers advanced features such as unlimited pipelines, role-based access controls, and enterprise support, making it suitable for larger organizations.