Compute Engine

C++ part of the Deep Lake codebase optimized for faster data fetching and computations

Overview of Deep Lake's Optimized Compute Engine built in C++

Compute Engine maximize performance of compute-heavy Deep Lake's features, such as distributed dataloading or large queries, by running certain operations in C++.

The interface for the Compute Engine is still in Python, and it is installed using pip install "deeplake[enterprise]", which delivers the compiled C++ code from binaries.

Features in the Optimized Compute Engine:

Tensor Query Language (TQL)Performant Dataloader

Last updated

Was this helpful?