Dremio Accelerates Data Transfer
New open source data connectivity interface co-developed by Dremio engineers enables significantly faster data transfer.
Note: TDWI’s editors carefully choose vendor-issued press releases about new or upgraded products and services. We have edited and/or condensed this release to highlight key features but make no claims as to the accuracy of the vendor's statements.
Dremio, a data lake transformation vendor, announced support for Apache Arrow Flight, an open source data connectivity technology co-developed by Dremio to improve data transfer rates. Client applications can now communicate with Dremio’s data lake service more than 10 times faster than using older technologies, such as Open Database Connectivity (ODBC) and Java Database Connectivity (JDBC).
Arrow Flight is cross-platform and supports multiple languages, including Python, Java and C++. As an example, data scientists can retrieve data directly from a Flight-enabled database such as Dremio into a Python dataframe without having to extract the data into local files on the client.
The ability to avoid data extracts, combined with Arrow Flight’s wire-level encryption and authentication capabilities, enables companies to overcome data governance and security challenges. Because data is being consumed directly from the centralized IT-controlled database or data lake service, data teams can control and monitor access to the data, and delete records when necessary to comply with GDPR and CCPA requirements, such as “the right to be forgotten.”
For details, visit www.dremio.com.