Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Wednesday, June 21 • 11:28am - 11:40am
JLD2: High-performance Serialization of Julia Data Structures in an HDF5-compatible Format

Sign up or log in to save this to your schedule and see who's attending!

Feedback form is now closed.
At present, two options exist for saving Julia data structures to disk: Julia's built-in serializer and the JLD (Julia data) package. The built-in serializer achieves reasonable performance, but uses a non-standardized format that differs by Julia version and processor architecture. JLD saves data structures in a standardized format (HDF5), but has substantial overhead when saving large numbers of mutable objects. In this talk, I describe the design of JLD2, a re-implementation of JLD. By replacing JLD's dependency on the HDF5 library with a pure Julia implementation of a subset of HDF5, JLD2 achieves performance comparable to Julia's built-in serializer, while writing files readable by standard HDF5 implementations. Additionally, JLD2 resolves numerous issues with the previous JLD format and implementation.


Speakers
SK

Simon Kornblith

Google
I am currently a Ph.D. student in neuroscience at MIT, but my affiliation will probably change before JuliaCon.


Wednesday June 21, 2017 11:28am - 11:40am
East Pauley Pauley Ballroom, Berkeley, CA