Other Projects

Here are some other things (apart from h5py and physics) that I’ve been working on:

You’re the Boss!

You’re the Boss: Management Basics for the New Supervisor is a book on management theory written by my father, intended as a guide and “life preserver” for newly promoted employees.  After he passed away, we published the entire book online in his memory.  There’s also a print version available from Amazon.com.

AnFFT

The anfft package (stands for “An FFT”, originally “Andrew’s FFT”) is a Python package for performing fast, multithreaded ffts using the FFTW library.  Currently it only runs on Linux, although I hope to get a 1.0 version tested on Mac and Windows.  Performance improvements over the stock NumPy and SciPy FFTs depends on your problem size, shape and number of cores, but I saw a 4x improvement in speed using it for my analysis.

Email me (andrew dot collette at gmail dot com) if you have a Mac and a few free hours to help with porting!

LZF Compression Filter for HDF5

This standalone filter brings fast compression to HDF5.  It’s written in C and completely self contained, using an embedded version of the liblzf library.  HDF5 projects using C, C++ or Python (via cython) can register the filter with HDF5 and compress/decompress datasets using the lzf codec.

The main advantage of lzf (over the built-in DEFLATE compression included with HDF5) is speed; lzf compresses roughly 2-3 times faster, while retaining a decent compression ratio.

There’s a benchmarking page here with more information.  The filter is included with the standard h5py distribution tarball available from Google Code.