Category Archives: Uncategorized

Google Analytics integration in pandas

We just released 0.10.0 of pandas. One of the new features in this release is integration with Google Analytics (GA). For those of you who need to download GA data and do custom analysis in pandas, this should make your … Continue reading

Posted in Uncategorized | Tagged , , , | 27 Comments

Special characters as variable names

Don’t use them. If you name a variable “s” or “n” or “c” in your nosetest test suite, and jump into the frame in PDB to debug, any expression starting with your variables will issue those commands to the debugger … Continue reading

Posted in Uncategorized | Leave a comment

Initial Experiments with OpenMP

tl;dr  – (note shorter bar is better) So I started looking at potential to use OpenMP to speed up various Cythonized operations in pandas. I picked the easiest starting point which was using cython.parallel.prange. The test case I used was a … Continue reading

Posted in Uncategorized | Leave a comment

Write the test first

It amazes me how a small change in order affects things. When I’m working on pandas, a lot of the work is fixing a bug that is reported on github or stackoverflow. For a while I was just jumping right … Continue reading

Posted in Uncategorized | Tagged , , , | Leave a comment

The Right Tools

I had the pleasure of assembling a new bed frame yesterday using a wrench plus a phillips drill bit instead of a screwdriver. As you can probably imagine, it was loads of fun.         +      !=   … Continue reading

Posted in Uncategorized | Tagged , , , , | Leave a comment

Fast Replace with Bottleneck

Looking at the Bottleneck library for ideas to speed up pandas Series/DataFrame.replace, I see a set of posted benchmarks with bottleneck’s replace at roughly 4 times as fast as the implementation using numpy.putmask (and numpy.isnan to create an intermediate masking array). … Continue reading

Posted in Uncategorized | Leave a comment

Better Visualizations

     I ran across an interesting article on the Freakonomics blog about the life of a quantitative analyst. A lot of them are very amusing, but the meta-chart above caught my eye in particular. My personal experience meshes well … Continue reading

Posted in Data Visualization, Uncategorized | Tagged , , , , , | Leave a comment