2021 State of the Tools
It has been a couple of years, hasn’t it? I thought I would do another state of the tools. Last year I had other things on my mind and didn’t get to this kind of thing, but let’s give it a whirl.
It has been a couple of years, hasn’t it? I thought I would do another state of the tools. Last year I had other things on my mind and didn’t get to this kind of thing, but let’s give it a whirl.
One of my projects this year has been to refactor and upgrade our Book Data Tools to be easier to work with. Along the way I found some bugs in the original data integration, and the process of finding these bugs and assessing their impact forms a useful case study for some of the principles I teach in my data science class.
Ritual is a powerful tool for navigating life. David Allen, in Getting Things Done, promotes a weekly review to take stock of your current Next Action lists, identify projects that need to be moved up (or down) the stack, and plan what’s next.
Regular rituals are an important part of my work management, linking together my notebook, runway, and self-care. My particular practices are modeled most closely after the tactical practices of implementing Michael Linenberger’s One Minute To-Do List on paper.
I use Jupyter notebooks extensively for data analysis and exploration. It’s fantastic to be able to quickly see output, including plots, and have it all saved and persisted and viewable on GitHub.
However, when it comes time to prepare for publication, I need to save high-resolution and/or vector versions of the plots for use in LaTeX or Word. The display in Jupyter does not have nearly high enough resolution to copy and paste into a document and have it look acceptably good.
Most of my projects, therefore, have a convenience function for plots that are going into the paper. This function saves the plot to disk (in both PDF and 600dpi PNG formats) and returns it so it can also be displayed in Jupyter. That way I don’t have two copies of the plot code — one for saving and one for interactive exploration — that can get out of sync.