Show HN: Pandashells – Bringing the Python data stack to the shell prompt(github.com)
github.com
Show HN: Pandashells – Bringing the Python data stack to the shell prompt
https://github.com/robdmc/pandashells
5 comments
Pandashells is a set of cli tools that opens up the power of the python data stack to the bash prompt. Brings dataframe manipulation, visualization and statistical modeling to the unix pipeline workflow.
Since you created this tool, you can put "Show HN:" at the beginning of your submission's title. That will make it show up on https://news.ycombinator.com/show
I'm a total HN noob. Don't see an option for editing the post. Am I just blind?
A lot of people will miss this since it's posted on a weekend. If this doesn't make the Monday morning HN front page, I recommend waiting a week or so and reposting as a Show HN some weekday morning.
No...after the first X minutes, the option to change the title is lost. Maybe a mod will change it though.
...and you can always send an email to the mods to ask them to do this - [email protected]
They tend to reply quickly and are very helpful, in my experience!
They tend to reply quickly and are very helpful, in my experience!
> There is no requirements file with pandashells because some of the tools only require the standard library, and there's no sense installing unnecessary packages if you only want to use that subset of tools.
This is a terrible idea. One of the main features of package managers is dependency management. If you want to be as minimalistic as possible, separate the tools into further packages (some of which have their requirements laid out properly, and some of which only require the standard library).
This is a terrible idea. One of the main features of package managers is dependency management. If you want to be as minimalistic as possible, separate the tools into further packages (some of which have their requirements laid out properly, and some of which only require the standard library).
Try the extra capabilities parameters in setup.py, so the user can selectively install what they'd like:
extras_require = {
'param_name': ['pkg1', 'pkg2'],
},
pip install package[param_name]thanks mixmastamyk. That's a good suggestion.
Thanks for the feedback. As you may know, getting matplotlib to work properly with backends like TkAgg can be quite a chore when installing using pip (non-python libraries are needed). The Pandashells install process could be improved. I intend on creating a conda package for Pandashells that should handle the dependency issue you raise, but I just haven't had time to do so yet. I am hoping the detailed examples in the docs will suffice until I do.
Why focus on TkAgg support? Just write graphics to a user-specified file.
A native-ish backend like TkAgg is valuable because it instantly pops up an interactive plot, which I find really useful for the quick-n-dirty data exploration tasks I usually use Pandashells for. You don't need the interactive backend and can use the --savefig option on plots to save images or html, but that takes time -- and I usually want my results now!! :)
It should be possible to pipe to file and then fire off a subprocess to open the resulting png.
In Windows, you can do:
Similarly, you can use `open` in OS X and `gnome-open` in at least some flavors of Linux (including Ubuntu).
Of course, you could always allow this command to be user configurable, with the defaults above depending on the OS in which the code is running.
In Windows, you can do:
os.system("start {}".format(output_file_name))
Similarly, you can use `open` in OS X and `gnome-open` in at least some flavors of Linux (including Ubuntu).
Of course, you could always allow this command to be user configurable, with the defaults above depending on the OS in which the code is running.
This looks amazing! The amount of time I spend writing short python scripts to manipulate data in simple ways is way too big, and this looks like it might fit my needs precisely. Thank you for creating this.
This is great! Do you want to make a Conda package for this or shall I?
I would love help making a conda package. I've never done that before. I didn't spend a lot of time looking, but I didn't find conda packages for some of the dependencies (e.g. gatspy). If you now how to work around that, I'd welcome the help.