tag:blogger.com,1999:blog-6104363047659965830.post5890775132233167054..comments2024-01-04T03:35:33.398-07:00Comments on Technical Tidbit of the Day: Query Hive from iPython NotebookMichael Malakhttp://www.blogger.com/profile/10007582156392845677noreply@blogger.comBlogger7125tag:blogger.com,1999:blog-6104363047659965830.post-19894332419763484832014-11-09T21:37:17.263-07:002014-11-09T21:37:17.263-07:00It's to parse the stdout from running the hive...It's to parse the stdout from running the hive command.<br /><br />You have to understand: this is merely a trick to get Hive data into iPython Notebook. It's not what I would call a first-class mechanism.Michael Malakhttps://www.blogger.com/profile/10007582156392845677noreply@blogger.comtag:blogger.com,1999:blog-6104363047659965830.post-66731570510157041242014-11-09T21:33:54.458-07:002014-11-09T21:33:54.458-07:00thank you!
last question:-
why does the last li...thank you! <br /><br />last question:-<br /><br />why does the last line have df = read_csv?<br /><br />why read_csv? the data in hive will be in native sql database correct? <br /><br />am i missing something? <br /><br />thank you very much! :)vjparikhhttps://www.blogger.com/profile/11007233215386448312noreply@blogger.comtag:blogger.com,1999:blog-6104363047659965830.post-36223247848712763472014-11-09T21:29:23.394-07:002014-11-09T21:29:23.394-07:00Correct -- nothing to install on the server sideCorrect -- nothing to install on the server sideMichael Malakhttps://www.blogger.com/profile/10007582156392845677noreply@blogger.comtag:blogger.com,1999:blog-6104363047659965830.post-35931572038801632472014-11-09T21:23:53.419-07:002014-11-09T21:23:53.419-07:00thank you michael for your prompt response!
so t...thank you michael for your prompt response! <br /><br />so that means i need to install sshpass on my local machine. is that right? no installation is required on the hadoop / hive side, correct?<br />vjparikhhttps://www.blogger.com/profile/11007233215386448312noreply@blogger.comtag:blogger.com,1999:blog-6104363047659965830.post-32889441280554964632014-11-09T20:54:17.733-07:002014-11-09T20:54:17.733-07:00vjparikh:
I don't know of an sshpass for Wind...vjparikh:<br /><br />I don't know of an sshpass for Windows. I did this on a MacBook, and presumably of course it also works on Linux.<br /><br />You could create a Linux VM (e.g. using VirtualBox) and do all your work from within the VM.<br /><br />Jeffrey:<br /><br />Sorry I didn't notice your post earlier. Although not official documentation, this page describes using bang (exclamation mark) to execute system shell commands:<br /><br />http://www.math.uiuc.edu/~gfrancis/illimath/windows/aszgard_mini/doc/IPython81Manual/node6.html#SECTION00067000000000000000Michael Malakhttps://www.blogger.com/profile/10007582156392845677noreply@blogger.comtag:blogger.com,1999:blog-6104363047659965830.post-1570929189688828642014-11-09T20:42:50.722-07:002014-11-09T20:42:50.722-07:00this thing doesnt work for me?
when i enter df to...this thing doesnt work for me?<br /><br />when i enter df to see the output - i get an error saying:- <br /><br />The system cannot find the path specified<br /><br />Does the sshpass need to be installed on client side or on the server side. If server side does it need to be installed where Hive is located? On client side how do i install sshpass if I am using windows 7vjparikhhttps://www.blogger.com/profile/11007233215386448312noreply@blogger.comtag:blogger.com,1999:blog-6104363047659965830.post-32181433708658046952014-08-22T11:51:30.481-06:002014-08-22T11:51:30.481-06:00This is definitely a useful post, I'm trying t...This is definitely a useful post, I'm trying to understand how "!$s" works both directly at the ipython prompt and in a scripting environment, but can't find any documentation on it.<br /><br />Any ideas where to look?Hihttps://www.blogger.com/profile/04019261271249764652noreply@blogger.com