Skip to content Skip to sidebar Skip to footer
Showing posts with the label Hadoop

Why "importerror: No Module Named Builtins" Appears After Importing Hive From Pyhive Package?

I have a simple question to ask. I have been trying to execute HIVE queries from Python using impyl… Read more Why "importerror: No Module Named Builtins" Appears After Importing Hive From Pyhive Package?

Spark 2.2 Thrift Server Error On Dataframe Numberformatexception When Query Hive Table

I have Hortonworks HDP 2.6.3 running Spark2 (v2.2). My test case is very simple: Create a Hive tab… Read more Spark 2.2 Thrift Server Error On Dataframe Numberformatexception When Query Hive Table

Unpickle File From Hdfs

I'm currently using Python 3 and would like to load a pickle file out of HDFS. from pywebhdfs.… Read more Unpickle File From Hdfs

Python Udfs In Pig

I've seen the documentatio here, but I confess that I feel it rather lacking. I was wondering … Read more Python Udfs In Pig

Spark Java.lang.verifyerror

I get the following error when I try to call I use python client for the spark. lines = sc.textFil… Read more Spark Java.lang.verifyerror

Get A List Of Subdirectories

I know I can do this: data = sc.textFile('/hadoop_foo/a') data.count() 240 data = sc.textFi… Read more Get A List Of Subdirectories