Skip to content Skip to sidebar Skip to footer
Showing posts with the label Hadoop

Why "importerror: No Module Named Builtins" Appears After Importing Hive From Pyhive Package?

I have a simple question to ask. I have been trying to execute HIVE queries from Python using impyl… Read more Why "importerror: No Module Named Builtins" Appears After Importing Hive From Pyhive Package?

Spark 2.2 Thrift Server Error On Dataframe Numberformatexception When Query Hive Table

I have Hortonworks HDP 2.6.3 running Spark2 (v2.2). My test case is very simple: Create a Hive tab… Read more Spark 2.2 Thrift Server Error On Dataframe Numberformatexception When Query Hive Table

Unpickle File From Hdfs

I'm currently using Python 3 and would like to load a pickle file out of HDFS. from pywebhdfs.… Read more Unpickle File From Hdfs

Python Udfs In Pig

I've seen the documentatio here, but I confess that I feel it rather lacking. I was wondering … Read more Python Udfs In Pig

Spark Java.lang.verifyerror

I get the following error when I try to call I use python client for the spark. lines = sc.textFil… Read more Spark Java.lang.verifyerror

Get A List Of Subdirectories

I know I can do this: data = sc.textFile('/hadoop_foo/a') data.count() 240 data = sc.textFi… Read more Get A List Of Subdirectories

Pyspark --py-files Doesn't Work

I use this as document suggests http://spark.apache.org/docs/1.1.1/submitting-applications.html sp… Read more Pyspark --py-files Doesn't Work

Hive Parseexception In Drop Table Statement

I'm using python and pyodbc module in particular to execute Hive queries on Hadoop. The portion… Read more Hive Parseexception In Drop Table Statement