1

I have a Django application running against MySQL database. I want to introduce Big Data analytics in the application by connecting the same application to Spark which has data stored as hive tables. I can run queries and access the data through beeline. I want to run similar queries from Django app and show the result set in the app.

My environment is :

Spark 1.5.2
Thriftserver 2
Hive metastore on MySQL

Any help will be appreciated.

Thanks

Improve this question
2
  • It's not really clear what exeactly your question is. To use the pyspark API you'd have to put pyspark and py4j on your PYTHONPATH and then read this. See also here Commented Jan 18, 2016 at 16:22
  • Thanks for your help. Commented Mar 22, 2016 at 11:06
Related questions
0
How to connect pyspark to HiveThriftServer2?
2
Spark Thriftserver not connecting to correct Hive database
0
Spark Managed and Unmanaged Tables
Load 4 more related questions Show fewer related questions

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.