使用星火包RStudio
问题描述:
我想使用火花CSV 包使用RStudio SparkR 。它可以完美地与SparkR外壳,但我没有发现任何方式将其包含在RStudio会话。
I would like to use the spark-csv package with SparkR using RStudio. It works perfectly with the SparkR shell but I didn't find any way to include it in a RStudio session.
任何想法,该怎么办呢?
Any idea how to do it ?
感谢您的帮助。
答
我也有同样的问题,期待this问题
I have had the same problem, look to this question
由Pragith给出的解决方案,可以完美运行,而不建立组装罐子:运行
The solution given by Pragith works perfect without building the assembly jar: run
Sys.setenv('SPARKR_SUBMIT_ARGS'='"--packages" "com.databricks:spark-csv_2.10:1.0.3" "sparkr-shell"')
在
library(SparkR)
你还可以从内部RStudio读取.csv文件。以同样的方式,你应该能够包括你想要的所有其他的包。
And you can read the .csv file from within RStudio. In the same way, you should be able to include all other packages you want.