使用星火包RStudio

使用星火包RStudio

问题描述:

我想使用火花CSV 包使用RStudio SparkR 。它可以完美地与SparkR外壳,但我没有发现任何方式将其包含在RStudio会话。

I would like to use the spark-csv package with SparkR using RStudio. It works perfectly with the SparkR shell but I didn't find any way to include it in a RStudio session.

任何想法,该怎么办呢?

Any idea how to do it ?

感谢您的帮助。

我也有同样的问题,期待this问题

I have had the same problem, look to this question

由Pragith给出的解决方案,可以完美运行,而不建立组装罐子:运行

The solution given by Pragith works perfect without building the assembly jar: run

Sys.setenv('SPARKR_SUBMIT_ARGS'='"--packages" "com.databricks:spark-csv_2.10:1.0.3" "sparkr-shell"')

library(SparkR)

你还可以从内部RStudio读取.csv文件。以同样的方式,你应该能够包括你想要的所有其他的包。

And you can read the .csv file from within RStudio. In the same way, you should be able to include all other packages you want.