Skip to content

Latest commit

 

History

History
30 lines (20 loc) · 753 Bytes

File metadata and controls

30 lines (20 loc) · 753 Bytes

阿里云 OSS

在线安装驱动:

!plugin app add - "byzer-objectstore-oss-3.3";

离线安装驱动:

请到 Byzer 下载站 https://download.byzer.org/byzer/misc/cloud/ 下载对应的驱动,然后将其置于 ${SPARK_HOME}/jars 或者 ${Byzer_HOME}/libs 目录中。然后常规哦暖气。

你可以使用如下方式注册对象存储文件系统:

load FS.``
Where `fs.oss.endpoint`="oss-cn-hangzhou.aliyuncs.com"
and `fs.oss.impl`="org.apache.hadoop.fs.aliyun.oss.AliyunOSSFileSystem"
and `fs.oss.accessKeyId`="xxxx"
and `fs.oss.accessKeySecret`="xxxx"
as output;

然后你就可以使用如下语句访问该对象存储了:

load parquet.`oss://xxxxx/poc/city_temperatures`  as city_temperatures;