Presto+yanagishima部署

Presto下载页面
https://prestodb.io/docs/current/installation/deployment.html

下载 presto-server-0.273.3.tar.gz后上传到服务器并解压

tar -zxvf presto-server-0.273.3.tar.gz -C /opt
mv /opt/presto-server-0.273.3 /opt/presto

创建目录

cd /opt/presto
mkdir  etc/

创建配置文件

vi etc/node.properties

    node.environment=production
    node.id=ffffffff-ffff-ffff-ffff-ffffffffffff
    node.data-dir=/opt/presto/data

vi etc/jvm.config

-Xmx16G
-XX:+UseG1GC
-XX:G1HeapRegionSize=32M
-XX:+UseGCOverheadLimit
-XX:+ExplicitGCInvokesConcurrent
-XX:+HeapDumpOnOutOfMemoryError
-XX:+ExitOnOutOfMemoryError
-XX:+CMSClassUnloadingEnabled
-XX:+AggressiveOpts
-XX:OnOutOfMemoryError=kill -9 %p
-XX:ReservedCodeCacheSize=150M

vi etc/config.properties

    coordinator=true
    node-scheduler.include-coordinator=true
    http-server.http.port=8080
    query.max-memory=5GB
    query.max-memory-per-node=1GB
    query.max-total-memory-per-node=2GB
    discovery-server.enabled=true
    discovery.uri=http://10.1.13.193:8080

vi etc/log.properties

    com.facebook.presto=INFO

mkdir etc/catalog
vi etc/catalog/jmx.properties

    connector.name=jmx

vi mysql.properties

connector.name=mysql
connection-url=jdbc:mysql://10.1.13.199:3306?useSSL=false
connection-user=root
connection-password=paaaswd

vi oracle.properties

connector.name=oracle
connection-url=jdbc:oracle:thin:test1/pass$123@//10.1.13.223:1521/orcl

vi mongodb.properties

connector.name=mongodb
mongodb.seeds=10.1.13.12:27017
mongodb.schema-collection=admin

vi sqlserver.properties

connector.name=sqlserver
connection-url=jdbc:sqlserver://10.1.13.13:1433
connection-user=sa
connection-password=passwd

vi redis.properties

connector.name=redis
redis.table-names=schema1.table1,schema1.table2
redis.nodes=10.1.13.14:6379

cd /opt/presto/bin
./launcher start

浏览器访问 http://PrestoIP:8080

下载yanagishima20.zip
上传服务器并解压

mkdir /opt/yanagishima
cd /opt/yanagishima
unzip yanagishima-20.zip

cd /opt/yanagishima/conf

vi yanagishima.properties

# yanagishima web port.
jetty.port=7080
# 30 minutes. If presto query exceeds this time, yanagishima cancel the query.
presto.query.max-run-time-seconds=1800
# 1GB. If presto query result file size exceeds this value, yanagishima cancel the query.
presto.max-result-file-byte-size=1073741824
# you can specify freely. But you need to specify same name to presto.coordinator.server.[...] and presto.redirect.server.[...] and catalog.[...] and schema.[...]
presto.datasources=your-presto
auth.your-presto=false
# presto coordinator url
presto.coordinator.server.your-presto=http://10.1.13.193:8080
# almost same as presto coordinator url. If you use reverse proxy, specify it
presto.redirect.server.your-presto=http://10.1.13.193:8080
# presto catalog name
catalog.your-presto=hive
# presto schema name
schema.your-presto=default
# if query result exceeds this limit, to show rest of result is skipped
select.limit=500
# http header name for audit log
audit.http.header.name=some.auth.header
use.audit.http.header.name=false
# limit to convert from tsv to values query
to.values.query.limit=500
# authorization feature
check.datasource=false
sql.query.engines=presto
# 1GB. If hive query result file size exceeds this value, yanagishima cancel the query.
hive.setup.query.path.your-hive=/opt/yanagishima/conf/hive_setup_query_your-hive

创建hive_setup_query_your-hive

touch /opt/yanagishima/conf/hive_setup_query_your-hive

cd /opt/yanagishima
nohup ./yanagishima-start.sh >y.log 2>&1 &

浏览器访问http://yanagishimaIP:7080
在此界面可以进行多表查询