1、Window开发环境搭建 1.1、Elasticsearch这段时间本人想学习Mall商城这个开源项目,我认为作者真的很强,我本人很喜欢他的代码,很优雅!笔记很明白!为了加深印象,提高自己技术,所以便有了这部署他的项目的笔记。附上他的GitHub地址:https://github.com/macrozheng/mall
用来进行搜索的,安装解压,然后安装ES的中文分词的插件,运行。下载ES的图形化界面,运行访问。
-
在https://www.elastic.co/cn/downloads/past-releases/elasticsearch-7-6-2 下载ES.
-
安装中文分词插件,在elasticsearch-7.6.2bin目录下执行以下命令:
$ elasticsearch-plugin install https://github.com/medcl/elasticsearch-analysis-ik/releases/download/v7.6.2/elasticsearch-analysis-ik-7.6.2.zip
-
运行bin目录下的elasticsearch.bat启动Elasticsearch服务
-
下载Kibana,作为访问Elasticsearch的客户端,请下载7.6.2版本的zip包,并解压到指定目录,下载地址:https://www.elastic.co/cn/downloads/past-releases/kibana-7-6-2
-
运行bin目录下的kibana.bat,启动Kibana服务;
-
打开Kibana的用户界面,访问地址:http://localhost:5601
用来日志处理的!
-
下载7.6.2版本的zip包,并解压到指定目录,下载地址:https://www.elastic.co/cn/downloads/past-releases/logstash-7-6-2
-
将Logstash的配置文件logstash.conf拷贝到安装目录的bin目录下,配置文件如下:
input {
tcp {
mode => "server"
host => "0.0.0.0"
port => 4560
codec => json_lines
type => "debug"
}
tcp {
mode => "server"
host => "0.0.0.0"
port => 4561
codec => json_lines
type => "error"
}
tcp {
mode => "server"
host => "0.0.0.0"
port => 4562
codec => json_lines
type => "business"
}
tcp {
mode => "server"
host => "0.0.0.0"
port => 4563
codec => json_lines
type => "record"
}
}
filter{
if [type] == "record" {
mutate {
remove_field => "port"
remove_field => "host"
remove_field => "@version"
}
json {
source => "message"
remove_field => ["message"]
}
}
}
output {
elasticsearch {
hosts => "localhost:9200"
index => "mall-%{type}-%{+YYYY.MM.dd}"
}
}
- Logstash需要安装json_lines插件。
$ logstash-plugin install logstash-codec-json_lines
- bin目录下,命令行启动
logstash -f logstash.conf1.3、MongoDB
- 下载MongoDB安装包,选择Windows x64版本安装,下载地址:https://www.mongodb.com/download-center/community
- 运行MongoDB安装包并选择自定义安装,设置好安装路径;
- 取消MongoDB Compass的安装选项(不取消安装极慢),需要可自行安装;
- 双击mongo.exe可以运行MongoDB自带客户端,操作MongoDB;
-
下载客户端工具Robo 3T,下载地址:https://robomongo.org/download
-
下载完成后解压,双击robo3t.exe即可使用;
-
之后创建一个到MongoDB的连接
-
安装Erlang,下载地址:http://erlang.org/download/otp_win64_21.3.exe
-
安装RabbitMQ,下载地址:https://dl.bintray.com/rabbitmq/all/rabbitmq-server/3.7.14/rabbitmq-server-3.7.14.exe
-
安装完成后,进入RabbitMQ安装目录下的sbin目录
-
在地址栏输入cmd并回车启动命令行,然后输入以下命令启动管理功能:
$ rabbitmq-plugins enable rabbitmq_management
- 访问地址查看是否安装成功:http://localhost:15672/
访问之后:增加一个user,增加一个/mall虚拟主机,给user赋予/mall虚拟主机1.5、阿里OSS
- 构建一个存储空间Bucket,读写权限设置为公共读,设置跨域资源共享。规则设置为任意主机*
接口文档地址: http://localhost:8080/swagger-ui.html mall-admin http://localhost:8081/swagger-ui.html mall-search http://localhost:8085/swagger-ui.html mall-portal2、Linux部署环境搭建
2.1、端口放行我们知道,一个项目肯定是要在Linux系统上跑的,Docker以其优秀的虚拟性,隔离化的机制,集装箱似的脱离宿主机的优点在项目部署中脱颖而出!所以我们采用 Docker 部署!
为了一次性到位!我先把需要的防火墙一次性打开!
在XShell中根据如下两个命令也放行端口。
firewall-cmd --zone=public --add-port=3346/tcp --permanent systemctl restart firewalld.service2.2、MySql
docker pull mysql:5.7
docker run -p 3306:3306 --name mysql -v /mydata/mysql/log:/var/log/mysql -v /mydata/mysql/data:/var/lib/mysql -v /mydata/mysql/conf:/etc/mysql -e MYSQL_ROOT_PASSWORD=root -d mysql:5.7
docker exec -it mysql /bin/bash
mysql -uroot -proot --default-character-set=utf8
create database mall character set utf8
这个使用通过xftp文件传输,把mall.sql 放到/mydata目录下面
docker cp /mydata/mall.sql mysql:/ #将mall.sql文件拷贝到mysql容器的/目录下:
use mall; source /mall.sql; #将sql文件导入到数据库:
grant all privileges on *.* to 'reader' @'%' identified by '123456'; #创建一个reader:123456帐号并修改权限,使得任何ip都能访问2.3、Redis
docker pull redis:5
docker run -p 6379:6379 --name redis -v /mydata/redis/data:/data -d redis:5 redis-server --appendonly yes2.4、Nginx
docker pull nginx:1.10
先运行一次容器(为了拷贝配置文件)
docker run -p 80:80 --name nginx -v /mydata/nginx/html:/usr/share/nginx/html -v /mydata/nginx/logs:/var/log/nginx -d nginx:1.10
docker container cp nginx:/etc/nginx /mydata/nginx/
mv nginx conf #修改文件名称
docker stop nginx docker rm nginx #终止并删除容器
再次启动,这样配置文件是宿主机就是/mydata/nginx/conf
docker run -p 80:80 --name nginx -v /mydata/nginx/html:/usr/share/nginx/html -v /mydata/nginx/logs:/var/log/nginx -v /mydata/nginx/conf:/etc/nginx -d nginx:1.102.5、RabbitMQ
docker pull rabbitmq:3.7.15
docker run -p 5672:5672 -p 15672:15672 --name rabbitmq -d rabbitmq:3.7.15
docker exec -it rabbitmq /bin/bash rabbitmq-plugins enable rabbitmq_management #开启管理功能
访问:http://主机:15672 也是一样创建mall用户,账号密码都是mall,设置/mall虚拟机,给mall用户分配/mall的虚拟机····2.6、Elasticsearch
docker pull elasticsearch:7.6.2
sysctl -w vm.max_map_count=262144 #sysctl -w vm.max_map_count=262144
默认是1G,我的服务器扛不住了,我就改为512M了。
docker run -p 9200:9200 -p 9300:9300 --name elasticsearch -e "discovery.type=single-node" -e "cluster.name=elasticsearch" -e ES_JAVA_OPTS="-Xms64m -Xmx512m" -v /mydata/elasticsearch/plugins:/usr/share/elasticsearch/plugins -v /mydata/elasticsearch/data:/usr/share/elasticsearch/data -d elasticsearch:7.6.2
chmod 777 /mydata/elasticsearch/data/ #给data目录权限
docker exec -it elasticsearch /bin/bash #此命令需要在容器中运行 elasticsearch-plugin install https://github.com/medcl/elasticsearch-analysis-ik/releases/download/v7.6.2/elasticsearch-analysis-ik-7.6.2.zip #安装中文分词器 docker restart elasticsearch
测试:http://主机:92002.7、LogStash
docker pull logstash:7.6.2
在window准备一个logstash.conf,logstash.conf的内容设置如下,然linux构建一个/mydata/logstash 把这个文件放到该文件夹下面。
input {
tcp {
mode => "server"
host => "0.0.0.0"
port => 4560
codec => json_lines
type => "debug"
}
tcp {
mode => "server"
host => "0.0.0.0"
port => 4561
codec => json_lines
type => "error"
}
tcp {
mode => "server"
host => "0.0.0.0"
port => 4562
codec => json_lines
type => "business"
}
tcp {
mode => "server"
host => "0.0.0.0"
port => 4563
codec => json_lines
type => "record"
}
}
filter{
if [type] == "record" {
mutate {
remove_field => "port"
remove_field => "host"
remove_field => "@version"
}
json {
source => "message"
remove_field => ["message"]
}
}
}
output {
elasticsearch {
hosts => "es:9200"
index => "mall-%{type}-%{+YYYY.MM.dd}"
}
}
mkdir /mydata/logstash
docker run --name logstash -p 4560:4560 -p 4561:4561 -p 4562:4562 -p 4563:4563 --link elasticsearch:es -v /mydata/logstash/logstash.conf:/usr/share/logstash/pipeline/logstash.conf -d logstash:7.6.2
docker exec -it logstash /bin/bash logstash-plugin install logstash-codec-json_lines #安装json_lines插件2.8、Kibana
docker pull kibana:7.6.2
docker run --name kibana -p 5601:5601 --link elasticsearch:es -e "elasticsearch.hosts=http://es:9200" -d kibana:7.6.2
访问地址进行测试:http://主机:56012.9、MongoDB
docker pull mongo:4.2.5
docker run -p 27017:27017 --name mongo -v /mydata/mongo/db:/data/db -d mongo:4.2.52.10、Docker Registry
构建一个私有的镜像仓库,配合后端用Maven打包SpringBoot项目使用。
docker run -d -p 5000:5000 --restart=always --name registry2 registry:2
让Docker 支持远程API调用。
vi /usr/lib/systemd/system/docker.service #用vim编辑器修改docker.service文件
需要修改的部分:
ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
修改后的部分:
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2375 -H unix://var/run/docker.sock
让Docker支持HTTP上传镜像
echo '{ "insecure-registries":["主机:5000"] }' > /etc/docker/daemon.json
systemctl daemon-reload
systemctl stop docker systemctl start docker2.11、MAVEN插件实现后端自动发布为镜像
- 修改项目根目录下的pom.xml中的docker.host属性:
http://106.55.226.70:2375
org.springframework.boot spring-boot-maven-plugin com.spotify docker-maven-plugin ${docker.maven.plugin.version} build-image package build mall/${project.artifactId}:${project.version} ${docker.host} java:8 ["java", "-jar", "-Dspring.profiles.active=prod","/${project.build.finalName}.jar"] / ${project.build.directory} ${project.build.finalName}.jar
- 双击根项目mall的package命令可以一次性打包所有应用的Docker镜像;
REPOSITORY TAG IMAGE ID CREATED SIZE mall/mall-portal 1.0-SNAPSHOT 70e0f76416a0 21 seconds ago 705MB mall/mall-search 1.0-SNAPSHOT f3290bd1d0c7 41 seconds ago 725MB mall/mall-admin 1.0-SNAPSHOT 26557b93a106 about a minute ago 705MB3、部署后端 3.1、部署mall-admin
docker run -p 8080:8080 --name mall-admin --link mysql:db --link redis:redis -v /etc/localtime:/etc/localtime -v /mydata/app/admin/logs:/var/logs -d mall/mall-admin:1.0-SNAPSHOT3.2、部署mall-port
docker run -p 8085:8085 --name mall-portal --link mysql:db --link redis:redis --link mongo:mongo --link rabbitmq:rabbit -v /etc/localtime:/etc/localtime -v /mydata/app/portal/logs:/var/logs -d mall/mall-portal:1.0-SNAPSHOT3.3、部署mall-search
docker run -p 8081:8081 --name mall-search --link elasticsearch:es --link mysql:db -v /etc/localtime:/etc/localtime -v /mydata/app/search/logs:/var/logs -d mall/mall-search:1.0-SNAPSHOT4、测试
接口测试可见1.6集成了Swagger-ui.修改dev.env.js,base_API 设置为你的虚拟机的主机!Window还是比较舒服的,解压就是黑屏启动完事了。Linux命令比较多!



