-
Notifications
You must be signed in to change notification settings - Fork 1.2k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
tiem: add all tiem v1.0.2 docs to master (#9304)
* Expose dt_storage_pool_log_gc_force_hardlink_rate to users. * Update tiflash/tiflash-configuration.md Co-authored-by: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> * Update tiflash/tiflash-configuration.md Co-authored-by: Grace Cai <qqzczy@126.com> * Update tiflash/tiflash-configuration.md * TiEM: add blank files and TOC (#9088) * TiEM: add blank files and TOC * fix ci * tiem: add deploy doc and 1.0.0 release notes (#9161) * tiem: add deploy doc and 1.0.0 release notes * add third party library * Update TOC.md * Apply suggestions from code review * tiem: add faq and quick start (#9200) * tiem: add faq and quick start * Update tiem/tiem-faq.md * tiem: rename files and add a few user guides (#9215) * tiem: rename files and add a few user guides * fix broken links * tiem: add tiem cluster management (#9250) * tiem: add tiem cluster management * Update tiem-manage-clusters.md * Update tiem-manage-clusters.md * Update tiem-manage-clusters.md * Update tiem-manage-clusters.md * Docs tiem overview (#9276) * tiem: add tiem manage tasks, manage system, import ... (#9302) * Docs tiem review (#9536) * Docs tiem: add upgrade doc and release notes for 1.0.1 and 1.0.2 (#9542) * tiem: update tiem docs for v1.0.2 open source (#9667) * tiem: update tiem docs for v1.0.2 open source * Update download-ecosystem-tools.md * Update download-ecosystem-tools.md * Update download-ecosystem-tools.md * address comment * Update tiem/tiem-overview.md Co-authored-by: Lilian Lee <lilin@pingcap.com> * delete 在线部署 Co-authored-by: Lilian Lee <lilin@pingcap.com> * Update tiflash/tiflash-configuration.md * Update TOC.md * Update tiem/tiem-release-1.0.2.md * Apply suggestions from code review * Apply suggestions from code review Co-authored-by: Aolin <aolin.zhang@pingcap.com> * Apply suggestions from code review Co-authored-by: Aolin <aolin.zhang@pingcap.com> Co-authored-by: jiaqizho <zhoujiaqi@pingcap.com> Co-authored-by: jiaqizho <smalinuxer@gmail.com> Co-authored-by: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Co-authored-by: Grace Cai <qqzczy@126.com> Co-authored-by: Roger Zhou <peng.zhounix@qq.com> Co-authored-by: shenhiboy <haibo@umich.edu> Co-authored-by: Lilian Lee <lilin@pingcap.com> Co-authored-by: Aolin <aolin.zhang@pingcap.com>
- Loading branch information
9 people
authored
Jun 6, 2022
1 parent
68abda2
commit 5d78273
Showing
28 changed files
with
2,389 additions
and
7 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,100 @@ | ||
| global: | ||
| user: "tiem" | ||
| group: "tiem" | ||
| ssh_port: 22 | ||
| deploy_dir: "/em-deploy" | ||
| data_dir: "/em-data" | ||
| arch: "amd64" | ||
| log_level: "info" | ||
| # specify the external elasticsearch address. default is empty | ||
| # and elasticsearch_servers can only have one value | ||
| external_elasticsearch_url: "" | ||
| login_host_user: "" | ||
| login_private_key_path: "" | ||
| login_public_key_path: "" | ||
|
|
||
| # filebeat deploy by monitored | ||
| monitored: | ||
| node_exporter_port: 4124 | ||
|
|
||
| tiem_cluster_servers: | ||
| - host: 172.16.5.148 | ||
| port: 4101 | ||
| metrics_port: 4104 | ||
| registry_client_port: 4106 | ||
| registry_peer_port: 4107 | ||
| # specify the recovery DB path for the central control unit | ||
| db_path: "" | ||
| deploy_dir: "/tiem-deploy/tiem-cluster-4101" | ||
| data_dir: "/tiem-data/tiem-cluster-41101" | ||
| tiem_api_servers: | ||
| - host: 172.16.5.148 | ||
| port: 4100 | ||
| metrics_port: 4103 | ||
| deploy_dir: "/tiem-deploy/tiem-api-4100" | ||
| data_dir: "/tiem-data/tiem-api-4100" | ||
|
|
||
| tiem_file_servers: | ||
| - host: 172.16.5.148 | ||
| port: 4102 | ||
| metrics_port: 4105 | ||
| deploy_dir: "/tiem-deploy/tiem-file-4102" | ||
| data_dir: "/tiem-data/tiem-file-4102" | ||
|
|
||
| tiem_web_servers: | ||
| - host: 172.16.5.148 | ||
| port: 4180 | ||
| deploy_dir: "/tiem-deploy/tiem-web-4180" | ||
| data_dir: "/tiem-data/tiem-web-4180" | ||
|
|
||
| elasticsearch_servers: | ||
| - host: 172.16.5.148 | ||
| port: 4108 | ||
| # Specify heap memory size, default by 4g | ||
| heap_size: "4g" | ||
| deploy_dir: "/tiem-deploy/elasticsearch-4108" | ||
| data_dir: "/tiem-data/elasticsearch-4108" | ||
|
|
||
| kibana_servers: | ||
| - host: 172.16.5.148 | ||
| port: 4109 | ||
| deploy_dir: "/tiem-deploy/kibana-4109" | ||
| data_dir: "/tiem-data/kibana-4109" | ||
| monitoring_servers: | ||
| - host: 172.16.5.148 | ||
| port: 4110 | ||
| deploy_dir: "/tiem-deploy/prometheus-4110" | ||
| data_dir: "/tiem-data/prometheus-4110" | ||
|
|
||
| grafana_servers: | ||
| - host: 172.16.5.148 | ||
| port: 4111 | ||
| deploy_dir: "/tiem-deploy/grafana-4111" | ||
| data_dir: "/tiem-data/grafana-4111" | ||
|
|
||
| alertmanager_servers: | ||
| - host: 172.16.5.148 | ||
| web_port: 4112 | ||
| cluster_port: 4113 | ||
| deploy_dir: "/tiem-deploy/alertmanager-4112" | ||
| data_dir: "/tiem-data/alertmanager-4112" | ||
|
|
||
| tracer_servers: | ||
| - host: 172.16.5.148 | ||
| port: 4114 | ||
| web_port: 4115 | ||
| zipkin_thrift_port: 4116 | ||
| compact_thrift_port: 4117 | ||
| binary_thrift_port: 4118 | ||
| agent_serve_port: 4119 | ||
| jaeger_thrift_port: 4120 | ||
| jaeger_host_port: 4121 | ||
| collector_port: 4122 | ||
| grpc_serve_port: 4123 | ||
| deploy_dir: "/tiem-deploy/tracer-4114" | ||
| data_dir: "/tiem-data/tracer-4114" | ||
|
|
||
| filebeat_servers: | ||
| - host: 172.16.5.148 | ||
| deploy_dir: "/tiem-deploy/filebeat-0" | ||
| data_dir: "/tiem-data/filebeat-0" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,98 @@ | ||
| global: | ||
| user: "tidb" | ||
| group: "tidb" | ||
| ssh_port: 22 | ||
| deploy_dir: "/em-deploy" | ||
| data_dir: "/em-data" | ||
| arch: "amd64" | ||
| log_level: "info" | ||
| # specify the external elasticsearch address. default is empty | ||
| # and elasticsearch_servers can only have one value | ||
| external_elasticsearch_url: "" | ||
| login_host_user: "" | ||
| login_private_key_path: "" | ||
| login_public_key_path: "" | ||
|
|
||
| monitored: | ||
| node_exporter_port: 4124 | ||
|
|
||
| em_cluster_servers: | ||
| - host: {ip} | ||
| # port: 4101 | ||
| # metrics_port: 4104 | ||
| # registry_client_port: 4106 | ||
| # registry_peer_port: 4107 | ||
| # deploy_dir: "/em-deploy/cluster-server-4101" | ||
| # data_dir: "/em-data/cluster-server-41101" | ||
|
|
||
| em_api_servers: | ||
| - host: {ip} | ||
| # port: 4100 | ||
| # metrics_port: 4103 | ||
| # deploy_dir: "/em-deploy/openapi-server-4100" | ||
| # data_dir: "/em-data/openapi-server-4100" | ||
|
|
||
| em_web_servers: | ||
| - host: {ip} | ||
| # port: 4180 | ||
| # deploy_dir: "/em-deploy/em-web-4180" | ||
| # data_dir: "/em-data/em-web-4180" | ||
|
|
||
| em_file_servers: | ||
| - host: {ip} | ||
| # port: 4102 | ||
| # metrics_port: 4105 | ||
| # deploy_dir: "/em-deploy/file-server-4102" | ||
| # data_dir: "/em-data/file-server-4102" | ||
|
|
||
| elasticsearch_servers: | ||
| - host: {ip} | ||
| # port: 4108 | ||
| # heap_size: "4g" | ||
| # deploy_dir: "/em-deploy/elasticsearch-4108" | ||
| # data_dir: "/em-data/elasticsearch-4108" | ||
|
|
||
| tracer_servers: | ||
| - host: {ip} | ||
| # port: 4114 | ||
| # web_port: 4115 | ||
| # zipkin_thrift_port: 4116 | ||
| # compact_thrift_port: 4117 | ||
| # binary_thrift_port: 4118 | ||
| # agent_serve_port: 4119 | ||
| # jaeger_thrift_port: 4120 | ||
| # jaeger_host_port: 4121 | ||
| # collector_port: 4122 | ||
| # grpc_serve_port: 4123 | ||
| # deploy_dir: "/em-deploy/tracer-4114" | ||
| # data_dir: "/em-data/tracer-4114" | ||
|
|
||
| kibana_servers: | ||
| - host: {ip} | ||
| # port: 4109 | ||
| # deploy_dir: "/em-deploy/kibana-4109" | ||
| # data_dir: "/em-data/kibana-4109" | ||
|
|
||
| monitoring_servers: | ||
| - host: {ip} | ||
| # port: 4110 | ||
| # deploy_dir: "/em-deploy/prometheus-4110" | ||
| # data_dir: "/em-data/prometheus-4110" | ||
|
|
||
| alertmanager_servers: | ||
| - host: {ip} | ||
| # web_port: 4112 | ||
| # cluster_port: 4113 | ||
| # deploy_dir: "/em-deploy/alertmanager-4112" | ||
| # data_dir: "/em-data/alertmanager-4112" | ||
|
|
||
| grafana_servers: | ||
| - host: {ip} | ||
| # port: 4111 | ||
| # deploy_dir: "/em-deploy/grafana-4111" | ||
| # data_dir: "/em-data/grafana-4111" | ||
|
|
||
| filebeat_servers: | ||
| - host: {ip} | ||
| # deploy_dir: "/em-deploy/filebeat-0" | ||
| # data_dir: "/em-data/filebeat-0" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,62 @@ | ||
| #!/bin/bash | ||
|
|
||
| # Prerequisite: | ||
| # 1. Install TiUP as root | ||
| # Example command: | ||
| # curl --proto '=https' --tlsv1.2 -sSf https://tiup-mirrors.pingcap.com/install.sh | sh | ||
| # 2. Prepare an EM deployment topology yaml to /opt/config.yaml | ||
| # 3. Put current script in /root/ path of EM machine and run it as root privilege, and leave the rest to the script. | ||
| # Example command: | ||
| # sh tiem_online_install.sh http://172.16.5.148:8080/tiup-repo/ /opt/config.yaml | ||
|
|
||
| if [ $# -ne 2 ] | ||
| then | ||
| echo "usage: $0 <online-repo-path> <em-deployment-topology-path>" | ||
| exit | ||
| fi | ||
|
|
||
| EM_REPO_MIRROR_PATH=$1 | ||
| EM_DEPLOYMENT_TOPO=$2 | ||
|
|
||
| echo "##### assign privileges for deployment topology file to all users started #####" | ||
| chmod 777 $EM_DEPLOYMENT_TOPO | ||
| echo "##### assign privileges for deployment topology file to all users finished #####" | ||
|
|
||
| echo "##### add user tidb started #####" | ||
| useradd tidb | ||
| echo "##### add user tidb finished #####" | ||
|
|
||
| echo "##### install TiUP to /usr/local/bin/ started #####" | ||
| install -Dm755 ~/.tiup/bin/tiup /usr/local/bin/ | ||
| echo "##### install TiUP to /usr/local/bin/ finished #####" | ||
|
|
||
| su - tidb << EOF | ||
| echo "##### mkdir & set mirror for EM installer started #####" | ||
| mkdir -p /home/tidb/.em/bin | ||
| TIUP_HOME=/home/tidb/.em tiup mirror set $EM_REPO_MIRROR_PATH | ||
| echo "##### mkdir & set mirror for EM installer finished #####" | ||
| echo "##### mkdir & set mirror for TiDB installer started #####" | ||
| mkdir -p /home/tidb/.tiup/bin | ||
| TIUP_HOME=/home/tidb/.tiup tiup mirror set https://tiup-mirrors.pingcap.com | ||
| echo "##### mkdir & set mirror for TiDB installer finished #####" | ||
| EOF | ||
|
|
||
| echo "##### mkdir & set mirror for TiDB installer finished #####" | ||
|
|
||
|
|
||
| EOF | ||
|
|
||
| echo "##### generate identity key started, simply press enter or respond yes if needed #####" | ||
| su - tidb -c "ssh-keygen -t rsa" | ||
| su - tidb -c "cp /home/tidb/.ssh/id_rsa /home/tidb/.ssh/tiup_rsa" | ||
|
|
||
| echo "##### generate identity key finished #####" | ||
|
|
||
| echo "##### deploy EM started, you may need to provide password for central machine and respond yes if needed #####" | ||
| su - tidb -c "TIUP_HOME=/home/tidb/.em tiup em deploy em-test $VERSION $EM_DEPLOYMENT_TOPO -u root -p" | ||
| su - tidb -c "TIUP_HOME=/home/tidb/.em tiup em start em-test" | ||
| echo "##### deploy EM finished #####" |
Oops, something went wrong.