Datahub installation and deployment guide
System requirements:windowsServer 2008 and above, 64-bit operating system, installation target disk space is at least 20G (required for log files).
Network requirements: a port that can be accessed by a dmp platform.
Installation file download address:
Deployment process
1. Download the Datahub installation file (windows64-bit)
Unzip the Datahub compressed file, including 3 files:
1) dmp-datahub-1.0. (Datahub program file, 1.0.0 is the version number, you can also view the version number and compilation time through the command line)
2) (Windows service installation tool)
3) wmi_exporter.exe (monitoring program)
2. Install Datahub
1. Create the installation directory (the following d:\ is the sample disk)
1) Create directories on the target disk (non-OS disk recommended), d:\datahub\logs and d:\datahub\old
2) Copy the extracted file to the directory d:\datahub\, and copy the dmp-datahub-1.0 file with a new file name.
3) Add to Anti-VirussoftwareWhitelist/trusted list (avoiding man-killing).
2. Set configuration file
1) Open, cd to d:\datahub, run the command line init, and generate a template configuration file. Reference screenshot:
2) Copy as, open and edit the file.
Configuration item description
Project name
Description value
Example
api_key
Dmp flow communicates with datahub, fill in the key when dmp adds the data source. It is recommended to use the configuration item value generated when initializing the configuration template file.
wVPWsxCgSpDYWPqk
env_code
Customer environment name (fill in the tenant code directly)
vanke
The number of connections to the database connection pool depends on SQL executionconcurrentHow many to count. It is recommended to use the default value
10
SQL execution timeout (seconds), 120 seconds is recommended
120
Database connection string (note sqlserverPort open)
Reference template file value
Log output level, suggestion: warn
warn
Log file output method (separated by commas in many ways), suggestion: file, aliyun.
File,aliyun
performanceMonitor the proxy address. If not enabled, just fill in the empty string. It is recommended to use the default value to enable it.
127.0.0.1:9182
Whether to enable opentrace performance tracking. 0 is not enabled. It is recommended to set to 0, and fill in 1 unless additional debugging is required.
0
Upload.zip_record
How many records are compressed into a zip file during asynchronous mode synchronization depends on the server's memory, CPU and table data size. It is recommended to use default values
100000
Note: env_code,,,,,, these configuration items need to be filled in. There are no special instructions for other configurations. Please use the default values.
3. Installation service
1) Run the command install in cmd, and the service installation configuration interface pops up, and configure the contents of the Application and I/O tabs according to the value in the figure below.
Service name: datahub
Application section:
Path: d:\datahub\
setup directory: d:\datahub
Arguments: serve -p 19988 (19988 means the external port of datahub)
I/O part:
Output (stdout): d:\datahub\logs\
Error (stderr): d:\datahub\logs\
After clicking the Install service button, a prompt pop-up will be successful.
If you want to edit the service after installation, you can use the command:
edit datahub
2) Automatic restart if the service fails
Enter the command interface of Windows run or open the service management tool through the control panel, then select the datahub service, double-click to pop up the property configuration window, click the [Recover] option page, change the first failure, the second failure, and the subsequent failure to [Restart the service], and click App to save.
4. Confirm the installation is successful
Enter in the browser
3. Install server performance monitoring (optional)
1. Install the monitoring program wmi_exporter.exe;
2. Use the instead command to install the wmi_exporter service (see datahub above);
Service name: vmi_exporter
Application section:
Path: d:\vmi_exporter\wmi_exporter.exe
setup directory: d:\vmi_exporter
Arguments: -- "cpu,process,net,mssql,tcp,os,system,service,logical_disk" ---enabled="accessmethods,bufman,databases,genstats,locks,memmgr,sqlstats" ---where "Name='dmpdatahub'" -- logger:eventlog?name=wmi_exporter -- :9182
I/O part:
Output (stdout): d:\vmi_exporter\logs\
Error (stderr): d:\vmi_exporter\logs\
3. Restart after the setting service fails (see the above installation of the datahub service);
4. Confirm the installation is complete and enter it in the browser.
appendix
Datahub command line instructions
init Create configuration file template
secret generates api_key
–help View instruction description