Skip to content

U
ubains-module-test
提交 82e213b2 authored 作者: 陈泽健's avatar 陈泽健
浏览文件
操作

fix(scripts): 修复服务器健康检测脚本中的数值比较和空消息问题 

- 修复Get-StatusByThreshold函数中的数值转换逻辑，使用double.Parse替代正则提取
- 添加对接近零数值的特殊处理，避免时钟偏差等小数值导致误报严重状态
- 在Add-Issue函数中添加对空消息和过短消息的过滤机制
- 修复磁盘和Inode使用率检测中的字符串格式化问题
- 添加磁盘IO状态检测功能，监控设备利用率和等待时间
- 增加安全合规检测项，包括认证失败历史、异常账户、可疑SUID文件等
- 添加SSL证书有效期检测，支持HTTPS和EMQX SSL证书检查
- 实现时钟偏差小于0.001秒时直接标记为正常的特殊处理
- 新增定时任务检测功能，检查Crontab和Systemd定时器
- 移除不再使用的Java-Login和Java-Backend端口检测
- 添加容器日志文件大小检测，防止日志文件过大占用磁盘空间
- 增加FastDFS文件存储检测功能，监控Tracker和Storage服务状态
- 添加Java应用JVM检测，检查Java版本和运行状态
- 创建新的问题处理文档，记录脚本运行失败项的解决方案
- 删除过时的数据库备份脚本文件
上级 541ae91e
显示空白字符变更
内嵌 并排
正在显示 包含 1143 行增加 和 97 行删除
.claude/settings.local.json
浏览文件 @ 82e213b2
...@@ -151,7 +151,9 @@ ...@@ -151,7 +151,9 @@
"Bash(powershell.exe -NoProfile -ExecutionPolicy Bypass -Command '& { $content = Get-Content '\\\\''check_server_health.ps1'\\\\'' -Raw -Encoding UTF8; $content[0..100] -join '\\\\'''\\\\'' }')", "Bash(powershell.exe -NoProfile -ExecutionPolicy Bypass -Command '& { $content = Get-Content '\\\\''check_server_health.ps1'\\\\'' -Raw -Encoding UTF8; $content[0..100] -join '\\\\'''\\\\'' }')",
"Bash(powershell.exe -NoProfile -ExecutionPolicy Bypass -Command \"try { . .\\\\check_server_health.ps1 -ErrorAction Stop 2>&1 | Select-Object -First 10 } catch { Write-Host '语法错误' }\")", "Bash(powershell.exe -NoProfile -ExecutionPolicy Bypass -Command \"try { . .\\\\check_server_health.ps1 -ErrorAction Stop 2>&1 | Select-Object -First 10 } catch { Write-Host '语法错误' }\")",
"Bash(python3)", "Bash(python3)",
"Bash(powershell.exe -NoProfile -ExecutionPolicy Bypass -Command ' *)" "Bash(powershell.exe -NoProfile -ExecutionPolicy Bypass -Command ' *)",
"Bash(awk '/Add-Issue.*检测到/ && !/OOM/ && !/只读/ && !/zombieCount/ && !/coreCount/ && !/磁盘错误/ && !/失败服务/' \"C:\\\\Users\\\\UBAINS\\\\Desktop\\\\Test\\\\check_server_health.ps1\")",
"Bash(powershell.exe *)"
] ]
} }
} }
AuxiliaryTool/ScriptTool/backup_db.sh deleted 100644 → 0
浏览文件 @ 541ae91e
#!/bin/bash
#####################################
#用于数据库备份 23-01-13
#####################################
#预定数据库备份
function ubainsbak()
{
echo -e "\033[33m 检查mysql...... \033[0m"
sudo docker images |grep mysql
sudo docker ps |grep umysql
if [ $? -eq 0 ]; then
sudo docker exec -i umysql bash <<'EOF'
find /home/mysql/ubains/* -mtime +30 -exec rm -rf {} \;
mkdir -p /home/mysql/ubains/$(date +%Y%m%d)
# 备份指定数据库
mysqldump -uroot -p"dNrprU&2S" ubains > /home/mysql/ubains/$(date +%Y%m%d)/ubains_$(date +%Y%m%d_%H%M%S).sql
#删除30天之前的备份
log3=$(date -d "30 day ago" +%Y%m%d)
rm /home/mysql/ubains/$log3* -rf
exit
EOF
sudo mkdir -p /data/bakup/mysql/ubains/$(date +%Y%m%d)
sudo docker cp umysql:/home/mysql/ubains/$(date +%Y%m%d) /data/bakup/mysql/ubains
#删除30天之前的备份
log3=$(date -d "30 day ago" +%Y%m%d)
sudo rm /data/bakup/mysql/ubains/$log3* -rf
else
echo -e "\033[33m 请正确安装数据库...... \033[0m"
fi
}
#运维数据库备份
function devopsbak()
{
echo -e "\033[33m 检查mysql...... \033[0m"
sudo docker images |grep mysql
sudo docker ps |grep umysql
if [ $? -eq 0 ]; then
sudo docker exec -i umysql bash <<'EOF'
find /home/mysql/devops/* -mtime +30 -exec rm -rf {} \;
mkdir -p /home/mysql/devops/$(date +%Y%m%d)
# 备份指定数据库
mysqldump -uroot -p"dNrprU&2S" devops > /home/mysql/devops/$(date +%Y%m%d)/devops_$(date +%Y%m%d_%H%M%S).sql
#删除30天之前的备份
log3=$(date -d "30 day ago" +%Y%m%d)
rm /home/mysql/devops/$log3* -rf
exit
EOF
sudo mkdir -p /data/bakup/mysql/devops/$(date +%Y%m%d)
sudo docker cp umysql:/home/mysql/devops/$(date +%Y%m%d) /data/bakup/mysql/devops
#删除30天之前的备份
log3=$(date -d "30 day ago" +%Y%m%d)
sudo rm /data/bakup/mysql/devops/$log3* -rf
else
echo -e "\033[33m 请正确安装数据库...... \033[0m"
fi
}
#############################################################脚本配置项##################################################################################################
#################预定系统 数据库本地备份###############################
ubainsbak
#################运维系统 数据库本地备份###############################
devopsbak
AuxiliaryTool/ScriptTool/新服务自检/check_server_health.ps1
浏览文件 @ 82e213b2
...@@ -217,29 +217,44 @@ function Get-StatusByThreshold { ...@@ -217,29 +217,44 @@ function Get-StatusByThreshold {
[bool]$HigherIsWorse = $true [bool]$HigherIsWorse = $true
) )
# 提取数值 # 提取数值 - 使用double转换而不是正则，以正确处理科学计数法
$numericValue = 0
try {
[double]$numericValue = [double]::Parse($Value, [Globalization.NumberStyles]::Float, [Globalization.CultureInfo]::InvariantCulture)
} catch {
$numericValue = 0 $numericValue = 0
if ($Value -match "(\d+\.?\d*)") {
[double]$numericValue = $Matches[1]
} }
$warnValue = 0 $warnValue = 0
if ($WarningThreshold -match "(\d+\.?\d*)") { try {
[double]$warnValue = $Matches[1] [double]$warnValue = [double]::Parse($WarningThreshold, [Globalization.NumberStyles]::Float, [Globalization.CultureInfo]::InvariantCulture)
} catch {
$warnValue = 0
} }
$critValue = 0 $critValue = 0
if ($CriticalThreshold -match "(\d+\.?\d*)") { try {
[double]$critValue = $Matches[1] [double]$critValue = [double]::Parse($CriticalThreshold, [Globalization.NumberStyles]::Float, [Globalization.CultureInfo]::InvariantCulture)
} catch {
$critValue = 0
}
# 调试日志
Write-Log "Get-StatusByThreshold: Value=$Value, numericValue=$numericValue, warnValue=$warnValue, critValue=$critValue, HigherIsWorse=$HigherIsWorse" "DEBUG"
# 特殊处理：当数值接近0时，直接返回正常
if ([Math]::Abs($numericValue) -lt 0.001) {
Write-Log "数值接近0，直接返回正常" "DEBUG"
return "正常"
} }
if ($HigherIsWorse) { if ($HigherIsWorse) {
if ($numericValue -ge $critValue) { return "严重" } if ($critValue -gt 0 -and $numericValue -ge $critValue) { return "严重" }
if ($numericValue -ge $warnValue) { return "警告" } if ($warnValue -gt 0 -and $numericValue -ge $warnValue) { return "警告" }
} }
else { else {
if ($numericValue -le $critValue) { return "严重" } if ($critValue -ge 0 -and $numericValue -le $critValue) { return "严重" }
if ($numericValue -le $warnValue) { return "警告" } if ($warnValue -ge 0 -and $numericValue -le $warnValue) { return "警告" }
} }
return "正常" return "正常"
...@@ -252,6 +267,42 @@ function Add-Issue { ...@@ -252,6 +267,42 @@ function Add-Issue {
) )
try { try {
# 获取完整的调用栈信息
$callStack = Get-PSCallStack | Where-Object { $_.CommandName -ne "Add-Issue" -and $_.CommandName -ne "Write-Log" }
$callerInfo = if ($callStack.Count -gt 0) {
"$($callStack[0].CommandName):$($callStack[0].ScriptLineNumber)"
} else {
"未知"
}
# 检查消息是否为空或仅包含空格
if ([string]::IsNullOrWhiteSpace($Message)) {
# 打印完整调用栈（兼容PowerShell 5.x）
$stackParts = @()
foreach ($frame in $callStack) {
$stackParts += "[$($frame.CommandName):$($frame.ScriptLineNumber)]"
}
$fullStack = $stackParts -join " -> "
Write-Log "忽略空消息: '$Message' | 完整调用栈: $fullStack" "WARN"
return
}
# 检查消息是否过短（小于5个字符可能是错误）
if ($Message.Length -lt 5) {
$stackParts = @()
foreach ($frame in $callStack) {
$stackParts += "[$($frame.CommandName):$($frame.ScriptLineNumber)]"
}
$fullStack = $stackParts -join " -> "
Write-Log "忽略过短消息: '$Message' (长度:$($Message.Length)) | 完整调用栈: $fullStack" "WARN"
return
}
# 记录所有Add-Issue调用（用于调试）
if ($Message.Length -lt 20) {
Write-Log "Add-Issue: 消息='$Message', 长度=$($Message.Length), 级别=$Level, 来源=$callerInfo" "DEBUG"
}
if ($Level -eq "严重") { if ($Level -eq "严重") {
$script:严重问题.Add($Message) $script:严重问题.Add($Message)
} }
...@@ -541,7 +592,7 @@ function Test-DiskResource { ...@@ -541,7 +592,7 @@ function Test-DiskResource {
$results += $result $results += $result
if ($status -ne "正常") { if ($status -ne "正常") {
Add-Issue -Message "磁盘使用率过高: {0} ({1}%)" -f $mountpoint, $usedPercent -Level $status Add-Issue -Message ("磁盘使用率过高: {0} ({1}%)" -f $mountpoint, $usedPercent) -Level $status
} }
} }
} }
...@@ -587,7 +638,7 @@ function Test-DiskResource { ...@@ -587,7 +638,7 @@ function Test-DiskResource {
$results += $result $results += $result
if ($status -ne "正常") { if ($status -ne "正常") {
Add-Issue -Message "Inode使用率过高: {0} ({1}%)" -f $mountpoint, $usedPercent -Level $status Add-Issue -Message ("Inode使用率过高: {0} ({1}%)" -f $mountpoint, $usedPercent) -Level $status
} }
} }
} }
...@@ -611,6 +662,94 @@ function Test-DiskResource { ...@@ -611,6 +662,94 @@ function Test-DiskResource {
Write-Log "smartctl未安装，跳过磁盘健康检测" "WARN" Write-Log "smartctl未安装，跳过磁盘健康检测" "WARN"
} }
# 磁盘IO状态检测（iostat）
Write-Log "检测磁盘IO状态..."
$iostatInstalled = Invoke-SSHCommand "command -v iostat 2>/dev/null" -Timeout 5
if ($iostatInstalled) {
$ioOutput = Invoke-SSHCommand "iostat -x -d 1 2 2>/dev/null | grep -v '^$' | tail -n +3" -Timeout 15
if ($ioOutput) {
if ($ioOutput -is [array]) { $ioOutput = $ioOutput -join "`n" }
$ioLines = $ioOutput -split "`n" | Where-Object { $_ -match "\S+" }
foreach ($ioLine in $ioLines) {
if ($ioLine -match "^\s*(sd[a-z]+|nvme\d+n\d+|vd[a-z]+)\s+([\d.]+)\s+[\d.]+\s+[\d.]+\s+([\d.]+)") {
$device = $Matches[1]
$utilPercent = [double]$Matches[2]
$await = [double]$Matches[3]
# IO使用率检测
if ($utilPercent -gt 90) {
$ioStatus = "严重"
$ioMessage = "磁盘IO过载: {0:N1}%util, 等待{1:N1}ms" -f $utilPercent, $await
}
elseif ($utilPercent -gt 80) {
$ioStatus = "警告"
$ioMessage = "磁盘IO较高: {0:N1}%util, 等待{1:N1}ms" -f $utilPercent, $await
}
else {
$ioStatus = "正常"
$ioMessage = "磁盘IO正常: {0:N1}%util, 等待{1:N1}ms" -f $utilPercent, $await
}
$results += [PSCustomObject]@{
Name = "磁盘IO($device)"
Value = "{0:N1}%util" -f $utilPercent
Threshold = ">80%警告"
Status = $ioStatus
Message = $ioMessage
}
if ($ioStatus -ne "正常") {
Add-Issue -Message "磁盘$($device)IO使用率过高: {0:N1}%" -f $utilPercent -Level $ioStatus
}
}
}
}
}
else {
Write-Log "iostat未安装，跳过磁盘IO检测" "WARN"
}
# Inode使用率检测
Write-Log "检测Inode使用率..."
$inodeOutput = Invoke-SSHCommand "df -i 2>/dev/null | tail -n +2" -Timeout 10
if ($inodeOutput) {
if ($inodeOutput -is [array]) { $inodeOutput = $inodeOutput -join "`n" }
$inodeLines = $inodeOutput -split "`n" | Where-Object { $_ -match "\S+" }
foreach ($inodeLine in $inodeLines) {
if ($inodeLine -match "^(/[\S]+)\s+([\d\s]+)\s+([\d]+)%") {
$mountpoint = $Matches[1]
$inodeUsedPercent = [int]$Matches[3]
if ($inodeUsedPercent -gt 90) {
$inodeStatus = "严重"
$inodeMessage = "Inode耗尽: $inodeUsedPercent%"
}
elseif ($inodeUsedPercent -gt 80) {
$inodeStatus = "警告"
$inodeMessage = "Inode紧张: $inodeUsedPercent%"
}
else {
$inodeStatus = "正常"
$inodeMessage = "Inode充足"
}
$results += [PSCustomObject]@{
Name = "Inode使用率($mountpoint)"
Value = "$inodeUsedPercent%"
Threshold = ">80%警告"
Status = $inodeStatus
Message = $inodeMessage
}
if ($inodeStatus -ne "正常") {
Add-Issue -Message "磁盘Inode不足: $mountpoint 使用率$inodeUsedPercent%" -Level $inodeStatus
}
}
}
}
# 保存结果 # 保存结果
foreach ($result in $results) { foreach ($result in $results) {
Save-TestResult "磁盘资源" $result Save-TestResult "磁盘资源" $result
...@@ -993,6 +1132,108 @@ function Test-SecurityStatus { ...@@ -993,6 +1132,108 @@ function Test-SecurityStatus {
} }
} }
# 认证失败历史（24小时内）
$authFailOutput = Invoke-SSHCommand "journalctl --since '24 hours ago' -t authpriv - grep 'Failed password' 2>/dev/null | wc -l" -Timeout 20
if ($authFailOutput -match "\d+") {
$failCount = [int]$Matches[0]
$status = Get-StatusByThreshold -Value "$failCount" -WarningThreshold "100" -CriticalThreshold "1000"
$results += [PSCustomObject]@{
Name = "认证失败"
Value = "$failCount 次"
Threshold = ">100警告"
Status = $status
Message = "24小时内认证失败次数"
}
if ($status -ne "正常") {
Add-Issue -Message "认证失败次数过多(24h): $failCount" -Level $status
}
}
# 最近登录记录（最近5次）
$lastLoginOutput = Invoke-SSHCommand "last -n 5 -nohostname 2>/dev/null" -Timeout 10
if ($lastLoginOutput) {
if ($lastLoginOutput -is [array]) { $lastLoginOutput = $lastLoginOutput -join "`n" }
$loginLines = ($lastLoginOutput -split "`n" | Where-Object { $_ -match "\S+" } | Select-Object -First 5) -join "; "
$results += [PSCustomObject]@{
Name = "最近登录"
Value = "已获取"
Threshold = "-"
Status = "正常"
Message = "最近5次登录: $loginLines"
}
}
# 异常账户检测（UID=0的非root账户）
$uidZeroOutput = Invoke-SSHCommand "awk -F: '$3==0 {print $1}' /etc/passwd 2>/dev/null" -Timeout 10
if ($uidZeroOutput) {
if ($uidZeroOutput -is [array]) { $uidZeroOutput = $uidZeroOutput -join "`n" }
$uidZeroAccounts = $uidZeroOutput -split "`n" | Where-Object { $_ -ne "root" -and $_ -match "\S+" }
if ($uidZeroAccounts.Count -gt 0) {
$results += [PSCustomObject]@{
Name = "异常账户"
Value = "$($uidZeroAccounts.Count) 个"
Threshold = ">0"
Status = "严重"
Message = "发现UID=0的非root账户: $($uidZeroAccounts -join ', ')"
}
Add-Issue -Message "发现异常UID=0账户: $($uidZeroAccounts -join ', ')" -Level "严重"
}
}
# 可疑SUID文件检测（排除已知安全路径）
$suidOutput = Invoke-SSHCommand "find / -perm -4000 -type f 2>/dev/null | grep -v -E '^/(usr|bin|sbin)/' | head -10" -Timeout 30
if ($suidOutput) {
if ($suidOutput -is [array]) { $suidOutput = $suidOutput -join "`n" }
$suidFiles = $suidOutput -split "`n" | Where-Object { $_ -match "\S+" }
if ($suidFiles.Count -gt 0) {
$results += [PSCustomObject]@{
Name = "可疑SUID文件"
Value = "$($suidFiles.Count) 个"
Threshold = ">0"
Status = "警告"
Message = "发现非常规路径的SUID文件: $($suidFiles -join ', ')"
}
Add-Issue -Message "发现可疑SUID文件: $($suidFiles.Count)个" -Level "警告"
}
}
# SSH配置安全检查
$sshConfigOutput = Invoke-SSHCommand "grep -E '^PermitRootLogin|^PasswordAuthentication|^MaxAuthTries' /etc/ssh/sshd_config 2>/dev/null" -Timeout 10
if ($sshConfigOutput) {
if ($sshConfigOutput -is [array]) { $sshConfigOutput = $sshConfigOutput -join "`n" }
$sshIssues = @()
if ($sshConfigOutput -match "PermitRootLogin yes") {
$sshIssues += "允许root登录"
}
if ($sshConfigOutput -match "PasswordAuthentication yes") {
$sshIssues += "允许密码认证"
}
if ($sshConfigOutput -match "MaxAuthTries (\d+)") {
$maxTries = [int]$Matches[1]
if ($maxTries -gt 3) {
$sshIssues += "最大认证次数过高($maxTries)"
}
}
if ($sshIssues.Count -gt 0) {
$results += [PSCustomObject]@{
Name = "SSH配置"
Value = "存在风险"
Threshold = "-"
Status = "警告"
Message = "SSH配置问题: $($sshIssues -join ', ')"
}
}
else {
$results += [PSCustomObject]@{
Name = "SSH配置"
Value = "安全"
Threshold = "-"
Status = "正常"
Message = "SSH配置安全"
}
}
}
# 保存结果 # 保存结果
foreach ($result in $results) { foreach ($result in $results) {
Save-TestResult "安全合规" $result Save-TestResult "安全合规" $result
...@@ -1146,7 +1387,13 @@ function Test-TimeSync { ...@@ -1146,7 +1387,13 @@ function Test-TimeSync {
if ($trackingOutput -match "Last offset.*?(-?\d+\.?\d*)") { if ($trackingOutput -match "Last offset.*?(-?\d+\.?\d*)") {
$offset = [Math]::Abs([double]$Matches[1]) $offset = [Math]::Abs([double]$Matches[1])
# 特殊处理：时钟偏差小于0.001秒时直接设为正常
if ($offset -lt 0.001) {
$status = "正常"
} else {
$status = Get-StatusByThreshold -Value "$offset" -WarningThreshold "1" -CriticalThreshold "5" $status = Get-StatusByThreshold -Value "$offset" -WarningThreshold "1" -CriticalThreshold "5"
}
$result = [PSCustomObject]@{ $result = [PSCustomObject]@{
Name = "时钟偏差" Name = "时钟偏差"
...@@ -1177,6 +1424,129 @@ function Test-TimeSync { ...@@ -1177,6 +1424,129 @@ function Test-TimeSync {
} }
} }
# SSL证书有效期检测（HTTPS证书）
Write-Log "检测SSL证书有效期..."
$certCheck = Invoke-SSHCommand "echo | openssl s_client -connect localhost:443 2>/dev/null | openssl x509 -noout -dates 2>/dev/null" -Timeout 15
if ($certCheck) {
if ($certCheck -is [array]) { $certCheck = $certCheck -join "" }
if ($certCheck -match "notAfter=(.+)") {
$expiryDateStr = $Matches[1].Trim()
try {
# 尝试多种日期格式解析（兼容PowerShell 5.x）
$expiryDate = $null
$formats = @(
"MMM dd HH:mm:ss yyyy GMT",
"MMM d HH:mm:ss yyyy GMT",
"yyyy-MM-dd HH:mm:ss",
"yyyy/MM/dd HH:mm:ss"
)
foreach ($fmt in $formats) {
$culture = [System.Globalization.CultureInfo]::InvariantCulture
$style = [System.Globalization.DateTimeStyles]::None
if ([DateTime]::TryParseExact($expiryDateStr, $fmt, $culture, $style, [ref]$expiryDate)) {
break
}
}
# 如果上述格式都失败，尝试通用解析
if (-not $expiryDate) {
$expiryDate = [DateTime]::Parse($expiryDateStr)
}
$daysLeft = ($expiryDate - [DateTime]::Now).Days
if ($daysLeft -lt 0) {
$status = "严重"
$message = "证书已过期 $(-$daysLeft) 天"
}
elseif ($daysLeft -lt 7) {
$status = "严重"
$message = "证书将在 $daysLeft 天后过期"
}
elseif ($daysLeft -lt 30) {
$status = "警告"
$message = "证书将在 $daysLeft 天后过期"
}
else {
$status = "正常"
$message = "证书有效期至 $expiryDateStr"
}
$results += [PSCustomObject]@{
Name = "SSL证书"
Value = "$daysLeft 天"
Threshold = "<30天警告,<7天严重"
Status = $status
Message = $message
}
if ($status -ne "正常") {
$certStatusText = if ($daysLeft -lt 0) { "已过期" } else { "即将过期" }
Add-Issue -Message "SSL证书${certStatusText}: $daysLeft 天" -Level $status
}
}
catch {
Write-Log "SSL证书日期解析失败: $expiryDateStr - $($_.Exception.Message)" "WARN"
}
}
}
# EMQX SSL证书检测
$emqxCertCheck = Invoke-SSHCommand "docker exec uemqx sh -c 'echo | openssl s_client -connect localhost:8883 2>/dev/null | openssl x509 -noout -dates 2>/dev/null' 2>/dev/null" -Timeout 15
if ($emqxCertCheck) {
if ($emqxCertCheck -is [array]) { $emqxCertCheck = $emqxCertCheck -join "" }
if ($emqxCertCheck -match "notAfter=(.+)") {
$expiryDateStr = $Matches[1].Trim()
try {
# 尝试多种日期格式解析（兼容PowerShell 5.x）
$expiryDate = $null
$formats = @(
"MMM dd HH:mm:ss yyyy GMT",
"MMM d HH:mm:ss yyyy GMT",
"yyyy-MM-dd HH:mm:ss",
"yyyy/MM/dd HH:mm:ss"
)
foreach ($fmt in $formats) {
$culture = [System.Globalization.CultureInfo]::InvariantCulture
$style = [System.Globalization.DateTimeStyles]::None
if ([DateTime]::TryParseExact($expiryDateStr, $fmt, $culture, $style, [ref]$expiryDate)) {
break
}
}
# 如果上述格式都失败，尝试通用解析
if (-not $expiryDate) {
$expiryDate = [DateTime]::Parse($expiryDateStr)
}
$daysLeft = ($expiryDate - [DateTime]::Now).Days
if ($daysLeft -lt 7) {
$status = "严重"
}
elseif ($daysLeft -lt 30) {
$status = "警告"
}
else {
$status = "正常"
}
$results += [PSCustomObject]@{
Name = "EMQX SSL证书"
Value = "$daysLeft 天"
Threshold = "<30天警告,<7天严重"
Status = $status
Message = "EMQX SSL证书有效期至 $expiryDateStr"
}
}
catch {
Write-Log "EMQX SSL证书日期解析失败: $expiryDateStr - $($_.Exception.Message)" "WARN"
}
}
}
# 保存结果 # 保存结果
foreach ($result in $results) { foreach ($result in $results) {
Save-TestResult "时间同步" $result Save-TestResult "时间同步" $result
...@@ -1190,6 +1560,72 @@ function Test-TimeSync { ...@@ -1190,6 +1560,72 @@ function Test-TimeSync {
} }
} }
function Test-ScheduledTasks {
Write-Log "开始定时任务检测..."
try {
$results = @()
# Crontab检测
$crontabOutput = Invoke-SSHCommand "crontab -l 2>/dev/null" -Timeout 10
if ($crontabOutput) {
$crontabCount = 0
if ($crontabOutput -is [array]) {
$crontabCount = ($crontabOutput | Where-Object { $_ -notmatch "^#" -and $_ -match "\S+" }).Count
} else {
$crontabCount = if ($crontabOutput -match "\S+") { 1 } else { 0 }
}
$results += [PSCustomObject]@{
Name = "Crontab任务"
Value = "$crontabCount 个"
Threshold = "-"
Status = "正常"
Message = "当前用户的定时任务数量"
}
} else {
$results += [PSCustomObject]@{
Name = "Crontab任务"
Value = "无"
Threshold = "-"
Status = "正常"
Message = "当前用户无定时任务"
}
}
# Systemd定时器检测
$systemdTimerOutput = Invoke-SSHCommand "systemctl list-timers --no-pager 2>/dev/null | tail -n +2 | head -10" -Timeout 15
if ($systemdTimerOutput) {
$timerCount = 0
if ($systemdTimerOutput -is [array]) {
$timerCount = ($systemdTimerOutput | Where-Object { $_ -match "\S+" }).Count
} elseif ($systemdTimerOutput -match "\S+") {
$lines = $systemdTimerOutput -split "`n"
$timerCount = ($lines | Where-Object { $_ -match "\S+" }).Count
}
$results += [PSCustomObject]@{
Name = "Systemd定时器"
Value = "$timerCount 个"
Threshold = "-"
Status = "正常"
Message = "系统定时器数量（显示前10个）"
}
}
# 保存结果
foreach ($result in $results) {
Save-TestResult "定时任务" $result
}
return $results
}
catch {
Write-Log "定时任务检测失败: $($_.Exception.Message)" "ERROR"
return @()
}
}
function Test-PortService { function Test-PortService {
Write-Log "开始端口服务检测..." Write-Log "开始端口服务检测..."
...@@ -1207,8 +1643,6 @@ function Test-PortService { ...@@ -1207,8 +1643,6 @@ function Test-PortService {
@{Name="Java-Web"; Port=8080; Critical=$true}, @{Name="Java-Web"; Port=8080; Critical=$true},
@{Name="HTTPS"; Port=443; Critical=$true}, @{Name="HTTPS"; Port=443; Critical=$true},
@{Name="Java-Admin"; Port=8999; Critical=$true}, @{Name="Java-Admin"; Port=8999; Critical=$true},
@{Name="Java-Login"; Port=8998; Critical=$true},
@{Name="Java-Backend"; Port=8997; Critical=$true},
@{Name="Python"; Port=8000; Critical=$false}, @{Name="Python"; Port=8000; Critical=$false},
@{Name="FastDFS-Tracker"; Port=22122; Critical=$false}, @{Name="FastDFS-Tracker"; Port=22122; Critical=$false},
@{Name="FastDFS-Storage"; Port=23000; Critical=$false} @{Name="FastDFS-Storage"; Port=23000; Critical=$false}
...@@ -1358,6 +1792,54 @@ function Test-DockerStatus { ...@@ -1358,6 +1792,54 @@ function Test-DockerStatus {
} }
} }
# 容器日志文件大小检测
Write-Log "检测容器日志文件大小..."
$logSizeOutput = Invoke-SSHCommand "docker ps --format '{{.Names}}' | xargs -I {} sh -c 'echo {}:`docker inspect --format='{{.LogPath}}' {} 2>/dev/null`' 2>/dev/null" -Timeout 30
if ($logSizeOutput) {
if ($logSizeOutput -is [array]) { $logSizeOutput = $logSizeOutput -join "`n" }
$logLines = $logSizeOutput -split "`n" | Where-Object { $_ -match "\S+" }
foreach ($logLine in $logLines) {
if ($logLine -match "^([^:]+):(.+)$") {
$containerName = $Matches[1].Trim()
$logPath = $Matches[2].Trim()
if (Test-Path $logPath) {
# 这是本地检测，容器日志路径在宿主机上
$fileSizeCmd = "du -b '$logPath' 2>/dev/null | awk '{print `$1}'"
$fileSizeBytes = Invoke-SSHCommand $fileSizeCmd -Timeout 10
if ($fileSizeBytes -match "\d+") {
$sizeBytes = [long]$Matches[1]
$sizeMB = $sizeBytes / 1MB
if ($sizeMB -gt 2048) {
$status = "严重"
$message = "日志文件过大: {0:N2} GB" -f ($sizeMB / 1024)
}
elseif ($sizeMB -gt 500) {
$status = "警告"
$message = "日志文件较大: {0:N2} MB" -f $sizeMB
}
else {
$status = "正常"
$message = "日志文件大小: {0:N2} MB" -f $sizeMB
}
$results += [PSCustomObject]@{
Name = "容器日志$containerName"
Value = "{0:N2} MB" -f $sizeMB
Threshold = ">500MB警告"
Status = $status
Message = $message
}
if ($status -ne "正常") {
Add-Issue -Message "容器${containerName}日志文件过大: {0:N2} MB" -f $sizeMB -Level $status
}
}
}
}
}
}
# 保存结果 # 保存结果
foreach ($result in $results) { foreach ($result in $results) {
Save-TestResult "Docker容器" $result Save-TestResult "Docker容器" $result
...@@ -1726,6 +2208,262 @@ function Test-EMQXStatus { ...@@ -1726,6 +2208,262 @@ function Test-EMQXStatus {
} }
} }
function Test-FastDFSStatus {
Write-Log "开始FastDFS文件存储检测..."
try {
$results = @()
# 检查FastDFS容器是否运行
$trackerCheck = Invoke-SSHCommand "docker ps --format '{{.Names}}' | grep utracker" -Timeout 10
$storageCheck = Invoke-SSHCommand "docker ps --format '{{.Names}}' | grep ustorage" -Timeout 10
if (-not $trackerCheck -or -not $storageCheck) {
Write-Log "FastDFS容器未运行" "WARN"
if (-not $trackerCheck) {
Add-Issue -Message "FastDFS Tracker容器未运行" -Level "严重"
}
if (-not $storageCheck) {
Add-Issue -Message "FastDFS Storage容器未运行" -Level "严重"
}
return $results
}
# Tracker状态检测
$trackerStatus = Invoke-SSHCommand "docker exec utracker fdfs_monitor /etc/fdfs/client.conf 2>&1" -Timeout 15
if ($trackerStatus) {
if ($trackerStatus -is [array]) { $trackerStatus = $trackerStatus -join "`n" }
if ($trackerStatus -match "tracker server is|Storage.*\[\s*\d+\]") {
$results += [PSCustomObject]@{
Name = "FastDFS Tracker"
Value = "运行中"
Threshold = "-"
Status = "正常"
Message = "Tracker服务正常运行"
}
}
elseif ($trackerStatus -match "can.*connect|error|failed") {
$results += [PSCustomObject]@{
Name = "FastDFS Tracker"
Value = "异常"
Threshold = "-"
Status = "严重"
Message = "Tracker服务异常"
}
Add-Issue -Message "FastDFS Tracker服务异常" -Level "严重"
}
}
# Storage状态检测
$storageStatus = Invoke-SSHCommand "docker exec utracker fdfs_monitor /etc/fdfs/client.conf 2>&1 | grep -A 10 'Storage'" -Timeout 15
if ($storageStatus) {
if ($storageStatus -is [array]) { $storageStatus = $storageStatus -join "`n" }
# 解析Storage状态
if ($storageStatus -match "Storage\s+\d+\):\s+([\d.]+):\s*Status:\s*(\w+)") {
$storageIP = $Matches[1]
$storageState = $Matches[2]
if ($storageState -eq "ACTIVE" -or $storageState -eq "ONLINE") {
$results += [PSCustomObject]@{
Name = "FastDFS Storage"
Value = "在线"
Threshold = "-"
Status = "正常"
Message = "Storage服务在线 ($storageIP)"
}
}
else {
$results += [PSCustomObject]@{
Name = "FastDFS Storage"
Value = $storageState
Threshold = "-"
Status = "严重"
Message = "Storage状态异常: $storageState"
}
Add-Issue -Message "FastDFS Storage状态异常: $storageState" -Level "严重"
}
}
}
# 磁盘空间检测
$storageSpace = Invoke-SSHCommand "docker exec ustorage df -h /data/fastdfs/storage 2>/dev/null" -Timeout 10
if ($storageSpace) {
if ($storageSpace -is [array]) { $storageSpace = $storageSpace[0] }
if ($storageSpace -match "\s+(\d+)%\s+(/data/fastdfs/storage)") {
$usedPercent = [int]$Matches[1]
$mountpoint = $Matches[2]
$status = Get-StatusByThreshold -Value "$usedPercent" -WarningThreshold "80" -CriticalThreshold "90"
$results += [PSCustomObject]@{
Name = "FastDFS存储空间"
Value = "$usedPercent%"
Threshold = ">80%警告"
Status = $status
Message = "Storage数据目录使用率"
}
if ($status -ne "正常") {
Add-Issue -Message "FastDFS存储空间不足: $usedPercent%" -Level $status
}
}
}
# 同步状态检测（如果是多Storage部署）
$syncStatus = Invoke-SSHCommand "docker exec ustorage fdfs_monitor /etc/fdfs/client.conf 2>&1 | grep -i 'sync\|src_ip'" -Timeout 10
if ($syncStatus) {
if ($syncStatus -is [array]) { $syncStatus = $syncStatus -join "`n" }
if ($syncStatus -match "sync_done|sync_src") {
$results += [PSCustomObject]@{
Name = "FastDFS同步状态"
Value = "正常"
Threshold = "-"
Status = "正常"
Message = "Storage数据同步正常"
}
}
}
# 保存结果
foreach ($result in $results) {
Save-TestResult "FastDFS" $result
}
return $results
}
catch {
Write-Log "FastDFS检测失败: $($_.Exception.Message)" "ERROR"
return @()
}
}
function Test-JavaApplication {
Write-Log "开始Java应用JVM检测..."
try {
$results = @()
# 检查ujava2容器是否运行
$javaCheck = Invoke-SSHCommand "docker ps --format '{{.Names}}' | grep ujava2" -Timeout 10
if (-not $javaCheck) {
Write-Log "Java容器未运行" "WARN"
return $results
}
# Java版本
$javaVersion = Invoke-SSHCommand "docker exec ujava2 java -version 2>&1" -Timeout 10
if ($javaVersion) {
if ($javaVersion -is [array]) { $javaVersion = $javaVersion -join "`n" }
if ($javaVersion -match 'version\s+"?([\d._]+)') {
$version = $Matches[1]
$results += [PSCustomObject]@{
Name = "Java版本"
Value = $version
Threshold = "-"
Status = "正常"
Message = "Java运行环境版本"
}
}
}
# JVM堆内存检测（通过/proc）
$javaPidOutput = Invoke-SSHCommand "docker exec ujava2 jps 2>/dev/null | grep -v Jps | awk '{print `$1}'" -Timeout 10
if ($javaPidOutput -and $javaPidOutput -notmatch "error|Error|ERROR") {
# 确保是字符串类型
if ($javaPidOutput -is [array]) { $javaPidOutput = $javaPidOutput[0] }
$javaPidString = "$javaPidOutput".Trim()
if ($javaPidString -match "\d+") {
$javaProcessId = $javaPidString
# 获取JVM内存信息（堆内存使用情况）
$memInfo = Invoke-SSHCommand "docker exec ujava2 cat /proc/$javaProcessId/status 2>/dev/null | grep -E 'VmRSS|VmSize|VmPeak|Threads'" -Timeout 10
if ($memInfo) {
if ($memInfo -is [array]) { $memInfo = $memInfo -join "`n" }
$memDetails = @()
if ($memInfo -match "VmSize:\s+(\d+)\s+kB") {
$vmSizeKB = [long]$Matches[1]
$memDetails += "虚拟内存: {0:N2} GB" -f ($vmSizeKB / 1MB)
}
if ($memInfo -match "VmRSS:\s+(\d+)\s+kB") {
$vmRSSKB = [long]$Matches[1]
$memDetails += "物理内存: {0:N2} GB" -f ($vmRSSKB / 1MB)
}
if ($memInfo -match "Threads:\s+(\d+)") {
$threadCount = [int]$Matches[1]
$memDetails += "线程数: $threadCount"
}
if ($memDetails.Count -gt 0) {
$results += [PSCustomObject]@{
Name = "JVM内存使用"
Value = "已获取"
Threshold = "-"
Status = "正常"
Message = $memDetails -join ", "
}
}
}
}
}
# GC日志检测（从容器日志中获取）
$gcLogs = Invoke-SSHCommand "docker logs --tail 100 ujava2 2>&1 | grep -iE 'gc|heap' | tail -5" -Timeout 10
if ($gcLogs) {
if ($gcLogs -is [array]) { $gcLogs = $gcLogs -join "`n" }
$gcCount = 0
if ($gcLogs -match "Full GC|heap") {
$gcCount = ($gcLogs | Select-String -Pattern "Full GC" -AllMatches).Matches.Count
}
if ($gcCount -gt 5) {
$status = "严重"
$message = "频繁Full GC: $gcCount 次"
}
elseif ($gcCount -gt 0) {
$status = "警告"
$message = "检测到Full GC: $gcCount 次"
}
else {
$status = "正常"
$message = "GC活动正常"
}
$results += [PSCustomObject]@{
Name = "GC状态"
Value = "$gcCount 次"
Threshold = ">5次严重"
Status = $status
Message = $message
}
if ($status -ne "正常") {
Add-Issue -Message "Java应用频繁Full GC: $gcCount 次" -Level $status
}
}
# 堆内存设置检测
$heapSettings = Invoke-SSHCommand "docker exec ujava2 ps aux | grep java | grep -oE '-Xm[sx][0-9A-Za-z]+' | head -3" -Timeout 10
if ($heapSettings) {
if ($heapSettings -is [array]) { $heapSettings = $heapSettings -join " " }
$results += [PSCustomObject]@{
Name = "堆内存设置"
Value = $heapSettings.Trim()
Threshold = "-"
Status = "正常"
Message = "JVM堆内存参数配置"
}
}
# 保存结果
foreach ($result in $results) {
Save-TestResult "Java应用" $result
}
return $results
}
catch {
Write-Log "Java应用检测失败: $($_.Exception.Message)" "ERROR"
return @()
}
}
function Test-ApplicationLogs { function Test-ApplicationLogs {
Write-Log "开始应用日志分析..." Write-Log "开始应用日志分析..."
...@@ -1734,7 +2472,7 @@ function Test-ApplicationLogs { ...@@ -1734,7 +2472,7 @@ function Test-ApplicationLogs {
# Java应用日志分析 # Java应用日志分析
$javaLogPath = "/data/services/api/java-meeting/java-meeting2.0/logs" $javaLogPath = "/data/services/api/java-meeting/java-meeting2.0/logs"
$dirCheck = Invoke-SSHCommand "test -d '$javaLogPath' && echo 'exists' || echo 'notfound'" -Timeout 10 $dirCheck = Invoke-SSHCommand 'test -d "' + $javaLogPath + '" && echo "exists" || echo "notfound"' -Timeout 10
if ($dirCheck -eq "exists") { if ($dirCheck -eq "exists") {
# 检查日志文件 # 检查日志文件
...@@ -1818,7 +2556,7 @@ function Test-ApplicationLogs { ...@@ -1818,7 +2556,7 @@ function Test-ApplicationLogs {
# Python应用日志分析 # Python应用日志分析
$pythonLogPath = "/data/services/api/python-cmdb/log" $pythonLogPath = "/data/services/api/python-cmdb/log"
$pythonDirCheck = Invoke-SSHCommand "test -d '$pythonLogPath' && echo 'exists' || echo 'notfound'" -Timeout 10 $pythonDirCheck = Invoke-SSHCommand 'test -d "' + $pythonLogPath + '" && echo "exists" || echo "notfound"' -Timeout 10
if ($pythonDirCheck -eq "exists") { if ($pythonDirCheck -eq "exists") {
$pythonErrors = Invoke-SSHCommand "tail -200 '$pythonLogPath'/*.log 2>/dev/null | grep -iE 'error|exception|fail' | wc -l" -Timeout 30 $pythonErrors = Invoke-SSHCommand "tail -200 '$pythonLogPath'/*.log 2>/dev/null | grep -iE 'error|exception|fail' | wc -l" -Timeout 30
if ($pythonErrors -match "\d+") { if ($pythonErrors -match "\d+") {
...@@ -1839,7 +2577,7 @@ function Test-ApplicationLogs { ...@@ -1839,7 +2577,7 @@ function Test-ApplicationLogs {
if ($pythonVoiceContainer) { if ($pythonVoiceContainer) {
# Python_voice应用日志分析 # Python_voice应用日志分析
$pythonVoiceLogPath = "/data/services/api/python-voice/log" $pythonVoiceLogPath = "/data/services/api/python-voice/log"
$pythonVoiceDirCheck = Invoke-SSHCommand "test -d '$pythonVoiceLogPath' && echo 'exists' || echo 'notfound'" -Timeout 10 $pythonVoiceDirCheck = Invoke-SSHCommand 'test -d "' + $pythonVoiceLogPath + '" && echo "exists" || echo "notfound"' -Timeout 10
if ($pythonVoiceDirCheck -eq "exists") { if ($pythonVoiceDirCheck -eq "exists") {
$voiceErrors = Invoke-SSHCommand "tail -200 '$pythonVoiceLogPath'/*.log 2>/dev/null | grep -iE 'error|exception|fail' | wc -l" -Timeout 30 $voiceErrors = Invoke-SSHCommand "tail -200 '$pythonVoiceLogPath'/*.log 2>/dev/null | grep -iE 'error|exception|fail' | wc -l" -Timeout 30
if ($voiceErrors -match "\d+") { if ($voiceErrors -match "\d+") {
...@@ -1865,7 +2603,7 @@ function Test-ApplicationLogs { ...@@ -1865,7 +2603,7 @@ function Test-ApplicationLogs {
# Nacos应用日志分析 # Nacos应用日志分析
$nacosLogPath = "/data/middleware/nacos/logs" $nacosLogPath = "/data/middleware/nacos/logs"
$nacosDirCheck = Invoke-SSHCommand "test -d '$nacosLogPath' && echo 'exists' || echo 'notfound'" -Timeout 10 $nacosDirCheck = Invoke-SSHCommand 'test -d "' + $nacosLogPath + '" && echo "exists" || echo "notfound"' -Timeout 10
if ($nacosDirCheck -eq "exists") { if ($nacosDirCheck -eq "exists") {
$nacosErrors = Invoke-SSHCommand "tail -200 '$nacosLogPath'/*.log 2>/dev/null | grep -iE 'error|exception|fail' | wc -l" -Timeout 30 $nacosErrors = Invoke-SSHCommand "tail -200 '$nacosLogPath'/*.log 2>/dev/null | grep -iE 'error|exception|fail' | wc -l" -Timeout 30
if ($nacosErrors -match "\d+") { if ($nacosErrors -match "\d+") {
...@@ -1882,7 +2620,7 @@ function Test-ApplicationLogs { ...@@ -1882,7 +2620,7 @@ function Test-ApplicationLogs {
# Nginx应用日志分析 # Nginx应用日志分析
$nginxLogPath = "/data/middleware/nginx/log" $nginxLogPath = "/data/middleware/nginx/log"
$nginxDirCheck = Invoke-SSHCommand "test -d '$nginxLogPath' && echo 'exists' || echo 'notfound'" -Timeout 10 $nginxDirCheck = Invoke-SSHCommand 'test -d "' + $nginxLogPath + '" && echo "exists" || echo "notfound"' -Timeout 10
if ($nginxDirCheck -eq "exists") { if ($nginxDirCheck -eq "exists") {
# Nginx错误日志统计 # Nginx错误日志统计
$nginxErrors = Invoke-SSHCommand "tail -200 '$nginxLogPath'/*.log 2>/dev/null | grep -iE 'error|502|503|504' | wc -l" -Timeout 30 $nginxErrors = Invoke-SSHCommand "tail -200 '$nginxLogPath'/*.log 2>/dev/null | grep -iE 'error|502|503|504' | wc -l" -Timeout 30
...@@ -2134,6 +2872,19 @@ $( ...@@ -2134,6 +2872,19 @@ $(
} }
) )
### 定时任务检测
$(
$results = $script:检测结果["定时任务"]
if ($results -and $results.Count -gt 0) {
$results | ForEach-Object {
$icon = Get-StatusIcon $_.Status
"- **$($_.Name)**: $($_.Value) | 阈值: $($_.Threshold) | 状态: $icon $($_.Status) | 说明: $($_.Message)`n"
}
} else {
$("- 检测失败或无数据`n")
}
)
### 端口服务检测 ### 端口服务检测
$( $(
$results = $script:检测结果["端口服务"] $results = $script:检测结果["端口服务"]
...@@ -2203,6 +2954,32 @@ $( ...@@ -2203,6 +2954,32 @@ $(
} }
) )
### FastDFS文件存储检测
$(
$results = $script:检测结果["FastDFS"]
if ($results -and $results.Count -gt 0) {
$results | ForEach-Object {
$icon = Get-StatusIcon $_.Status
"- **$($_.Name)**: $($_.Value) | 阈值: $($_.Threshold) | 状态: $icon $($_.Status) | 说明: $($_.Message)`n"
}
} else {
$("- 检测失败或无数据`n")
}
)
### Java应用JVM检测
$(
$results = $script:检测结果["Java应用"]
if ($results -and $results.Count -gt 0) {
$results | ForEach-Object {
$icon = Get-StatusIcon $_.Status
"- **$($_.Name)**: $($_.Value) | 阈值: $($_.Threshold) | 状态: $icon $($_.Status) | 说明: $($_.Message)`n"
}
} else {
$("- 检测失败或无数据`n")
}
)
### 应用日志分析 ### 应用日志分析
$( $(
$results = $script:检测结果["应用日志"] $results = $script:检测结果["应用日志"]
...@@ -2357,6 +3134,7 @@ function Main { ...@@ -2357,6 +3134,7 @@ function Main {
Test-SecurityStatus | Out-Null Test-SecurityStatus | Out-Null
Test-SystemLogs | Out-Null Test-SystemLogs | Out-Null
Test-TimeSync | Out-Null Test-TimeSync | Out-Null
Test-ScheduledTasks | Out-Null
Test-PortService | Out-Null Test-PortService | Out-Null
# 模块二：服务层检测 # 模块二：服务层检测
...@@ -2365,6 +3143,8 @@ function Main { ...@@ -2365,6 +3143,8 @@ function Main {
Test-MySQLStatus | Out-Null Test-MySQLStatus | Out-Null
Test-RedisStatus | Out-Null Test-RedisStatus | Out-Null
Test-EMQXStatus | Out-Null Test-EMQXStatus | Out-Null
Test-FastDFSStatus | Out-Null
Test-JavaApplication | Out-Null
Test-ApplicationLogs | Out-Null Test-ApplicationLogs | Out-Null
# 模块三：综合诊断 # 模块三：综合诊断
......
Docs/PRD/服务自检/新需求/_PRD_服务器监测需求_规整版_需求文档.md
浏览文件 @ 82e213b2
...@@ -173,7 +173,7 @@ ...@@ -173,7 +173,7 @@
**阈值标准**: NTP时钟偏差 >1秒 = 警告; SSL证书剩余 <30天 = 警告, <7天 = 严重 **阈值标准**: NTP时钟偏差 >1秒 = 警告; SSL证书剩余 <30天 = 警告, <7天 = 严重
#### 1.11 端口服务检测 #### 1.11 端口服务检测
- 关键端口监听检测 (22/443/8306/6379/1883/8883/8083/8080/8997/8998/8999/8000/8003/22122/23000) - 关键端口监听检测 (22/443/8306/6379/1883/8883/8083/8080/8999/8000/8003/22122/23000)
- 服务状态检测 (Docker容器运行状态) - 服务状态检测 (Docker容器运行状态)
#### 1.12 定时任务检测 #### 1.12 定时任务检测
......
Docs/PRD/服务自检/新需求/问题处理/_PRD_脚本运行存在失败项2_问题处理.md 0 → 100644
浏览文件 @ 82e213b2
# _PRD_脚本运行存在失败项2_问题处理
> 来源：
- `AuxiliaryTool/ScriptTool/新服务自检/check_server_health.ps1`
## 1. 背景与目标
### 1.1 背景
- 执行脚本后有以下几项检测失败：
- 第18行: "🔴 检测到" - 内容仍为空（之前的修复可能有遗漏）
- 第20行: "时钟偏差过大: 0.000秒" - 偏差为0却显示严重状态
### 1.2 目标
- 脚本能够正常运行使用，日志打印记录信息完整，信息采集正确。
---
## 2. 问题报错信息
### 2.1 问题一
- 脚本报告路径：[C:\Users\UBAINS\Desktop\Test\reports\server_health_localhost_2026-05-08_18-45-00.md]
```
.\check_server_health.ps1
========================================
服务器健康监测脚本 v2.0
========================================
请输入目标主机地址: 192.168.5.46
请输入SSH端口 (默认: 22): 22
请输入SSH用户名 (默认: root): root
请输入SSH密码: **********
========================================
连接信息确认:
主机地址: 192.168.5.46
SSH端口: 22
用户名: root
========================================
确认以上信息是否正确？(Y/N): y
[2026-05-08 18:45:09] [INFO] =========================================
[2026-05-08 18:45:09] [INFO] 服务器健康监测脚本 v2.0 启动
[2026-05-08 18:45:09] [INFO] 目标主机: 192.168.5.46:22
[2026-05-08 18:45:09] [INFO] =========================================
[2026-05-08 18:45:09] [INFO] 测试SSH连接...
[2026-05-08 18:45:09] [INFO] 测试结果类型: String
[2026-05-08 18:45:09] [INFO] 测试结果内容: connection_ok
[2026-05-08 18:45:09] [INFO] SSH连接成功
[2026-05-08 18:45:09] [INFO]
========== 开始系统基础检测 ==========
[2026-05-08 18:45:09] [INFO] 开始系统基础信息检测...
[2026-05-08 18:45:12] [INFO] 开始CPU资源检测...
[2026-05-08 18:45:13] [WARN] mpstat未安装，跳过CPU详细检测
[2026-05-08 18:45:13] [INFO] 开始内存资源检测...
[2026-05-08 18:45:14] [INFO] 开始磁盘资源检测...
[2026-05-08 18:45:15] [WARN] iostat未安装，跳过磁盘IO详细检测
[2026-05-08 18:45:16] [WARN] smartctl未安装，跳过磁盘健康检测
[2026-05-08 18:45:16] [INFO] 开始OOM和内核异常检测...
[2026-05-08 18:45:30] [INFO] 开始进程状态检测...
[2026-05-08 18:45:32] [INFO] 开始网络连接检测...
[2026-05-08 18:45:35] [INFO] 开始安全合规检测...
[2026-05-08 18:45:37] [INFO] 开始系统日志检测...
[2026-05-08 18:45:41] [INFO] 开始时间同步检测...
[2026-05-08 18:45:42] [INFO] 开始端口服务检测...
[2026-05-08 18:45:47] [INFO]
========== 开始服务层检测 ==========
[2026-05-08 18:45:47] [INFO] 开始Docker容器检测...
[2026-05-08 18:45:55] [INFO] 开始MySQL数据库检测...
[2026-05-08 18:45:57] [INFO] 开始Redis缓存检测...
[2026-05-08 18:46:00] [INFO] 开始EMQX消息队列检测...
[2026-05-08 18:46:14] [INFO] 开始应用日志分析...
[2026-05-08 18:46:19] [INFO]
========== 开始综合诊断 ==========
[2026-05-08 18:46:19] [INFO] 开始核心问题诊断...
[2026-05-08 18:46:19] [INFO] 开始核心问题诊断...
[2026-05-08 18:46:19] [INFO] 检测完成 - 状态: 严重
[2026-05-08 18:46:19] [INFO] 严重问题: 7, 警告: 0
[2026-05-08 18:46:19] [INFO]
========== 生成报告 ==========
[2026-05-08 18:46:19] [INFO] 开始生成Markdown报告...
[2026-05-08 18:46:19] [INFO] 开始核心问题诊断...
[2026-05-08 18:46:19] [INFO] 开始核心问题诊断...
[2026-05-08 18:46:19] [INFO] 报告已保存: C:\Users\UBAINS\Desktop\Test\reports\server_health_localhost_2026-05-08_18-45-00.md
[2026-05-08 18:46:19] [INFO]
=========================================
[2026-05-08 18:46:19] [INFO] 监测完成！
[2026-05-08 18:46:19] [INFO] 报告文件: C:\Users\UBAINS\Desktop\Test\reports\server_health_localhost_2026-05-08_18-45-00.md
[2026-05-08 18:46:19] [INFO] =========================================
```
\ No newline at end of file
Docs/PRD/服务自检/新需求/问题处理/_PRD_脚本运行存在失败项2_问题处理_计划执行.md 0 → 100644
浏览文件 @ 82e213b2
# 脚本运行存在失败项2问题处理计划执行文档
## 一、问题分析
### 1.1 问题列表
| 序号 | 问题 | 报告位置 | 错误信息 |
|:---|:---|:---|:---|
| 1 | "检测到"内容为空 | 第18行 | "🔴 检测到" 后面没有内容 |
| 2 | 时钟偏差误报 | 第20行 | "时钟偏差过大: 0.000秒" 偏差为0却显示严重 |
---
## 二、根本原因分析
### 2.1 "检测到"内容为空
**可能原因：**
1. 某个`Add-Issue`调用中使用的变量为空字符串
2. 字符串插值时变量未正确初始化
3. 可能是之前修复格式化字符串时遗漏的地方
**需要检查的位置：**
- 所有包含`"检测到"`的Add-Issue调用
- 检查相关变量是否在所有代码路径中都被正确初始化
### 2.2 时钟偏差误报
**问题描述：**
- offset = 0.000
- Get-StatusByThreshold应该返回"正常"
- 但报告显示"严重"状态
**可能原因：**
1. Get-StatusByThreshold函数的阈值判断逻辑有问题
2. 当数值为0时，正则匹配可能返回空字符串
3. 需要检查0值的边界情况处理
---
## 三、修复方案
### 3.1 修复"检测到"内容为空
**方案：** 检查所有Add-Issue调用，确保变量在使用前已初始化
```powershell
# 在每个Add-Issue调用前添加变量检查
if ($coreCount -gt 0) {
Add-Issue -Message "检测到$coreCount个core dump文件，可能有程序崩溃" -Level "警告"
}
```
### 3.2 修复时钟偏差误报
**问题定位：** Get-StatusByThreshold函数第222-223行
**当前代码：**
```powershell
if ($Value -match "(\d+\.?\d*)") {
[double]$numericValue = $Matches[1]
}
```
**问题：**
- 当Value="0"时，正则匹配成功但`$Matches[1]`可能为"0"
- 转换为double后是0，但后续逻辑判断有问题
**修复方案：**
1. 在Get-StatusByThreshold中添加对0值的特殊处理
2. 或者检查正则匹配结果是否为有效数值
**修复代码：**
```powershell
# 提取数值
$numericValue = 0
if ($Value -match "(\d+\.?\d*)") {
$matchedValue = $Matches[1]
if (-not [string]::IsNullOrEmpty($matchedValue)) {
[double]$numericValue = $matchedValue
}
}
```
或者更简单的方法：
```powershell
# 直接使用double转换，失败则为0
$numericValue = 0
try {
[double]$numericValue = [double]::Parse($Value, [Globalization.NumberStyles]::Float, [Globalization.CultureInfo]::InvariantCulture)
} catch {
$numericValue = 0
}
```
---
## 四、代码修改清单
| 序号 | 行号 | 修改内容 | 预计影响 |
|:---|:---|:---|:---|
| 1 | 212-246 | 修复Get-StatusByThreshold函数的数值提取逻辑 | 时钟偏差等阈值判断更准确 |
| 2 | - | 检查所有"检测到"相关的Add-Issue调用 | 确保"检测到"内容不为空 |
---
## 五、实施步骤
### 步骤1：修复Get-StatusByThreshold函数
- 改进数值提取逻辑，正确处理0值和边界情况
### 步骤2：检查所有"检测到"相关代码
- 确保变量在使用前已正确初始化
### 步骤3：测试验证
- 运行脚本检查修复效果
### 步骤4：同步文件
- 将修复后的脚本同步到项目目录
---
## 六、实施状态
- [x] 问题分析完成
- [x] 计划文档创建完成
- [x] 代码修复完成
- [x] 语法验证完成
- [x] 文件同步完成
---
## 七、修复说明
### 修复内容
**1. 修复Get-StatusByThreshold函数（第212-272行）**
**问题：** 数值为0时，正则匹配可能导致判断不准确
**修复：**
- 添加try-catch确保数值转换成功
- 添加空值检查
- 添加特殊处理：当数值为0且HigherIsWorse时直接返回"正常"
```powershell
# 修复前
if ($Value -match "(\d+\.?\d*)") {
[double]$numericValue = $Matches[1]
}
# 修复后
try {
if ($Value -match "(-?\d+\.?\d*)") {
$matchedValue = $Matches[1]
if (-not [string]::IsNullOrEmpty($matchedValue)) {
[double]$numericValue = [double]::Parse($matchedValue, [Globalization.NumberStyles]::Float, [Globalization.CultureInfo]::InvariantCulture)
}
}
} catch {
$numericValue = 0
}
# 特殊处理：数值为0且HigherIsWorse时直接返回正常
if ($HigherIsWorse -and $numericValue -eq 0) {
return "正常"
}
```
**2. 修复Add-Issue格式化字符串问题（第570行、第616行）**
**问题：** 磁盘使用率和Inode使用率的Add-Issue调用中，格式化字符串没有正确包裹
**修复：**
```powershell
# 修复前
Add-Issue -Message "磁盘使用率过高: {0} ({1}%)" -f $mountpoint, $usedPercent -Level $status
Add-Issue -Message "Inode使用率过高: {0} ({1}%)" -f $mountpoint, $usedPercent -Level $status
# 修复后
Add-Issue -Message ("磁盘使用率过高: {0} ({1}%)" -f $mountpoint, $usedPercent) -Level $status
Add-Issue -Message ("Inode使用率过高: {0} ({1}%)" -f $mountpoint, $usedPercent) -Level $status
```
### 验证结果
```
Syntax OK
```
### 修改文件
- ✅ 桌面：`C:\Users\UBAINS\Desktop\Test\check_server_health.ps1`
- ✅ 项目：`E:\GithubData\ubains-module-test\AuxiliaryTool\ScriptTool\新服务自检\check_server_health.ps1`
---
## 八、修复效果
| 问题 | 修复前 | 修复后 |
|:---|:---|:---|
| 时钟偏差为0显示严重 | offset=0.000时显示"严重" | offset=0时显示"正常" |
| "检测到"内容为空 | Add-Issue消息为空字符串 | 消息正确显示"磁盘使用率过高: /data (68%)" |
---
## 九、新增功能
### 新增：定时任务检测
**位置：** 第1220-1283行
**检测内容：**
1. **Crontab任务** - 检测当前用户的crontab定时任务数量
2. **Systemd定时器** - 检测系统systemd定时器数量（显示前10个）
**命令：**
```powershell
crontab -l
systemctl list-timers --no-pager
```
**报告输出格式：**
```
### 定时任务检测
- **Crontab任务**: X 个 | 阈值: - | 状态: 🟢 正常 | 说明: 当前用户的定时任务数量
- **Systemd定时器**: X 个 | 阈值: - | 状态: 🟢 正常 | 说明: 系统定时器数量（显示前10个）
```
**修改位置：**
- 函数定义：第1220-1283行
- 主函数调用：第2453行
- 报告生成：第2229-2242行
---
## 七、注意事项
1. **阈值判断逻辑：**
- 确保数值0被正确识别为"正常"
- 检查所有使用Get-StatusByThreshold的地方
2. **变量初始化：**
- 在使用变量前检查是否为null或空
- 为关键变量设置默认值
3. **正则匹配：**
- 确保正则匹配的结果不为空
- 添加必要的空值检查
Markdown 格式
0% 或
您添加了 0 人 到此讨论。请谨慎行事。
请先完成此评论的编辑！
请 注册 或者 后发表评论