6.4 KiB
6.4 KiB
智能查 SEO 服务部署指南(纯 Nginx 方案)
方案说明
使用纯 Nginx 配置实现爬虫检测,无需 Node.js 服务器。
工作原理:
请求 → Nginx 检测 User-Agent
├─ 是爬虫 → 返回静态 SEO HTML 模板
└─ 普通用户 → 返回 SPA 应用
部署步骤
1. 构建前端项目
cd /www/wwwroot/zhinengcha.cn
npm run build
2. 生成 SEO 模板到 dist 目录
cd /www/wwwroot/zhinengcha.cn/server
node generate-seo-templates.cjs
生成后目录结构:
dist/
├── index.html
├── assets/
└── seo-templates/
├── index.html
├── agent.html
├── help.html
├── ...
3. 修改 Nginx 配置
将以下配置复制到宝塔面板的站点配置中:
server
{
listen 80;
listen 443 ssl;
listen 443 quic;
listen [::]:443 ssl;
listen [::]:443 quic;
http2 on;
listen [::]:80;
server_name zhinengcha.cn www.zhinengcha.cn p.zhenaicha.cn;
index index.html index.htm default.htm default.html;
root /www/wwwroot/zhinengcha.cn/dist;
#CERT-APPLY-CHECK--START
# 用于SSL证书申请时的文件验证相关配置 -- 请勿删除并保持这段设置在优先级高的位置
include /www/server/panel/vhost/nginx/well-known/zhinengcha.cn.conf;
#CERT-APPLY-CHECK--END
#SSL-START SSL相关配置,请勿删除或修改下一行带注释的404规则
#error_page 404/404.html;
ssl_certificate /www/server/panel/vhost/cert/zhinengcha.cn/fullchain.pem;
ssl_certificate_key /www/server/panel/vhost/cert/zhinengcha.cn/privkey.pem;
ssl_protocols TLSv1.1 TLSv1.2 TLSv1.3;
ssl_ciphers EECDH+CHACHA20:EECDH+CHACHA20-draft:EECDH+AES128:RSA+AES128:EECDH+AES256:RSA+AES256:EECDH+3DES:RSA+3DES:!MD5;
ssl_prefer_server_ciphers on;
ssl_session_tickets on;
ssl_session_cache shared:SSL:10m;
ssl_session_timeout 10m;
add_header Strict-Transport-Security "max-age=31536000";
add_header Alt-Svc 'quic=":443"; h3=":443"; h3-29=":443"; h3-27=":443";h3-25=":443"; h3-T050=":443"; h3-Q050=":443";h3-Q049=":443";h3-Q048=":443"; h3-Q046=":443"; h3-Q043=":443"';
error_page 497 https://$host$request_uri;
#SSL-END
#ERROR-PAGE-START 错误页配置,可以注释、删除或修改
#error_page 404 /404.html;
#error_page 502 /502.html;
#ERROR-PAGE-END
#REWRITE-START URL重写规则引用,修改后将导致面板设置的伪静态规则失效
include /www/server/panel/vhost/rewrite/html_zhinengcha.cn.conf;
#REWRITE-END
#禁止访问的文件或目录
location ~ ^/(\.user.ini|\.htaccess|\.git|\.env|\.svn|\.project|LICENSE|README.md)
{
return 404;
}
#一键申请SSL证书验证目录相关设置
location ~ \.well-known{
allow all;
}
# API 代理
location /api/v1 {
proxy_pass http://127.0.0.1:21004;
proxy_set_header Host 127.0.0.1:$server_port;
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
proxy_set_header REMOTE-HOST $remote_addr;
add_header X-Cache $upstream_cache_status;
proxy_set_header X-Host $host:$server_port;
proxy_set_header X-Scheme $scheme;
proxy_connect_timeout 30s;
proxy_read_timeout 86400s;
proxy_send_timeout 30s;
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection "upgrade";
}
# 前端路由处理 - 爬虫检测返回静态SEO页面
location / {
set $seo_page 0;
# 检测常见爬虫 User-Agent
if ($http_user_agent ~* "(baiduspider|googlebot|bingbot|msnbot|360spider|sogou|youdaobot|twitterbot|facebookexternalhit|linkedinbot|bytespider)") {
set $seo_page 1;
}
# 如果是爬虫,返回对应的 SEO 静态页面
if ($seo_page = 1) {
rewrite ^/$ /seo-templates/index.html last;
}
if ($seo_page = 1) {
rewrite ^/agent$ /seo-templates/agent.html last;
}
if ($seo_page = 1) {
rewrite ^/help$ /seo-templates/help.html last;
}
if ($seo_page = 1) {
rewrite ^/help/guide$ /seo-templates/help-guide.html last;
}
if ($seo_page = 1) {
rewrite ^/example$ /seo-templates/example.html last;
}
if ($seo_page = 1) {
rewrite ^/service$ /seo-templates/service.html last;
}
if ($seo_page = 1) {
rewrite ^/inquire/riskassessment$ /seo-templates/inquire-riskassessment.html last;
}
if ($seo_page = 1) {
rewrite ^/inquire/companyinfo$ /seo-templates/inquire-companyinfo.html last;
}
if ($seo_page = 1) {
rewrite ^/inquire/marriage$ /seo-templates/inquire-marriage.html last;
}
if ($seo_page = 1) {
rewrite ^/promote$ /seo-templates/promote.html last;
}
# 普通用户返回 SPA
try_files $uri $uri/ /index.html;
}
# SEO 静态模板目录
location /seo-templates {
root /www/wwwroot/zhinengcha.cn/dist;
internal;
}
#禁止在证书验证目录放入敏感文件
if ( $uri ~ "^/\.well-known/.*\.(php|jsp|py|js|css|lua|ts|go|zip|tar\.gz|rar|7z|sql|bak)$" ) {
return 403;
}
location ~ .*\\.(gif|jpg|jpeg|png|bmp|swf)$
{
expires 30d;
error_log /dev/null;
access_log /dev/null;
}
location ~ .*\\.(js|css)?$
{
expires 12h;
error_log /dev/null;
access_log /dev/null;
}
access_log /www/wwwlogs/zhinengcha.cn.log;
error_log /www/wwwlogs/zhinengcha.cn.error.log;
}
4. 重载 Nginx
nginx -t && nginx -s reload
验证部署
# 模拟百度爬虫访问首页
curl -A "Mozilla/5.0 (compatible; Baiduspider/2.0)" https://www.zhinengcha.cn/
# 模拟 Google 爬虫访问首页
curl -A "Mozilla/5.0 (compatible; Googlebot/2.1)" https://www.zhinengcha.cn/
# 普通浏览器访问(应返回 SPA)
curl -A "Mozilla/5.0 (Windows NT 10.0; Win64; x64) Chrome/120.0.0.0" https://www.zhinengcha.cn/
更新 SEO 配置
当修改 useSEO.js 中的 TDK 配置后:
- 同步更新
server/generate-seo-templates.cjs中的pageSEOConfigs - 重新生成模板:
node generate-seo-templates.cjs - 重新部署
dist目录