Ticket #128 (closed 故障: fixed)

Opened 14 years ago

Last modified 13 years ago

比价定时任务执行报内存溢出错误

Reported by: huangzhong Owned by:
Priority: major Milestone:
Component: 比价 Version:
Keywords: 内存溢出 Cc: chenchongqi, yuanhuoqing, liaojunqiang, huangjianhua
Due Date: 09/10/2012

Description

  • 故障现象

比价的爬虫智能匹配关系全部丢失

  • 故障分析

查看日志，发现执行定时任务的时候内存溢出，导致监控脚本自动重启，检查resin的jvm配置，发现只有256M

  • 解决方案

把resin的jvm配置成了1G

  • 影响

对网友前台访问没有影响，只是影响到了编辑的审核

  • 隐患

1.随着爬虫爬取的数据越来越多，一次把数据从数据库读出并加载到内存的做法是不合适的，控制每次读取的数据量。
2.比价中有多处TRUNCATE TABLE操作，要逐步修改过来

Change History

comment:1 Changed 13 years ago by chenchongqi

  • Status changed from new to closed
  • Component changed from Snake to 比价
  • Resolution set to fixed
Note: See TracTickets for help on using tickets.