现象:
创新互联公司是一家集网站建设,黔西南州企业网站建设,黔西南州品牌网站建设,网站定制,黔西南州网站建设报价,网络营销,网络优化,黔西南州网站推广为一体的创新建站企业,帮助传统企业提升企业形象加强企业竞争力。可充分满足这一群体相比中小企业更为丰富、高端、多元的互联网需求。同时我们时刻保持专业、时尚、前沿,时刻以成就客户成长自我,坚持不断学习、思考、沉淀、净化自己,让我们为更多的企业打造出实用型网站。
昨天突然线上很多接口获取失败,通过 kibana发现大量异常,具体异常信息:
...into fallback. Rejected command because thread-pool queueSize is at rejection threshold.
异常代码出处:
@FeignClient(name = "api", fallbackFactory = LoadBalancingFallbackFactory.class) public interface LoadBalancingFeignClient { @PostMapping(value = "/api/loadBalancing/server") Result currentServer(); } @Slf4j @Component public class LoadBalancingFallbackFactory implements FallbackFactory{ @Override public LoadBalancingFeignClient create(Throwable throwable) { final String msg = throwable.getMessage(); return () -> { log.error("loadBalancingFeignClient currentServer into fallback. {}", msg); return Result.error(); };**** } }
原因:
看到这里已经很明显了,是由于hystrix线程池不够用,直接熔断导致的。
项目apollo配置:
hystrix.command.default.execution.isolation.thread.timeoutInMilliseconds = 3500 hystrix.threadpool.default.maxQueueSize = 60 hystrix.threadpool.default.queueSizeRejectionThreshold = 40
hystrix参数简析:
maxQueueSize:线程池大小,默认为-1,创建的队列是SynchronousQueue,如果设置大于0则根据其大小创建LinkedBlockingQueue。
queueSizeRejectionThreshold:动态控制线程池队列的上限,即使maxQueueSize没有达到,达到queueSizeRejectionThreshold该值后,请求也会被拒绝,默认值5
相关源码:
hystrix-core-1.5.12-sources.jar!/com/netflix/hystrix/strategy/concurrency/HystrixContextScheduler.java
private class HystrixContextSchedulerWorker extends Worker { private final Worker worker; private HystrixContextSchedulerWorker(Worker actualWorker) { this.worker = actualWorker; } @Override public void unsubscribe() { worker.unsubscribe(); } @Override public boolean isUnsubscribed() { return worker.isUnsubscribed(); } @Override public Subscription schedule(Action0 action, long delayTime, TimeUnit unit) { if (threadPool != null) { if (!threadPool.isQueueSpaceAvailable()) { throw new RejectedExecutionException("Rejected command because thread-pool queueSize is at rejection threshold."); } } return worker.schedule(new HystrixContexSchedulerAction(concurrencyStrategy, action), delayTime, unit); } @Override public Subscription schedule(Action0 action) { if (threadPool != null) { if (!threadPool.isQueueSpaceAvailable()) { throw new RejectedExecutionException("Rejected command because thread-pool queueSize is at rejection threshold."); } } return worker.schedule(new HystrixContexSchedulerAction(concurrencyStrategy, action)); } }
解决办法:
- 适当调大Hystrix线程队列参数
- 动态水平扩容服务
- 优化下游服务,减少服务响应时间
以上就是本文的全部内容,希望对大家的学习有所帮助,也希望大家多多支持创新互联。
当前标题:SpringCloudHystrix线程池不足的解决方法
URL标题:http://lswzjz.com/article/gooedj.html