依赖

<dependency>
   <groupId>org.springframework.boot</groupId>
   <artifactId>spring-boot-starter-data-elasticsearch</artifactId>
</dependency>

报错

Caused by: org.apache.http.ContentTooLongException: entity content is too long [143914703] for the configured buffer limit [104857600]
	at org.elasticsearch.client.HeapBufferedAsyncResponseConsumer.onEntityEnclosed(HeapBufferedAsyncResponseConsumer.java:76)
	at org.apache.http.nio.protocol.AbstractAsyncResponseConsumer.responseReceived(AbstractAsyncResponseConsumer.java:137)
	at org.apache.http.impl.nio.client.MainClientExec.responseReceived(MainClientExec.java:315)
	at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.responseReceived(DefaultClientExchangeHandlerImpl.java:151)
	at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.responseReceived(HttpAsyncRequestExecutor.java:315)
	at org.apache.http.impl.nio.DefaultNHttpClientConnection.consumeInput(DefaultNHttpClientConnection.java:255)
	at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:81)
	at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:39)
	at org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:114)
	at org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:162)
	at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:337)
	at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315)
	at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:276)
	at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
	at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
	at java.lang.Thread.run(Thread.java:748)

报错原因

[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-NXGHY2dx-1618848247954)(87AD3BA521154555ABF66CAFD2B426E4)]

[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-T7qdvOc9-1618848247956)(18BAA571CDA140318386176DBE2C6CFC)]

在ElasticsearchRestTemplate中使用了RequestIOptions.DEFAULT

[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-8ruDUCwo-1618848247957)(AE6C362F09BF493C9DD94AA04FD7D244)]

[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-JpnLOyHw-1618848247958)(E74476BBAC53491E86531ACA80A325DE)]

解决办法

查看了源码HttpAsyncResponseConsumerFactory是没有通过Spring容器注入的,所以没办法通过声明Bean来覆盖,那么我想到的办法是通过反射来修改RequestIOptions中的HttpAsyncResponseConsumerFactory

因为我的项目使用的是SpringMVC,那么我可以在运行时来修改,即第一次接口调用的时候来修改,这个时候相关的类已经全部加载完毕。那么我可以使用SpringMVC的拦截器HandleInceptor的preHandle()

以下就为我的配置,修改最大每次查询上限为300MB

@Configuration
public class MvcConfig implements WebMvcConfigurer {
    @Override
    public void addInterceptors(InterceptorRegistry registry) {
        //设置ElasticsearchRestTemplate查询的最大值为300MB 默认为100MB
        registry.addInterceptor(new HandlerInterceptor() {
            private boolean isSetBuffer = false;

            @Override
            public boolean preHandle(HttpServletRequest request, HttpServletResponse response, Object handler) throws Exception {
                //已经设置过
                if (isSetBuffer) {
                    return true;
                }
                //设置es查询buffer大小
                RequestOptions requestOptions = RequestOptions.DEFAULT;
                Class<? extends RequestOptions> aClass = requestOptions.getClass();
                Field aDefault = aClass.getDeclaredField("httpAsyncResponseConsumerFactory");
                aDefault.setAccessible(true);
                //去除final
                Field modifiersField = Field.class.getDeclaredField("modifiers");
                modifiersField.setAccessible(true);
                modifiersField.setInt(aDefault, aDefault.getModifiers() & ~Modifier.FINAL);

                //设置默认的工厂
                aDefault.set(requestOptions, new HttpAsyncResponseConsumerFactory() {
                    /**
                     * Creates the {@link HttpAsyncResponseConsumer}, called once per request attempt.
                     */
                    @Override
                    public HttpAsyncResponseConsumer<HttpResponse> createHttpAsyncResponseConsumer() {
                        //300MB
                        return new HeapBufferedAsyncResponseConsumer(3 * 100 * 1024 * 1024);
                    }
                });
                //标记
                isSetBuffer = true;

                return true;
            }
        });
    }
}
Logo

为开发者提供学习成长、分享交流、生态实践、资源工具等服务,帮助开发者快速成长。

更多推荐