发表新帖
发表新帖

上传图片报错：Too many open files

Blade 未结
关注 举报
1 247
xuan0xuan00
xuan0xuan00 剑圣 2023-04-27 15:10

一、该问题的重现步骤是什么？

1. 不太好容易复现

2. resource服务可以正常使用2~3天，之后所有文件都会上传失败

3.系统不能上传文件后，jar包内存和cpu正常，不像内存泄露

二、你期待的结果是什么？实际看到的又是什么？


三、你正在使用的是什么产品，什么版本？在什么操作系统上？

bladex微服务版，3.0.1版本   linux服务器

四、请提供详细的错误堆栈信息，这很重要。


五、若有更多详细信息，请在下面提供。

org.springframework.web.multipart.MultipartException: Failed to parse multipart servlet request; nested exception is java.lang.RuntimeException: java.nio.file.FileSystemException: /www/MovingSource_tmp/undertow5282707552161694231upload: Too many open files

at org.springframework.web.multipart.support.StandardMultipartHttpServletRequest.handleParseFailure(StandardMultipartHttpServletRequest.java:124)

at org.springframework.web.multipart.support.StandardMultipartHttpServletRequest.parseRequest(StandardMultipartHttpServletRequest.java:115)

at org.springframework.web.multipart.support.StandardMultipartHttpServletRequest.(StandardMultipartHttpServletRequest.java:88)

at org.springframework.web.multipart.support.StandardServletMultipartResolver.resolveMultipart(StandardServletMultipartResolver.java:122)

at org.springframework.web.servlet.DispatcherServlet.checkMultipart(DispatcherServlet.java:1205)

at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1039)

at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:963)

at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)

at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:517)

at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:584)

at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:74)

at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:129)

at com.github.xiaoymin.knife4j.spring.filter.ProductionSecurityFilter.doFilter(ProductionSecurityFilter.java:45)

at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)

at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)

at org.springblade.core.log.filter.LogTraceFilter.doFilter(LogTraceFilter.java:39)

at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)

at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)

at org.springblade.core.boot.request.BladeRequestFilter.doFilter(BladeRequestFilter.java:58)

at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)

at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)

at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)

at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)

at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)

at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)

at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93)

at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)

at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)

at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)

at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96)

at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)

at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)

at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)

at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)

at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)

at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)

at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)

at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84)

at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62)

at io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68)

at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36)

at io.undertow.servlet.handlers.RedirectDirHandler.handleRequest(RedirectDirHandler.java:68)

at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:117)

at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57)

at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)

at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46)

at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64)

at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60)

at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77)

at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43)

at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)

at io.undertow.servlet.handlers.SendErrorPageHandler.handleRequest(SendErrorPageHandler.java:52)

at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)

at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:275)

at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:79)

at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:134)

at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:131)

at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48)

at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43)

at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:255)

at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:79)

at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:100)

at io.undertow.server.Connectors.executeRootHandler(Connectors.java:387)

at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:852)

at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)

at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:2019)

at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1558)

at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1449)

at org.xnio.XnioWorker$WorkerThreadFactory$1$1.run(XnioWorker.java:1282)

at java.lang.Thread.run(Thread.java:745)

Caused by: java.lang.RuntimeException: java.nio.file.FileSystemException: /www/MovingSource_tmp/undertow5282707552161694231upload: Too many open files

at io.undertow.server.handlers.form.MultiPartParserDefinition$MultiPartUploadHandler.beginPart(MultiPartParserDefinition.java:299)

at io.undertow.util.MultipartParser$ParseState.headerName(MultipartParser.java:208)

at io.undertow.util.MultipartParser$ParseState.parse(MultipartParser.java:123)

at io.undertow.server.handlers.form.MultiPartParserDefinition$MultiPartUploadHandler.parseBlocking(MultiPartParserDefinition.java:235)

at io.undertow.servlet.spec.HttpServletRequestImpl.parseFormData(HttpServletRequestImpl.java:857)

at io.undertow.servlet.spec.HttpServletRequestImpl.loadParts(HttpServletRequestImpl.java:583)

at io.undertow.servlet.spec.HttpServletRequestImpl.getParts(HttpServletRequestImpl.java:534)

at javax.servlet.http.HttpServletRequestWrapper.getParts(HttpServletRequestWrapper.java:317)

at org.springframework.web.multipart.support.StandardMultipartHttpServletRequest.parseRequest(StandardMultipartHttpServletRequest.java:95)

... 70 more

Caused by: java.nio.file.FileSystemException: /www/MovingSource_tmp/undertow5282707552161694231upload: Too many open files

at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91)

at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)

at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)

at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)

at java.nio.file.Files.newByteChannel(Files.java:361)

at java.nio.file.Files.createFile(Files.java:632)

at java.nio.file.TempFileHelper.create(TempFileHelper.java:138)

at java.nio.file.TempFileHelper.createTempFile(TempFileHelper.java:161)

at java.nio.file.Files.createTempFile(Files.java:852)

at io.undertow.server.handlers.form.MultiPartParserDefinition$MultiPartUploadHandler.beginPart(MultiPartParserDefinition.java:292)

... 78 more


1条回答
  • admin - BladeX作者
    2023-04-27 18:31

    参考这个试试：https://sns.bladex.cn/article-14995.html

    作者追问:2023-04-28 10:40

    这个方法已经尝试过了，没有用。这个帖子是解决找不到临时文件。

    我这边的异常情况是Too many open files。核心代码我们都没有动过。

    回答: 2023-04-28 11:07

    请问用的是minio么？有可能minio的新版驱动，把流的自动关闭取消掉了，可能要自行关闭，你参考这个新的写法试试。

    下载bladex-tool，修改对应源码，然后执行mvn clean install把修改安装到本地，再跑跑看有没有问题。还有个临时的解决办法就是提高linux ulimit的值，先提高后让他报错时间延长，等问题解决再重新部署。

    @SneakyThrows
public BladeFile putFile(String bucketName, String fileName, InputStream stream, String contentType) {
   makeBucket(bucketName);
   String originalName = fileName;
   fileName = getFileName(fileName);
   try {
      client.putObject(
         PutObjectArgs.builder()
            .bucket(getBucketName(bucketName))
            .object(fileName)
            .stream(stream, stream.available(), -1)
            .contentType(contentType)
            .build()
      );
   } catch (Exception e) {
      e.printStackTrace();
   } finally {
      try {
         if (stream != null) {
            stream.close();
         }
      } catch (Exception e) {
         e.printStackTrace();
      }
   }
   BladeFile file = new BladeFile();
   file.setOriginalName(originalName);
   file.setName(fileName);
   file.setDomain(getOssHost(bucketName));
   file.setLink(fileLink(bucketName, fileName));
   return file;
}


    image.png

    作者追问:2023-04-28 14:35

    提高linux ulimit的值治标不治本，我先把代码改一下，看看情况再说

    作者追问:2023-04-28 14:36

    忘记讲了，是minio

    0 讨论(0)
 看不清?
提交回复
官方产品
BladeX 企业级开发平台 BladeX 可视化数据大屏
官方推荐
阿里云服务器限时1折优惠
热议问题
BladeX 企业版3.1.1.RELEASE 支持人大金仓数据库吗？ 1
Table 'dx_order_bonus.flw_channel_definition' doesn't exist 1
Blade-boot 3.4.0版本集成blade-workflow-boot插件出现swgger V3依赖缺失 1
租户登录需要输入租户ID 1
BladeX微服务如何指定NACOS新建的命名空间的YAML配置 2
微服务中如何启用本地文件存储？ 1
角色管理-权限设置报错 1
调用腾讯SMS服务启动项目TencentSmsTemplate in your configuration. 1
日志级别：response日志过大，如何取消response日志打印？ 2
关于BladeX-Tool等工程的依赖需要进行Token令牌认证下载 1
layui

扫一扫访问 Blade技术社区 移动端

Blade技术社区 2024 © 上海布雷德科技有限公司 沪ICP备2023009528号-1 苏公网安备 32041102000998号