Large File Uploads Crash Server

Description

Uploading files larger than approximately 55 MB crashes my server.

Although I can reproduce the issue fairy easily on my test server, I haven't found a 100% reliable test case.

I'm trying to test the following theory: Uploading a file that takes roughly the same amount of time to upload as a request timeout causes the problem.

In other words: My request timeout is set to 80s, and it takes ~80s to upload 55 MB worth of a file. Therefore, I theorize that a 55 MB file can trigger the problem.

Wild theory: Maybe if the request times out while copying the file from the temp folder to the destination, then it triggers an instability.

Environment

  • RHEL 6.7 (64-bit)

  • Stock JVM [1.7.0_76 (Oracle Corporation) 64bit]

  • JAVA_OPTS="-Xms1024m -Xmx4096m -XXermSize=256m -XX:MaxPermSize=256m -XX:ReservedCodeCacheSize=128m -XX:+UseParallelGC -Dsun.rmi.dgc.client.gcInterval=300000 -Dsun.rmi.dgc.server.gcInterval=300000 -javaagent:lib/lucee-inst.jar -javaagent:/opt/fusionreactor/instance/vnuchocpdWebLT_Lucee/fusionreactor.jar=name=vnuchocpdWebLT_Lucee,address=8088"

Activity

Show:

Zac Spitzer 26 July 2024 at 10:47

Assuming this is solved by the linked task, closing

Pothys - MitrahSoft 26 June 2024 at 07:46

Still, does this issue happens? because it seems to be fixed. Could you please check this and update here. It'll improve the status of the ticket.

Michael Forell 1 April 2020 at 19:00

From my point of view problems with large uploads still persits.

Although my issues started, when I allowed uploads larger than 1.5GB and smaller than 5GB. I had several crashes and had a look in the heap-dumps.

From what I saw, either was one big file or several smaller ones in the heap that caused the crashes. When I changed the upload limit to 1GB the crashes went away.

Maybe it’s a duplicate of this ticket

I’d really appreciate, if we get a fix for this.

Jamie Jackson 1 April 2020 at 17:44

FYI, I’m not going to be much help in verifying whether the problem still exists. We gave up on Lucee uploads a while ago because of this and bypassed it with a workaround.

However I did some analysis a long time ago and found (through step debugging Lucee core, IIRC) that files over 55MB were treated differently: https://groups.google.com/d/msg/lucee/doo5yazongg/kWXzUK-GDQAJ

Back in the day, I could reproduce the crashes (but not reliably) on certain environments (but not on others). It may have had to do with the amount of load on the server or some other unknown voodoo.

Zac Spitzer 1 April 2020 at 16:25

tried this out, I can upload 1gb files with the latest snapshot

but if I reduce the timeout to just 5s

Fixed

Details

Assignee

Reporter

Priority

Labels

New Issue warning screen

Before you create a new Issue, please post to the mailing list first https://dev.lucee.org

Once the issue has been verified, one of the Lucee team will ask you to file an issue

Affects versions

Created 28 September 2015 at 19:28
Updated 26 July 2024 at 10:47
Resolved 26 July 2024 at 10:47