Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Lucee Calls the S3 API Twice for directoryList("myS3Path")

Description

Looking at FusionReactor, `directoryList(inboundPath, false, "query")` results in two GET requests to the S3 API.

Time

Date

HTTP

Ex. Time

URI

10:27:42.906

01/06/2020

HTTPClient/GET

2.49s

https://files.mysite.com.s3.amazonaws.com:443/?max-keys=10&prefix=private/reports/inbound&delimiter=,

10:27:47.593 AM

01/06/2020

HTTPClient/GET

4.66s

https://files.mysite.com.s3.amazonaws.com:443/?max-keys=1000&prefix=private/reports/inbound&delimiter=,

Performance can get get especially bad for large buckets with lots of files. (It doesn't matter if the folder/prefix, itself, is empty; S3 must have to deal with all files and whittle them down with the prefix filter.) I have seen each request of the pair take 8 seconds a piece.

There's probably nothing to be done about the performance of a single API call, but why does Lucee perform two calls when I can accomplish the same with one?

Environment

None

Attachments

1
  • 06 Jan 2020, 04:05 pm

Activity

Show:

Jamie Jackson 25 November 2022 at 22:12

Might this get fixed along with recent move way from jets3t in the S3 extension?

Michael Offner 13 January 2020 at 14:40

i know that this is not done by accident, there is a reason for that, but i need to check the code to get back the memory.

Pothys - MitrahSoft 9 January 2020 at 13:41

I've checked this ticket & confirmed the issue happened on lucee as you said and made a test with ACF. ACF doesn't do this, it returns only one call when we check with that s3.
will confirm about this issue.

Details

Assignee

Reporter

Priority

Labels

New Issue warning screen

Before you create a new Issue, please post to the mailing list first https://dev.lucee.org

Once the issue has been verified, one of the Lucee team will ask you to file an issue

Affects versions

Created 6 January 2020 at 16:27
Updated 25 November 2022 at 22:12

Flag notifications