Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to control the upload file's size in S3 #39

Open
grontorino opened this issue Jun 19, 2020 · 1 comment
Open

How to control the upload file's size in S3 #39

grontorino opened this issue Jun 19, 2020 · 1 comment
Labels
question Further information is requested

Comments

@grontorino
Copy link

I'm confused how to set the Chunk_size to control the upload file size, it's seems not work after modify INPUT or SERVICE.
No matter how I modify the Buffer_Size or Buffer_Chunk_Size, the uploaded file size is still about 540Kb. Is there any other way?

2020-06-19 07:42:53     546653 20200619074252.log.gz
2020-06-19 07:42:55     547130 20200619074254.log.gz
2020-06-19 07:42:56     547566 20200619074255.log.gz
2020-06-19 07:42:57     548861 20200619074256.log.gz
2020-06-19 07:42:58     282101 20200619074257.log.gz

Here is my config:

[SERVICE]
    Flush        300
    Daemon       Off
    Log_Level    warning
    HTTP_Server  On
    HTTP_Listen  0.0.0.0
    HTTP_Port    2020
    
    #log_Level                 info
    #storage.path              /var/log/
    #storage.sync              normal
    #storage.checksum          off
    #storage.backlog.mem_limit 200M

[INPUT]
    Name forward
    Host 0.0.0.0
    #storage.type  filesystem
    Buffer_Size 200M
    Buffer_Chunk_Size  10M
@cosmo0920
Copy link
Owner

For golang plugin, there is no way to control emitting size.
Could you send your feature request to fluent-bit-go repository?

@cosmo0920 cosmo0920 added the question Further information is requested label Jun 20, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants