Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data export: memory usage and export location #3150

Open
jonsbun opened this issue Dec 23, 2024 · 2 comments
Open

Data export: memory usage and export location #3150

jonsbun opened this issue Dec 23, 2024 · 2 comments

Comments

@jonsbun
Copy link

jonsbun commented Dec 23, 2024

I have a few questions about CloudBeaver (v24.3.1) data export functionality:

  1. It looks like memory is not released after table export (JAVA_OPTS=-Xmx8g). That leads to OOM during the next data export. I am running CloudBeaver in the Kubernetes environment.
    memory_usage

  2. In DEBUG logs, the export location is set as /tmp/dbeaver/.work-data/data-transfer/124rpl6u8fpbhj4j7xq7b5290_794327ee-efe3-4686-8251-09935a5e80ac.csv. How to set data export location to /opt/cloudbeaver/workspace/.work-data/data-transfer?

@EvgeniaBzzz
Copy link
Contributor

Hi @jonsbun
Thank you for your report, we'll take a look!

To point 2: you can change system property java.io.tmpdir to /opt/cloudbeaver/workspace, but then all temp files will be stored in /opt/cloudbeaver/workspace/dbeaver/.work-data/data-transfer

@dariamarutkina dariamarutkina added this to the 24.3.4 milestone Jan 20, 2025
@dariamarutkina dariamarutkina modified the milestones: 24.3.4, 24.3.5 Feb 3, 2025
@dariamarutkina dariamarutkina removed this from the 24.3.5 milestone Feb 10, 2025
@HocKu7
Copy link
Contributor

HocKu7 commented Mar 10, 2025

Hi @jonsbun.
I do not think the issue is directly related to CloudBeaver. I am inclined to believe that the problem is caused by allocating all available RAM to the Java Heap by setting JAVA_OPTS=-Xmx8g. As a result, the Java application consumed all available memory and crashed with an OutOfMemoryError (OOM). I would recommend setting the maximum heap size to approximately 6GB instead or even less.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants