The team is facing freezing issues on a compute node with 60 GB RAM and a 1000 GB disk while ingesting a large table via Kafka. Materialized views cannot be declared during processing, and queries creating views are timing out. Rick Otten suggested setting a memory limit on the compute node to prevent OOM errors. Victor Müller mentioned that the issue is causing the node to become unresponsive, not necessarily running out of memory. Eric recommended checking the Troubleshooting and Troubleshoot out-of-memory issues documentation for guidance.
Victor Müller
Asked on Feb 16, 2024
--total-memory-bytes: 8589934592
for 8GB memory limit.