# Running FoundationDB

**URL:** https://forums.foundationdb.org/c/using-foundationdb/running-foundationdb/17.md?page=1

[Latest](https://forums.foundationdb.org/latest.md) · [Categories](https://forums.foundationdb.org/categories.md) · [Tags](https://forums.foundationdb.org/tags.md)

**Page:** 2

---

## [Smaller memory allocations for stateless pods?](https://forums.foundationdb.org/t/smaller-memory-allocations-for-stateless-pods/4797)

<div class="topic-metadata">

**Author:** [@jon](https://forums.foundationdb.org/u/jon)\
**Replies:** 2\
**Last updated:** [April 10, 2025, 9:12pm UTC](https://forums.foundationdb.org/t/smaller-memory-allocations-for-stateless-pods/4797 "2025-04-10T21:12:35Z")

</div>

We’re building out a new FoundationDB cluster, and I’m thinking about resource allocations after an initial load test. We’re using the FDB Kubernetes Operator and previously ran a load test that handled 100% of our write…

---

## [Significant changes in CPU load on resolver processes depending on placement in a cluster](https://forums.foundationdb.org/t/significant-changes-in-cpu-load-on-resolver-processes-depending-on-placement-in-a-cluster/4800)

<div class="topic-metadata">

**Author:** [@jon](https://forums.foundationdb.org/u/jon)\
**Replies:** 1\
**Last updated:** [March 7, 2025, 4:19pm UTC](https://forums.foundationdb.org/t/significant-changes-in-cpu-load-on-resolver-processes-depending-on-placement-in-a-cluster/4800 "2025-03-07T16:19:56Z")

</div>

With apologies for the now-familiar introduction, we’re evaluating FoundationDB for some new use cases and are doing an initial load test. We’re using the FDB Kubernetes operator in three\_data\_hall configuration; we’re u…

---

## [Containerized networking](https://forums.foundationdb.org/t/containerized-networking/4795)

<div class="topic-metadata">

**Author:** [@czephyr](https://forums.foundationdb.org/u/czephyr)\
**Replies:** 0\
**Last updated:** [March 4, 2025, 6:57pm UTC](https://forums.foundationdb.org/t/containerized-networking/4795 "2025-03-04T18:57:23Z")

</div>

Hello, I’m struggling to understand how the networking works once fdb is running in a container. Lets take this docker-compose.yml as an example services: foundationdb: image: foundationdb/foundationdb:7.3.63 …

---

## [Database reporting not healthy despite having all the processes running](https://forums.foundationdb.org/t/database-reporting-not-healthy-despite-having-all-the-processes-running/4730)

<div class="topic-metadata">

**Author:** [@mpatou\_openai](https://forums.foundationdb.org/u/mpatou_openai)\
**Replies:** 2\
**Last updated:** [February 15, 2025, 7:57pm UTC](https://forums.foundationdb.org/t/database-reporting-not-healthy-despite-having-all-the-processes-running/4730 "2025-02-15T19:57:20Z")

</div>

We used to alert on .client.database\_status.available but we discovered during one incident that this was still reporting as available despite having some shards unavailable and since then we move to .client.database\_sta…

---

## [Option to ipv6 in DNS lookup for backups](https://forums.foundationdb.org/t/option-to-ipv6-in-dns-lookup-for-backups/4114)

<div class="topic-metadata">

**Author:** [@larshagen](https://forums.foundationdb.org/u/larshagen)\
**Replies:** 1\
**Last updated:** [January 13, 2025, 9:53pm UTC](https://forums.foundationdb.org/t/option-to-ipv6-in-dns-lookup-for-backups/4114 "2025-01-13T21:53:05Z")

</div>

I am working on getting our FDB backup in Google Cloud Platform to work directly with Google Cloud Storage, instead of our current setup of using the deprecated Minio gateway. One of our issues is the same as reported i…

---

## [Backuping fdb to a filesystem vs blobstore](https://forums.foundationdb.org/t/backuping-fdb-to-a-filesystem-vs-blobstore/4733)

<div class="topic-metadata">

**Author:** [@mpatou\_openai](https://forums.foundationdb.org/u/mpatou_openai)\
**Replies:** 1\
**Last updated:** [December 18, 2024, 3:41am UTC](https://forums.foundationdb.org/t/backuping-fdb-to-a-filesystem-vs-blobstore/4733 "2024-12-18T03:41:13Z")

</div>

We are using Azure and the azure blobstore is not yet fully supported by the the fdbbackup client (and not supported by the K8s operator). I’m wondering is there any major concerns with backuping up the db to a file sys…

---

## [Storage server spending large amount of CPU time in the network stack](https://forums.foundationdb.org/t/storage-server-spending-large-amount-of-cpu-time-in-the-network-stack/4712)

<div class="topic-metadata">

**Author:** [@mpatou\_openai](https://forums.foundationdb.org/u/mpatou_openai)\
**Replies:** 1\
**Last updated:** [December 7, 2024, 8:27pm UTC](https://forums.foundationdb.org/t/storage-server-spending-large-amount-of-cpu-time-in-the-network-stack/4712 "2024-12-07T20:27:16Z")

</div>

In production in one of our cluster in 7.3.43 (our clusters handle different kind of workload so 1 is not comparable to another) we are seeing a lot of CPU (90% +) used on some storage server. I did some flamegraph profi…

---

## [\\xff\\0x02/blog range is heavily queried](https://forums.foundationdb.org/t/xff-0x02-blog-range-is-heavily-queried/4711)

<div class="topic-metadata">

**Author:** [@mpatou\_openai](https://forums.foundationdb.org/u/mpatou_openai)\
**Replies:** 0\
**Last updated:** [November 26, 2024, 2:50am UTC](https://forums.foundationdb.org/t/xff-0x02-blog-range-is-heavily-queried/4711 "2024-11-26T02:50:21Z")

</div>

We noticed one of our cluster has a set of storage server that are running at very high CPU (\>90%) when the rest is somewhat normal. When I started to look I noticed that one of the hotrange was for the system key. I wr…

---

## [Does FoundationDB support running 1 GRV proxy per zone?](https://forums.foundationdb.org/t/does-foundationdb-support-running-1-grv-proxy-per-zone/4555)

<div class="topic-metadata">

**Author:** [@gm42](https://forums.foundationdb.org/u/gm42)\
**Replies:** 4\
**Last updated:** [November 13, 2024, 2:26pm UTC](https://forums.foundationdb.org/t/does-foundationdb-support-running-1-grv-proxy-per-zone/4555 "2024-11-13T14:26:45Z")

</div>

Hi there :slight\_smile: I am trying to figure out whether it’s possible (or not) to run a cluster configuration with operator where there is 1 GRV proxy on each zone, with the intent of minimizing latency on read-only q…

---

## [Whats the right way of starting a single-node fdb cluster?](https://forums.foundationdb.org/t/whats-the-right-way-of-starting-a-single-node-fdb-cluster/4691)

<div class="topic-metadata">

**Author:** [@janmejay](https://forums.foundationdb.org/u/janmejay)\
**Replies:** 1\
**Last updated:** [November 8, 2024, 5:09pm UTC](https://forums.foundationdb.org/t/whats-the-right-way-of-starting-a-single-node-fdb-cluster/4691 "2024-11-08T17:09:23Z")

</div>

I am new to fdb, and I am trying to bring up a single-node fdb cluster to play with locally. I have tried using the image docker image foundationdb/foundationdb:7.3.55 and building fdb myself and trying to run the serve…

---

## [Check if fdbbackup is running](https://forums.foundationdb.org/t/check-if-fdbbackup-is-running/4675)

<div class="topic-metadata">

**Author:** [@hikouki-gumo](https://forums.foundationdb.org/u/hikouki-gumo)\
**Replies:** 1\
**Last updated:** [November 5, 2024, 11:24am UTC](https://forums.foundationdb.org/t/check-if-fdbbackup-is-running/4675 "2024-11-05T11:24:11Z")

</div>

Hi all, I’m running fdbbackup in continuous mode (start -z). I deploy fdbbackup as a Kubernetes job and sometimes need to redeploy this job. Because there is already a backup in progress (continuous mode), the job will …

---

## [After restarting FoundationDB, the new processes use less memory. Why?](https://forums.foundationdb.org/t/after-restarting-foundationdb-the-new-processes-use-less-memory-why/4664)

<div class="topic-metadata">

**Author:** [@swr](https://forums.foundationdb.org/u/swr)\
**Replies:** 2\
**Last updated:** [October 21, 2024, 6:51pm UTC](https://forums.foundationdb.org/t/after-restarting-foundationdb-the-new-processes-use-less-memory-why/4664 "2024-10-21T18:51:08Z")

</div>

After I restart a machine running FoundationDB, (restarting fdbmonitor via systemd,) the total free memory on the machine increases. What causes fresh FDB processes to use less memory than FDB processes running for a lon…

---

## [What exactly is happening when Replication health is in state "(Re)initializing automatic data distribution"?](https://forums.foundationdb.org/t/what-exactly-is-happening-when-replication-health-is-in-state-re-initializing-automatic-data-distribution/4663)

<div class="topic-metadata">

**Author:** [@swr](https://forums.foundationdb.org/u/swr)\
**Replies:** 0\
**Last updated:** [October 16, 2024, 3:33pm UTC](https://forums.foundationdb.org/t/what-exactly-is-happening-when-replication-health-is-in-state-re-initializing-automatic-data-distribution/4663 "2024-10-16T15:33:40Z")

</div>

The specific scenario I encountered this status in is: FDB cluster is in double redundancy mode, with 3 machines A single machine’s fdbmonitor process is restarted via systemd (restarting that machine’s running fdbserv…

---

## [How would I recover from this failed cluster move?](https://forums.foundationdb.org/t/how-would-i-recover-from-this-failed-cluster-move/4125)

<div class="topic-metadata">

**Author:** [@swr](https://forums.foundationdb.org/u/swr)\
**Replies:** 11\
**Last updated:** [October 16, 2024, 3:12pm UTC](https://forums.foundationdb.org/t/how-would-i-recover-from-this-failed-cluster-move/4125 "2024-10-16T15:12:00Z")

</div>

I attempted to move a development FDB cluster to a new set of machines, and broke the cluster, resulting in data loss. I’d like to understand where I went wrong, and whether it’s possible to recover any of the data. Her…

---

## [What causes a point in time backup to backup slowly?](https://forums.foundationdb.org/t/what-causes-a-point-in-time-backup-to-backup-slowly/4646)

<div class="topic-metadata">

**Author:** [@swr](https://forums.foundationdb.org/u/swr)\
**Replies:** 3\
**Last updated:** [October 15, 2024, 7:24pm UTC](https://forums.foundationdb.org/t/what-causes-a-point-in-time-backup-to-backup-slowly/4646 "2024-10-15T19:24:02Z")

</div>

We’re running FDB on Linux VMs, not with the K8S operator. We initiate a nightly backup using fdbbackup to Amazon S3, and the runtime of this backup is unpredictable. Sometimes the backup takes less than 5 minutes, and …

---

## [The cluster is continuously Restoring replication factor, and Moing data has not decreased](https://forums.foundationdb.org/t/the-cluster-is-continuously-restoring-replication-factor-and-moing-data-has-not-decreased/4652)

<div class="topic-metadata">

**Author:** [@Northwo](https://forums.foundationdb.org/u/Northwo)\
**Replies:** 1\
**Last updated:** [October 10, 2024, 10:05am UTC](https://forums.foundationdb.org/t/the-cluster-is-continuously-restoring-replication-factor-and-moing-data-has-not-decreased/4652 "2024-10-10T10:05:39Z")

</div>

Title: Help needed with replication issues and storage process errors after continuous data writes Description: I have a FoundationDB cluster(7.1.5) with 3 machines. Each machine has four RAID5 volumes, each made up of…

---

## [Cannot restore fdbbackup from one cluster to another](https://forums.foundationdb.org/t/cannot-restore-fdbbackup-from-one-cluster-to-another/3129)

<div class="topic-metadata">

**Author:** [@tangerine](https://forums.foundationdb.org/u/tangerine)\
**Replies:** 1\
**Last updated:** [October 8, 2024, 7:09am UTC](https://forums.foundationdb.org/t/cannot-restore-fdbbackup-from-one-cluster-to-another/3129 "2024-10-08T07:09:45Z")

</div>

Hi, I am trying to test backup and restore from one cluster to another. But I am getting the following error: fdbrestore start -r file:///root/backup/srv/sdc/foundationdb/2022-jan-backups/backup-2022-01-19-16-31-26.02…

---

## [Messed up fdbserver on macos m2 pro](https://forums.foundationdb.org/t/messed-up-fdbserver-on-macos-m2-pro/4629)

<div class="topic-metadata">

**Author:** [@fe3071baac4c314bc238](https://forums.foundationdb.org/u/fe3071baac4c314bc238)\
**Replies:** 1\
**Last updated:** [September 23, 2024, 10:51am UTC](https://forums.foundationdb.org/t/messed-up-fdbserver-on-macos-m2-pro/4629 "2024-09-23T10:51:59Z")

</div>

Hi. I downloaded a new version of fdb through github releases (7.3.42) without fully uninstalling the previous one. fdbmonitor boots fine, so does fdbcli, but it seems that fdbserver “hangs”. The problem is relatively …

---

## [How to recover FDB data based on cloud disk data](https://forums.foundationdb.org/t/how-to-recover-fdb-data-based-on-cloud-disk-data/4620)

<div class="topic-metadata">

**Author:** [@418572](https://forums.foundationdb.org/u/418572)\
**Replies:** 4\
**Last updated:** [September 20, 2024, 9:17am UTC](https://forums.foundationdb.org/t/how-to-recover-fdb-data-based-on-cloud-disk-data/4620 "2024-09-20T09:17:22Z")

</div>

Using cluster file \`/mnt/config-volume/cluster-file’. The database is unavailable; type \`status’ for more information. Welcome to the fdbcli. For help, type \`help’. fdb\> status “We are currently facing an urgent issu…

---

## [Foundationdb segment scan](https://forums.foundationdb.org/t/foundationdb-segment-scan/4609)

<div class="topic-metadata">

**Author:** [@vivan](https://forums.foundationdb.org/u/vivan)\
**Replies:** 0\
**Last updated:** [September 11, 2024, 11:48am UTC](https://forums.foundationdb.org/t/foundationdb-segment-scan/4609 "2024-09-11T11:48:01Z")

</div>

How can foundationdb support shard scanning? As the underlying database, I want to use a stateless client to interact with foundationdb. Through this client, I can write fdb KV with a special prefix. However, when I want…

---

## [TLS Mixed Cluster v7.3](https://forums.foundationdb.org/t/tls-mixed-cluster-v7-3/4587)

<div class="topic-metadata">

**Author:** [@behos](https://forums.foundationdb.org/u/behos)\
**Replies:** 0\
**Last updated:** [August 20, 2024, 11:51am UTC](https://forums.foundationdb.org/t/tls-mixed-cluster-v7-3/4587 "2024-08-20T11:51:20Z")

</div>

Hello :wave: I am trying to follow the steps for migrating a FoundationDB cluster from non-TLS to TLS and I’m having some strange issues on basically the first step: In order to have both TLS and non-TLS ports listenin…

---

## [What types of FDB backups are point-in-time restorable?](https://forums.foundationdb.org/t/what-types-of-fdb-backups-are-point-in-time-restorable/4565)

<div class="topic-metadata">

**Author:** [@swr](https://forums.foundationdb.org/u/swr)\
**Replies:** 2\
**Last updated:** [July 23, 2024, 2:17pm UTC](https://forums.foundationdb.org/t/what-types-of-fdb-backups-are-point-in-time-restorable/4565 "2024-07-23T14:17:02Z")

</div>

I’ve been poring over the FoundationDB backup/restore documentation, and I have a few questions. Are all of my assumptions here correct? When performing a continuous backup, the mutation log contains all mutations sin…

---

## [Optimizing FoundationDB Performance for Large-Scale Data Processing](https://forums.foundationdb.org/t/optimizing-foundationdb-performance-for-large-scale-data-processing/4531)

<div class="topic-metadata">

**Author:** [@tam](https://forums.foundationdb.org/u/tam)\
**Replies:** 1\
**Last updated:** [July 4, 2024, 7:19am UTC](https://forums.foundationdb.org/t/optimizing-foundationdb-performance-for-large-scale-data-processing/4531 "2024-07-04T07:19:32Z")

</div>

Hey guys! :smiling\_face\_with\_three\_hearts: I am neck-deep in a project wrangling terabytes of data with FoundationDB, and I’m hitting some walls when it comes to optimizing performance. Any insights or battle-tested ad…

---

## [Incorrect clusterfile coordinators when using three\_data\_hall?](https://forums.foundationdb.org/t/incorrect-clusterfile-coordinators-when-using-three-data-hall/4493)

<div class="topic-metadata">

**Author:** [@gm42](https://forums.foundationdb.org/u/gm42)\
**Replies:** 12\
**Last updated:** [July 4, 2024, 7:14am UTC](https://forums.foundationdb.org/t/incorrect-clusterfile-coordinators-when-using-three-data-hall/4493 "2024-07-04T07:14:15Z")

</div>

I am using a three\_data\_hall cluster composed of 3 halls, 1 per AZ: apiVersion: apps.foundationdb.org/v1beta2 kind: FoundationDBCluster metadata: name: my-cluster-$az namespace: my-ns spec: version: 7.3.27 skip:…

---

## [Debugging high latency in toy cluster](https://forums.foundationdb.org/t/debugging-high-latency-in-toy-cluster/4406)

<div class="topic-metadata">

**Author:** [@rbkrabbe](https://forums.foundationdb.org/u/rbkrabbe)\
**Replies:** 3\
**Last updated:** [May 28, 2024, 8:22am UTC](https://forums.foundationdb.org/t/debugging-high-latency-in-toy-cluster/4406 "2024-05-28T08:22:02Z")

</div>

Hi, I’m evaluating FoundationDB for an upcoming project, and I’m seeing way higher latencies than I would expect on writes. I’m running a 5 node cluster in a local Kubernetes cluster using Kind. The cluster is using a …

---

## [Tenant required\_experimental not permitted](https://forums.foundationdb.org/t/tenant-required-experimental-not-permitted/4446)

<div class="topic-metadata">

**Author:** [@newhook](https://forums.foundationdb.org/u/newhook)\
**Replies:** 0\
**Last updated:** [April 20, 2024, 12:46am UTC](https://forums.foundationdb.org/t/tenant-required-experimental-not-permitted/4446 "2024-04-20T00:46:34Z")

</div>

A transition from disabled or optional to required does not seem to be permitted. That also seems to supported from a reading of the code and the tests cases. How are you supposed to initialize required tenant mode? T…

---

## [The relationship between uniform distribution of data and the number of storage units](https://forums.foundationdb.org/t/the-relationship-between-uniform-distribution-of-data-and-the-number-of-storage-units/4435)

<div class="topic-metadata">

**Author:** [@vivan](https://forums.foundationdb.org/u/vivan)\
**Replies:** 4\
**Last updated:** [April 19, 2024, 2:51am UTC](https://forums.foundationdb.org/t/the-relationship-between-uniform-distribution-of-data-and-the-number-of-storage-units/4435 "2024-04-19T02:51:28Z")

</div>

In our testing, we found that the data cannot be evenly distributed onto the disks, leading to some disks being excessively utilized, resulting in abnormal cluster states. I want to know if adding more storage can make t…

---

## [Maximum file size on ext4](https://forums.foundationdb.org/t/maximum-file-size-on-ext4/4420)

<div class="topic-metadata">

**Author:** [@agill](https://forums.foundationdb.org/u/agill)\
**Replies:** 4\
**Last updated:** [April 18, 2024, 12:10am UTC](https://forums.foundationdb.org/t/maximum-file-size-on-ext4/4420 "2024-04-18T00:10:33Z")

</div>

Hello, Is it possible for the storage or tlog server to encounter a condition wherein it can exceed the maximum file size on ext4, i.e., 16TiB? In other words, assuming it grew to this size and failed with an I/O error,…

---

## [Nodes not joining cluster, \`coordinators auto\` hanging](https://forums.foundationdb.org/t/nodes-not-joining-cluster-coordinators-auto-hanging/4380)

<div class="topic-metadata">

**Author:** [@danthegoodman](https://forums.foundationdb.org/u/danthegoodman)\
**Replies:** 3\
**Last updated:** [March 10, 2024, 2:21pm UTC](https://forums.foundationdb.org/t/nodes-not-joining-cluster-coordinators-auto-hanging/4380 "2024-03-10T14:21:09Z")

</div>

I’ve created 2 ubuntu machines on hetzner cloud with port 4500 open. I installed the 7.3.27-1 client then server on each, and ran the make\_public script on one server. I copied that cluster file to the other server, rep…

---

## [FoundationDb stucked excluding a node](https://forums.foundationdb.org/t/foundationdb-stucked-excluding-a-node/4371)

<div class="topic-metadata">

**Author:** [@COran](https://forums.foundationdb.org/u/COran)\
**Replies:** 0\
**Last updated:** [February 28, 2024, 3:38pm UTC](https://forums.foundationdb.org/t/foundationdb-stucked-excluding-a-node/4371 "2024-02-28T15:38:25Z")

</div>

Hi, We have a weird situation where some of our FoundationDb clusters are stucked to exclude a node. Here the symptoms after excluding a node : the moving\_data.in\_flight\_bytes is plateauing for hours during the time w…

[Previous page](https://forums.foundationdb.org/c/using-foundationdb/running-foundationdb/17.md)

[Next page](https://forums.foundationdb.org/c/using-foundationdb/running-foundationdb/17.md?page=2)
