Getting started with 7.3.x on macos

Hi all,

I’m following along with the getting started guide and am on an M1 Mac using macos 13.4

After installing the package FoundationDB-7.3.4_arm64.pkg I can see the processes running but fdbcli reports The database is unavailable. If I issue the status command then I get Could not communicate with a quorum of coordination servers along with the host/port being unreachable.

Looking at foundationdb.conf and fdb.cluster seems fine so I’m not sure where to start in troubleshooting here. Any tips would be appreciated!

Edit: adding that running lsof -PiTCP -sTCP:LISTEN does not show the port despite ps aux showing a process for:
/usr/local/libexec/fdbserver --cluster-file /usr/local/etc/foundationdb/fdb.cluster --datadir /usr/local/foundationdb/data/4689 --listen-address

Try to create new database
configure new single ssd

Thanks for the quick reply.
I should have added that I tried that previously and this is what I get:

WARNING: Long delay (Ctrl-C to interrupt)

The database is unavailable; type `status' for more information.

Show output for status details

fdb> status details

Using cluster file `/usr/local/etc/foundationdb/fdb.cluster'.

Could not communicate with a quorum of coordination servers:
  127.0.0.1:4689  (unreachable)

As mentioned, I can see the three processes running but nothing is actively listening on port 4689 on this machine. foundationdb.conf and fdb.cluster are default as below.

foundationdb.conf

## foundationdb.conf
##
## Configuration file for FoundationDB server processes
## Full documentation is available at
## https://apple.github.io/foundationdb/configuration.html#the-configuration-file

[general]
restart-delay = 60
## by default, restart-backoff = restart-delay-reset-interval = restart-delay
# initial-restart-delay = 0
# restart-backoff = 60
# restart-delay-reset-interval = 60
cluster-file = /usr/local/etc/foundationdb/fdb.cluster
# kill-on-configuration-change = true

## Default parameters for individual fdbserver processes
[fdbserver]
command = /usr/local/libexec/fdbserver
public-address = auto:$ID
listen-address = public
datadir = /usr/local/foundationdb/data/$ID
logdir = /usr/local/foundationdb/logs
# logsize = 10MiB
# maxlogssize = 100MiB
# machine-id =
# datacenter-id =
# class =
# memory = 8GiB
# storage-memory = 1GiB
# cache-memory = 2GiB
# metrics-cluster =
# metrics-prefix =

## An individual fdbserver process with id 4689
## Parameters set here override defaults from the [fdbserver] section
[fdbserver.4689]

[backup_agent]
command = /usr/local/foundationdb/backup_agent/backup_agent
logdir = /usr/local/foundationdb/logs

[backup_agent.1]

fdb.cluster

[redacted]:[redacted]@127.0.0.1:4689

For extra info, here’s the trace output during process start. I’ve only included the section where it attempts to connect and fails. The same sequence then repeats itself continuously.

<Event Severity="10" Time="1687508030.430788" DateTime="2023-06-23T08:13:50Z" Type="Net2Starting" ID="0000000000000000" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" />
<Event Severity="10" Time="1687508030.431819" DateTime="2023-06-23T08:13:50Z" Type="ProgramStart" ID="0000000000000000" SourceVersion="b8c8342654ee5c6809095cb249fa11ab61c71d3b" Version="7.3.4" PackageName="7.3" ActualTime="1687508030" CommandLine="/usr/local/foundationdb/backup_agent/backup_agent --cluster-file=/usr/local/etc/foundationdb/fdb.cluster --logdir=/usr/local/foundationdb/logs" MemoryLimit="8589934592" ThreadID="3845582435253558139" TrackLatestType="Original" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" />
<Event Severity="10" Time="1687508030.431534" DateTime="2023-06-23T08:13:50Z" Type="ClientStart" ID="0000000000000000" SourceVersion="b8c8342654ee5c6809095cb249fa11ab61c71d3b" Version="7.3.4" PackageName="7.3" ActualTime="1687508030" ApiVersion="730" ClientLibrary="/usr/local/foundationdb/backup_agent/backup_agent" ImageOffset="0x104efc000" Primary="1" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" TrackLatestType="Original" />
<Event Severity="10" Time="1687508030.431534" DateTime="2023-06-23T08:13:50Z" Type="Net2TLSConfig" ID="0000000000000000" CAPath="" CertificatePath="" KeyPath="" HasPassword="0" VerifyPeers="Check.Valid=1" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" />
<Event Severity="10" Time="1687508030.431534" DateTime="2023-06-23T08:13:50Z" Type="NotifyAddressHealthy" ID="0000000000000000" SuppressedEventCount="0" Address="127.0.0.1:4689" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" />
<Event Severity="10" Time="1687508030.431534" DateTime="2023-06-23T08:13:50Z" Type="DatabaseContextCreated" ID="52c8bef042a839fa" Backtrace="atos -o backup_agent.debug -arch x86_64 -l 0x104efc000 0x105d1e074 0x1053f2a9c 0x105405a18 0x104f107b4 0x104f1474c 0x1a7ebff28" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" />
<Event Severity="10" Time="1687508030.431534" DateTime="2023-06-23T08:13:50Z" Type="ConnectToDatabase" ID="52c8bef042a839fa" Version="7.3.4" ClusterFile="file:///usr/local/etc/foundationdb/fdb.cluster" ConnectionString="[redacted]:[redacted]@127.0.0.1:4689" ClientLibrary="/usr/local/foundationdb/backup_agent/backup_agent" Primary="1" Internal="1" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" TrackLatestType="Original" />
<Event Severity="10" Time="1687508030.431534" DateTime="2023-06-23T08:13:50Z" Type="CodeCoverage" ID="0000000000000000" File="fdbclient/ReadYourWrites.actor.cpp" Line="1632" Condition="true" Covered="1" Comment="ReadYourWritesTransaction::get" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" />
<Event Severity="10" Time="1687508030.431534" DateTime="2023-06-23T08:13:50Z" Type="Net2Running" ID="0000000000000000" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" />
<Event Severity="10" Time="1687508030.431534" DateTime="2023-06-23T08:13:50Z" Type="ProcessTimeOffset" ID="0000000000000000" ProcessTime="1687508030.433908" SystemTime="1687508030.433908" OffsetFromSystemTime="0.000000" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" />
<Event Severity="10" Time="1687508030.433962" DateTime="2023-06-23T08:13:50Z" Type="ConnectingTo" ID="0000000000000000" SuppressedEventCount="0" PeerAddr="127.0.0.1:4689" PeerReferences="3" FailureStatus="OK" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" />
<Event Severity="10" Time="1687508030.433962" DateTime="2023-06-23T08:13:50Z" Type="TaskBucketMetrics" ID="59cf995a33f0fca8" Elapsed="0" DispatchSlotChecksStarted="0 -1 0" DispatchErrors="0 -1 0" DispatchDoTasks="0 -1 0" DispatchEmptyTasks="0 -1 0" DispatchSlotChecksComplete="0 -1 0" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" />
<Event Severity="20" Time="1687508030.433962" DateTime="2023-06-23T08:13:50Z" Type="N2_ConnectError" ID="87c4b2db27eb066a" SuppressedEventCount="0" ErrorCode="61" Message="Connection refused" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" />
<Event Severity="10" Time="1687508030.433962" DateTime="2023-06-23T08:13:50Z" Type="ConnectionTimedOut" ID="0000000000000000" SuppressedEventCount="0" PeerAddr="127.0.0.1:4689" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" />
<Event Severity="10" Time="1687508030.433962" DateTime="2023-06-23T08:13:50Z" Type="ConnectionClosed" ID="0000000000000000" Error="connection_failed" ErrorDescription="Network connection failed" ErrorCode="1026" SuppressedEventCount="0" PeerAddr="127.0.0.1:4689" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" />
<Event Severity="10" Time="1687508030.433962" DateTime="2023-06-23T08:13:50Z" Type="MonitorProxiesConnectFailed" ID="0000000000000000" Error="request_maybe_delivered" Coordinator="127.0.0.1:4689" ThreadID="3845582435253558139" Machine="127.0.0.1:29625" LogGroup="default" ClientDescription="primary-7.3.4-9893010054083035221" />

FWIW I’m experiencing the exact same issue (found this via search).

1 Like

I have the same issue as well. In fact, I am unable to get a working configuration at all on my M2. I documented my experience here: