Hi
I have a single server foundationdb 6.2.28-1 cluster on Ubuntu 18.4.
I have been using this database for development and now I would like to migrate my data to a new server.
I have been trying to run a backup – and I don’t know why it is not working.
fdbbackup start -d file:///home/ovhdeploy/mybackups/ -t a2 --log
I do not see any data file or directory in the target folder. what am I doing wrong ? How do I get a simple backup ? What am I missing ?
My foundationdb conf file looks like this:
## foundationdb.conf
##
## Configuration file for FoundationDB server processes
## Full documentation is available at
## https://apple.github.io/foundationdb/configuration.html#the-configuration-file
[fdbmonitor]
user = foundationdb
group = foundationdb
[general]
restart_delay = 60
## by default, restart_backoff = restart_delay_reset_interval = restart_delay
# initial_restart_delay = 0
# restart_backoff = 60
# restart_delay_reset_interval = 60
cluster_file = /etc/foundationdb/fdb.cluster
# delete_envvars =
# kill_on_configuration_change = true
## Default parameters for individual fdbserver processes
[fdbserver]
command = /usr/sbin/fdbserver
public_address = auto:$ID
listen_address = public
datadir = /var/lib/foundationdb/data/$ID
logdir = /var/log/foundationdb
# logsize = 10MiB
# maxlogssize = 100MiB
# machine_id =
# datacenter_id =
# class =
# memory = 8GiB
# storage_memory = 1GiB
# cache_memory = 2GiB
# metrics_cluster =
# metrics_prefix =
## An individual fdbserver process with id 4500
## Parameters set here override defaults from the [fdbserver] section
[fdbserver.4500]
[backup_agent]
command = /usr/lib/foundationdb/backup_agent/backup_agent
logdir = /var/log/foundationdb
cluster_file = /etc/foundationdb/fdb.cluster
[backup_agent.1]
My fdbclistatus
Using cluster file `/etc/foundationdb/fdb.cluster’.
Configuration:
Redundancy mode - single
Storage engine - memory-2
Coordinators - 1
Usable Regions - 1
Cluster:
FoundationDB processes - 1
Zones - 1
Machines - 1
Memory availability - 3.8 GB per process on machine with least available
>>>>> (WARNING: 4.0 GB recommended) <<<<<
Fault Tolerance - 0 machines
Server time - 05/11/21 15:15:43
Data:
Replication health - Healthy
Moving data - 0.000 GB
Sum of key-value sizes - 51 MB
Disk space used - 667 MB
Operating space:
Storage server - 0.8 GB free on most full server
Log server - 74.4 GB free on most full server
Workload:
Read rate - 46 Hz
Write rate - 30 Hz
Transactions started - 18 Hz
Transactions committed - 3 Hz
Conflict rate - 1 Hz
Backup and DR:
Running backups - 5
Running DRs - 0
Running backup tags:
a1 - 9ba38df648500568a091e60965bc0031
a11 - 5f9a2766e9ec0b3250e9fd9979efcf13
a2 - bb240a13795dd34551ff5a90dee4167a
a3 - 435cd027beeda8b39e076b34c9589261
local1 - f3d96325be0a72ae7ca8b65bdc8a8600
Process performance details:
51.81.82.209:4500 ( 4% cpu; 3% machine; 0.000 Gbps; 0% disk IO; 0.7 GB / 3.8 GB RAM )
Coordination servers:
51.81.82.209:4500 (reachable)
g
I ran the fdbbackup command with -log option. Here is the trace log
<?xml version="1.0"?>
<Trace>
<Event Severity="10" Time="1620680495.136356" Type="Net2Starting" ID="0000000000000000" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.136898" Type="ProgramStart" ID="0000000000000000" SourceVersion="569ab46bf638cd0bfc86f192b724c9217e090760" Version="6.2.28" PackageName="6.2" ActualTime="1620680495" CommandLine="fdbbackup start -d file:///home/ovhdeploy/mybackups/ -t a11 --log" MemoryLimit="8589934592" TrackLatestType="Original" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.136391" Type="ClientStart" ID="0000000000000000" SourceVersion="569ab46bf638cd0bfc86f192b724c9217e090760" Version="6.2.28" PackageName="6.2" ClusterFile="/etc/foundationdb/fdb.cluster" ConnectionString="nT04Z470:MYeQWuan@51.81.82.209:4500" ActualTime="1620680495" ApiVersion="-1" ImageOffset="(nil)" Machine="51.81.82.209:20040" LogGroup="default" TrackLatestType="Original" />
<Event Severity="10" Time="1620680495.136391" Type="MachineLoadDetail" ID="0000000000000000" User="16029683" Nice="571403" System="5537761" Idle="2527854034" IOWait="897398" IRQ="0" SoftIRQ="412553" Steal="1161187" Guest="0" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.136391" Type="Net2TLSConfig" ID="0000000000000000" CAPath="" CertificatePath="" KeyPath="" HasPassword="0" VerifyPeers="Check.Valid=1" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.136391" Type="NotifyAddressHealthy" ID="0000000000000000" SuppressedEventCount="0" Address="51.81.82.209:4500" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.136391" Type="FBA_SubmitBackup" ID="0000000000000000" TagName="a11" StopWhenDone="1" OutContainer="file:///home/ovhdeploy/mybackups/" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.136391" Type="CodeCoverage" ID="0000000000000000" File="fdbclient/ReadYourWrites.actor.cpp" Line="1210" Condition="true" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.136391" Type="StartingSlowTaskProfilingThread" ID="0000000000000000" Interval="0.125" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.136391" Type="Net2Running" ID="0000000000000000" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.136391" Type="ProcessTimeOffset" ID="0000000000000000" ProcessTime="1620680495.141706" SystemTime="1620680495.141706" OffsetFromSystemTime="-0.000000" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.141750" Type="ConnectingTo" ID="0000000000000000" SuppressedEventCount="0" PeerAddr="51.81.82.209:4500" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.141750" Type="ConnectionExchangingConnectPacket" ID="b78ff4e0fe2b2081" SuppressedEventCount="0" PeerAddr="51.81.82.209:4500" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.143118" Type="ConnectionEstablished" ID="b78ff4e0fe2b2081" SuppressedEventCount="0" Peer="51.81.82.209:4500" ConnectionId="1" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.143118" Type="ConnectedOutgoing" ID="0000000000000000" SuppressedEventCount="0" PeerAddr="51.81.82.209:4500" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.150350" Type="CodeCoverage" ID="0000000000000000" File="fdbclient/NativeAPI.actor.cpp" Line="2393" Condition="true" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.656754" Type="CodeCoverage" ID="0000000000000000" File="fdbclient/TaskBucket.actor.cpp" Line="641" Condition="true" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.656754" Type="MachineLoadDetail" ID="0000000000000000" User="16029703" Nice="571403" System="5537763" Idle="2527854104" IOWait="897399" IRQ="0" SoftIRQ="412554" Steal="1161198" Guest="0" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.656754" Type="ProcessMetrics" ID="0000000000000000" Elapsed="0.517662" CPUSeconds="0.012184" MainThreadCPUSeconds="0.011504" UptimeSeconds="0.520363" Memory="184107008" ResidentMemory="14430208" UnusedAllocatedMemory="0" MbpsSent="0.111826" MbpsReceived="0.0645982" DiskTotalBytes="0" DiskFreeBytes="0" DiskQueueDepth="0" DiskIdleSeconds="0" DiskReads="0" DiskWrites="0" DiskReadsCount="0" DiskWritesCount="0" DiskWriteSectors="0" DiskReadSectors="0" FileWrites="0" FileReads="0" CacheReadBytes="0" CacheFinds="0" CacheWritesBlocked="0" CacheReadsBlocked="0" CachePageReadsMerged="0" CacheWrites="0" CacheReads="0" CacheHits="0" CacheMisses="0" CacheEvictions="0" DCID="[not set]" ZoneID="[not set]" MachineID="[not set]" AIOSubmitCount="0" AIOCollectCount="0" AIOSubmitLag="0" AIODiskStall="0" CurrentConnections="1" ConnectionsEstablished="1.93176" ConnectionsClosed="0" ConnectionErrors="0" TLSPolicyFailures="0" Machine="51.81.82.209:20040" LogGroup="default" TrackLatestType="Original" />
<Event Severity="10" Time="1620680495.656754" Type="MemoryMetrics" ID="0000000000000000" TotalMemory16="131072" ApproximateUnusedMemory16="0" ActiveThreads16="1" TotalMemory32="131072" ApproximateUnusedMemory32="0" ActiveThreads32="1" TotalMemory64="262144" ApproximateUnusedMemory64="0" ActiveThreads64="2" TotalMemory96="131040" ApproximateUnusedMemory96="0" ActiveThreads96="1" TotalMemory128="131072" ApproximateUnusedMemory128="0" ActiveThreads128="1" TotalMemory256="131072" ApproximateUnusedMemory256="0" ActiveThreads256="1" TotalMemory512="131072" ApproximateUnusedMemory512="0" ActiveThreads512="1" TotalMemory1024="131072" ApproximateUnusedMemory1024="0" ActiveThreads1024="1" TotalMemory2048="131072" ApproximateUnusedMemory2048="0" ActiveThreads2048="1" TotalMemory4096="131072" ApproximateUnusedMemory4096="0" ActiveThreads4096="1" TotalMemory8192="131072" ApproximateUnusedMemory8192="0" ActiveThreads8192="1" HugeArenaMemory="0" DCID="[not set]" ZoneID="[not set]" MachineID="[not set]" Machine="51.81.82.209:20040" LogGroup="default" />
<Event Severity="10" Time="1620680495.656754" Type="NetworkMetrics" ID="0000000000000000" Elapsed="0.517662" CantSleep="0" WontSleep="1" Yields="2" YieldCalls="12" YieldCallsTrue="0" SlowTaskSignals="0" YieldBigStack="0" RunLoopIterations="32" TimersExecuted="34" TasksExecuted="51" ASIOEventsProcessed="46" ReadCalls="25" WriteCalls="12" ReadProbes="13" WriteProbes="0" PacketsRead="13" PacketsGenerated="14" WouldBlock="13" LaunchTime="1.3113e-05" ReactTime="0.000119686" DCID="[not set]" ZoneID="[not set]" MachineID="[not set]" SlowTask1M="1" SlowTask8M="1" PriorityBusy1="0.00823736" PriorityMaxBusy1="0.00550795" PriorityBusy2050="0.00823736" PriorityMaxBusy2050="0.00550795" PriorityBusy3050="0.00823736" PriorityMaxBusy3050="0.00550795" PriorityBusy4050="0.00823736" PriorityMaxBusy4050="0.00550795" PriorityBusy4950="0.00823736" PriorityMaxBusy4950="0.00550795" PriorityBusy5050="0.00799799" PriorityMaxBusy5050="0.00550795" PriorityBusy7050="0.00777292" PriorityMaxBusy7050="0.00550795" PriorityBusy8050="0.0060935" PriorityMaxBusy8050="0.00515246" PriorityBusy10050="0.000212431" PriorityMaxBusy10050="5.60284e-05" Machine="51.81.82.209:20040" LogGroup="default" TrackLatestType="Original" />
<Event Severity="10" Time="1620680495.656754" Type="MachineMetrics" ID="0000000000000000" Elapsed="0.517662" MbpsSent="0.00157632" MbpsReceived="0.00417261" OutSegs="734" RetransSegs="0" CPUSeconds="0.167624" TotalMemory="4035411968" CommittedMemory="733433856" AvailableMemory="3301978112" DCID="[not set]" ZoneID="[not set]" MachineID="[not set]" Machine="51.81.82.209:20040" LogGroup="default" TrackLatestType="Original" />
</Trace>
Status Error message:
The backup on tag `a11’ is in progress to file:///home/ovhdeploy/mybackups/backup-2021-05-10-21-01-35.149613.
BackupUID: 5f9a2766e9ec0b3250e9fd9979efcf13
BackupURL: file:///home/ovhdeploy/mybackups/backup-2021-05-10-21-01-35.149613
Snapshot interval is 864000 seconds. The initial snapshot is still running.
Details:
LogBytes written - 0
RangeBytes written - 0
Last complete log version and timestamp - 10717055754681, 2021/05/10.21:01:39+0000
Last complete snapshot version and timestamp - N/A, N/A
Current Snapshot start version and timestamp - 10717055754681, 2021/05/10.21:01:39+0000
Expected snapshot end version and timestamp - 10717055754681, 2021/05/10.21:01:39+0000
Backup supposed to stop at next snapshot completion - Yes
Recent Errors (since initialization)
5 second(s) ago : 'File could not be written' on 'file_backup_write_range_5.2'