B2 mount not showing files

fhk1407 · April 24, 2019, 10:45am

Hi. I successfully completed a full b2 backup of a mounted NAS (Freenas, 5TB in size).

Now trying to mount the repo (which completes fine), but browsing the mounted location doesn’t show the files, only my “Downloads” library (under “Snapshots”. Downloads should not be part of the backup??).

Anyone can figure out what is going on? (This is on Linux Mint)

fd0 · April 24, 2019, 1:18pm

Hi, welcome to the forum! Can you paste the whole command line you’re using, including anything that restic prints? You can mask anything you don’t like us to see with XXX or so. This would help us to maybe see what’s going on. Also, you need to keep restic mount running in a terminal until you’re done accessing the files…

fhk1407 · April 24, 2019, 1:45pm

Hi. Sure:

restic mount /home/fhk/Restic
repository 2a00e563 opened successfully, password is correct
Now serving the repository at /home/fhk/Restic
When finished, quit with Ctrl-c or umount the mountpoint.

restic -r b2:restic-freenas:14XX mount /home/fhk/Restic will yield the same result.

cdhowie · April 24, 2019, 3:00pm

With this command still running, what is the output of ls -l /home/fhk/Restic?

fhk1407 · April 26, 2019, 6:29am

dr-xr-xr-x 1 fhk fhk 0 Apr 24 15:52 hosts
dr-xr-xr-x 1 fhk fhk 0 Apr 24 15:52 ids
dr-xr-xr-x 1 fhk fhk 0 Apr 24 15:52 snapshots
dr-xr-xr-x 1 fhk fhk 0 Apr 24 15:52 tags

The backup command is restic backup /home/fhk/Storage --exclude="/_nobackup"

fd0 · April 26, 2019, 7:05am

Is there anything in any of the directories? Can you find any of the snapshot IDs printed by restic snapshots in the subdir snapshots/ in the fuse mount?

fhk1407 · April 26, 2019, 1:20pm

The snapshots/ tags/ dir are empty. Screenshot of the rest (as stated earlier /Downloads is not even part of the backup…) Selection_001

fhk1407 · April 26, 2019, 1:28pm

Could it be that a backup has not completed succesfully, despite archiving several TBs to B2…?

cdhowie · April 26, 2019, 3:48pm

If there is something in ids then there should be things in snapshots as well. Note that the other three directories (hosts, snapshots, and tags) should only contain symlinks into ids. tags will only be populated if your snapshots have any tags.

From the command line can you list the contents of each directory? ls -l /home/fhk/Restic/*

fhk1407 · May 1, 2019, 7:02am

restic snapshots is resulting in this

restic snapshots
repository 2a00e563 opened successfully, password is correct
ID        Time                 Host             Tags        Paths
-------------------------------------------------------------------------------
6b432fd4  2019-03-21 15:19:17  XXX-XXXXX              /home/fhk/Downloads
-------------------------------------------------------------------------------
1 snapshots

So the backup of /fhk/home/Storage is clearly not completed successfully?

Backup jobs output stuff lije this in the end: (What is it?)

	/usr/local/go/src/crypto/tls/conn.go:761 +0x61
bytes.(*Buffer).ReadFrom(0x14d38560, 0x89eee50, 0x41ae34e0, 0xfffff, 0x804ffb9, 0x87cc100, 0x888d680)
	/usr/local/go/src/bytes/buffer.go:207 +0x9d
crypto/tls.(*Conn).readFromUntil(0x14d38400, 0x89f04d0, 0x24275208, 0x5, 0x24275208, 0x805174f)
	/usr/local/go/src/crypto/tls/conn.go:783 +0xd6
crypto/tls.(*Conn).readRecordOrCCS(0x14d38400, 0x88e8900, 0x14d384b0, 0x8095ce0)
	/usr/local/go/src/crypto/tls/conn.go:590 +0x115
crypto/tls.(*Conn).readRecord(...)
	/usr/local/go/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0x14d38400, 0x2a3cc000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/crypto/tls/conn.go:1236 +0x12b
net/http.(*persistConn).Read(0x1b44a140, 0x2a3cc000, 0x1000, 0x1000, 0x804c064, 0xb14f280, 0x36f41e2f)
	/usr/local/go/src/net/http/transport.go:1524 +0x198
bufio.(*Reader).fill(0x4c4d0d20)
	/usr/local/go/src/bufio/bufio.go:100 +0xf3
bufio.(*Reader).Peek(0x4c4d0d20, 0x1, 0x0, 0x0, 0x1, 0x52fbeb00, 0x0)
	/usr/local/go/src/bufio/bufio.go:138 +0x41
net/http.(*persistConn).readLoop(0x1b44a140)
	/usr/local/go/src/net/http/transport.go:1677 +0x19e
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1357 +0x8ea

cdhowie · May 1, 2019, 3:48pm

This is a stack trace indicating a crash or other abnormal termination. We’d need to see the beginning of the stack trace to know what went wrong; this is only the tail end of it.

fhk1407 · May 1, 2019, 7:54pm

How to submit? (“New users only allowed two links in a post bla bla”)

cdhowie · May 1, 2019, 8:15pm

Format it as a block of code. (Paste the stacktrace, select it all, then click “preformatted text” in the formatting toolbar.)

fhk1407 · May 2, 2019, 6:29am

OK, thanks. Here you go:

    9fac40, 0x4c39e1a0, 0x40f79f80, 0x4c39e1a0, 0x0)
	/restic/internal/archiver/tree_saver.go:152 +0x125
github.com/restic/restic/internal/archiver.NewTreeSaver.func1(0x0, 0x0)
	/restic/internal/archiver/tree_saver.go:63 +0x60
gopkg.in/tomb%2ev2.(*Tomb).run(0xb120060, 0x4c39e2a0)
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:163 +0x21
created by gopkg.in/tomb%2ev2.(*Tomb).Go
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:159 +0x9e

goroutine 201 [select, 468 minutes]:
github.com/restic/restic/internal/archiver.(*TreeSaver).worker(0x3fc96360, 0x89fac40, 0x4c39e1a0, 0x40f79f80, 0x4c39e1a0, 0x0)
	/restic/internal/archiver/tree_saver.go:152 +0x125
github.com/restic/restic/internal/archiver.NewTreeSaver.func1(0x0, 0x0)
	/restic/internal/archiver/tree_saver.go:63 +0x60
gopkg.in/tomb%2ev2.(*Tomb).run(0xb120060, 0x4c39e2c0)
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:163 +0x21
created by gopkg.in/tomb%2ev2.(*Tomb).Go
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:159 +0x9e

goroutine 202 [select, 468 minutes]:
github.com/restic/restic/internal/archiver.(*TreeSaver).worker(0x3fc96360, 0x89fac40, 0x4c39e1a0, 0x40f79f80, 0x4c39e1a0, 0x0)
	/restic/internal/archiver/tree_saver.go:152 +0x125
github.com/restic/restic/internal/archiver.NewTreeSaver.func1(0x0, 0x0)
	/restic/internal/archiver/tree_saver.go:63 +0x60
gopkg.in/tomb%2ev2.(*Tomb).run(0xb120060, 0x4c39e2e0)
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:163 +0x21
created by gopkg.in/tomb%2ev2.(*Tomb).Go
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:159 +0x9e

goroutine 203 [select, 468 minutes]:
github.com/restic/restic/internal/archiver.(*TreeSaver).worker(0x3fc96360, 0x89fac40, 0x4c39e1a0, 0x40f79f80, 0x4c39e1a0, 0x0)
	/restic/internal/archiver/tree_saver.go:152 +0x125
github.com/restic/restic/internal/archiver.NewTreeSaver.func1(0x6d3bc184, 0xf58bd574)
	/restic/internal/archiver/tree_saver.go:63 +0x60
gopkg.in/tomb%2ev2.(*Tomb).run(0xb120060, 0x4c39e300)
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:163 +0x21
created by gopkg.in/tomb%2ev2.(*Tomb).Go
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:159 +0x9e

goroutine 204 [select, 468 minutes]:
github.com/restic/restic/internal/archiver.(*TreeSaver).worker(0x3fc96360, 0x89fac40, 0x4c39e1a0, 0x40f79f80, 0x4c39e1a0, 0x8959229a)
	/restic/internal/archiver/tree_saver.go:152 +0x125
github.com/restic/restic/internal/archiver.NewTreeSaver.func1(0xfbed1ee, 0x4e626ae9)
	/restic/internal/archiver/tree_saver.go:63 +0x60
gopkg.in/tomb%2ev2.(*Tomb).run(0xb120060, 0x4c39e340)
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:163 +0x21
created by gopkg.in/tomb%2ev2.(*Tomb).Go
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:159 +0x9e

goroutine 205 [select, 468 minutes]:
github.com/restic/restic/internal/archiver.(*TreeSaver).worker(0x3fc96360, 0x89fac40, 0x4c39e1a0, 0x40f79f80, 0x4c39e1a0, 0x0)
	/restic/internal/archiver/tree_saver.go:152 +0x125
github.com/restic/restic/internal/archiver.NewTreeSaver.func1(0x0, 0x0)
	/restic/internal/archiver/tree_saver.go:63 +0x60
gopkg.in/tomb%2ev2.(*Tomb).run(0xb120060, 0x4c39e360)
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:163 +0x21
created by gopkg.in/tomb%2ev2.(*Tomb).Go
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:159 +0x9e

goroutine 206 [select, 360 minutes]:
github.com/restic/restic/internal/archiver.(*TreeSaver).worker(0x3fc96360, 0x89fac40, 0x4c39e1a0, 0x40f79f80, 0x4c39e1a0, 0xdb187f13)
	/restic/internal/archiver/tree_saver.go:152 +0x125
github.com/restic/restic/internal/archiver.NewTreeSaver.func1(0x84949216, 0x521df58f)
	/restic/internal/archiver/tree_saver.go:63 +0x60
gopkg.in/tomb%2ev2.(*Tomb).run(0xb120060, 0x4c39e380)
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:163 +0x21
created by gopkg.in/tomb%2ev2.(*Tomb).Go
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:159 +0x9e

goroutine 207 [select, 468 minutes]:
github.com/restic/restic/internal/archiver.(*TreeSaver).worker(0x3fc96360, 0x89fac40, 0x4c39e1a0, 0x40f79f80, 0x4c39e1a0, 0x566c9f3a)
	/restic/internal/archiver/tree_saver.go:152 +0x125
github.com/restic/restic/internal/archiver.NewTreeSaver.func1(0xacee0ee1, 0x2783dce8)
	/restic/internal/archiver/tree_saver.go:63 +0x60
gopkg.in/tomb%2ev2.(*Tomb).run(0xb120060, 0x4c39e3a0)
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:163 +0x21
created by gopkg.in/tomb%2ev2.(*Tomb).Go
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:159 +0x9e

goroutine 208 [select, 468 minutes]:
github.com/restic/restic/internal/archiver.(*TreeSaver).worker(0x3fc96360, 0x89fac40, 0x4c39e1a0, 0x40f79f80, 0x4c39e1a0, 0x3d2417aa)
	/restic/internal/archiver/tree_saver.go:152 +0x125
github.com/restic/restic/internal/archiver.NewTreeSaver.func1(0x1ffefeec, 0x1cad2dc4)
	/restic/internal/archiver/tree_saver.go:63 +0x60
gopkg.in/tomb%2ev2.(*Tomb).run(0xb120060, 0x4c39e3c0)
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:163 +0x21
created by gopkg.in/tomb%2ev2.(*Tomb).Go
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:159 +0x9e

goroutine 401 [select, 468 minutes]:
github.com/restic/restic/internal/archiver.(*TreeSaver).worker(0x3fc96360, 0x89fac40, 0x4c39e1a0, 0x40f79f80, 0x4c39e1a0, 0x0)
	/restic/internal/archiver/tree_saver.go:152 +0x125
github.com/restic/restic/internal/archiver.NewTreeSaver.func1(0x0, 0x0)
	/restic/internal/archiver/tree_saver.go:63 +0x60
gopkg.in/tomb%2ev2.(*Tomb).run(0xb120060, 0x4c39e400)
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:163 +0x21
created by gopkg.in/tomb%2ev2.(*Tomb).Go
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:159 +0x9e

goroutine 14001 [select]:
net/http.(*persistConn).writeLoop(0x260e60a0)
	/usr/local/go/src/net/http/transport.go:1958 +0xcc
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1358 +0x90b

goroutine 14099 [select]:
net/http.(*persistConn).writeLoop(0x276ba500)
	/usr/local/go/src/net/http/transport.go:1958 +0xcc
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1358 +0x90b

goroutine 13968 [runnable]:
syscall.Syscall(0x4, 0x15, 0xbf31300, 0x1035, 0x1035, 0x1035, 0x0)
	/usr/local/go/src/syscall/asm_linux_386.s:19 +0x5
syscall.write(0x15, 0xbf31300, 0x1035, 0x1035, 0x0, 0xe7cba429, 0x1020)
	/usr/local/go/src/syscall/zsyscall_linux_386.go:1005 +0x49
syscall.Write(...)
	/usr/local/go/src/syscall/syscall_unix.go:191
internal/poll.(*FD).Write(0xb093220, 0xbf31300, 0x1035, 0x1035, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:268 +0x147
net.(*netFD).Write(0xb093220, 0xbf31300, 0x1035, 0x1035, 0x3e258780, 0x2a3cd000, 0x1000)
	/usr/local/go/src/net/fd_unix.go:220 +0x3f
net.(*conn).Write(0x24275208, 0xbf31300, 0x1035, 0x1035, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:189 +0x57
crypto/tls.(*Conn).write(0x14d38400, 0xbf31300, 0x1035, 0x1035, 0x2a3cd000, 0x1000, 0x1000)
	/usr/local/go/src/crypto/tls/conn.go:896 +0x122
crypto/tls.(*Conn).writeRecordLocked(0x14d38400, 0x17, 0x2a3cd000, 0x1000, 0x1000, 0x86740eb, 0x1c891c30, 0x2a3cd000)
	/usr/local/go/src/crypto/tls/conn.go:945 +0x21e
crypto/tls.(*Conn).Write(0x14d38400, 0x2a3cd000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/crypto/tls/conn.go:1114 +0x17e
net/http.persistConnWriter.Write(0x1b44a140, 0x2a3cd000, 0x1000, 0x1000, 0xb493400, 0x2a3cd000, 0x1000)
	/usr/local/go/src/net/http/transport.go:1373 +0x3f
bufio.(*Writer).Flush(0x3ff54880, 0x2a3cd000, 0x1000)
	/usr/local/go/src/bufio/bufio.go:590 +0x63
bufio.(*Writer).ReadFrom(0x3ff54880, 0x89f02f0, 0x41d3bdf0, 0xe7ba2f50, 0x3ff54880, 0x1, 0xb040c00)
	/usr/local/go/src/bufio/bufio.go:716 +0x22c
io.copyBuffer(0x89eec30, 0x3ff54880, 0x89f02f0, 0x41d3bdf0, 0x0, 0x0, 0x0, 0x1000, 0x20e, 0x0, ...)
	/usr/local/go/src/io/io.go:388 +0x29a
io.Copy(...)
	/usr/local/go/src/io/io.go:364
net/http.(*transferWriter).writeBody(0xb493400, 0x89eec30, 0x3ff54880, 0x2, 0x2)
	/usr/local/go/src/net/http/transfer.go:369 +0x68d
net/http.(*Request).write(0x1c6cc680, 0x89eec30, 0x3ff54880, 0x0, 0xb405720, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/http/request.go:655 +0x5cd
net/http.(*persistConn).writeLoop(0x1b44a140)
	/usr/local/go/src/net/http/transport.go:1961 +0x14c
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1358 +0x90b

goroutine 13946 [IO wait]:
internal/poll.runtime_pollWait(0xe7b9df34, 0x77, 0xffffffff)
	/usr/local/go/src/runtime/netpoll.go:182 +0x4c
internal/poll.(*pollDesc).wait(0x26f5e1f4, 0x77, 0x600, 0x68a, 0xffffffff)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x7e
internal/poll.(*pollDesc).waitWrite(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:96
internal/poll.(*FD).Write(0x26f5e1e0, 0x11e0d300, 0x1035, 0x1035, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:276 +0x202
net.(*netFD).Write(0x26f5e1e0, 0x11e0d300, 0x1035, 0x1035, 0x2eaea1e0, 0x27107000, 0x1000)
	/usr/local/go/src/net/fd_unix.go:220 +0x3f
net.(*conn).Write(0x19a77448, 0x11e0d300, 0x1035, 0x1035, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:189 +0x57
crypto/tls.(*Conn).write(0x25b9e400, 0x11e0d300, 0x1035, 0x1035, 0x27107000, 0x1000, 0x1000)
	/usr/local/go/src/crypto/tls/conn.go:896 +0x122
crypto/tls.(*Conn).writeRecordLocked(0x25b9e400, 0x17, 0x27107000, 0x1000, 0x1000, 0x86740eb, 0x4e3e81e8, 0x27107000)
	/usr/local/go/src/crypto/tls/conn.go:945 +0x21e
crypto/tls.(*Conn).Write(0x25b9e400, 0x27107000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/crypto/tls/conn.go:1114 +0x17e
net/http.persistConnWriter.Write(0xb451900, 0x27107000, 0x1000, 0x1000, 0x263f6370, 0x27107000, 0x1000)
	/usr/local/go/src/net/http/transport.go:1373 +0x3f
bufio.(*Writer).Flush(0x4d373d40, 0x27107000, 0x1000)
	/usr/local/go/src/bufio/bufio.go:590 +0x63
bufio.(*Writer).ReadFrom(0x4d373d40, 0x89f02f0, 0x3ede00d0, 0xe7ba2f50, 0x4d373d40, 0x1, 0xb03e600)
	/usr/local/go/src/bufio/bufio.go:716 +0x22c
io.copyBuffer(0x89eec30, 0x4d373d40, 0x89f02f0, 0x3ede00d0, 0x0, 0x0, 0x0, 0x1000, 0x20e, 0x0, ...)
	/usr/local/go/src/io/io.go:388 +0x29a
io.Copy(...)
	/usr/local/go/src/io/io.go:364
net/http.(*transferWriter).writeBody(0x263f6370, 0x89eec30, 0x4d373d40, 0x2, 0x2)
	/usr/local/go/src/net/http/transfer.go:369 +0x68d
net/http.(*Request).write(0xb2a2200, 0x89eec30, 0x4d373d40, 0x0, 0xb1ce4c0, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/http/request.go:655 +0x5cd
net/http.(*persistConn).writeLoop(0xb451900)
	/usr/local/go/src/net/http/transport.go:1961 +0x14c
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1358 +0x90b

goroutine 13945 [IO wait]:
internal/poll.runtime_pollWait(0xe7b9df34, 0x72, 0xffffffff)
	/usr/local/go/src/runtime/netpoll.go:182 +0x4c
internal/poll.(*pollDesc).wait(0x26f5e1f4, 0x72, 0x1800, 0x184e, 0xffffffff)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x7e
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0x26f5e1e0, 0x3ecf6000, 0x184e, 0x184e, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:169 +0x16a
net.(*netFD).Read(0x26f5e1e0, 0x3ecf6000, 0x184e, 0x184e, 0x0, 0xeacf3a72, 0x172)
	/usr/local/go/src/net/fd_unix.go:202 +0x3f
net.(*conn).Read(0x19a77448, 0x3ecf6000, 0x184e, 0x184e, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:177 +0x57
crypto/tls.(*atLeastReader).Read(0x3aa5b720, 0x3ecf6000, 0x184e, 0x184e, 0x0, 0xb0165e4, 0x89f04d0)
	/usr/local/go/src/crypto/tls/conn.go:761 +0x61
bytes.(*Buffer).ReadFrom(0x25b9e560, 0x89eee50, 0x3aa5b720, 0xe6d8cec8, 0x804ffb9, 0x87cc100, 0x888d680)
	/usr/local/go/src/bytes/buffer.go:207 +0x9d
crypto/tls.(*Conn).readFromUntil(0x25b9e400, 0x89f04d0, 0x19a77448, 0x5, 0x19a77448, 0x805174f)
	/usr/local/go/src/crypto/tls/conn.go:783 +0xd6
crypto/tls.(*Conn).readRecordOrCCS(0x25b9e400, 0x88e8900, 0x25b9e4b0, 0x8095ce0)
	/usr/local/go/src/crypto/tls/conn.go:590 +0x115
crypto/tls.(*Conn).readRecord(...)
	/usr/local/go/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0x25b9e400, 0x27106000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/crypto/tls/conn.go:1236 +0x12b
net/http.(*persistConn).Read(0xb451900, 0x27106000, 0x1000, 0x1000, 0x804c064, 0x52fbe780, 0x4f0a9e2f)
	/usr/local/go/src/net/http/transport.go:1524 +0x198
bufio.(*Reader).fill(0x5165a090)
	/usr/local/go/src/bufio/bufio.go:100 +0xf3
bufio.(*Reader).Peek(0x5165a090, 0x1, 0x0, 0x0, 0x1, 0x263f4200, 0x0)
	/usr/local/go/src/bufio/bufio.go:138 +0x41
net/http.(*persistConn).readLoop(0xb451900)
	/usr/local/go/src/net/http/transport.go:1677 +0x19e
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1357 +0x8ea

goroutine 14098 [IO wait]:
internal/poll.runtime_pollWait(0xe7b9dd24, 0x72, 0xffffffff)
	/usr/local/go/src/runtime/netpoll.go:182 +0x4c
internal/poll.(*pollDesc).wait(0x276a8104, 0x72, 0x1800, 0x184e, 0xffffffff)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x7e
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0x276a80f0, 0x3ecf7980, 0x184e, 0x184e, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:169 +0x16a
net.(*netFD).Read(0x276a80f0, 0x3ecf7980, 0x184e, 0x184e, 0x0, 0xeb1171ae, 0x2e)
	/usr/local/go/src/net/fd_unix.go:202 +0x3f
net.(*conn).Read(0x40a00280, 0x3ecf7980, 0x184e, 0x184e, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:177 +0x57
crypto/tls.(*atLeastReader).Read(0x3ec022e0, 0x3ecf7980, 0x184e, 0x184e, 0x0, 0xb0165e4, 0x89f04d0)
	/usr/local/go/src/crypto/tls/conn.go:761 +0x61
bytes.(*Buffer).ReadFrom(0x14d38360, 0x89eee50, 0x3ec022e0, 0x8, 0x804ffb9, 0x87cc100, 0x888d680)
	/usr/local/go/src/bytes/buffer.go:207 +0x9d
crypto/tls.(*Conn).readFromUntil(0x14d38200, 0x89f04d0, 0x40a00280, 0x5, 0x40a00280, 0xffffffe1)
	/usr/local/go/src/crypto/tls/conn.go:783 +0xd6
crypto/tls.(*Conn).readRecordOrCCS(0x14d38200, 0x88e8900, 0x14d382b0, 0x8095ce0)
	/usr/local/go/src/crypto/tls/conn.go:590 +0x115
crypto/tls.(*Conn).readRecord(...)
	/usr/local/go/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0x14d38200, 0x32376000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/crypto/tls/conn.go:1236 +0x12b
net/http.(*persistConn).Read(0x276ba500, 0x32376000, 0x1000, 0x1000, 0x804c064, 0x2cfe0380, 0x1d56fe2f)
	/usr/local/go/src/net/http/transport.go:1524 +0x198
bufio.(*Reader).fill(0x263f2480)
	/usr/local/go/src/bufio/bufio.go:100 +0xf3
bufio.(*Reader).Peek(0x263f2480, 0x1, 0x0, 0x0, 0x1, 0x263f4000, 0x0)
	/usr/local/go/src/bufio/bufio.go:138 +0x41
net/http.(*persistConn).readLoop(0x276ba500)
	/usr/local/go/src/net/http/transport.go:1677 +0x19e
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1357 +0x8ea

goroutine 13936 [IO wait]:
internal/poll.runtime_pollWait(0xe7b9dfb8, 0x72, 0xffffffff)
	/usr/local/go/src/runtime/netpoll.go:182 +0x4c
internal/poll.(*pollDesc).wait(0xb4170a4, 0x72, 0x1800, 0x184e, 0xffffffff)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x7e
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xb417090, 0x401aa000, 0x184e, 0x184e, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:169 +0x16a
net.(*netFD).Read(0xb417090, 0x401aa000, 0x184e, 0x184e, 0xf, 0xeb11725c, 0xdc)
	/usr/local/go/src/net/fd_unix.go:202 +0x3f
net.(*conn).Read(0xb32f198, 0x401aa000, 0x184e, 0x184e, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:177 +0x57
crypto/tls.(*atLeastReader).Read(0x3ec02dc0, 0x401aa000, 0x184e, 0x184e, 0x0, 0xb0165e4, 0x89f04d0)
	/usr/local/go/src/crypto/tls/conn.go:761 +0x61
bytes.(*Buffer).ReadFrom(0x1c758560, 0x89eee50, 0x3ec02dc0, 0x0, 0x804ffb9, 0x87cc100, 0x888d680)
	/usr/local/go/src/bytes/buffer.go:207 +0x9d
crypto/tls.(*Conn).readFromUntil(0x1c758400, 0x89f04d0, 0xb32f198, 0x5, 0xb32f198, 0x805174f)
	/usr/local/go/src/crypto/tls/conn.go:783 +0xd6
crypto/tls.(*Conn).readRecordOrCCS(0x1c758400, 0x88e8900, 0x1c7584b0, 0x8095ce0)
	/usr/local/go/src/crypto/tls/conn.go:590 +0x115
crypto/tls.(*Conn).readRecord(...)
	/usr/local/go/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0x1c758400, 0x18221000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/crypto/tls/conn.go:1236 +0x12b
net/http.(*persistConn).Read(0x260e60a0, 0x18221000, 0x1000, 0x1000, 0x804c064, 0x40f78fc0, 0x3f1cee2f)
	/usr/local/go/src/net/http/transport.go:1524 +0x198
bufio.(*Reader).fill(0x23f1c5a0)
	/usr/local/go/src/bufio/bufio.go:100 +0xf3
bufio.(*Reader).Peek(0x23f1c5a0, 0x1, 0x0, 0x0, 0x1, 0x52fbed00, 0x0)
	/usr/local/go/src/bufio/bufio.go:138 +0x41
net/http.(*persistConn).readLoop(0x260e60a0)
	/usr/local/go/src/net/http/transport.go:1677 +0x19e
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1357 +0x8ea

goroutine 14101 [IO wait]:
internal/poll.runtime_pollWait(0xe7b9dda8, 0x77, 0xffffffff)
	/usr/local/go/src/runtime/netpoll.go:182 +0x4c
internal/poll.(*pollDesc).wait(0xb2d07e4, 0x77, 0x900, 0x95a, 0xffffffff)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x7e
internal/poll.(*pollDesc).waitWrite(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:96
internal/poll.(*FD).Write(0xb2d07d0, 0x123a6600, 0x1035, 0x1035, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:276 +0x202
net.(*netFD).Write(0xb2d07d0, 0x123a6600, 0x1035, 0x1035, 0x40508480, 0x37b65000, 0x1000)
	/usr/local/go/src/net/fd_unix.go:220 +0x3f
net.(*conn).Write(0x259b4058, 0x123a6600, 0x1035, 0x1035, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:189 +0x57
crypto/tls.(*Conn).write(0x1f12e000, 0x123a6600, 0x1035, 0x1035, 0x37b65000, 0x1000, 0x1000)
	/usr/local/go/src/crypto/tls/conn.go:896 +0x122
crypto/tls.(*Conn).writeRecordLocked(0x1f12e000, 0x17, 0x37b65000, 0x1000, 0x1000, 0x86740eb, 0x5d670e00, 0x37b65000)
	/usr/local/go/src/crypto/tls/conn.go:945 +0x21e
crypto/tls.(*Conn).Write(0x1f12e000, 0x37b65000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/crypto/tls/conn.go:1114 +0x17e
net/http.persistConnWriter.Write(0x276ba5a0, 0x37b65000, 0x1000, 0x1000, 0xb2bf360, 0x37b65000, 0x1000)
	/usr/local/go/src/net/http/transport.go:1373 +0x3f
bufio.(*Writer).Flush(0x1f12a680, 0x37b65000, 0x1000)
	/usr/local/go/src/bufio/bufio.go:590 +0x63
bufio.(*Writer).ReadFrom(0x1f12a680, 0x89f02f0, 0x3a5a9830, 0xe7ba2f50, 0x1f12a680, 0x1, 0xb03c000)
	/usr/local/go/src/bufio/bufio.go:716 +0x22c
io.copyBuffer(0x89eec30, 0x1f12a680, 0x89f02f0, 0x3a5a9830, 0x0, 0x0, 0x0, 0x1000, 0x20e, 0x0, ...)
	/usr/local/go/src/io/io.go:388 +0x29a
io.Copy(...)
	/usr/local/go/src/io/io.go:364
net/http.(*transferWriter).writeBody(0xb2bf360, 0x89eec30, 0x1f12a680, 0x2, 0x2)
	/usr/local/go/src/net/http/transfer.go:369 +0x68d
net/http.(*Request).write(0x1f5e6200, 0x89eec30, 0x1f12a680, 0x0, 0xb03b180, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/http/request.go:655 +0x5cd
net/http.(*persistConn).writeLoop(0x276ba5a0)
	/usr/local/go/src/net/http/transport.go:1961 +0x14c
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1358 +0x90b

goroutine 14100 [IO wait]:
internal/poll.runtime_pollWait(0xe7b9dda8, 0x72, 0xffffffff)
	/usr/local/go/src/runtime/netpoll.go:182 +0x4c
internal/poll.(*pollDesc).wait(0xb2d07e4, 0x72, 0x1800, 0x184e, 0xffffffff)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x7e
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xb2d07d0, 0x401ad300, 0x184e, 0x184e, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:169 +0x16a
net.(*netFD).Read(0xb2d07d0, 0x401ad300, 0x184e, 0x184e, 0xfe, 0xeac4c1d8, 0x58)
	/usr/local/go/src/net/fd_unix.go:202 +0x3f
net.(*conn).Read(0x259b4058, 0x401ad300, 0x184e, 0x184e, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:177 +0x57
crypto/tls.(*atLeastReader).Read(0x39ffc580, 0x401ad300, 0x184e, 0x184e, 0x0, 0xb0165e4, 0x89f04d0)
	/usr/local/go/src/crypto/tls/conn.go:761 +0x61
bytes.(*Buffer).ReadFrom(0x1f12e160, 0x89eee50, 0x39ffc580, 0x8, 0x804ffb9, 0x87cc100, 0x888d680)
	/usr/local/go/src/bytes/buffer.go:207 +0x9d
crypto/tls.(*Conn).readFromUntil(0x1f12e000, 0x89f04d0, 0x259b4058, 0x5, 0x259b4058, 0x805174f)
	/usr/local/go/src/crypto/tls/conn.go:783 +0xd6
crypto/tls.(*Conn).readRecordOrCCS(0x1f12e000, 0x88e8900, 0x1f12e0b0, 0x8095ce0)
	/usr/local/go/src/crypto/tls/conn.go:590 +0x115
crypto/tls.(*Conn).readRecord(...)
	/usr/local/go/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0x1f12e000, 0x37b64000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/crypto/tls/conn.go:1236 +0x12b
net/http.(*persistConn).Read(0x276ba5a0, 0x37b64000, 0x1000, 0x1000, 0x804c064, 0x263f4400, 0x4e448e2f)
	/usr/local/go/src/net/http/transport.go:1524 +0x198
bufio.(*Reader).fill(0x263f25a0)
	/usr/local/go/src/bufio/bufio.go:100 +0xf3
bufio.(*Reader).Peek(0x263f25a0, 0x1, 0x0, 0x0, 0x1, 0x263f4300, 0x0)
	/usr/local/go/src/bufio/bufio.go:138 +0x41
net/http.(*persistConn).readLoop(0x276ba5a0)
	/usr/local/go/src/net/http/transport.go:1677 +0x19e
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1357 +0x8ea

goroutine 13967 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0xe7b9e03c, 0x72, 0xffffffff)
	/usr/local/go/src/runtime/netpoll.go:182 +0x4c
internal/poll.(*pollDesc).wait(0xb093234, 0x72, 0x1800, 0x184e, 0xffffffff)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x7e
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xb093220, 0x401ab980, 0x184e, 0x184e, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:169 +0x16a
net.(*netFD).Read(0xb093220, 0x401ab980, 0x184e, 0x184e, 0x3ffff, 0xeb40b04e, 0x14e)
	/usr/local/go/src/net/fd_unix.go:202 +0x3f
net.(*conn).Read(0x24275208, 0x401ab980, 0x184e, 0x184e, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:177 +0x57
crypto/tls.(*atLeastReader).Read(0x41ae34e0, 0x401ab980, 0x184e, 0x184e, 0x0, 0xb0165e4, 0x89f04d0)
	/usr/local/go/src/crypto/tls/conn.go:761 +0x61
bytes.(*Buffer).ReadFrom(0x14d38560, 0x89eee50, 0x41ae34e0, 0xfffff, 0x804ffb9, 0x87cc100, 0x888d680)
	/usr/local/go/src/bytes/buffer.go:207 +0x9d
crypto/tls.(*Conn).readFromUntil(0x14d38400, 0x89f04d0, 0x24275208, 0x5, 0x24275208, 0x805174f)
	/usr/local/go/src/crypto/tls/conn.go:783 +0xd6
crypto/tls.(*Conn).readRecordOrCCS(0x14d38400, 0x88e8900, 0x14d384b0, 0x8095ce0)
	/usr/local/go/src/crypto/tls/conn.go:590 +0x115
crypto/tls.(*Conn).readRecord(...)
	/usr/local/go/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0x14d38400, 0x2a3cc000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/crypto/tls/conn.go:1236 +0x12b
net/http.(*persistConn).Read(0x1b44a140, 0x2a3cc000, 0x1000, 0x1000, 0x804c064, 0xb14f280, 0x36f41e2f)
	/usr/local/go/src/net/http/transport.go:1524 +0x198
bufio.(*Reader).fill(0x4c4d0d20)
	/usr/local/go/src/bufio/bufio.go:100 +0xf3
bufio.(*Reader).Peek(0x4c4d0d20, 0x1, 0x0, 0x0, 0x1, 0x52fbeb00, 0x0)
	/usr/local/go/src/bufio/bufio.go:138 +0x41
net/http.(*persistConn).readLoop(0x1b44a140)
	/usr/local/go/src/net/http/transport.go:1677 +0x19e
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1357 +0x8ea

cdhowie · May 2, 2019, 6:34am

There’s still some output missing. Presumably your terminal only keeps 400 lines of scrollback.

Can you redirect the output to a file, and then copy from that file? For example:

restic backup ... 2>&1 | tee restic.log

fhk1407 · May 3, 2019, 10:39am

Here you go (the beginning, the entire stack is much to large to copy here):

runtime stack:
runtime.throw(0x88aa8db, 0xd)
	/usr/local/go/src/runtime/panic.go:617 +0x6a
runtime.largeAlloc(0x1074ac62, 0x98d0101, 0x3)
	/usr/local/go/src/runtime/malloc.go:1057 +0x10f
runtime.mallocgc.func1()
	/usr/local/go/src/runtime/malloc.go:950 +0x39
runtime.systemstack(0x6166e0e0)
	/usr/local/go/src/runtime/asm_386.s:396 +0x53
runtime.mstart()
	/usr/local/go/src/runtime/proc.go:1153

goroutine 166 [running]:
runtime.systemstack_switch()
	/usr/local/go/src/runtime/asm_386.s:357 fp=0x3f91daac sp=0x3f91daa8 pc=0x8096fb0
runtime.mallocgc(0x1074ac62, 0x879e5e0, 0x94d0001, 0x9691901)
	/usr/local/go/src/runtime/malloc.go:949 +0x67f fp=0x3f91db00 sp=0x3f91daac pc=0x80520cf
runtime.makeslice(0x879e5e0, 0x1074ac62, 0x1074ac62, 0x1)
	/usr/local/go/src/runtime/slice.go:49 +0x4f fp=0x3f91db14 sp=0x3f91db00 pc=0x80842ef
github.com/restic/restic/internal/crypto.sliceForAppend(...)
	/restic/internal/crypto/crypto.go:272
github.com/restic/restic/internal/crypto.(*Key).Seal(0x94d0050, 0x659ba000, 0x10, 0x2aaaaa, 0x96919f0, 0x10, 0x10, 0xc7c00000, 0x1074ac42, 0x1074c000, ...)
	/restic/internal/crypto/crypto.go:303 +0x247 fp=0x3f91db64 sp=0x3f91db14 pc=0x8311517
github.com/restic/restic/internal/repository.(*Repository).SaveAndEncrypt(0x9564300, 0x89fac40, 0xba94360, 0x804ef02, 0xc7c00000, 0x1074ac42, 0x1074c000, 0x9a7e2e20, 0x0, 0x0, ...)
	/restic/internal/repository/repository.go:237 +0x1a2 fp=0x3f91dc44 sp=0x3f91db64 pc=0x8365d22
github.com/restic/restic/internal/repository.(*Repository).SaveBlob(0x9564300, 0x89fac40, 0xba94360, 0xf1c1c102, 0xc7c00000, 0x1074ac42, 0x1074c000, 0x4c3d8876, 0xb1d9dc0d, 0xf1c1c189, ...)
	/restic/internal/repository/repository.go:700 +0x116 fp=0x3f91dd3c sp=0x3f91dc44 pc=0x8368366
github.com/restic/restic/internal/archiver.(*BlobSaver).saveBlob(0x613f6440, 0x89fac40, 0xba94360, 0x2, 0xc7c00000, 0x1074ac42, 0x1074c000, 0x0, 0x0, 0x0, ...)
	/restic/internal/archiver/blob_saver.go:146 +0x223 fp=0x3f91dec0 sp=0x3f91dd3c pc=0x8370e83
github.com/restic/restic/internal/archiver.(*BlobSaver).worker(0x613f6440, 0x89fac40, 0xba94360, 0x31fe3700, 0xba94360, 0x0)
	/restic/internal/archiver/blob_saver.go:166 +0x150 fp=0x3f91dfac sp=0x3f91dec0 pc=0x83711e0
github.com/restic/restic/internal/archiver.NewBlobSaver.func1(0x0, 0x0)
	/restic/internal/archiver/blob_saver.go:42 +0x60 fp=0x3f91dfd0 sp=0x3f91dfac pc=0x8376230
gopkg.in/tomb%2ev2.(*Tomb).run(0x2ffad590, 0x613f6480)
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:163 +0x21 fp=0x3f91dfe8 sp=0x3f91dfd0 pc=0x82e72f1
runtime.goexit()
	/usr/local/go/src/runtime/asm_386.s:1321 +0x1 fp=0x3f91dfec sp=0x3f91dfe8 pc=0x80987f1
created by gopkg.in/tomb%2ev2.(*Tomb).Go
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:159 +0x9e

goroutine 1 [select, 2 minutes]:
github.com/restic/restic/internal/archiver.(*FileSaver).Save(0x31cd02d0, 0x89fac40, 0x613f63e0, 0x3dc10f50, 0x6e, 0x8a02120, 0x977ccd0, 0x89febe0, 0x6158c360, 0x28865500, ...)
	/restic/internal/archiver/file_saver.go:116 +0x17e
github.com/restic/restic/internal/archiver.(*Archiver).Save(0x2ae7e280, 0x89fac40, 0x613f63e0, 0x3dc10f50, 0x6e, 0x3dc10ee0, 0x6e, 0x0, 0x3dc10f50, 0x6e, ...)
	/restic/internal/archiver/archiver.go:399 +0x535
github.com/restic/restic/internal/archiver.(*Archiver).SaveDir(0x2ae7e280, 0x89fac40, 0x613f63e0, 0x15bb2120, 0x55, 0x89febe0, 0x948e360, 0x15bb20c0, 0x55, 0x0, ...)
	/restic/internal/archiver/archiver.go:236 +0x34f
github.com/restic/restic/internal/archiver.(*Archiver).Save(0x2ae7e280, 0x89fac40, 0x613f63e0, 0x15bb2120, 0x55, 0x15bb20c0, 0x55, 0x0, 0x15bb2120, 0x55, ...)
	/restic/internal/archiver/archiver.go:413 +0xbcb
github.com/restic/restic/internal/archiver.(*Archiver).SaveDir(0x2ae7e280, 0x89fac40, 0x613f63e0, 0x1f1f2ae0, 0x30, 0x89febe0, 0x948e2d0, 0x1f1f2ab0, 0x30, 0x0, ...)
	/restic/internal/archiver/archiver.go:236 +0x34f
github.com/restic/restic/internal/archiver.(*Archiver).Save(0x2ae7e280, 0x89fac40, 0x613f63e0, 0x1f1f2ae0, 0x30, 0x1f1f2ab0, 0x30, 0x0, 0x1f1f2ae0, 0x30, ...)
	/restic/internal/archiver/archiver.go:413 +0xbcb
github.com/restic/restic/internal/archiver.(*Archiver).SaveDir(0x2ae7e280, 0x89fac40, 0x613f63e0, 0x98ea120, 0x1f, 0x89febe0, 0x6158c000, 0xffcff00b, 0x1f, 0x0, ...)
	/restic/internal/archiver/archiver.go:236 +0x34f
github.com/restic/restic/internal/archiver.(*Archiver).Save(0x2ae7e280, 0x89fac40, 0x613f63e0, 0x98ea120, 0x1f, 0xffcff00b, 0x1f, 0x0, 0x98ea120, 0x1f, ...)
	/restic/internal/archiver/archiver.go:413 +0xbcb
github.com/restic/restic/internal/archiver.(*Archiver).SaveTree(0x2ae7e280, 0x89fac40, 0x613f63e0, 0x98ea100, 0x1a, 0x61576340, 0x0, 0x0, 0x0, 0x0)
	/restic/internal/archiver/archiver.go:517 +0x48a
github.com/restic/restic/internal/archiver.(*Archiver).SaveTree(0x2ae7e280, 0x89fac40, 0x613f63e0, 0x98ea080, 0x11, 0x61576320, 0x0, 0x9825800, 0xa0b7b5a0, 0x3c3ac4e4)
	/restic/internal/archiver/archiver.go:545 +0x819
github.com/restic/restic/internal/archiver.(*Archiver).SaveTree(0x2ae7e280, 0x89fac40, 0x613f63e0, 0x6158a060, 0x9, 0x61576300, 0x0, 0x80000000, 0xffffffff, 0x7fffffff)
	/restic/internal/archiver/archiver.go:545 +0x819
github.com/restic/restic/internal/archiver.(*Archiver).SaveTree(0x2ae7e280, 0x89fac40, 0x613f63e0, 0x6158a030, 0x5, 0x615762e0, 0x0, 0x4, 0x25, 0x5)
	/restic/internal/archiver/archiver.go:545 +0x819
github.com/restic/restic/internal/archiver.(*Archiver).SaveTree(0x2ae7e280, 0x89fac40, 0x613f63e0, 0x88a11b2, 0x1, 0x613f6300, 0x0, 0x0, 0x0, 0x0)
	/restic/internal/archiver/archiver.go:545 +0x819
github.com/restic/restic/internal/archiver.(*Archiver).Snapshot.func1(0x2ae7e280, 0x89fac40, 0x613f63e0, 0x613f6300, 0x0, 0x0, 0x0, 0x9492640, 0xf, 0x0, ...)
	/restic/internal/archiver/archiver.go:775 +0xb9
github.com/restic/restic/internal/archiver.(*Archiver).Snapshot(0x2ae7e280, 0x89fac40, 0x949dde0, 0x9494898, 0x1, 0x1, 0x0, 0x0, 0x0, 0x9492640, ...)
	/restic/internal/archiver/archiver.go:785 +0x1a3
main.runBackup(0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/restic/cmd/restic/cmd_backup.go:589 +0xd3c
main.glob..func2(0x8fba080, 0x96b2000, 0x1, 0x3, 0x0, 0x0)
	/restic/cmd/restic/cmd_backup.go:62 +0x1b5
github.com/spf13/cobra.(*Command).execute(0x8fba080, 0x949df80, 0x3, 0x4, 0x8fba080, 0x949df80)
	/restic/vendor/github.com/spf13/cobra/command.go:762 +0x337
github.com/spf13/cobra.(*Command).ExecuteC(0x8fbaa80, 0x8, 0x9494840, 0x94a6360)
	/restic/vendor/github.com/spf13/cobra/command.go:852 +0x244
github.com/spf13/cobra.(*Command).Execute(...)
	/restic/vendor/github.com/spf13/cobra/command.go:800
main.main()
	/restic/cmd/restic/main.go:86 +0x7b

goroutine 18 [syscall, 2238 minutes]:
os/signal.signal_recv(0x0)
	/usr/local/go/src/runtime/sigqueue.go:139 +0x12f
os/signal.loop()
	/usr/local/go/src/os/signal/signal_unix.go:23 +0x1a
created by os/signal.init.0
	/usr/local/go/src/os/signal/signal_unix.go:29 +0x37

goroutine 19 [chan receive, 2238 minutes]:
github.com/restic/restic/internal/restic.init.0.func1.1()
	/restic/internal/restic/lock.go:257 +0xb2
created by github.com/restic/restic/internal/restic.init.0.func1
	/restic/internal/restic/lock.go:254 +0x2b

goroutine 4 [chan receive, 2238 minutes]:
github.com/restic/restic/internal/restic.init.2.func1(0x94b80c0)
	/restic/internal/restic/progress_unix.go:17 +0x64
created by github.com/restic/restic/internal/restic.init.2
	/restic/internal/restic/progress_unix.go:16 +0x99

goroutine 6 [select]:
go.opencensus.io/stats/view.(*worker).start(0x943bc20)
	/restic/vendor/go.opencensus.io/stats/view/worker.go:147 +0xb2
created by go.opencensus.io/stats/view.init.0
	/restic/vendor/go.opencensus.io/stats/view/worker.go:29 +0x47

goroutine 8 [chan receive, 2238 minutes]:
main.CleanupHandler(0x942f080)
	/restic/cmd/restic/cleanup.go:62 +0x47
created by main.init.0
	/restic/cmd/restic/cleanup.go:24 +0x59

goroutine 21 [select]:
github.com/restic/restic/internal/ui/termstatus.(*Terminal).run(0x949a240, 0x89fac40, 0x9682480)
	/restic/internal/ui/termstatus/status.go:98 +0x117
github.com/restic/restic/internal/ui/termstatus.(*Terminal).Run(0x949a240, 0x89fac40, 0x9682480)
	/restic/internal/ui/termstatus/status.go:83 +0x62
main.glob..func2.1(0x0, 0x0)
	/restic/cmd/restic/cmd_backup.go:60 +0x57
gopkg.in/tomb%2ev2.(*Tomb).run(0x949a210, 0x94a63e0)
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:163 +0x21
created by gopkg.in/tomb%2ev2.(*Tomb).Go
	/restic/vendor/gopkg.in/tomb.v2/tomb.go:159 +0x9e

goroutine 212 [select, 4 minutes]:
main.refreshLocks(0x8fc23b0, 0x942f6c0)
	/restic/cmd/restic/lock.go:72 +0x183
created by main.lockRepository
	/restic/cmd/restic/lock.go:49 +0x244

goroutine 204 [select]:
github.com/restic/restic/internal/archiver.(*BlobSaver).Save(0x613f6440, 0x89fac40, 0xba94360, 0x92501, 0x2b149140, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/restic/internal/archiver/blob_saver.go:54 +0x125
github.com/restic/restic/internal/archiver.(*FileSaver).saveFile(0x31cd02d0, 0x89fac40, 0xba94360, 0x9445900, 0x118724d0, 0x6e, 0x8a02120, 0x99715b0, 0x89febe0, 0x3eb9c090, ...)
	/restic/internal/archiver/file_saver.go:197 +0x447

cdhowie · May 3, 2019, 12:39pm

It’s still missing the actual error detail, but I think we can infer from the primary stack trace that restic failed to allocate memory. The backup is likely failing because restic is requiring more memory than the system has available.

fhk1407 · May 3, 2019, 2:01pm

8 gigs of RAM on the box… Not enough to perform a backup? Are you looking in to optimize that?

fd0 · May 5, 2019, 6:54am

Yes, we’re working on that. For 5TB, it is indeed possible (depending on the number of files) that 8GB RAM is not enough. At the moment, restic holds most information about the data in the repo (which data is stored where) in memory.

I’m wondering though, according to the output of restic snapshots you pasted above, there should be at least one snapshot. Does restic mount also print errors?

Please be aware that (according to the info you pasted above) only a single backup was completed successfully so far.

fhk1407 · May 6, 2019, 11:03am

There is one completed snapshot. Only a few files, made for testing purposes. It is mounted correctly, and no errors. The limitation is bugger - as you point out I have no backup right now. I deleted the one I had via Synology in the belief that the Restic backup was successful. Anything in beta that might do the job?