Timing log of publishing with Fission

This is a log of publishing some changes to ~10 - 20 files from my Jekyll blog, which in total is around ~1600 files (and ~2500 directories, because jekyll uses file paths to do naming, and then the “leaf” directory will have an index.html in it).

2020-10-03 21:46:13.189635: [debug] Reading global config.yaml
2020-10-03 21:46:13.190002: [debug] Reading YAML from "/Users/bmann/.config/fission/config.yaml"
2020-10-03 21:46:13.192019: [debug] Path does exist
2020-10-03 21:46:13.192847: [debug] App (Up (Options {watch = False, updateDNS = True, updateData = True, filePath = "./", ipfsCfg = Config {binPath = Nothing, timeoutSeconds = Timeout {getSeconds = 300}}, verboseFlag = True}))
2020-10-03 21:46:13.192899: [debug] App interpreter
2020-10-03 21:46:13.192971: [debug] Reading YAML from "/Users/bmann/repos/simply-jekyll/fission.yaml"
2020-10-03 21:46:13.193029: [debug] Path does exist
2020-10-03 21:46:13.194181: [debug] Ed25519 key loaded
2020-10-03 21:46:13.194219: [debug] Loaded Server DID: did:key:zStEZpzSMtTt9k2vszgvCwF4fLQQSyA15W5AQ4z3AR6Bx4eFJ5crJFbuGxKmbma4
2020-10-03 21:46:13.194479: [debug] Reading global config.yaml
2020-10-03 21:46:13.194529: [debug] Reading YAML from "/Users/bmann/.config/fission/config.yaml"
2020-10-03 21:46:13.194582: [debug] Path does exist
2020-10-03 21:46:13.194771: [debug] Retrieved Peers from .fission.yaml: [Peer {peer = "/dns4/node.runfission.com/tcp/4001/ipfs/QmVLEz2SxoNiFnuyLpbXsH6SvjPTrHNMU88vCQZyhgBzgw"},Peer {peer = "/ip4/3.226.224.78/tcp/4001/p2p/QmPeeeZZXxMBAPxxba7a6ggjDr5jLuD3RAFnmPPcvJ9fMS"},Peer {peer = "/ip4/3.226.224.78/udp/4001/quic/p2p/QmPeeeZZXxMBAPxxba7a6ggjDr5jLuD3RAFnmPPcvJ9fMS"}]
2020-10-03 21:46:13.194816: [debug] Loaded peers
2020-10-03 21:46:13.196287: [debug] FissionCLI context switch
2020-10-03 21:46:13.196361: [debug] Attempting user verification
2020-10-03 21:46:13.196517: [debug] Loaded Server DID: did:key:zStEZpzSMtTt9k2vszgvCwF4fLQQSyA15W5AQ4z3AR6Bx4eFJ5crJFbuGxKmbma4
2020-10-03 21:46:13.196568: [debug] Loaded Server DID: did:key:zStEZpzSMtTt9k2vszgvCwF4fLQQSyA15W5AQ4z3AR6Bx4eFJ5crJFbuGxKmbma4
2020-10-03 21:46:13.196732: [debug] Sending web request
🕐2020-10-03 21:46:13.891868: [debug] User is registered
2020-10-03 21:46:13.892007: [debug] FissionCLI context switch
2020-10-03 21:46:13.892051: [debug] Connecting peers
2020-10-03 21:46:13.892153: [debug] Peer {peer = "/dns4/node.runfission.com/tcp/4001/ipfs/QmVLEz2SxoNiFnuyLpbXsH6SvjPTrHNMU88vCQZyhgBzgw"}
2020-10-03 21:46:13.892210: [debug] Peer {peer = "/ip4/3.226.224.78/tcp/4001/p2p/QmPeeeZZXxMBAPxxba7a6ggjDr5jLuD3RAFnmPPcvJ9fMS"}
2020-10-03 21:46:13.892291: [debug] Peer {peer = "/ip4/3.226.224.78/udp/4001/quic/p2p/QmPeeeZZXxMBAPxxba7a6ggjDr5jLuD3RAFnmPPcvJ9fMS"}
2020-10-03 21:46:13.892357: [debug] Running local IPFS
2020-10-03 21:46:13.892477: [debug] Writing to /Users/bmann/.config/fission/tmp/b7b29a36b0ea8ee40020590a3d3aba9d757f053af818c8e5c71d4bc8d95c2f97
2020-10-03 21:46:13.897571: [debug] Starting IPFS daemon
2020-10-03 21:46:13.897618: [debug] Starting new IPFS Daemon
2020-10-03 21:46:13.897659: [debug] IPFS_PATH set to: Just "/Users/bmann/.config/fission/ipfs"
2020-10-03 21:46:13.898119: [debug] IPFS daemon started
⏯ 1 second to read global YAML, local YAML, Load key, get peers, check user if registered, connect to peers, start IPFS ⏯

This is pretty fast, especially since it includes a network check.

2020-10-03 21:46:13.898198: [debug] Checking if IPFS daemon is running
2020-10-03 21:46:15.474539: [debug] ExitFailure 1
2020-10-03 21:46:16.479960: [debug] Checking if IPFS daemon is running
2020-10-03 21:46:16.566696: [debug] ExitFailure 1
2020-10-03 21:46:17.569089: [debug] Checking if IPFS daemon is running
2020-10-03 21:46:17.648255: [debug] ExitFailure 1
2020-10-03 21:46:18.653865: [debug] Checking if IPFS daemon is running
2020-10-03 21:46:18.728494: [debug] ExitFailure 1
2020-10-03 21:46:19.730629: [debug] Checking if IPFS daemon is running
2020-10-03 21:46:19.805325: [debug] ExitFailure 1
2020-10-03 21:46:20.808431: [debug] Checking if IPFS daemon is running
2020-10-03 21:46:20.884509: [debug] ExitFailure 1
2020-10-03 21:46:21.889435: [debug] Checking if IPFS daemon is running
2020-10-03 21:46:22.074333: [debug] ExitFailure 1
2020-10-03 21:46:23.078143: [debug] Checking if IPFS daemon is running
2020-10-03 21:46:23.186301: [debug] ExitFailure 1
2020-10-03 21:46:24.191714: [debug] Checking if IPFS daemon is running
2020-10-03 21:46:24.281763: [debug] ExitFailure 1
2020-10-03 21:46:25.286870: [debug] Checking if IPFS daemon is running
2020-10-03 21:46:25.367864: [debug] ExitFailure 1
2020-10-03 21:46:26.372260: [debug] IPFS daemon startup appears stuck. Retrying.
⏯ 13 seconds checking to see if IPFS daemon is running and determining it's stuck ⏯

Ugh. Took us 13 seconds to NOT start IPFS :frowning:

2020-10-03 21:46:26.442468: [debug] Starting IPFS daemon
2020-10-03 21:46:26.442525: [debug] Starting new IPFS Daemon
2020-10-03 21:46:26.442573: [debug] IPFS_PATH set to: Just "/Users/bmann/.config/fission/ipfs"
2020-10-03 21:46:26.442959: [debug] IPFS daemon started
2020-10-03 21:46:26.443026: [debug] Checking if IPFS daemon is running
2020-10-03 21:46:26.484227: [debug] ExitFailure 1
2020-10-03 21:46:27.485904: [debug] Checking if IPFS daemon is running
2020-10-03 21:46:27.518762: [debug] ExitFailure 1
2020-10-03 21:46:28.524033: [debug] Checking if IPFS daemon is running
2020-10-03 21:46:28.575990: [debug] ExitSuccess
2020-10-03 21:46:28.576101: [debug] Placed IPFS daemon in MVar
2020-10-03 21:46:28.576142: [debug] IPFS Daemon var full
2020-10-03 21:46:28.576163: [debug] Running: /Users/bmann/.config/fission/bin/fission-ipfs swarm connect /dns4/node.runfission.com/tcp/4001/ipfs/QmVLEz2SxoNiFnuyLpbXsH6SvjPTrHNMU88vCQZyhgBzgw
2020-10-03 21:46:29.265015: [debug] Running local IPFS
2020-10-03 21:46:29.265160: [debug] Writing to /Users/bmann/.config/fission/tmp/b7b29a36b0ea8ee40020590a3d3aba9d757f053af818c8e5c71d4bc8d95c2f97
2020-10-03 21:46:29.265637: [debug] Starting IPFS daemon
2020-10-03 21:46:29.265669: [debug] IPFS Daemon already running
2020-10-03 21:46:29.265723: [debug] Running: /Users/bmann/.config/fission/bin/fission-ipfs swarm connect /ip4/3.226.224.78/tcp/4001/p2p/QmPeeeZZXxMBAPxxba7a6ggjDr5jLuD3RAFnmPPcvJ9fMS
2020-10-03 21:46:29.782340: [debug] Running local IPFS
2020-10-03 21:46:29.782515: [debug] Writing to /Users/bmann/.config/fission/tmp/b7b29a36b0ea8ee40020590a3d3aba9d757f053af818c8e5c71d4bc8d95c2f97
2020-10-03 21:46:29.782945: [debug] Starting IPFS daemon
2020-10-03 21:46:29.782976: [debug] IPFS Daemon already running
2020-10-03 21:46:29.783029: [debug] Running: /Users/bmann/.config/fission/bin/fission-ipfs swarm connect /ip4/3.226.224.78/udp/4001/quic/p2p/QmPeeeZZXxMBAPxxba7a6ggjDr5jLuD3RAFnmPPcvJ9fMS
2020-10-03 21:46:29.813185: [debug] Successfully connected to a node. Full results:
2020-10-03 21:46:29.813250: [debug] [Right (),Right (),Right ()]
2020-10-03 21:46:29.813280: [debug] Connected to remote node
⏯ 3.5 seconds to actually get a running IPFS and do a swarm connect ⏯

This is not bad, if we can get this the first time.

2020-10-03 21:46:29.813335: [debug] Reading YAML from "./fission.yaml"
2020-10-03 21:46:29.813421: [debug] Path does exist
2020-10-03 21:46:29.813770: [debug] Starting single IPFS add locally of "/Users/bmann/repos/simply-jekyll/_site"
2020-10-03 21:46:29.813828: [debug] Running local IPFS
2020-10-03 21:46:29.813880: [debug] Writing to /Users/bmann/.config/fission/tmp/b7b29a36b0ea8ee40020590a3d3aba9d757f053af818c8e5c71d4bc8d95c2f97
2020-10-03 21:46:29.814382: [debug] Starting IPFS daemon
2020-10-03 21:46:29.814418: [debug] IPFS Daemon already running
2020-10-03 21:46:29.814462: [debug] Running: /Users/bmann/.config/fission/bin/fission-ipfs add -HQr /Users/bmann/repos/simply-jekyll/_site  --timeout=300s --cid-version=1 --ignore-rules-path=/Users/bmann/.config/fission/tmp/b7b29a36b0ea8ee40020590a3d3aba9d757f053af818c8e5c71d4bc8d95c2f97
⏯ sub-1 second to set up ignore rules and call IPFS add ⏯

Other than wanting to mark the beginning of the IPFS add call, this is obviously super quick.

2020-10-03 21:46:33.884226: [debug] Loaded Server DID: did:key:zStEZpzSMtTt9k2vszgvCwF4fLQQSyA15W5AQ4z3AR6Bx4eFJ5crJFbuGxKmbma4
⏯ 4 seconds to complete IPFS add of ~10-20 changed text files ⏯

With naming and everything I don’t know exactly how many text files and directories changed. Point being, relatively small file sizes and minor changes in blocks from an IPFS perspective.

At this point, we have the hash and all the files are added to your local IPFS store, and you could connect to it locally.

2020-10-03 21:46:33.884311: [debug] Loaded Server DID: did:key:zStEZpzSMtTt9k2vszgvCwF4fLQQSyA15W5AQ4z3AR6Bx4eFJ5crJFbuGxKmbma4
2020-10-03 21:46:33.884436: [debug] Sending web request
🚀 Now live on the network
📝 DNS updated! Check out your site at: 
🔗 ancient-aquamarine-metalic-princess.fission.app
2020-10-03 21:46:52.312736: [debug] Stopping IPFS Daemon
⏯ 19 seconds to pin / update hash to server, update DNS and stop the IPFS daemon ⏯

19 seconds to do all that is pretty fast :rocket: :logo:

Total elapsed: 39 seconds

Really, this is quite nice! I think I’d like to see us spit out a couple more messages, because in non-verbose mode, it “feels” like nothing is happening.

2 Likes