Skip to content

Commit e498ab7

Browse files
authored
Update the Indexer 3.x migration document. (algorand#1579)
1 parent 0f41c6d commit e498ab7

File tree

1 file changed

+41
-6
lines changed

1 file changed

+41
-6
lines changed

docs/MigrationFAQ.md

+41-6
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,21 @@ No. The Indexer 3.x REST API is fully backward compatible with Indexer 2.x. No c
88

99
No. The "follower" node used by Conduit is not a general purpose node and cannot submit transactions to the network. It has disabled many services compared to other types of nodes.
1010

11+
## Can I re-use a 2.x database?
12+
13+
Yes. The schema for 2.15.4 and 3.2.0 are fully compatible. If you have an existing database, or a database backup, it can be used to speed up the setup time.
14+
15+
If you provide Conduit with the follower node's admin API token, then Conduit will attempt to run fast catchup automatically by looking at the latest round in the database and finding an appropriate catchpoint. Once the catchpoint is restored, it will resume with normal block processing.
16+
17+
## How long does it take to synchronize a new deployment?
18+
19+
With an optimal deployment, the process can take less than a week, but it is common for the process to take 3+ weeks. The process is typically disk and network bound.
20+
21+
For optimal performance ensure:
22+
* A fast network connection.
23+
* Low latency between Conduit, the follower node and postgres.
24+
* Fast disk, locally attached NVMe is ideal for Conduit and algod.
25+
1126
## What are the resource requirements for Conduit and Indexer 3.x compared to Indexer 2.x?
1227

1328
The storage requirements are much less. The Conduit follower node runs with non-archival storage requirements compared to the archival storage requirements needed by Indexer 2.x. For mainnet at round 32 million, this can save between 1.2TB and 1.6TB of storage.
@@ -20,11 +35,31 @@ The postgres requirements are the same for those reading the full history (exist
2035

2136
No, these are not currently supported.
2237

23-
## How long does it take to synchronize a new deployment?
2438

25-
With an optimal deployment, the process can take less than a week, but it is common for the process to take 3+ weeks. The process is typically disk and network bound.
39+
## Conduit error: "operation not available during catchup"
2640

27-
For optimal performance ensure:
28-
* A fast network connection.
29-
* Low latency between Conduit, the follower node and postgres.
30-
* Fast disk, locally attached NVMe is ideal for Conduit and algod.
41+
You will see this error if the node is running fast catchup while Conduit is being started. The process will terminate after the maximum number of retries.
42+
43+
Some operators are used to manually running fast catchup as part of their deployment process. With Conduit, running fast catchup manually is no longer required. By setting the node's admin API token in the Conduit config, fast catchup will run automatically if necessary.
44+
45+
Docker users should avoid the `FAST_CATCHUP=1` environment setting.
46+
47+
If you see this message for a new deployment, recreate the follower node and ensure fast catchup is not used.
48+
49+
## Conduit error: "initializing block round _____ but next round to account is 0"
50+
51+
You will see this error if the node is running fast catchup while Conduit is being started. The process will terminate after the maximum number of retries.
52+
53+
This can also occur during initialization you reset the database or use the start-at-round option.
54+
55+
If this happens during a new installation, it is best to reset everything and start from the beginning. If it happens for a long running deployment you should contact Algorand Inc for support.
56+
57+
## Conduit error: "failed to set sync round on the ledger"
58+
59+
You will see this error if the node is not configured as a "follower" node. The process will terminate after the maximum number of retries.
60+
61+
Please refer to the [Using Conduit to Populate an Indexer Database](https://github.com/algorand/conduit/blob/master/docs/tutorials/IndexerWriter.md) documentation.
62+
63+
## Help! My question is not answered here!
64+
65+
If your question is not answered here [please join us on discord](https://discord.com/invite/algorand). We routinely monitor the `conduit` channel along with many Conduit operators.

0 commit comments

Comments
 (0)