Go Ceramic Anchor Service

Architecture

Data Pipeline

https://lucid.app/documents/view/c9b677a7-2b60-4bec-89c7-43d10e2a262e

Flows

https://lucid.app/documents/view/9fb65517-add6-48f5-a35b-e8c5835a9762

TODOs (roughly ordered by priority)

Major

• Implement failure handling service
• Prepare Anchor Worker code to accept batches
• Prepare Anchor Worker code to post anchor results to a queue
• Graceful shutdown
• Terraform for deployments
• Implement dead-letter queue (DLQ)
• Metrics
• Unit tests (backward compatibility tests?)
• Performance tests

Minor

• Test against local infra, e.g. Localstack
• CI/CD
• Clarify contexts being used in various spots - operation ctx vs. server ctx

Starter

• Use DynamoDB un/marshalling for millisecond resolution checkpoints instead of storing date/time strings (see pipeline-tools