Skip to content
This repository has been archived by the owner on Dec 13, 2021. It is now read-only.

Tags: osrg/namazu-swarm

Tags

v0.0.2

Toggle v0.0.2's commit message

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.
rewrite from scratch (#8)

Signed-off-by: Akihiro Suda <[email protected]>

v0.0.1

Toggle v0.0.1's commit message

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.
add example/zookeeper (1h -> 10min on 5 nodes) (#5)

standalone (without namazu swarm): about 1 hours
Namazu Swarm, Kubernetes, 5 nodes: about 10 minutes

Each of the node has 4 CPUs, 15 GB RAM

4 of 165 jobs failed. I believe we can improve 2 times faster.

```
2016-09-04 07:18:31,877 [INFO] Completed 165 jobs (4 failed)
ZooKeeperThreadTest: took 10.087706 seconds (job creation..completion)
CommandsTest: took 10.941764 seconds (job creation..completion)
ZooKeeperTestableTest: took 11.070872 seconds (job creation..completion)
QuorumServerTest: took 13.274292 seconds (job creation..completion)
ClientReconnectTest: took 14.082000 seconds (job creation..completion)
ZooKeeperServerBeanTest: took 16.158218 seconds (job creation..completion)
ToStringTest: took 20.494574 seconds (job creation..completion)
ZooKeeperServerStartupTest: took 28.231567 seconds (job creation..completion)
RemotePeerBeanTest: took 35.818706 seconds (job creation..completion)
QuorumPeerConfigTest: took 50.873921 seconds (job creation..completion)
LearnerTest: took 51.100612 seconds (job creation..completion)
WatchesReportTest: took 53.122982 seconds (job creation..completion)
PrepRequestProcessorTest: took 54.719467 seconds (job creation..completion)
ReconfigFailureCasesTest: took 64.237307 seconds (job creation..completion)
PortAssignmentTest: took 71.084063 seconds (job creation..completion)
CommitProcessorConcurrencyTest: took 75.243839 seconds (job creation..completion)
SaslClientTest: took 76.267669 seconds (job creation..completion)
JettyAdminServerTest: took 76.312443 seconds (job creation..completion)
ReferenceCountedACLCacheTest: took 76.916500 seconds (job creation..completion)
CommandResponseTest: took 77.293244 seconds (job creation..completion)
DataTreeTest: took 78.472331 seconds (job creation..completion)
LocalPeerBeanTest: took 88.817983 seconds (job creation..completion)
WatchesSummaryTest: took 89.018348 seconds (job creation..completion)
SaslAuthDesignatedServerTest: took 89.674241 seconds (job creation..completion)
WatchLeakTest: took 90.812335 seconds (job creation..completion)
LearnerSnapshotThrottlerTest: took 93.202326 seconds (job creation..completion)
SaslAuthDesignatedClientTest: took 95.377242 seconds (job creation..completion)
WatchedEventTest: took 96.696218 seconds (job creation..completion)
WatchesPathReportTest: took 96.990980 seconds (job creation..completion)
StringUtilTest: took 97.998330 seconds (job creation..completion)
RemoveWatchesCmdTest: took 98.700408 seconds (job creation..completion)
SessionTrackerTest: took 98.908683 seconds (job creation..completion)
DatadirCleanupManagerTest: took 98.951348 seconds (job creation..completion)
MultiResponseTest: took 99.750955 seconds (job creation..completion)
CustomHostProviderTest: took 100.013574 seconds (job creation..completion)
MultiTransactionRecordTest: took 100.189327 seconds (job creation..completion)
EventTypeTest: took 100.614201 seconds (job creation..completion)
VerifyingFileFactoryTest: took 100.632619 seconds (job creation..completion)
ConnectStringParserTest: took 100.763964 seconds (job creation..completion)
ACLRootTest: took 100.770064 seconds (job creation..completion)
KeeperStateTest: took 101.266808 seconds (job creation..completion)
OOMTest: took 101.362309 seconds (job creation..completion)
SessionTrackerCheckTest: took 101.465637 seconds (job creation..completion)
BinaryInputArchiveTest: took 101.475541 seconds (job creation..completion)
ZooKeeperServerConfTest: took 101.522567 seconds (job creation..completion)
FLENewEpochTest: took 101.744285 seconds (job creation..completion)
SaslAuthFailTest: took 101.980589 seconds (job creation..completion)
CreateModeTest: took 102.668819 seconds (job creation..completion)
PathUtilsTest: took 102.738582 seconds (job creation..completion)
VerGenTest: took 102.754279 seconds (job creation..completion)
CommitProcessorTest: took 102.957214 seconds (job creation..completion)
ACLTest: took 102.970344 seconds (job creation..completion)
ClientPortBindTest: took 103.116933 seconds (job creation..completion)
LENonTerminateTest: took 103.360277 seconds (job creation..completion)
StandaloneTest: took 103.459259 seconds (job creation..completion)
CRCTest: took 103.463071 seconds (job creation..completion)
X509AuthTest: took 103.667109 seconds (job creation..completion)
OSMXBeanTest: took 103.709569 seconds (job creation..completion)
ACLCountTest: took 103.766352 seconds (job creation..completion)
SessionInvalidationTest: took 103.866397 seconds (job creation..completion)
AtomicFileWritingIdiomTest: took 103.985899 seconds (job creation..completion)
SaslAuthFailNotifyTest: took 104.450094 seconds (job creation..completion)
InvalidSnapCountTest: took 104.800051 seconds (job creation..completion)
RaceConditionTest: took 105.409350 seconds (job creation..completion)
FLERestartTest: took 105.434326 seconds (job creation..completion)
ZooKeeperServerTest: took 105.465082 seconds (job creation..completion)
SaslAuthMissingClientConfigTest: took 105.474859 seconds (job creation..completion)
SerializationPerfTest: took 105.529764 seconds (job creation..completion)
LearnerHandlerTest: took 105.665199 seconds (job creation..completion)
AtomicFileOutputStreamTest: took 105.795837 seconds (job creation..completion)
FourLetterWordsTest: took 105.948612 seconds (job creation..completion)
ByteBufferInputStreamTest: took 106.036642 seconds (job creation..completion)
WatcherFuncTest: took 106.216618 seconds (job creation..completion)
CreateTest: took 106.599260 seconds (job creation..completion)
MultiAsyncTransactionTest: took 106.677968 seconds (job creation..completion)
ClientRetryTest: took 107.087004 seconds (job creation..completion)
AuthTest: took 107.590758 seconds (job creation..completion)
ZKClientConfigTest: took 107.690837 seconds (job creation..completion)
RepeatStartupTest: took 107.710308 seconds (job creation..completion)
MaxCnxnsTest: took 107.775680 seconds (job creation..completion)
NettyServerCnxnTest: took 107.781949 seconds (job creation..completion)
ZooKeeperQuotaTest: took 108.003659 seconds (job creation..completion)
TimeTest: took 108.075176 seconds (job creation..completion)
SaslAuthTest: took 108.091659 seconds (job creation..completion)
StandaloneDisabledTest: took 108.639542 seconds (job creation..completion)
SaslAuthFailDesignatedClientTest: took 108.850405 seconds (job creation..completion)
NIOServerCnxnTest: took 109.094506 seconds (job creation..completion)
ChrootTest: took 109.137282 seconds (job creation..completion)
FLEPredicateTest: took 109.962983 seconds (job creation..completion)
GetChildren2Test: took 110.220385 seconds (job creation..completion)
ServerCnxnTest: took 110.396793 seconds (job creation..completion)
FLELostMessageTest: took 111.253249 seconds (job creation..completion)
QuorumPeerTest: took 111.538943 seconds (job creation..completion)
NonRecoverableErrorTest: took 111.690744 seconds (job creation..completion)
BufferSizeTest: took 111.734545 seconds (job creation..completion)
NIOConnectionFactoryFdLeakTest: took 111.882980 seconds (job creation..completion)
FLEBackwardElectionRoundTest: took 111.934536 seconds (job creation..completion)
StaticHostProviderTest: took 113.504831 seconds (job creation..completion)
Zab1_0Test: took 113.698162 seconds (job creation..completion)
NullDataTest: took 114.122657 seconds (job creation..completion)
SyncCallTest: took 114.372754 seconds (job creation..completion)
ObserverTest: took 116.040074 seconds (job creation..completion)
StatTest: took 116.315901 seconds (job creation..completion)
MultiTransactionTest: took 117.887655 seconds (job creation..completion)
ChrootAsyncTest: took 117.934982 seconds (job creation..completion)
TruncateTest: took 118.093238 seconds (job creation..completion)
FLEZeroWeightTest: took 118.174079 seconds (job creation..completion)
ZkDatabaseCorruptionTest: took 118.550660 seconds (job creation..completion)
RestoreCommittedLogTest: took 118.703448 seconds (job creation..completion)
AsyncTest: took 118.792227 seconds (job creation..completion)
CreateContainerTest: took 120.268133 seconds (job creation..completion)
ZooKeeperTest: took 120.276869 seconds (job creation..completion)
QuorumUtilTest: took 120.387510 seconds (job creation..completion)
ObserverHierarchicalQuorumTest: took 121.539948 seconds (job creation..completion)
DuplicateLocalSessionUpgradeTest: took 121.606414 seconds (job creation..completion)
FourLetterWordsQuorumTest: took 122.229152 seconds (job creation..completion)
DeserializationPerfTest: took 122.723468 seconds (job creation..completion)
SSLTest: took 123.800026 seconds (job creation..completion)
SSLAuthTest: took 123.925538 seconds (job creation..completion)
LETest: took 124.337241 seconds (job creation..completion)
LeaderSessionTrackerTest: took 124.702488 seconds (job creation..completion)
AsyncOpsTest: took 125.335236 seconds (job creation..completion)
LoadFromLogTest: took 125.503013 seconds (job creation..completion)
ObserverLETest: took 127.124032 seconds (job creation..completion)
ReconfigBackupTest: took 127.394179 seconds (job creation..completion)
WatcherTest: took 128.309430 seconds (job creation..completion)
LocalSessionsOnlyTest: took 130.683564 seconds (job creation..completion)
QuorumMajorityTest: took 130.885603 seconds (job creation..completion)
ZooKeeperServerMainTest: took 132.302454 seconds (job creation..completion)
CnxManagerTest: took 132.424545 seconds (job creation..completion)
HierarchicalQuorumTest: took 133.075610 seconds (job creation..completion)
InvalidSnapshotTest: took 133.210229 seconds (job creation..completion)
RecoveryTest: took 135.450881 seconds (job creation..completion)
GetProposalFromTxnTest: took 138.208650 seconds (job creation..completion)
WatchEventWhenAutoResetTest: took 139.148822 seconds (job creation..completion)
FLETest: took 139.185609 seconds (job creation..completion)
SessionTest: took 140.679966 seconds (job creation..completion)
SessionUpgradeTest: took 141.049295 seconds (job creation..completion)
ReadOnlyModeTest: took 142.383318 seconds (job creation..completion)
LocalSessionRequestTest: took 143.006522 seconds (job creation..completion)
ReconfigLegacyTest: took 144.694358 seconds (job creation..completion)
PurgeTxnTest: took 146.638359 seconds (job creation..completion)
QuorumQuotaTest: took 147.252778 seconds (job creation..completion)
ClientHammerTest: took 149.578333 seconds (job creation..completion)
QuorumPeerMainTest: took 156.124594 seconds (job creation..completion)
ChrootClientTest: took 158.190239 seconds (job creation..completion)
RemoveWatchesTest: took 158.960574 seconds (job creation..completion)
ClientTest: took 160.863094 seconds (job creation..completion)
ClientSkipACLTest: took 162.903893 seconds (job creation..completion)
ObserverQuorumHammerTest: took 163.695320 seconds (job creation..completion)
NettyNettySuiteHammerTest: took 182.221188 seconds (job creation..completion)
QuorumHammerTest: took 182.964924 seconds (job creation..completion)
AsyncHammerTest: took 183.474092 seconds (job creation..completion)
NioNettySuiteHammerTest: took 188.556229 seconds (job creation..completion)
DisconnectedWatcherTest: took 189.742979 seconds (job creation..completion)
ZxidRolloverTest: took 191.320002 seconds (job creation..completion)
QuorumZxidSyncTest: took 194.330384 seconds (job creation..completion)
QuorumRequestPipelineTest: took 199.396373 seconds (job creation..completion)
QuorumTest: took 234.557445 seconds (job creation..completion)
FollowerResyncConcurrencyTest: took 245.253646 seconds (job creation..completion)
ReconfigRecoveryTest: took 267.086347 seconds (job creation..completion)
ReconfigTest: took 379.169911 seconds (job creation..completion)
NioNettySuiteTest: took 518.760587 seconds (job creation..completion)
NettyNettySuiteTest: took 532.372192 seconds (job creation..completion)
 (at run.py:67)
Command exited with non-zero status 64
166.35user 81.54system 10:00.92elapsed 41%CPU (0avgtext+0avgdata 71636maxresident)k
3192inputs+128416outputs (17major+4448079minor)pagefaults 0swaps

real    10m4.379s
user    2m46.812s
sys     1m21.620s
```