1
0
Fork 0
Commit Graph

64 Commits

Author SHA1 Message Date
Gregory Eremin e21ffb6eb4 There's no need to balance the number of workers
Goroutines are too cheap to bother
2015-10-27 03:52:54 +03:00
Gregory Eremin 850f0033a5 Respect min/max num workers range 2015-10-27 03:42:00 +03:00
Gregory Eremin 4eae1c3b8d Implement configurable scaling PoC 2015-10-27 03:33:04 +03:00
Gregory Eremin b0142de4a7 Make worker pool size, add autoscale option 2015-10-27 03:09:19 +03:00
Gregory Eremin e0eb526af5 Make sample size configurable 2015-10-27 03:03:21 +03:00
Gregory Eremin 6f56486566 Move all stats related code to stats package 2015-10-27 02:54:00 +03:00
Gregory Eremin 1cace592e6 Move basic features of stats logger into base structure 2015-10-27 02:11:09 +03:00
Gregory Eremin 98ff2625a4 Stats group tests 2015-10-26 13:22:01 +03:00
Gregory Eremin 3918b26043 Cleanup duplicated code 2015-10-25 14:35:39 +03:00
Gregory Eremin e098c2d7ea Give number printer adequate reasons to crash 2015-10-24 19:34:33 +03:00
Gregory Eremin 6d56b1b3be Update example consumer 2015-10-24 19:28:17 +03:00
Gregory Eremin 797e892120 Customizable logger 2015-10-24 19:25:16 +03:00
Gregory Eremin 4465d2c561 Handle worker crashes 2015-10-24 18:49:38 +03:00
Gregory Eremin 2ebd972a34 Add statistics fetcher interface 2015-10-24 18:17:24 +03:00
Gregory Eremin 1550495bf9 Collect task wait statistics 2015-10-24 18:08:12 +03:00
Gregory Eremin bfa1575d79 Add statistics groups 2015-10-24 04:22:02 +03:00
Gregory Eremin 0e1fbbe729 Language 2015-10-24 03:07:47 +03:00
Gregory Eremin 3937c71a42 Skip base function in task name 2015-10-24 02:42:58 +03:00
Gregory Eremin 78cfb92db3 Use statistics logger in example app 2015-10-24 02:42:00 +03:00
Gregory Eremin 0549519e0e Implement statistics logger 2015-10-24 02:41:41 +03:00
Gregory Eremin 0e5670707f Add statistics interface 2015-10-24 02:41:19 +03:00
Gregory Eremin d2041b69a1 Handle panic debug on the Satan side 2015-10-24 02:40:20 +03:00
Gregory Eremin 182cfa3e40 Use auto increment value as worker index 2015-10-24 01:04:47 +03:00
Gregory Eremin 53f2cec247 Move rate limiting advise to the second place 2015-10-18 03:56:37 +03:00
Gregory Eremin 0c77cdb096 Reset system task creation time when restarting 2015-10-18 03:49:33 +03:00
Gregory Eremin 285d05cfd2 Log messages on Kafka startup/shutdown 2015-10-18 03:46:52 +03:00
Gregory Eremin 787156d3ba Wait for Kafka partition to shutdown 2015-10-18 03:45:25 +03:00
Gregory Eremin ef17093207 Now we can safely stop waiting for tasks when shutdown is closed 2015-10-18 03:34:10 +03:00
Gregory Eremin d847be21c6 Make shutdown handling predictable 2015-10-18 03:22:07 +03:00
Gregory Eremin 559886f297 Move task to a separate file, move processing logic to task.process 2015-10-17 06:16:00 +03:00
Gregory Eremin e8aebe3b1c Wrong indentation in submodules file lol 2015-10-17 06:00:51 +03:00
Gregory Eremin f89a21334d Make use of git submodules and GO15VENDOREXPERIMENT env variable 2015-10-17 05:58:55 +03:00
Gregory Eremin ec98145508 Correct zero rate to 1 too 2015-10-17 05:37:13 +03:00
Gregory Eremin 0f4bed32c8 Implement processing rate limits 2015-10-17 05:33:46 +03:00
Gregory Eremin a9a50522fb Always measure task execution time 2015-10-17 05:14:09 +03:00
Gregory Eremin 40dbc556f5 System processes are now named and supervised 2015-10-17 04:51:05 +03:00
Gregory Eremin a8443577d2 Add a comment that is very useful in reading stack traces 2015-10-17 04:31:47 +03:00
Gregory Eremin 9141fd9f80 Make function names more consistent 2015-10-17 04:11:29 +03:00
Gregory Eremin 290b1dfd4e Move example Kafka implementation to a separate package 2015-10-17 04:10:16 +03:00
Gregory Eremin 6acd520f08 Add example readme draft 2015-10-17 03:58:31 +03:00
Gregory Eremin dd2a6fcca2 Use Kafka plugin based consumer implementation in example 2015-10-17 03:42:27 +03:00
Gregory Eremin 87b8e851cc Make Satan not backend opinionated 2015-10-17 03:41:21 +03:00
Gregory Eremin dff6c81d04 Add consumer support to daemons 2015-10-17 03:40:17 +03:00
Gregory Eremin 8eac0b59fb Remove backend package. Backend implementation is now solely up to user 2015-10-17 03:39:54 +03:00
Gregory Eremin 75335347ff Add a gitignore file 2015-10-17 01:14:46 +03:00
Gregory Eremin 777ff5a09b Caller now accepts any unmarshal functions; JSON is used by default 2015-10-17 01:08:14 +03:00
Gregory Eremin d0ff12ce64 Add example consumer 2015-10-16 02:35:03 +03:00
Gregory Eremin f784e8a2e0 Process tasks until shutdown channel is open 2015-10-16 02:28:40 +03:00
Gregory Eremin 8f35ee060e Kafka backend initializer 2015-10-16 02:28:06 +03:00
Gregory Eremin b6f0d2953f Invert ShouldShutdown logic 2015-10-16 02:27:03 +03:00