72 Commits

Author SHA1 Message Date
3c77fec5e3 Implement base stats snapshot 2015-10-28 00:12:28 +03:00
c7db902da2 Use time.Time.Sub function instead of manipulating nanoseconds 2015-10-27 22:47:36 +03:00
79cb745a5d Define an empty Shutdown function on base daemon 2015-10-27 19:54:08 +03:00
7af5b18d85 Dashboard server draft 2015-10-27 04:22:45 +03:00
80da11ad60 Implement statistics server 2015-10-27 04:16:02 +03:00
3033508706 Collecting task wait time for workers is no longer necessary 2015-10-27 04:00:41 +03:00
7432c5e0d8 Increase default num workers 2015-10-27 03:56:41 +03:00
61041dbd1b Don't log notices on worker start/stop 2015-10-27 03:56:08 +03:00
e21ffb6eb4 There's no need to balance the number of workers
Goroutines are too cheap to bother
2015-10-27 03:52:54 +03:00
850f0033a5 Respect min/max num workers range 2015-10-27 03:42:00 +03:00
4eae1c3b8d Implement configurable scaling PoC 2015-10-27 03:33:04 +03:00
b0142de4a7 Make worker pool size, add autoscale option 2015-10-27 03:09:19 +03:00
e0eb526af5 Make sample size configurable 2015-10-27 03:03:21 +03:00
6f56486566 Move all stats related code to stats package 2015-10-27 02:54:00 +03:00
1cace592e6 Move basic features of stats logger into base structure 2015-10-27 02:11:09 +03:00
98ff2625a4 Stats group tests 2015-10-26 13:22:01 +03:00
3918b26043 Cleanup duplicated code 2015-10-25 14:35:39 +03:00
e098c2d7ea Give number printer adequate reasons to crash 2015-10-24 19:34:33 +03:00
6d56b1b3be Update example consumer 2015-10-24 19:28:17 +03:00
797e892120 Customizable logger 2015-10-24 19:25:16 +03:00
4465d2c561 Handle worker crashes 2015-10-24 18:49:38 +03:00
2ebd972a34 Add statistics fetcher interface 2015-10-24 18:17:24 +03:00
1550495bf9 Collect task wait statistics 2015-10-24 18:08:12 +03:00
bfa1575d79 Add statistics groups 2015-10-24 04:22:02 +03:00
0e1fbbe729 Language 2015-10-24 03:07:47 +03:00
3937c71a42 Skip base function in task name 2015-10-24 02:42:58 +03:00
78cfb92db3 Use statistics logger in example app 2015-10-24 02:42:00 +03:00
0549519e0e Implement statistics logger 2015-10-24 02:41:41 +03:00
0e5670707f Add statistics interface 2015-10-24 02:41:19 +03:00
d2041b69a1 Handle panic debug on the Satan side 2015-10-24 02:40:20 +03:00
182cfa3e40 Use auto increment value as worker index 2015-10-24 01:04:47 +03:00
53f2cec247 Move rate limiting advise to the second place 2015-10-18 03:56:37 +03:00
0c77cdb096 Reset system task creation time when restarting 2015-10-18 03:49:33 +03:00
285d05cfd2 Log messages on Kafka startup/shutdown 2015-10-18 03:46:52 +03:00
787156d3ba Wait for Kafka partition to shutdown 2015-10-18 03:45:25 +03:00
ef17093207 Now we can safely stop waiting for tasks when shutdown is closed 2015-10-18 03:34:10 +03:00
d847be21c6 Make shutdown handling predictable 2015-10-18 03:22:07 +03:00
559886f297 Move task to a separate file, move processing logic to task.process 2015-10-17 06:16:00 +03:00
e8aebe3b1c Wrong indentation in submodules file lol 2015-10-17 06:00:51 +03:00
f89a21334d Make use of git submodules and GO15VENDOREXPERIMENT env variable 2015-10-17 05:58:55 +03:00
ec98145508 Correct zero rate to 1 too 2015-10-17 05:37:13 +03:00
0f4bed32c8 Implement processing rate limits 2015-10-17 05:33:46 +03:00
a9a50522fb Always measure task execution time 2015-10-17 05:14:09 +03:00
40dbc556f5 System processes are now named and supervised 2015-10-17 04:51:05 +03:00
a8443577d2 Add a comment that is very useful in reading stack traces 2015-10-17 04:31:47 +03:00
9141fd9f80 Make function names more consistent 2015-10-17 04:11:29 +03:00
290b1dfd4e Move example Kafka implementation to a separate package 2015-10-17 04:10:16 +03:00
6acd520f08 Add example readme draft 2015-10-17 03:58:31 +03:00
dd2a6fcca2 Use Kafka plugin based consumer implementation in example 2015-10-17 03:42:27 +03:00
87b8e851cc Make Satan not backend opinionated 2015-10-17 03:41:21 +03:00