archives/snowflake
2
0
Fork 0
mirror of https://gitlab.torproject.org/tpo/anti-censorship/pluggable-transports/snowflake.git synced 2025-10-14 05:11:19 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions
snowflake/common/ipsetsink
History
David Fifield 8e5ea82611 Add a scanner error check to ClusterCounter.Count. 
It was silently exiting at the "recordingStart":"2022-09-23T17:06:59.680537075Z"
line, the first line whose length (66873) exceeds
bufio.MaxScanTokenSize. Now distinctcounter exits with an error status
instead of reporting partial results.

$ ./distinctcounter -from 2023-01-01T00:00:00Z -to 2023-01-10T00:00:00Z -in metrics-ip-salted.jsonl
2023/04/20 13:54:11 unable to count:bufio.Scanner: token too long
2023-04-20 11:28:58 -04:00
..
sinkcluster Add a scanner error check to ClusterCounter.Count. 2023-04-20 11:28:58 -04:00
sink.go Use truncated hash instead crc64 for counted hash 2022-06-16 15:00:12 +01:00
sink_test.go Add distinct IP counter 2022-06-16 14:58:12 +01:00