我正在编写一个工具来帮助分析小型的日志文件(例如,1-2MB,在罕见的情况下高达50 MB)。
日志文件来自文件同步应用程序,并包含各种不同的日志行:
2016-02-22 21:18:03,872 +0200 INFO pid=670 4664029184:PerfReporter perf_reporter.pyo:71 Current Stats: sync_bo=0, dio=266945, blacklist_len=0, uptime=1601770, pc=60, sync_x=0, sync_y=0, prs=78368, sync_percent=0, corpus=8819, c0=1510, pvm=3095812
2016-02-22 21:18:03,874 +0200 INFO pid=670 4664029184:PerfReporter sync_http_client.pyo:237 Opening direct connection to csi.gstatic.com:443.
2016-02-22 21:19:13,185 +0200 INFO pid=670 4650881024:SyncClientImpressionsThread impression_logger.pyo:278 Heartbeat was added.
2015-06-23 12:15:29,860 +0300 INFO pid=33914 4634906624:Worker-2 snapshot_sqlite.pyo:143 Adding local entry inode=57033344, filename=None
2015-06-23 12:15:29,861 +0300 INFO pid=33914 4634906624:Worker-2 snapshot_sqlite.pyo:171 Adding cloud entry resource_id=file:0B_JGPr4BzMr4dmdCbFBibms5WFk, filename=None
2015-06-23 12:15:29,862 +0300 INFO pid=33914 4634906624:Worker-2 snapshot_sqlite.pyo:253 Updating cloud entry doc_id=0B_JGPr4BzMr4dmdCbFBibms5WFk, filename=~$Foo Bar.xlsx
2015-06-23 12:15:30,247 +0300 INFO pid=33914 4651732992:Batcher batcher.pyo:849 Batcher Stats = file_count = Counter({_COUNT_KEY(direction=_DownloadDirectionType(Direction.DOWNLOAD), action=_FSChangeActionType(Action.CREATE), batch=False, successful=True): 1}), byte_count = Counter({_COUNT_KEY(direction=_DownloadDirectionType(Direction.DOWNLOAD), action=
_FSChangeActionType(Action.CREATE), batch=False, successful=True): 165}), batch_operation_count = Counter(), process_seconds = Counter({_COUNT_KEY(direction=_DownloadDirectionType(Direction.DOWNLOAD), action=_FSChangeActionType(Action.CREATE), batch=False, successful=True): 0.6173379421234131}), duration seconds = 1 (start_time = 1435050929, end_time = 143505093
0)我将解析出任何键值对,以及几个关键属性(例如inode号、文件名、doc_id)。
然后,我想要一个UI (控制台或Web UI),它允许您对各种事物进行过滤,并显示完整的日志:
是否有任何现有的UI元素/工具包/框架允许在多个维度上进行轻松的过滤?
例如,您可以选择一个inode编号和事件类型,并在一段时间内看到该组合的完整历史记录?
可能与Splunk/Kibana和ilk所允许的相似,但可以作为独立组件使用?(控制台或网页)
发布于 2016-03-02 11:43:18
使用MASSALYZER,您可以在控制台中完成它。如果你需要帮助,就问我!
https://stackoverflow.com/questions/35617310
复制相似问题