spark core 2.0 TimeTrackingOutputStream
2017-01-20 10:01
267 查看
TimeTrackingOutputStream 拦截写琼脂求,并且跟踪写操作花费的时间,并把时间写到shuffle write的metrics里。
/** * Intercepts write calls and tracks total time spent writing in order to update shuffle write * metrics. Not thread safe. */ @Private public final class TimeTrackingOutputStream extends OutputStream { private final ShuffleWriteMetrics writeMetrics; private final OutputStream outputStream; public TimeTrackingOutputStream(ShuffleWriteMetrics writeMetrics, OutputStream outputStream) { this.writeMetrics = writeMetrics; this.outputStream = outputStream; } @Override public void write(int b) throws IOException { final long startTime = System.nanoTime(); outputStream.write(b); writeMetrics.incWriteTime(System.nanoTime() - startTime); } @Override public void write(byte[] b) throws IOException { final long startTime = System.nanoTime(); outputStream.write(b); writeMetrics.incWriteTime(System.nanoTime() - startTime); } @Override public void write(byte[] b, int off, int len) throws IOException { final long startTime = System.nanoTime(); outputStream.write(b, off, len); writeMetrics.incWriteTime(System.nanoTime() - startTime); } @Override public void flush() throws IOException { final long startTime = System.nanoTime(); outputStream.flush(); writeMetrics.incWriteTime(System.nanoTime() - startTime); } @Override public void close() throws IOException { final long startTime = System.nanoTime(); outputStream.close(); writeMetrics.incWriteTime(System.nanoTime() - startTime); } }
相关文章推荐
- spark core 2.0 ChunkedByteBufferOutputStream
- Setup 64-bit Windows Server for Running ASP.NET 1.1 and ASP.NET 2.0 at the Same Time
- 斯坦福大学的Real-time 3D internal marker tracking during arc radiotherapy by the use of combined MV–kV imaging
- 《Realtime and Robust Hand Tracking from Depth》读书笔记1
- spark core 2.0 CoarseGrainedSchedulerBackend SchedulerBackend ExecutorAllocationClient 源代码解析
- spark core 2.0 Executor
- 多目标跟踪(MOT)论文随笔-SIMPLE ONLINE AND REALTIME TRACKING WITH A DEEP ASSOCIATION METRIC (Deep SORT)
- spark core 2.0 UnifiedMemoryManager
- Adaptive Color Attributes for Real-Time Visual Tracking几句话总结
- Fusing time-of-flight depth and color for real-time segmentation and tracking
- 《Realtime and Robust Hand Tracking from Depth》读书笔记2
- spark core 2.0 MemoryManager
- Real-time tracking of multiple objects using adaptive correlation filters with complex constraints
- 论文笔记:Parallel Tracking and Verifying: A Framework for Real-Time and High Accuracy Visual Tracking
- Real-Time Compressive Tracking阅读与分析
- Top Ten Signs You Spend Too Much Time Thinking About Web 2.0
- [论文笔记]Real-Time* Multiple Object Tracking (MOT) for Autonomous Navigation
- TabStrip within ASP.NET 2.0 in C# with Design Time Support
- Real-Time Compressive Tracking论文代码详细注释
- Work Time Manager【开源项目】- 创建自己日志组件 2.0重构