-
Notifications
You must be signed in to change notification settings - Fork 6
/
Copy pathspark_job.log
7155 lines (7153 loc) · 807 KB
/
spark_job.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
24/08/13 15:12:43 INFO SparkContext: Running Spark version 3.5.1
24/08/13 15:12:43 INFO SparkContext: OS info Linux, 6.5.0-45-generic, amd64
24/08/13 15:12:43 INFO SparkContext: Java version 11.0.24
24/08/13 15:12:43 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
24/08/13 15:12:43 INFO ResourceUtils: ==============================================================
24/08/13 15:12:43 INFO ResourceUtils: No custom resources configured for spark.driver.
24/08/13 15:12:43 INFO ResourceUtils: ==============================================================
24/08/13 15:12:43 INFO SparkContext: Submitted application: KafkaTransactionConsumer
24/08/13 15:12:43 INFO ResourceProfile: Default ResourceProfile created, executor resources: Map(cores -> name: cores, amount: 1, script: , vendor: , memory -> name: memory, amount: 1024, script: , vendor: , offHeap -> name: offHeap, amount: 0, script: , vendor: ), task resources: Map(cpus -> name: cpus, amount: 1.0)
24/08/13 15:12:43 INFO ResourceProfile: Limiting resource is cpu
24/08/13 15:12:43 INFO ResourceProfileManager: Added ResourceProfile id: 0
24/08/13 15:12:43 INFO SecurityManager: Changing view acls to: root
24/08/13 15:12:43 INFO SecurityManager: Changing modify acls to: root
24/08/13 15:12:43 INFO SecurityManager: Changing view acls groups to:
24/08/13 15:12:43 INFO SecurityManager: Changing modify acls groups to:
24/08/13 15:12:43 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: root; groups with view permissions: EMPTY; users with modify permissions: root; groups with modify permissions: EMPTY
24/08/13 15:12:44 INFO Utils: Successfully started service 'sparkDriver' on port 36095.
24/08/13 15:12:44 INFO SparkEnv: Registering MapOutputTracker
24/08/13 15:12:44 INFO SparkEnv: Registering BlockManagerMaster
24/08/13 15:12:44 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
24/08/13 15:12:44 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
24/08/13 15:12:44 INFO SparkEnv: Registering BlockManagerMasterHeartbeat
24/08/13 15:12:44 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-e327b430-f147-442b-b8e8-b7457cdf607c
24/08/13 15:12:44 INFO MemoryStore: MemoryStore started with capacity 434.4 MiB
24/08/13 15:12:44 INFO SparkEnv: Registering OutputCommitCoordinator
24/08/13 15:12:44 INFO JettyUtils: Start Jetty 0.0.0.0:4040 for SparkUI
24/08/13 15:12:44 WARN Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
24/08/13 15:12:44 INFO Utils: Successfully started service 'SparkUI' on port 4041.
24/08/13 15:12:44 INFO Executor: Starting executor ID driver on host 3316099bf65c
24/08/13 15:12:44 INFO Executor: OS info Linux, 6.5.0-45-generic, amd64
24/08/13 15:12:44 INFO Executor: Java version 11.0.24
24/08/13 15:12:44 INFO Executor: Starting executor with user classpath (userClassPathFirst = false): ''
24/08/13 15:12:44 INFO Executor: Created or updated repl class loader org.apache.spark.util.MutableURLClassLoader@e909fe1 for default.
24/08/13 15:12:44 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 38099.
24/08/13 15:12:44 INFO NettyBlockTransferService: Server created on 3316099bf65c:38099
24/08/13 15:12:44 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
24/08/13 15:12:44 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 3316099bf65c, 38099, None)
24/08/13 15:12:44 INFO BlockManagerMasterEndpoint: Registering block manager 3316099bf65c:38099 with 434.4 MiB RAM, BlockManagerId(driver, 3316099bf65c, 38099, None)
24/08/13 15:12:44 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 3316099bf65c, 38099, None)
24/08/13 15:12:44 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, 3316099bf65c, 38099, None)
24/08/13 15:12:44 INFO SharedState: Setting hive.metastore.warehouse.dir ('null') to the value of spark.sql.warehouse.dir.
24/08/13 15:12:44 INFO SharedState: Warehouse path is 'file:/opt/spark/spark-warehouse'.
24/08/13 15:12:49 INFO CodeGenerator: Code generated in 174.373382 ms
24/08/13 15:12:49 INFO SparkContext: Starting job: json at NativeMethodAccessorImpl.java:0
24/08/13 15:12:49 INFO DAGScheduler: Got job 0 (json at NativeMethodAccessorImpl.java:0) with 8 output partitions
24/08/13 15:12:49 INFO DAGScheduler: Final stage: ResultStage 0 (json at NativeMethodAccessorImpl.java:0)
24/08/13 15:12:49 INFO DAGScheduler: Parents of final stage: List()
24/08/13 15:12:49 INFO DAGScheduler: Missing parents: List()
24/08/13 15:12:49 INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[6] at json at NativeMethodAccessorImpl.java:0), which has no missing parents
24/08/13 15:12:49 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 21.1 KiB, free 434.4 MiB)
24/08/13 15:12:49 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 10.2 KiB, free 434.4 MiB)
24/08/13 15:12:49 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on 3316099bf65c:38099 (size: 10.2 KiB, free: 434.4 MiB)
24/08/13 15:12:49 INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:1585
24/08/13 15:12:49 INFO DAGScheduler: Submitting 8 missing tasks from ResultStage 0 (MapPartitionsRDD[6] at json at NativeMethodAccessorImpl.java:0) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7))
24/08/13 15:12:49 INFO TaskSchedulerImpl: Adding task set 0.0 with 8 tasks resource profile 0
24/08/13 15:12:49 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0) (3316099bf65c, executor driver, partition 0, PROCESS_LOCAL, 7595 bytes)
24/08/13 15:12:49 INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1) (3316099bf65c, executor driver, partition 1, PROCESS_LOCAL, 7595 bytes)
24/08/13 15:12:49 INFO TaskSetManager: Starting task 2.0 in stage 0.0 (TID 2) (3316099bf65c, executor driver, partition 2, PROCESS_LOCAL, 7595 bytes)
24/08/13 15:12:49 INFO TaskSetManager: Starting task 3.0 in stage 0.0 (TID 3) (3316099bf65c, executor driver, partition 3, PROCESS_LOCAL, 7595 bytes)
24/08/13 15:12:49 INFO TaskSetManager: Starting task 4.0 in stage 0.0 (TID 4) (3316099bf65c, executor driver, partition 4, PROCESS_LOCAL, 7595 bytes)
24/08/13 15:12:49 INFO TaskSetManager: Starting task 5.0 in stage 0.0 (TID 5) (3316099bf65c, executor driver, partition 5, PROCESS_LOCAL, 7595 bytes)
24/08/13 15:12:49 INFO TaskSetManager: Starting task 6.0 in stage 0.0 (TID 6) (3316099bf65c, executor driver, partition 6, PROCESS_LOCAL, 7595 bytes)
24/08/13 15:12:49 INFO TaskSetManager: Starting task 7.0 in stage 0.0 (TID 7) (3316099bf65c, executor driver, partition 7, PROCESS_LOCAL, 8068 bytes)
24/08/13 15:12:49 INFO Executor: Running task 3.0 in stage 0.0 (TID 3)
24/08/13 15:12:49 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
24/08/13 15:12:49 INFO Executor: Running task 5.0 in stage 0.0 (TID 5)
24/08/13 15:12:49 INFO Executor: Running task 7.0 in stage 0.0 (TID 7)
24/08/13 15:12:49 INFO Executor: Running task 1.0 in stage 0.0 (TID 1)
24/08/13 15:12:49 INFO Executor: Running task 4.0 in stage 0.0 (TID 4)
24/08/13 15:12:49 INFO Executor: Running task 2.0 in stage 0.0 (TID 2)
24/08/13 15:12:49 INFO Executor: Running task 6.0 in stage 0.0 (TID 6)
24/08/13 15:12:50 INFO CodeGenerator: Code generated in 27.238269 ms
24/08/13 15:12:50 INFO PythonRunner: Times: total = 749, boot = 542, init = 207, finish = 0
24/08/13 15:12:50 INFO PythonRunner: Times: total = 752, boot = 548, init = 204, finish = 0
24/08/13 15:12:50 INFO PythonRunner: Times: total = 756, boot = 545, init = 211, finish = 0
24/08/13 15:12:50 INFO PythonRunner: Times: total = 762, boot = 556, init = 206, finish = 0
24/08/13 15:12:50 INFO PythonRunner: Times: total = 757, boot = 552, init = 205, finish = 0
24/08/13 15:12:50 INFO Executor: Finished task 4.0 in stage 0.0 (TID 4). 1979 bytes result sent to driver
24/08/13 15:12:50 INFO Executor: Finished task 1.0 in stage 0.0 (TID 1). 1979 bytes result sent to driver
24/08/13 15:12:50 INFO Executor: Finished task 6.0 in stage 0.0 (TID 6). 1936 bytes result sent to driver
24/08/13 15:12:50 INFO PythonRunner: Times: total = 792, boot = 562, init = 230, finish = 0
24/08/13 15:12:50 INFO Executor: Finished task 2.0 in stage 0.0 (TID 2). 1979 bytes result sent to driver
24/08/13 15:12:50 INFO PythonRunner: Times: total = 801, boot = 569, init = 232, finish = 0
24/08/13 15:12:50 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1936 bytes result sent to driver
24/08/13 15:12:50 INFO Executor: Finished task 7.0 in stage 0.0 (TID 7). 2759 bytes result sent to driver
24/08/13 15:12:50 INFO PythonRunner: Times: total = 816, boot = 585, init = 231, finish = 0
24/08/13 15:12:50 INFO Executor: Finished task 3.0 in stage 0.0 (TID 3). 1979 bytes result sent to driver
24/08/13 15:12:50 INFO Executor: Finished task 5.0 in stage 0.0 (TID 5). 1936 bytes result sent to driver
24/08/13 15:12:50 INFO TaskSetManager: Finished task 1.0 in stage 0.0 (TID 1) in 1039 ms on 3316099bf65c (executor driver) (1/8)
24/08/13 15:12:50 INFO TaskSetManager: Finished task 2.0 in stage 0.0 (TID 2) in 1041 ms on 3316099bf65c (executor driver) (2/8)
24/08/13 15:12:50 INFO TaskSetManager: Finished task 4.0 in stage 0.0 (TID 4) in 1039 ms on 3316099bf65c (executor driver) (3/8)
24/08/13 15:12:50 INFO TaskSetManager: Finished task 6.0 in stage 0.0 (TID 6) in 1038 ms on 3316099bf65c (executor driver) (4/8)
24/08/13 15:12:50 INFO TaskSetManager: Finished task 3.0 in stage 0.0 (TID 3) in 1042 ms on 3316099bf65c (executor driver) (5/8)
24/08/13 15:12:50 INFO TaskSetManager: Finished task 7.0 in stage 0.0 (TID 7) in 1038 ms on 3316099bf65c (executor driver) (6/8)
24/08/13 15:12:50 INFO TaskSetManager: Finished task 5.0 in stage 0.0 (TID 5) in 1041 ms on 3316099bf65c (executor driver) (7/8)
24/08/13 15:12:50 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 1057 ms on 3316099bf65c (executor driver) (8/8)
24/08/13 15:12:50 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool
24/08/13 15:12:50 INFO PythonAccumulatorV2: Connected to AccumulatorServer at host: 127.0.0.1 port: 58581
24/08/13 15:12:50 INFO DAGScheduler: ResultStage 0 (json at NativeMethodAccessorImpl.java:0) finished in 1.225 s
24/08/13 15:12:50 INFO DAGScheduler: Job 0 is finished. Cancelling potential speculative or zombie tasks for this job
24/08/13 15:12:50 INFO TaskSchedulerImpl: Killing all running tasks in stage 0: Stage finished
24/08/13 15:12:50 INFO DAGScheduler: Job 0 finished: json at NativeMethodAccessorImpl.java:0, took 1.283159 s
INFO:py4j.java_gateway:Callback Server Starting
INFO:py4j.java_gateway:Socket listening on ('127.0.0.1', 42801)
24/08/13 15:12:51 INFO StateStoreCoordinatorRef: Registered StateStoreCoordinator endpoint
24/08/13 15:12:51 WARN ResolveWriteToStream: Temporary checkpoint location created which is deleted normally when the query didn't fail: /tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88. If it's required to delete it under any circumstances, please set spark.sql.streaming.forceDeleteTempCheckpointLocation to true. Important to know deleting temp checkpoint folder is best effort.
24/08/13 15:12:51 INFO ResolveWriteToStream: Checkpoint root file:///tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88 resolved to file:/tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88.
24/08/13 15:12:51 WARN ResolveWriteToStream: spark.sql.adaptive.enabled is not supported in streaming DataFrames/Datasets and will be disabled.
24/08/13 15:12:51 INFO CheckpointFileManager: Writing atomically to file:/tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88/metadata using temp file file:/tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88/.metadata.5f618b71-7ad1-42cd-ac96-56fba5fcb667.tmp
24/08/13 15:12:51 INFO CheckpointFileManager: Renamed temp file file:/tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88/.metadata.5f618b71-7ad1-42cd-ac96-56fba5fcb667.tmp to file:/tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88/metadata
24/08/13 15:12:51 INFO MicroBatchExecution: Starting [id = 07e17fe6-f642-4b41-a3c6-2103074edb59, runId = 04363934-cd81-4b98-bdfb-679a9965684d]. Use file:/tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88 to store the query checkpoint.
24/08/13 15:12:51 INFO MicroBatchExecution: Reading table [org.apache.spark.sql.kafka010.KafkaSourceProvider$KafkaTable@6313bdfd] from DataSourceV2 named 'kafka' [org.apache.spark.sql.kafka010.KafkaSourceProvider@196e7cf0]
24/08/13 15:12:51 INFO OffsetSeqLog: BatchIds found from listing:
24/08/13 15:12:51 INFO OffsetSeqLog: BatchIds found from listing:
24/08/13 15:12:51 INFO MicroBatchExecution: Starting new streaming query.
24/08/13 15:12:51 INFO MicroBatchExecution: Stream started from {}
24/08/13 15:12:52 INFO AdminClientConfig: AdminClientConfig values:
bootstrap.servers = [kafka:9092]
client.dns.lookup = use_all_dns_ips
client.id =
connections.max.idle.ms = 300000
default.api.timeout.ms = 60000
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
receive.buffer.bytes = 65536
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retries = 2147483647
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
security.providers = null
send.buffer.bytes = 131072
socket.connection.setup.timeout.max.ms = 30000
socket.connection.setup.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.3]
ssl.endpoint.identification.algorithm = https
ssl.engine.factory.class = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.certificate.chain = null
ssl.keystore.key = null
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLSv1.3
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.certificates = null
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
24/08/13 15:12:52 WARN AdminClientConfig: The configuration 'key.deserializer' was supplied but isn't a known config.
24/08/13 15:12:52 WARN AdminClientConfig: The configuration 'value.deserializer' was supplied but isn't a known config.
24/08/13 15:12:52 WARN AdminClientConfig: The configuration 'enable.auto.commit' was supplied but isn't a known config.
24/08/13 15:12:52 WARN AdminClientConfig: The configuration 'max.poll.records' was supplied but isn't a known config.
24/08/13 15:12:52 WARN AdminClientConfig: The configuration 'auto.offset.reset' was supplied but isn't a known config.
24/08/13 15:12:52 INFO AppInfoParser: Kafka version: 2.8.1
24/08/13 15:12:52 INFO AppInfoParser: Kafka commitId: 839b886f9b732b15
24/08/13 15:12:52 INFO AppInfoParser: Kafka startTimeMs: 1723561972466
24/08/13 15:12:53 INFO CheckpointFileManager: Writing atomically to file:/tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88/sources/0/0 using temp file file:/tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88/sources/0/.0.9012da88-46d4-44e4-a4e5-0e72af404534.tmp
24/08/13 15:12:53 INFO CheckpointFileManager: Renamed temp file file:/tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88/sources/0/.0.9012da88-46d4-44e4-a4e5-0e72af404534.tmp to file:/tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88/sources/0/0
24/08/13 15:12:53 INFO KafkaMicroBatchStream: Initial offsets: {"bank-transactions":{"0":20}}
24/08/13 15:12:53 INFO CheckpointFileManager: Writing atomically to file:/tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88/offsets/0 using temp file file:/tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88/offsets/.0.8f8abb6c-1844-4a5a-805f-e205422cdbba.tmp
24/08/13 15:12:53 INFO CheckpointFileManager: Renamed temp file file:/tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88/offsets/.0.8f8abb6c-1844-4a5a-805f-e205422cdbba.tmp to file:/tmp/temporary-5f4489c0-5bb6-4365-958d-afca36fdfc88/offsets/0
24/08/13 15:12:53 INFO MicroBatchExecution: Committed offsets for batch 0. Metadata OffsetSeqMetadata(0,1723561973087,Map(spark.sql.streaming.stateStore.providerClass -> org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider, spark.sql.streaming.join.stateFormatVersion -> 2, spark.sql.streaming.stateStore.compression.codec -> lz4, spark.sql.streaming.stateStore.rocksdb.formatVersion -> 5, spark.sql.streaming.statefulOperator.useStrictDistribution -> true, spark.sql.streaming.flatMapGroupsWithState.stateFormatVersion -> 2, spark.sql.streaming.multipleWatermarkPolicy -> min, spark.sql.streaming.aggregation.stateFormatVersion -> 2, spark.sql.shuffle.partitions -> 200))
24/08/13 15:12:53 INFO KafkaOffsetReaderAdmin: Partitions added: Map()
24/08/13 15:12:53 INFO KafkaOffsetReaderAdmin: Partitions added: Map()
24/08/13 15:12:53 INFO KafkaOffsetReaderAdmin: Partitions added: Map()
24/08/13 15:12:53 INFO KafkaOffsetReaderAdmin: Partitions added: Map()
24/08/13 15:12:53 INFO CodeGenerator: Code generated in 32.546173 ms
INFO:py4j.clientserver:Python Server ready to receive messages
INFO:py4j.clientserver:Received command c on object id p0
24/08/13 15:12:53 INFO CatalogUtil: Loading custom FileIO implementation: org.apache.iceberg.aws.s3.S3FileIO
24/08/13 15:12:53 INFO BlockManagerInfo: Removed broadcast_0_piece0 on 3316099bf65c:38099 in memory (size: 10.2 KiB, free: 434.4 MiB)
24/08/13 15:12:54 INFO BaseMetastoreTableOperations: Refreshing table metadata from new version: s3://warehouse/bronz_raw_transactions_bc4f48e7-ccfe-4dab-9e58-e5d923c7ea0d/metadata/00000-05504e36-c257-4898-966c-b74c7ca55c49.metadata.json
24/08/13 15:12:55 INFO NessieUtil: loadTableMetadata for 'bronz_raw_transactions' from location 's3://warehouse/bronz_raw_transactions_bc4f48e7-ccfe-4dab-9e58-e5d923c7ea0d/metadata/00000-05504e36-c257-4898-966c-b74c7ca55c49.metadata.json' at 'Branch{name=main, metadata=null, hash=e31fd29b1074db76fbf2d54e34cc9d93885ebbf61136672d2d14b9a3e2936481}'
24/08/13 15:12:55 INFO BaseMetastoreCatalog: Table loaded by catalog: nessie.bronz_raw_transactions
24/08/13 15:12:55 INFO SparkWrite: Requesting 402653184 bytes advisory partition size for table nessie.bronz_raw_transactions
24/08/13 15:12:55 INFO SparkWrite: Requesting ClusteredDistribution(days(transaction_datetime)) as write distribution for table nessie.bronz_raw_transactions
24/08/13 15:12:55 INFO SparkWrite: Requesting [] as write ordering for table nessie.bronz_raw_transactions
24/08/13 15:12:55 INFO CodeGenerator: Code generated in 16.348868 ms
24/08/13 15:12:55 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 32.0 KiB, free 434.4 MiB)
24/08/13 15:12:55 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 434.4 MiB)
24/08/13 15:12:55 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on 3316099bf65c:38099 (size: 3.4 KiB, free: 434.4 MiB)
24/08/13 15:12:55 INFO SparkContext: Created broadcast 1 from start at NativeMethodAccessorImpl.java:0
24/08/13 15:12:55 INFO AppendDataExec: Start processing data source write support: IcebergBatchWrite(table=nessie.bronz_raw_transactions, format=PARQUET). The input RDD has 200 partitions.
24/08/13 15:12:55 INFO SparkContext: Starting job: start at NativeMethodAccessorImpl.java:0
24/08/13 15:12:55 INFO DAGScheduler: Registering RDD 17 (start at NativeMethodAccessorImpl.java:0) as input to shuffle 0
24/08/13 15:12:55 INFO DAGScheduler: Got job 1 (start at NativeMethodAccessorImpl.java:0) with 200 output partitions
24/08/13 15:12:55 INFO DAGScheduler: Final stage: ResultStage 2 (start at NativeMethodAccessorImpl.java:0)
24/08/13 15:12:55 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 1)
24/08/13 15:12:55 INFO DAGScheduler: Missing parents: List()
24/08/13 15:12:55 INFO DAGScheduler: Submitting ResultStage 2 (ShuffledRowRDD[18] at start at NativeMethodAccessorImpl.java:0), which has no missing parents
24/08/13 15:12:55 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 14.3 KiB, free 434.4 MiB)
24/08/13 15:12:55 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 7.8 KiB, free 434.3 MiB)
24/08/13 15:12:55 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on 3316099bf65c:38099 (size: 7.8 KiB, free: 434.4 MiB)
24/08/13 15:12:55 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1585
24/08/13 15:12:55 INFO DAGScheduler: Submitting 200 missing tasks from ResultStage 2 (ShuffledRowRDD[18] at start at NativeMethodAccessorImpl.java:0) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14))
24/08/13 15:12:55 INFO TaskSchedulerImpl: Adding task set 2.0 with 200 tasks resource profile 0
24/08/13 15:12:55 INFO TaskSetManager: Starting task 0.0 in stage 2.0 (TID 8) (3316099bf65c, executor driver, partition 0, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 1.0 in stage 2.0 (TID 9) (3316099bf65c, executor driver, partition 1, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 2.0 in stage 2.0 (TID 10) (3316099bf65c, executor driver, partition 2, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 3.0 in stage 2.0 (TID 11) (3316099bf65c, executor driver, partition 3, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 4.0 in stage 2.0 (TID 12) (3316099bf65c, executor driver, partition 4, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 5.0 in stage 2.0 (TID 13) (3316099bf65c, executor driver, partition 5, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 6.0 in stage 2.0 (TID 14) (3316099bf65c, executor driver, partition 6, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 7.0 in stage 2.0 (TID 15) (3316099bf65c, executor driver, partition 7, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 2.0 in stage 2.0 (TID 10)
24/08/13 15:12:55 INFO Executor: Running task 1.0 in stage 2.0 (TID 9)
24/08/13 15:12:55 INFO Executor: Running task 5.0 in stage 2.0 (TID 13)
24/08/13 15:12:55 INFO Executor: Running task 3.0 in stage 2.0 (TID 11)
24/08/13 15:12:55 INFO Executor: Running task 4.0 in stage 2.0 (TID 12)
24/08/13 15:12:55 INFO Executor: Running task 6.0 in stage 2.0 (TID 14)
24/08/13 15:12:55 INFO Executor: Running task 7.0 in stage 2.0 (TID 15)
24/08/13 15:12:55 INFO Executor: Running task 0.0 in stage 2.0 (TID 8)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 9 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 9 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 9 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 10 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 10 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 10 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 10 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 10 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 4 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 7 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 5 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 3 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 6 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 0 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 1 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 2 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 3 (task 11, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 2 (task 10, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 1 (task 9, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 4 (task 12, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 0 (task 8, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 5 (task 13, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 6 (task 14, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 7 (task 15, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Finished task 0.0 in stage 2.0 (TID 8). 3891 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 6.0 in stage 2.0 (TID 14). 3891 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 3.0 in stage 2.0 (TID 11). 3891 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 8.0 in stage 2.0 (TID 16) (3316099bf65c, executor driver, partition 8, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 2.0 in stage 2.0 (TID 10). 3891 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 5.0 in stage 2.0 (TID 13). 3891 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 7.0 in stage 2.0 (TID 15). 3891 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 4.0 in stage 2.0 (TID 12). 3891 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Finished task 6.0 in stage 2.0 (TID 14) in 118 ms on 3316099bf65c (executor driver) (1/200)
24/08/13 15:12:55 INFO Executor: Running task 8.0 in stage 2.0 (TID 16)
24/08/13 15:12:55 INFO Executor: Finished task 1.0 in stage 2.0 (TID 9). 3891 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 9.0 in stage 2.0 (TID 17) (3316099bf65c, executor driver, partition 9, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 10.0 in stage 2.0 (TID 18) (3316099bf65c, executor driver, partition 10, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 9.0 in stage 2.0 (TID 17)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 2.0 in stage 2.0 (TID 10) in 125 ms on 3316099bf65c (executor driver) (2/200)
24/08/13 15:12:55 INFO Executor: Running task 10.0 in stage 2.0 (TID 18)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 8 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 8 (task 16, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 11.0 in stage 2.0 (TID 19) (3316099bf65c, executor driver, partition 11, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 12.0 in stage 2.0 (TID 20) (3316099bf65c, executor driver, partition 12, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 13.0 in stage 2.0 (TID 21) (3316099bf65c, executor driver, partition 13, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 13.0 in stage 2.0 (TID 21)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
24/08/13 15:12:55 INFO Executor: Running task 12.0 in stage 2.0 (TID 20)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 14.0 in stage 2.0 (TID 22) (3316099bf65c, executor driver, partition 14, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 5.0 in stage 2.0 (TID 13) in 133 ms on 3316099bf65c (executor driver) (3/200)
24/08/13 15:12:55 INFO Executor: Running task 14.0 in stage 2.0 (TID 22)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 9 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 9 (task 17, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 1.0 in stage 2.0 (TID 9) in 137 ms on 3316099bf65c (executor driver) (4/200)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 0.0 in stage 2.0 (TID 8) in 139 ms on 3316099bf65c (executor driver) (5/200)
24/08/13 15:12:55 INFO Executor: Running task 11.0 in stage 2.0 (TID 19)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 4.0 in stage 2.0 (TID 12) in 137 ms on 3316099bf65c (executor driver) (6/200)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 7.0 in stage 2.0 (TID 15) in 135 ms on 3316099bf65c (executor driver) (7/200)
24/08/13 15:12:55 INFO Executor: Finished task 9.0 in stage 2.0 (TID 17). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO TaskSetManager: Finished task 3.0 in stage 2.0 (TID 11) in 139 ms on 3316099bf65c (executor driver) (8/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 10 is committing.
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Starting task 15.0 in stage 2.0 (TID 23) (3316099bf65c, executor driver, partition 15, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 10 (task 18, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 13 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 13 (task 21, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 16.0 in stage 2.0 (TID 24) (3316099bf65c, executor driver, partition 16, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 13.0 in stage 2.0 (TID 21). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Running task 15.0 in stage 2.0 (TID 23)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO Executor: Finished task 10.0 in stage 2.0 (TID 18). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO Executor: Running task 16.0 in stage 2.0 (TID 24)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 11 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 11 (task 19, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 14 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 14 (task 22, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Finished task 14.0 in stage 2.0 (TID 22). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 8.0 in stage 2.0 (TID 16). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 17.0 in stage 2.0 (TID 25) (3316099bf65c, executor driver, partition 17, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 11.0 in stage 2.0 (TID 19). 3848 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO TaskSetManager: Finished task 9.0 in stage 2.0 (TID 17) in 32 ms on 3316099bf65c (executor driver) (9/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 12 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 12 (task 20, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Running task 17.0 in stage 2.0 (TID 25)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO TaskSetManager: Finished task 10.0 in stage 2.0 (TID 18) in 31 ms on 3316099bf65c (executor driver) (10/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 16 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 16 (task 24, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 13.0 in stage 2.0 (TID 21) in 24 ms on 3316099bf65c (executor driver) (11/200)
24/08/13 15:12:55 INFO Executor: Finished task 12.0 in stage 2.0 (TID 20). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 18.0 in stage 2.0 (TID 26) (3316099bf65c, executor driver, partition 18, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 16.0 in stage 2.0 (TID 24). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Finished task 8.0 in stage 2.0 (TID 16) in 40 ms on 3316099bf65c (executor driver) (12/200)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 19.0 in stage 2.0 (TID 27) (3316099bf65c, executor driver, partition 19, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 18.0 in stage 2.0 (TID 26)
24/08/13 15:12:55 INFO Executor: Running task 19.0 in stage 2.0 (TID 27)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 15 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 15 (task 23, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 20.0 in stage 2.0 (TID 28) (3316099bf65c, executor driver, partition 20, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Finished task 14.0 in stage 2.0 (TID 22) in 31 ms on 3316099bf65c (executor driver) (13/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 18 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 18 (task 26, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 19 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 19 (task 27, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Running task 20.0 in stage 2.0 (TID 28)
24/08/13 15:12:55 INFO Executor: Finished task 15.0 in stage 2.0 (TID 23). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 17 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 17 (task 25, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Finished task 19.0 in stage 2.0 (TID 27). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 18.0 in stage 2.0 (TID 26). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 21.0 in stage 2.0 (TID 29) (3316099bf65c, executor driver, partition 21, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 11.0 in stage 2.0 (TID 19) in 43 ms on 3316099bf65c (executor driver) (14/200)
24/08/13 15:12:55 INFO Executor: Running task 21.0 in stage 2.0 (TID 29)
24/08/13 15:12:55 INFO Executor: Finished task 17.0 in stage 2.0 (TID 25). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Starting task 22.0 in stage 2.0 (TID 30) (3316099bf65c, executor driver, partition 22, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 20 is committing.
24/08/13 15:12:55 INFO TaskSetManager: Finished task 12.0 in stage 2.0 (TID 20) in 44 ms on 3316099bf65c (executor driver) (15/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 20 (task 28, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Running task 22.0 in stage 2.0 (TID 30)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 23.0 in stage 2.0 (TID 31) (3316099bf65c, executor driver, partition 23, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 20.0 in stage 2.0 (TID 28). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Finished task 16.0 in stage 2.0 (TID 24) in 35 ms on 3316099bf65c (executor driver) (16/200)
24/08/13 15:12:55 INFO Executor: Running task 23.0 in stage 2.0 (TID 31)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 21 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 21 (task 29, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 22 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 22 (task 30, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Finished task 21.0 in stage 2.0 (TID 29). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 24.0 in stage 2.0 (TID 32) (3316099bf65c, executor driver, partition 24, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 22.0 in stage 2.0 (TID 30). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Running task 24.0 in stage 2.0 (TID 32)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 25.0 in stage 2.0 (TID 33) (3316099bf65c, executor driver, partition 25, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 15.0 in stage 2.0 (TID 23) in 45 ms on 3316099bf65c (executor driver) (17/200)
24/08/13 15:12:55 INFO Executor: Running task 25.0 in stage 2.0 (TID 33)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 19.0 in stage 2.0 (TID 27) in 27 ms on 3316099bf65c (executor driver) (18/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 11 ms
24/08/13 15:12:55 INFO TaskSetManager: Starting task 26.0 in stage 2.0 (TID 34) (3316099bf65c, executor driver, partition 26, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 23 is committing.
24/08/13 15:12:55 INFO TaskSetManager: Finished task 18.0 in stage 2.0 (TID 26) in 43 ms on 3316099bf65c (executor driver) (19/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 23 (task 31, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Running task 26.0 in stage 2.0 (TID 34)
24/08/13 15:12:55 INFO Executor: Finished task 23.0 in stage 2.0 (TID 31). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 25 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 25 (task 33, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO Executor: Finished task 25.0 in stage 2.0 (TID 33). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 26 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 24 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 24 (task 32, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 26 (task 34, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 27.0 in stage 2.0 (TID 35) (3316099bf65c, executor driver, partition 27, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 27.0 in stage 2.0 (TID 35)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 17.0 in stage 2.0 (TID 25) in 57 ms on 3316099bf65c (executor driver) (20/200)
24/08/13 15:12:55 INFO Executor: Finished task 26.0 in stage 2.0 (TID 34). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 28.0 in stage 2.0 (TID 36) (3316099bf65c, executor driver, partition 28, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 24.0 in stage 2.0 (TID 32). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Running task 28.0 in stage 2.0 (TID 36)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 20.0 in stage 2.0 (TID 28) in 46 ms on 3316099bf65c (executor driver) (21/200)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 29.0 in stage 2.0 (TID 37) (3316099bf65c, executor driver, partition 29, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 21.0 in stage 2.0 (TID 29) in 44 ms on 3316099bf65c (executor driver) (22/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO Executor: Running task 29.0 in stage 2.0 (TID 37)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 22.0 in stage 2.0 (TID 30) in 41 ms on 3316099bf65c (executor driver) (23/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 27 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 27 (task 35, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Starting task 30.0 in stage 2.0 (TID 38) (3316099bf65c, executor driver, partition 30, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 27.0 in stage 2.0 (TID 35). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 28 is committing.
24/08/13 15:12:55 INFO Executor: Running task 30.0 in stage 2.0 (TID 38)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 28 (task 36, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 31.0 in stage 2.0 (TID 39) (3316099bf65c, executor driver, partition 31, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
24/08/13 15:12:55 INFO TaskSetManager: Finished task 23.0 in stage 2.0 (TID 31) in 47 ms on 3316099bf65c (executor driver) (24/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 29 is committing.
24/08/13 15:12:55 INFO Executor: Running task 31.0 in stage 2.0 (TID 39)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 29 (task 37, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Finished task 28.0 in stage 2.0 (TID 36). 3848 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 7 ms
24/08/13 15:12:55 INFO TaskSetManager: Starting task 32.0 in stage 2.0 (TID 40) (3316099bf65c, executor driver, partition 32, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 30 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 30 (task 38, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 25.0 in stage 2.0 (TID 33) in 50 ms on 3316099bf65c (executor driver) (25/200)
24/08/13 15:12:55 INFO Executor: Finished task 29.0 in stage 2.0 (TID 37). 3848 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 30.0 in stage 2.0 (TID 38). 3848 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 33.0 in stage 2.0 (TID 41) (3316099bf65c, executor driver, partition 33, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 32.0 in stage 2.0 (TID 40)
24/08/13 15:12:55 INFO Executor: Running task 33.0 in stage 2.0 (TID 41)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 34.0 in stage 2.0 (TID 42) (3316099bf65c, executor driver, partition 34, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 26.0 in stage 2.0 (TID 34) in 41 ms on 3316099bf65c (executor driver) (26/200)
24/08/13 15:12:55 INFO Executor: Running task 34.0 in stage 2.0 (TID 42)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 24.0 in stage 2.0 (TID 32) in 57 ms on 3316099bf65c (executor driver) (27/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO TaskSetManager: Starting task 35.0 in stage 2.0 (TID 43) (3316099bf65c, executor driver, partition 35, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 31 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 31 (task 39, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 27.0 in stage 2.0 (TID 35) in 37 ms on 3316099bf65c (executor driver) (28/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:55 INFO Executor: Running task 35.0 in stage 2.0 (TID 43)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 33 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 33 (task 41, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO Executor: Finished task 31.0 in stage 2.0 (TID 39). 3891 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO Executor: Finished task 33.0 in stage 2.0 (TID 41). 3848 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Finished task 28.0 in stage 2.0 (TID 36) in 43 ms on 3316099bf65c (executor driver) (29/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 34 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 34 (task 42, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 36.0 in stage 2.0 (TID 44) (3316099bf65c, executor driver, partition 36, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 12 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 32 is committing.
24/08/13 15:12:55 INFO Executor: Running task 36.0 in stage 2.0 (TID 44)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 35 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 35 (task 43, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 32 (task 40, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 29.0 in stage 2.0 (TID 37) in 47 ms on 3316099bf65c (executor driver) (30/200)
24/08/13 15:12:55 INFO Executor: Finished task 34.0 in stage 2.0 (TID 42). 3848 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 35.0 in stage 2.0 (TID 43). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 32.0 in stage 2.0 (TID 40). 3848 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 37.0 in stage 2.0 (TID 45) (3316099bf65c, executor driver, partition 37, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 37.0 in stage 2.0 (TID 45)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO TaskSetManager: Starting task 38.0 in stage 2.0 (TID 46) (3316099bf65c, executor driver, partition 38, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 36 is committing.
24/08/13 15:12:55 INFO TaskSetManager: Finished task 30.0 in stage 2.0 (TID 38) in 47 ms on 3316099bf65c (executor driver) (31/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 36 (task 44, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Running task 38.0 in stage 2.0 (TID 46)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 31.0 in stage 2.0 (TID 39) in 46 ms on 3316099bf65c (executor driver) (32/200)
24/08/13 15:12:55 INFO Executor: Finished task 36.0 in stage 2.0 (TID 44). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 39.0 in stage 2.0 (TID 47) (3316099bf65c, executor driver, partition 39, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 37 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 37 (task 45, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 40.0 in stage 2.0 (TID 48) (3316099bf65c, executor driver, partition 40, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 39.0 in stage 2.0 (TID 47)
24/08/13 15:12:55 INFO Executor: Running task 40.0 in stage 2.0 (TID 48)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 33.0 in stage 2.0 (TID 41) in 35 ms on 3316099bf65c (executor driver) (33/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Finished task 35.0 in stage 2.0 (TID 43) in 30 ms on 3316099bf65c (executor driver) (34/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO Executor: Finished task 37.0 in stage 2.0 (TID 45). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 38 is committing.
24/08/13 15:12:55 INFO TaskSetManager: Starting task 41.0 in stage 2.0 (TID 49) (3316099bf65c, executor driver, partition 41, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 38 (task 46, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:55 INFO TaskSetManager: Finished task 34.0 in stage 2.0 (TID 42) in 37 ms on 3316099bf65c (executor driver) (35/200)
24/08/13 15:12:55 INFO Executor: Running task 41.0 in stage 2.0 (TID 49)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 42.0 in stage 2.0 (TID 50) (3316099bf65c, executor driver, partition 42, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 40 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 40 (task 48, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Running task 42.0 in stage 2.0 (TID 50)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO Executor: Finished task 40.0 in stage 2.0 (TID 48). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 38.0 in stage 2.0 (TID 46). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 39 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 39 (task 47, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 43.0 in stage 2.0 (TID 51) (3316099bf65c, executor driver, partition 43, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 44.0 in stage 2.0 (TID 52) (3316099bf65c, executor driver, partition 44, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 43.0 in stage 2.0 (TID 51)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO Executor: Finished task 39.0 in stage 2.0 (TID 47). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 41 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 41 (task 49, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 32.0 in stage 2.0 (TID 40) in 59 ms on 3316099bf65c (executor driver) (36/200)
24/08/13 15:12:55 INFO Executor: Running task 44.0 in stage 2.0 (TID 52)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 36.0 in stage 2.0 (TID 44) in 32 ms on 3316099bf65c (executor driver) (37/200)
24/08/13 15:12:55 INFO Executor: Finished task 41.0 in stage 2.0 (TID 49). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 43 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 43 (task 51, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 42 is committing.
24/08/13 15:12:55 INFO Executor: Finished task 43.0 in stage 2.0 (TID 51). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 42 (task 50, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 45.0 in stage 2.0 (TID 53) (3316099bf65c, executor driver, partition 45, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 37.0 in stage 2.0 (TID 45) in 32 ms on 3316099bf65c (executor driver) (38/200)
24/08/13 15:12:55 INFO Executor: Running task 45.0 in stage 2.0 (TID 53)
24/08/13 15:12:55 INFO Executor: Finished task 42.0 in stage 2.0 (TID 50). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 46.0 in stage 2.0 (TID 54) (3316099bf65c, executor driver, partition 46, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 46.0 in stage 2.0 (TID 54)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 38.0 in stage 2.0 (TID 46) in 33 ms on 3316099bf65c (executor driver) (39/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Finished task 40.0 in stage 2.0 (TID 48) in 28 ms on 3316099bf65c (executor driver) (40/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 44 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 44 (task 52, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 47.0 in stage 2.0 (TID 55) (3316099bf65c, executor driver, partition 47, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 45 is committing.
24/08/13 15:12:55 INFO TaskSetManager: Starting task 48.0 in stage 2.0 (TID 56) (3316099bf65c, executor driver, partition 48, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 45 (task 53, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Running task 47.0 in stage 2.0 (TID 55)
24/08/13 15:12:55 INFO Executor: Finished task 44.0 in stage 2.0 (TID 52). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 45.0 in stage 2.0 (TID 53). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Running task 48.0 in stage 2.0 (TID 56)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 49.0 in stage 2.0 (TID 57) (3316099bf65c, executor driver, partition 49, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Finished task 39.0 in stage 2.0 (TID 47) in 37 ms on 3316099bf65c (executor driver) (41/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO Executor: Running task 49.0 in stage 2.0 (TID 57)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 41.0 in stage 2.0 (TID 49) in 32 ms on 3316099bf65c (executor driver) (42/200)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 50.0 in stage 2.0 (TID 58) (3316099bf65c, executor driver, partition 50, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 50.0 in stage 2.0 (TID 58)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 51.0 in stage 2.0 (TID 59) (3316099bf65c, executor driver, partition 51, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 51.0 in stage 2.0 (TID 59)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Starting task 52.0 in stage 2.0 (TID 60) (3316099bf65c, executor driver, partition 52, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 46 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 46 (task 54, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
24/08/13 15:12:55 INFO Executor: Running task 52.0 in stage 2.0 (TID 60)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 47 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 47 (task 55, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 43.0 in stage 2.0 (TID 51) in 32 ms on 3316099bf65c (executor driver) (43/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 48 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 48 (task 56, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 44.0 in stage 2.0 (TID 52) in 32 ms on 3316099bf65c (executor driver) (44/200)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 42.0 in stage 2.0 (TID 50) in 38 ms on 3316099bf65c (executor driver) (45/200)
24/08/13 15:12:55 INFO Executor: Finished task 48.0 in stage 2.0 (TID 56). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Finished task 45.0 in stage 2.0 (TID 53) in 27 ms on 3316099bf65c (executor driver) (46/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 51 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 51 (task 59, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 53.0 in stage 2.0 (TID 61) (3316099bf65c, executor driver, partition 53, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 46.0 in stage 2.0 (TID 54). 3848 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 49 is committing.
24/08/13 15:12:55 INFO TaskSetManager: Starting task 54.0 in stage 2.0 (TID 62) (3316099bf65c, executor driver, partition 54, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 49 (task 57, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Finished task 51.0 in stage 2.0 (TID 59). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Running task 53.0 in stage 2.0 (TID 61)
24/08/13 15:12:55 INFO Executor: Finished task 47.0 in stage 2.0 (TID 55). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Finished task 48.0 in stage 2.0 (TID 56) in 22 ms on 3316099bf65c (executor driver) (47/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 15 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 50 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 50 (task 58, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Finished task 49.0 in stage 2.0 (TID 57). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 52 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 52 (task 60, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 46.0 in stage 2.0 (TID 54) in 44 ms on 3316099bf65c (executor driver) (48/200)
24/08/13 15:12:55 INFO Executor: Finished task 50.0 in stage 2.0 (TID 58). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Running task 54.0 in stage 2.0 (TID 62)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 55.0 in stage 2.0 (TID 63) (3316099bf65c, executor driver, partition 55, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 52.0 in stage 2.0 (TID 60). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Finished task 51.0 in stage 2.0 (TID 59) in 33 ms on 3316099bf65c (executor driver) (49/200)
24/08/13 15:12:55 INFO Executor: Running task 55.0 in stage 2.0 (TID 63)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 56.0 in stage 2.0 (TID 64) (3316099bf65c, executor driver, partition 56, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 53 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 53 (task 61, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Running task 56.0 in stage 2.0 (TID 64)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 54 is committing.
24/08/13 15:12:55 INFO Executor: Finished task 53.0 in stage 2.0 (TID 61). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 54 (task 62, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 55 is committing.
24/08/13 15:12:55 INFO TaskSetManager: Starting task 57.0 in stage 2.0 (TID 65) (3316099bf65c, executor driver, partition 57, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 55 (task 63, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Finished task 54.0 in stage 2.0 (TID 62). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Running task 57.0 in stage 2.0 (TID 65)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 47.0 in stage 2.0 (TID 55) in 52 ms on 3316099bf65c (executor driver) (50/200)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 58.0 in stage 2.0 (TID 66) (3316099bf65c, executor driver, partition 58, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO Executor: Finished task 55.0 in stage 2.0 (TID 63). 3848 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Finished task 49.0 in stage 2.0 (TID 57) in 50 ms on 3316099bf65c (executor driver) (51/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO Executor: Running task 58.0 in stage 2.0 (TID 66)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 56 is committing.
24/08/13 15:12:55 INFO TaskSetManager: Finished task 50.0 in stage 2.0 (TID 58) in 48 ms on 3316099bf65c (executor driver) (52/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 56 (task 64, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 59.0 in stage 2.0 (TID 67) (3316099bf65c, executor driver, partition 59, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 59.0 in stage 2.0 (TID 67)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 60.0 in stage 2.0 (TID 68) (3316099bf65c, executor driver, partition 60, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 52.0 in stage 2.0 (TID 60) in 48 ms on 3316099bf65c (executor driver) (53/200)
24/08/13 15:12:55 INFO Executor: Running task 60.0 in stage 2.0 (TID 68)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO TaskSetManager: Finished task 53.0 in stage 2.0 (TID 61) in 43 ms on 3316099bf65c (executor driver) (54/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 57 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 57 (task 65, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 59 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 58 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 59 (task 67, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 58 (task 66, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 61.0 in stage 2.0 (TID 69) (3316099bf65c, executor driver, partition 61, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 61.0 in stage 2.0 (TID 69)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 60 is committing.
24/08/13 15:12:55 INFO TaskSetManager: Finished task 54.0 in stage 2.0 (TID 62) in 45 ms on 3316099bf65c (executor driver) (55/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 60 (task 68, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Finished task 56.0 in stage 2.0 (TID 64). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 57.0 in stage 2.0 (TID 65). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 59.0 in stage 2.0 (TID 67). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 58.0 in stage 2.0 (TID 66). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 60.0 in stage 2.0 (TID 68). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 62.0 in stage 2.0 (TID 70) (3316099bf65c, executor driver, partition 62, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 62.0 in stage 2.0 (TID 70)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 63.0 in stage 2.0 (TID 71) (3316099bf65c, executor driver, partition 63, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO Executor: Running task 63.0 in stage 2.0 (TID 71)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 55.0 in stage 2.0 (TID 63) in 31 ms on 3316099bf65c (executor driver) (56/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 61 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 61 (task 69, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 64.0 in stage 2.0 (TID 72) (3316099bf65c, executor driver, partition 64, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 56.0 in stage 2.0 (TID 64) in 36 ms on 3316099bf65c (executor driver) (57/200)
24/08/13 15:12:55 INFO Executor: Running task 64.0 in stage 2.0 (TID 72)
24/08/13 15:12:55 INFO Executor: Finished task 61.0 in stage 2.0 (TID 69). 3891 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Finished task 57.0 in stage 2.0 (TID 65) in 31 ms on 3316099bf65c (executor driver) (58/200)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 65.0 in stage 2.0 (TID 73) (3316099bf65c, executor driver, partition 65, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO Executor: Running task 65.0 in stage 2.0 (TID 73)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 62 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 62 (task 70, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO Executor: Finished task 62.0 in stage 2.0 (TID 70). 3848 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Starting task 66.0 in stage 2.0 (TID 74) (3316099bf65c, executor driver, partition 66, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO TaskSetManager: Finished task 59.0 in stage 2.0 (TID 67) in 30 ms on 3316099bf65c (executor driver) (59/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 63 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 64 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 63 (task 71, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 64 (task 72, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Running task 66.0 in stage 2.0 (TID 74)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO TaskSetManager: Finished task 58.0 in stage 2.0 (TID 66) in 37 ms on 3316099bf65c (executor driver) (60/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 65 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 65 (task 73, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Finished task 64.0 in stage 2.0 (TID 72). 3848 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 67.0 in stage 2.0 (TID 75) (3316099bf65c, executor driver, partition 67, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 65.0 in stage 2.0 (TID 73). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 63.0 in stage 2.0 (TID 71). 3848 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Running task 67.0 in stage 2.0 (TID 75)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 68.0 in stage 2.0 (TID 76) (3316099bf65c, executor driver, partition 68, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 60.0 in stage 2.0 (TID 68) in 35 ms on 3316099bf65c (executor driver) (61/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO Executor: Running task 68.0 in stage 2.0 (TID 76)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 66 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 66 (task 74, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 69.0 in stage 2.0 (TID 77) (3316099bf65c, executor driver, partition 69, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 61.0 in stage 2.0 (TID 69) in 32 ms on 3316099bf65c (executor driver) (62/200)
24/08/13 15:12:55 INFO Executor: Running task 69.0 in stage 2.0 (TID 77)
24/08/13 15:12:55 INFO Executor: Finished task 66.0 in stage 2.0 (TID 74). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 70.0 in stage 2.0 (TID 78) (3316099bf65c, executor driver, partition 70, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Finished task 62.0 in stage 2.0 (TID 70) in 32 ms on 3316099bf65c (executor driver) (63/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 67 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 67 (task 75, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Running task 70.0 in stage 2.0 (TID 78)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 68 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 68 (task 76, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 69 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 69 (task 77, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 71.0 in stage 2.0 (TID 79) (3316099bf65c, executor driver, partition 71, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 67.0 in stage 2.0 (TID 75). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Finished task 64.0 in stage 2.0 (TID 72) in 34 ms on 3316099bf65c (executor driver) (64/200)
24/08/13 15:12:55 INFO Executor: Running task 71.0 in stage 2.0 (TID 79)
24/08/13 15:12:55 INFO Executor: Finished task 68.0 in stage 2.0 (TID 76). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 72.0 in stage 2.0 (TID 80) (3316099bf65c, executor driver, partition 72, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 63.0 in stage 2.0 (TID 71) in 39 ms on 3316099bf65c (executor driver) (65/200)
24/08/13 15:12:55 INFO Executor: Running task 72.0 in stage 2.0 (TID 80)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 73.0 in stage 2.0 (TID 81) (3316099bf65c, executor driver, partition 73, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
24/08/13 15:12:55 INFO Executor: Running task 73.0 in stage 2.0 (TID 81)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 70 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 70 (task 78, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 71 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 71 (task 79, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 74.0 in stage 2.0 (TID 82) (3316099bf65c, executor driver, partition 74, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 70.0 in stage 2.0 (TID 78). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 71.0 in stage 2.0 (TID 79). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO Executor: Running task 74.0 in stage 2.0 (TID 82)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 72 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 72 (task 80, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Finished task 69.0 in stage 2.0 (TID 77). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO Executor: Finished task 72.0 in stage 2.0 (TID 80). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 73 is committing.
24/08/13 15:12:55 INFO TaskSetManager: Starting task 75.0 in stage 2.0 (TID 83) (3316099bf65c, executor driver, partition 75, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 73 (task 81, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Running task 75.0 in stage 2.0 (TID 83)
24/08/13 15:12:55 INFO Executor: Finished task 73.0 in stage 2.0 (TID 81). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Finished task 65.0 in stage 2.0 (TID 73) in 40 ms on 3316099bf65c (executor driver) (66/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Finished task 68.0 in stage 2.0 (TID 76) in 30 ms on 3316099bf65c (executor driver) (67/200)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 66.0 in stage 2.0 (TID 74) in 37 ms on 3316099bf65c (executor driver) (68/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 74 is committing.
24/08/13 15:12:55 INFO TaskSetManager: Starting task 76.0 in stage 2.0 (TID 84) (3316099bf65c, executor driver, partition 76, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 67.0 in stage 2.0 (TID 75) in 34 ms on 3316099bf65c (executor driver) (69/200)
24/08/13 15:12:55 INFO Executor: Running task 76.0 in stage 2.0 (TID 84)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 74 (task 82, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Finished task 70.0 in stage 2.0 (TID 78) in 29 ms on 3316099bf65c (executor driver) (70/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 75 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 75 (task 83, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 77.0 in stage 2.0 (TID 85) (3316099bf65c, executor driver, partition 77, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 74.0 in stage 2.0 (TID 82). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 75.0 in stage 2.0 (TID 83). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:55 INFO Executor: Running task 77.0 in stage 2.0 (TID 85)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 76 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 76 (task 84, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 78.0 in stage 2.0 (TID 86) (3316099bf65c, executor driver, partition 78, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 79.0 in stage 2.0 (TID 87) (3316099bf65c, executor driver, partition 79, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Running task 78.0 in stage 2.0 (TID 86)
24/08/13 15:12:55 INFO Executor: Finished task 76.0 in stage 2.0 (TID 84). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Finished task 71.0 in stage 2.0 (TID 79) in 30 ms on 3316099bf65c (executor driver) (71/200)
24/08/13 15:12:55 INFO Executor: Running task 79.0 in stage 2.0 (TID 87)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 72.0 in stage 2.0 (TID 80) in 29 ms on 3316099bf65c (executor driver) (72/200)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 69.0 in stage 2.0 (TID 77) in 41 ms on 3316099bf65c (executor driver) (73/200)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 80.0 in stage 2.0 (TID 88) (3316099bf65c, executor driver, partition 80, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:55 INFO Executor: Running task 80.0 in stage 2.0 (TID 88)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 77 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 77 (task 85, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 79 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 79 (task 87, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 78 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 78 (task 86, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Finished task 77.0 in stage 2.0 (TID 85). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 79.0 in stage 2.0 (TID 87). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 78.0 in stage 2.0 (TID 86). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Starting task 81.0 in stage 2.0 (TID 89) (3316099bf65c, executor driver, partition 81, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 73.0 in stage 2.0 (TID 81) in 34 ms on 3316099bf65c (executor driver) (74/200)
24/08/13 15:12:55 INFO Executor: Running task 81.0 in stage 2.0 (TID 89)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 82.0 in stage 2.0 (TID 90) (3316099bf65c, executor driver, partition 82, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO Executor: Running task 82.0 in stage 2.0 (TID 90)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO TaskSetManager: Finished task 74.0 in stage 2.0 (TID 82) in 32 ms on 3316099bf65c (executor driver) (75/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 80 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 80 (task 88, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 83.0 in stage 2.0 (TID 91) (3316099bf65c, executor driver, partition 83, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 75.0 in stage 2.0 (TID 83) in 28 ms on 3316099bf65c (executor driver) (76/200)
24/08/13 15:12:55 INFO Executor: Finished task 80.0 in stage 2.0 (TID 88). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Running task 83.0 in stage 2.0 (TID 91)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 84.0 in stage 2.0 (TID 92) (3316099bf65c, executor driver, partition 84, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 76.0 in stage 2.0 (TID 84) in 37 ms on 3316099bf65c (executor driver) (77/200)
24/08/13 15:12:55 INFO Executor: Running task 84.0 in stage 2.0 (TID 92)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 12 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 82 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 82 (task 90, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 77.0 in stage 2.0 (TID 85) in 35 ms on 3316099bf65c (executor driver) (78/200)
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 81 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 81 (task 89, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 85.0 in stage 2.0 (TID 93) (3316099bf65c, executor driver, partition 85, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 82.0 in stage 2.0 (TID 90). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO Executor: Finished task 81.0 in stage 2.0 (TID 89). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 83 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 83 (task 91, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO Executor: Running task 85.0 in stage 2.0 (TID 93)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 78.0 in stage 2.0 (TID 86) in 37 ms on 3316099bf65c (executor driver) (79/200)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO TaskSetManager: Starting task 86.0 in stage 2.0 (TID 94) (3316099bf65c, executor driver, partition 86, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO Executor: Finished task 83.0 in stage 2.0 (TID 91). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 84 is committing.
24/08/13 15:12:55 INFO Executor: Running task 86.0 in stage 2.0 (TID 94)
24/08/13 15:12:55 INFO TaskSetManager: Starting task 87.0 in stage 2.0 (TID 95) (3316099bf65c, executor driver, partition 87, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 84 (task 92, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:55 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:55 INFO Executor: Finished task 84.0 in stage 2.0 (TID 92). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO DataWritingSparkTask: Writer for partition 85 is committing.
24/08/13 15:12:55 INFO DataWritingSparkTask: Committed partition 85 (task 93, attempt 0, stage 2.0)
24/08/13 15:12:55 INFO TaskSetManager: Finished task 79.0 in stage 2.0 (TID 87) in 42 ms on 3316099bf65c (executor driver) (80/200)
24/08/13 15:12:55 INFO Executor: Running task 87.0 in stage 2.0 (TID 95)
24/08/13 15:12:55 INFO Executor: Finished task 85.0 in stage 2.0 (TID 93). 3805 bytes result sent to driver
24/08/13 15:12:55 INFO TaskSetManager: Finished task 80.0 in stage 2.0 (TID 88) in 39 ms on 3316099bf65c (executor driver) (81/200)
24/08/13 15:12:56 INFO TaskSetManager: Starting task 88.0 in stage 2.0 (TID 96) (3316099bf65c, executor driver, partition 88, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:56 INFO TaskSetManager: Starting task 89.0 in stage 2.0 (TID 97) (3316099bf65c, executor driver, partition 89, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:56 INFO Executor: Running task 88.0 in stage 2.0 (TID 96)
24/08/13 15:12:56 INFO TaskSetManager: Finished task 81.0 in stage 2.0 (TID 89) in 40 ms on 3316099bf65c (executor driver) (82/200)
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:56 INFO Executor: Running task 89.0 in stage 2.0 (TID 97)
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 5 ms
24/08/13 15:12:56 INFO DataWritingSparkTask: Writer for partition 87 is committing.
24/08/13 15:12:56 INFO DataWritingSparkTask: Writer for partition 86 is committing.
24/08/13 15:12:56 INFO TaskSetManager: Finished task 82.0 in stage 2.0 (TID 90) in 41 ms on 3316099bf65c (executor driver) (83/200)
24/08/13 15:12:56 INFO DataWritingSparkTask: Committed partition 87 (task 95, attempt 0, stage 2.0)
24/08/13 15:12:56 INFO DataWritingSparkTask: Committed partition 86 (task 94, attempt 0, stage 2.0)
24/08/13 15:12:56 INFO TaskSetManager: Starting task 90.0 in stage 2.0 (TID 98) (3316099bf65c, executor driver, partition 90, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:56 INFO Executor: Running task 90.0 in stage 2.0 (TID 98)
24/08/13 15:12:56 INFO DataWritingSparkTask: Writer for partition 88 is committing.
24/08/13 15:12:56 INFO DataWritingSparkTask: Committed partition 88 (task 96, attempt 0, stage 2.0)
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:56 INFO Executor: Finished task 87.0 in stage 2.0 (TID 95). 3848 bytes result sent to driver
24/08/13 15:12:56 INFO DataWritingSparkTask: Writer for partition 89 is committing.
24/08/13 15:12:56 INFO Executor: Finished task 88.0 in stage 2.0 (TID 96). 3805 bytes result sent to driver
24/08/13 15:12:56 INFO TaskSetManager: Finished task 83.0 in stage 2.0 (TID 91) in 47 ms on 3316099bf65c (executor driver) (84/200)
24/08/13 15:12:56 INFO Executor: Finished task 86.0 in stage 2.0 (TID 94). 3805 bytes result sent to driver
24/08/13 15:12:56 INFO DataWritingSparkTask: Committed partition 89 (task 97, attempt 0, stage 2.0)
24/08/13 15:12:56 INFO TaskSetManager: Starting task 91.0 in stage 2.0 (TID 99) (3316099bf65c, executor driver, partition 91, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:56 INFO Executor: Finished task 89.0 in stage 2.0 (TID 97). 3805 bytes result sent to driver
24/08/13 15:12:56 INFO TaskSetManager: Starting task 92.0 in stage 2.0 (TID 100) (3316099bf65c, executor driver, partition 92, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:56 INFO Executor: Running task 91.0 in stage 2.0 (TID 99)
24/08/13 15:12:56 INFO TaskSetManager: Starting task 93.0 in stage 2.0 (TID 101) (3316099bf65c, executor driver, partition 93, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:56 INFO Executor: Running task 92.0 in stage 2.0 (TID 100)
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:56 INFO DataWritingSparkTask: Writer for partition 90 is committing.
24/08/13 15:12:56 INFO DataWritingSparkTask: Committed partition 90 (task 98, attempt 0, stage 2.0)
24/08/13 15:12:56 INFO TaskSetManager: Starting task 94.0 in stage 2.0 (TID 102) (3316099bf65c, executor driver, partition 94, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:56 INFO Executor: Finished task 90.0 in stage 2.0 (TID 98). 3805 bytes result sent to driver
24/08/13 15:12:56 INFO Executor: Running task 93.0 in stage 2.0 (TID 101)
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:56 INFO DataWritingSparkTask: Writer for partition 92 is committing.
24/08/13 15:12:56 INFO DataWritingSparkTask: Committed partition 92 (task 100, attempt 0, stage 2.0)
24/08/13 15:12:56 INFO Executor: Running task 94.0 in stage 2.0 (TID 102)
24/08/13 15:12:56 INFO TaskSetManager: Starting task 95.0 in stage 2.0 (TID 103) (3316099bf65c, executor driver, partition 95, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 7 ms
24/08/13 15:12:56 INFO DataWritingSparkTask: Writer for partition 91 is committing.
24/08/13 15:12:56 INFO DataWritingSparkTask: Committed partition 91 (task 99, attempt 0, stage 2.0)
24/08/13 15:12:56 INFO TaskSetManager: Finished task 87.0 in stage 2.0 (TID 95) in 40 ms on 3316099bf65c (executor driver) (85/200)
24/08/13 15:12:56 INFO Executor: Running task 95.0 in stage 2.0 (TID 103)
24/08/13 15:12:56 INFO TaskSetManager: Finished task 85.0 in stage 2.0 (TID 93) in 46 ms on 3316099bf65c (executor driver) (86/200)
24/08/13 15:12:56 INFO Executor: Finished task 92.0 in stage 2.0 (TID 100). 3891 bytes result sent to driver
24/08/13 15:12:56 INFO TaskSetManager: Starting task 96.0 in stage 2.0 (TID 104) (3316099bf65c, executor driver, partition 96, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:56 INFO Executor: Finished task 91.0 in stage 2.0 (TID 99). 3848 bytes result sent to driver
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:56 INFO TaskSetManager: Starting task 97.0 in stage 2.0 (TID 105) (3316099bf65c, executor driver, partition 97, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:56 INFO DataWritingSparkTask: Writer for partition 94 is committing.
24/08/13 15:12:56 INFO Executor: Running task 96.0 in stage 2.0 (TID 104)
24/08/13 15:12:56 INFO DataWritingSparkTask: Writer for partition 95 is committing.
24/08/13 15:12:56 INFO DataWritingSparkTask: Committed partition 95 (task 103, attempt 0, stage 2.0)
24/08/13 15:12:56 INFO DataWritingSparkTask: Committed partition 94 (task 102, attempt 0, stage 2.0)
24/08/13 15:12:56 INFO TaskSetManager: Finished task 84.0 in stage 2.0 (TID 92) in 69 ms on 3316099bf65c (executor driver) (87/200)
24/08/13 15:12:56 INFO Executor: Running task 97.0 in stage 2.0 (TID 105)
24/08/13 15:12:56 INFO TaskSetManager: Finished task 88.0 in stage 2.0 (TID 96) in 42 ms on 3316099bf65c (executor driver) (88/200)
24/08/13 15:12:56 INFO TaskSetManager: Finished task 89.0 in stage 2.0 (TID 97) in 41 ms on 3316099bf65c (executor driver) (89/200)
24/08/13 15:12:56 INFO Executor: Finished task 94.0 in stage 2.0 (TID 102). 3805 bytes result sent to driver
24/08/13 15:12:56 INFO TaskSetManager: Finished task 86.0 in stage 2.0 (TID 94) in 51 ms on 3316099bf65c (executor driver) (90/200)
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
24/08/13 15:12:56 INFO Executor: Finished task 95.0 in stage 2.0 (TID 103). 3805 bytes result sent to driver
24/08/13 15:12:56 INFO TaskSetManager: Finished task 90.0 in stage 2.0 (TID 98) in 35 ms on 3316099bf65c (executor driver) (91/200)
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) push-merged-local and 0 (0.0 B) remote blocks
24/08/13 15:12:56 INFO DataWritingSparkTask: Writer for partition 96 is committing.
24/08/13 15:12:56 INFO DataWritingSparkTask: Committed partition 96 (task 104, attempt 0, stage 2.0)
24/08/13 15:12:56 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 7 ms
24/08/13 15:12:56 INFO DataWritingSparkTask: Writer for partition 93 is committing.
24/08/13 15:12:56 INFO DataWritingSparkTask: Committed partition 93 (task 101, attempt 0, stage 2.0)
24/08/13 15:12:56 INFO TaskSetManager: Starting task 98.0 in stage 2.0 (TID 106) (3316099bf65c, executor driver, partition 98, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:56 INFO Executor: Finished task 96.0 in stage 2.0 (TID 104). 3805 bytes result sent to driver
24/08/13 15:12:56 INFO Executor: Running task 98.0 in stage 2.0 (TID 106)
24/08/13 15:12:56 INFO TaskSetManager: Starting task 99.0 in stage 2.0 (TID 107) (3316099bf65c, executor driver, partition 99, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:56 INFO TaskSetManager: Starting task 100.0 in stage 2.0 (TID 108) (3316099bf65c, executor driver, partition 100, PROCESS_LOCAL, 7615 bytes)
24/08/13 15:12:56 INFO Executor: Running task 99.0 in stage 2.0 (TID 107)
24/08/13 15:12:56 INFO TaskSetManager: Finished task 91.0 in stage 2.0 (TID 99) in 34 ms on 3316099bf65c (executor driver) (92/200)
24/08/13 15:12:56 INFO TaskSetManager: Finished task 92.0 in stage 2.0 (TID 100) in 33 ms on 3316099bf65c (executor driver) (93/200)
24/08/13 15:12:56 INFO Executor: Running task 100.0 in stage 2.0 (TID 108)
24/08/13 15:12:56 INFO TaskSetManager: Starting task 101.0 in stage 2.0 (TID 109) (3316099bf65c, executor driver, partition 101, PROCESS_LOCAL, 7615 bytes)