深入了解Spark Shuffle的原理,分別對(duì)Spark Shuffle過程和Spark Shuffle過程做了比較深入的講解?
課程內(nèi)容如下:?
1、課程內(nèi)容?
2、MapOutputTracker?
3、HashShuffleWriter?
4、SortShuffleWriter?
5、UnsafeShuffleWriter?
6、BypassMergeSortShuffleWriter?
7、ShuffleReader?
8、ShuffleManager+MemoryManager+StorageManager