Spark MLlib 保序回归

Posted 2021-01-25 rhadoop-hive

"C:Program FilesJavajdk1.8.0_181injava" "-javaagent:D:SoftwareIntelliJ IDEA 2017.2.2libidea_rt.jar=64070:D:SoftwareIntelliJ IDEA 2017.2.2in" -Dfile.encoding=UTF-8 -classpath "C:Program FilesJavajdk1.8.0_181jrelibcharsets.jar;C:Program FilesJavajdk1.8.0_181jrelibdeploy.jar;C:Program FilesJavajdk1.8.0_181jrelibextaccess-bridge-64.jar;C:Program FilesJavajdk1.8.0_181jrelibextcldrdata.jar;C:Program FilesJavajdk1.8.0_181jrelibextdnsns.jar;C:Program FilesJavajdk1.8.0_181jrelibextjaccess.jar;C:Program FilesJavajdk1.8.0_181jrelibextjfxrt.jar;C:Program FilesJavajdk1.8.0_181jrelibextlocaledata.jar;C:Program FilesJavajdk1.8.0_181jrelibext
ashorn.jar;C:Program FilesJavajdk1.8.0_181jrelibextsunec.jar;C:Program FilesJavajdk1.8.0_181jrelibextsunjce_provider.jar;C:Program FilesJavajdk1.8.0_181jrelibextsunmscapi.jar;C:Program FilesJavajdk1.8.0_181jrelibextsunpkcs11.jar;C:Program FilesJavajdk1.8.0_181jrelibextzipfs.jar;C:Program FilesJavajdk1.8.0_181jrelibjavaws.jar;C:Program FilesJavajdk1.8.0_181jrelibjce.jar;C:Program FilesJavajdk1.8.0_181jrelibjfr.jar;C:Program FilesJavajdk1.8.0_181jrelibjfxswt.jar;C:Program FilesJavajdk1.8.0_181jrelibjsse.jar;C:Program FilesJavajdk1.8.0_181jrelibmanagement-agent.jar;C:Program FilesJavajdk1.8.0_181jrelibplugin.jar;C:Program FilesJavajdk1.8.0_181jrelib
esources.jar;C:Program FilesJavajdk1.8.0_181jrelib
t.jar;E:Scala_workplacescala菜鸟教程productionSpark_Mllibe;C:Program Files (x86)scalalibscala-actors-migration.jar;C:Program Files (x86)scalalibscala-actors.jar;C:Program Files (x86)scalalibscala-library.jar;C:Program Files (x86)scalalibscala-reflect.jar;C:Program Files (x86)scalalibscala-swing.jar;D:spark-1.6.3-bin-2.6.0-cdh5.7.0libspark-assembly-1.6.3-hadoop2.6.0-cdh5.7.0.jar" Isotonic_Regression
Using Spark‘s default log4j profile: org/apache/spark/log4j-defaults.properties
18/12/07 18:04:04 INFO SparkContext: Running Spark version 1.6.3
18/12/07 18:04:04 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
18/12/07 18:04:05 INFO SecurityManager: Changing view acls to: wpguoc
18/12/07 18:04:05 INFO SecurityManager: Changing modify acls to: wpguoc
18/12/07 18:04:05 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(wpguoc); users with modify permissions: Set(wpguoc)
18/12/07 18:04:05 INFO Utils: Successfully started service ‘sparkDriver‘ on port 64093.
18/12/07 18:04:06 INFO Slf4jLogger: Slf4jLogger started
18/12/07 18:04:06 INFO Remoting: Starting remoting
18/12/07 18:04:06 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://[email protected]:64106]
18/12/07 18:04:06 INFO Utils: Successfully started service ‘sparkDriverActorSystem‘ on port 64106.
18/12/07 18:04:06 INFO SparkEnv: Registering MapOutputTracker
18/12/07 18:04:06 INFO SparkEnv: Registering BlockManagerMaster
18/12/07 18:04:06 INFO DiskBlockManager: Created local directory at C:UserswpguocAppDataLocalTemplockmgr-b47ff26b-4ce0-4041-8926-ff0ecdd1a719
18/12/07 18:04:06 INFO MemoryStore: MemoryStore started with capacity 1127.3 MB
18/12/07 18:04:06 INFO SparkEnv: Registering OutputCommitCoordinator
18/12/07 18:04:06 INFO Utils: Successfully started service ‘SparkUI‘ on port 4040.
18/12/07 18:04:06 INFO SparkUI: Started SparkUI at http://192.168.66.80:4040
18/12/07 18:04:06 INFO Executor: Starting executor ID driver on host localhost
18/12/07 18:04:06 INFO Utils: Successfully started service ‘org.apache.spark.network.netty.NettyBlockTransferService‘ on port 64125.
18/12/07 18:04:06 INFO NettyBlockTransferService: Server created on 64125
18/12/07 18:04:06 INFO BlockManagerMaster: Trying to register BlockManager
18/12/07 18:04:06 INFO BlockManagerMasterEndpoint: Registering block manager localhost:64125 with 1127.3 MB RAM, BlockManagerId(driver, localhost, 64125)
18/12/07 18:04:06 INFO BlockManagerMaster: Registered BlockManager
boundaries	predictions
0.5	1.2024656206666666
0.9	1.2024656206666666
prediction	lable
1.2024656206666666	1.850001003
1.2024656206666666	1.708672171
1.2024656206666666	1.415907359
1.2024656206666666	1.393065378
1.2024656206666666	1.221406694
1.2024656206666666	1.186060644