IntelliJ IDEA(Ultimate版本)的下载、安装和WordCount的初步使用(本地模式和集群模式)
不多说,直接上干货!
IntelliJ IDEA号称当前Java开发效率最高的IDE工具。IntelliJ IDEA有两个版本:社区版(Community)和旗舰版(Ultimate)。社区版时免费的、开源的,但功能较少,旗舰版提供了较多的功能,是收费的,可以试用30天。
强烈推荐,新手刚入门,可以去用社区版,但是,立马还是用旗舰版,我可是走了弯路,当然,体会到其中的棘手还是很不错!
IDEA Community(社区版)再谈之无奈之下还是去安装社区版
IntelliJ IDEA(Community版本)的下载、安装和WordCount的初步使用(本地模式和集群模式)
1、IntelliJ IDEA(Ultimate)的下载
2、IntelliJ IDEA(Ultimate)的安装
3、IntelliJ IDEA(Ultimate)中的scala插件安装
4、用SBT方式来创建工程 或 选择Scala方式来创建工程
5、本地模式或集群模式
我们知道,对于开发而言,IDE是有很多个选择的版本。如我们大部分人经常用的是如下。
Eclipse *版本
Eclipse *下载
而我们知道,对于spark的scala开发啊,有为其专门设计的eclipse,Scala IDE for Eclipse
Scala IDE for Eclipse的下载、安装和WordCount的初步使用(本地模式和集群模式)
这里,我们知道,spark的开发可以通过IntelliJ IDEA或者Scala IDE for Eclipse,包括来构建spark开发环境和源码阅读环境。由于IntelliJ IDEA对scala的支持更好,所以目前spark开发团队使用IntelliJ IDEA作为开发环境。强烈推荐!
1、IntelliJ IDEA(Ultimate)的下载
下载链接: http://www.jetbrains.com/idea/download/
一般,我们使用选择免费的社区版就好了,不过Apache的贡献者可以免费获得商业发行版的使用权。但是,在本博文里,我就是要大家安装Ultimate版本,因为,我有办法教大家成功破解并长期使用。
直接下载最新版本(当然,你也可以下载历史版本)
注意:下载IntelliJ IDEA Ultimate的历史版本
我们找历史版本,Windows7下安装IntelliJ IDEA UltimateEdition 2016.1.4(64)。
2、IntelliJ IDEA(Ultimate)的安装
D:\SoftWare\IntelliJ IDEA\IntelliJ IDEA Ultimate Edition 2016.1.4
创建桌面快捷方式,我只选一个64位的够了;
注意:如果你的JDK是32位的,Tomcat是32位的,估计要使用32位的才行;
创建扩展名关联:都选上吧 ;
安装到这里就完成了,但接下来还有一些步骤需要配置
3、IntelliJ IDEA(Ultimate)的使用
在这之前,先在本地里安装好java和scala
这个必须要同意,不然的话我们安装它干嘛!
输入激活码##
网上找一个注册码,或者使用以下注册码(有效期为2017年01月31日至2018年01月30日)
CNEKJPQZEX-eyJsaWNlbnNlSWQiOiJDTkVLSlBRWkVYIiwibGljZW5zZWVOYW1lIjoibGFuIHl1IiwiYXNzaWduZWVOYW1lIjoiIiwiYXNzaWduZWVFbWFpbCI6IiIsImxpY2Vuc2VSZXN0cmljdGlvbiI6IkZvciBlZHVjYXRpb25hbCB1c2Ugb25seSIsImNoZWNrQ29uY3VycmVudFVzZSI6ZmFsc2UsInByb2R1Y3RzIjpbeyJjb2RlIjoiQUMiLCJwYWlkVXBUbyI6IjIwMTgtMDEtMzAifSx7ImNvZGUiOiJETSIsInBhaWRVcFRvIjoiMjAxOC0wMS0zMCJ9LHsiY29kZSI6IklJIiwicGFpZFVwVG8iOiIyMDE4LTAxLTMwIn0seyJjb2RlIjoiUlMwIiwicGFpZFVwVG8iOiIyMDE4LTAxLTMwIn0seyJjb2RlIjoiV1MiLCJwYWlkVXBUbyI6IjIwMTgtMDEtMzAifSx7ImNvZGUiOiJEUE4iLCJwYWlkVXBUbyI6IjIwMTgtMDEtMzAifSx7ImNvZGUiOiJSQyIsInBhaWRVcFRvIjoiMjAxOC0wMS0zMCJ9LHsiY29kZSI6IlBTIiwicGFpZFVwVG8iOiIyMDE4LTAxLTMwIn0seyJjb2RlIjoiREMiLCJwYWlkVXBUbyI6IjIwMTgtMDEtMzAifSx7ImNvZGUiOiJEQiIsInBhaWRVcFRvIjoiMjAxOC0wMS0zMCJ9LHsiY29kZSI6IlJNIiwicGFpZFVwVG8iOiIyMDE4LTAxLTMwIn0seyJjb2RlIjoiUEMiLCJwYWlkVXBUbyI6IjIwMTgtMDEtMzAifSx7ImNvZGUiOiJDTCIsInBhaWRVcFRvIjoiMjAxOC0wMS0zMCJ9XSwiaGFzaCI6IjUxOTU1OTMvMCIsImdyYWNlUGVyaW9kRGF5cyI6MCwiYXV0b1Byb2xvbmdhdGVkIjpmYWxzZSwiaXNBdXRvUHJvbG9uZ2F0ZWQiOmZhbHNlfQ==-QOxwjWvRwJz6vo6J6adC3CJ4ukQHosbPYZ94URUVFna/Rbew8xK/M5gP3kAaPh6ZDveFdtMR1UBoumq3eCwXtXM3U3ls5noB4LIr+QplVlCj2pK5uNq7g/feyNyQcHpSXtvhIOnXDBLOecB05DOsxzm0p7ulGGJoAInmHeb9mc0eYjqc4RPpUQfh6HSYBnvEnKMlLF5bz4KEtzmsvvgA55CwzwQ3gRitm5Q/wUT7AQCBdjmBfNUjKVQL6TSjSDPp56FUdEs4Aab8LqstA2DIMbxocO64rvytmcUeIwu8Mi5uq87KQP5AQMSMYb59Inbd+dmVfx5cJo3fRS4/5s3/Hg==-MIIEPjCCAiagAwIBAgIBBTANBgkqhkiG9w0BAQsFADAYMRYwFAYDVQQDDA1KZXRQcm9maWxlIENBMB4XDTE1MTEwMjA4MjE0OFoXDTE4MTEwMTA4MjE0OFowETEPMA0GA1UEAwwGcHJvZDN5MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAxcQkq+zdxlR2mmRYBPzGbUNdMN6OaXiXzxIWtMEkrJMO/5oUfQJbLLuMSMK0QHFmaI37WShyxZcfRCidwXjot4zmNBKnlyHodDij/78TmVqFl8nOeD5+07B8VEaIu7c3E1N+e1doC6wht4I4+IEmtsPAdoaj5WCQVQbrI8KeT8M9VcBIWX7fD0fhexfg3ZRt0xqwMcXGNp3DdJHiO0rCdU+Itv7EmtnSVq9jBG1usMSFvMowR25mju2JcPFp1+I4ZI+FqgR8gyG8oiNDyNEoAbsR3lOpI7grUYSvkB/xVy/VoklPCK2h0f0GJxFjnye8NT1PAywoyl7RmiAVRE/EKwIDAQABo4GZMIGWMAkGA1UdEwQCMAAwHQYDVR0OBBYEFGEpG9oZGcfLMGNBkY7SgHiMGgTcMEgGA1UdIwRBMD+AFKOetkhnQhI2Qb1t4Lm0oFKLl/GzoRykGjAYMRYwFAYDVQQDDA1KZXRQcm9maWxlIENBggkA0myxg7KDeeEwEwYDVR0lBAwwCgYIKwYBBQUHAwEwCwYDVR0PBAQDAgWgMA0GCSqGSIb3DQEBCwUAA4ICAQC9WZuYgQedSuOc5TOUSrRigMw4/+wuC5EtZBfvdl4HT/8vzMW/oUlIP4YCvA0XKyBaCJ2iX+ZCDKoPfiYXiaSiH+HxAPV6J79vvouxKrWg2XV6ShFtPLP+0gPdGq3x9R3+kJbmAm8w+FOdlWqAfJrLvpzMGNeDU14YGXiZ9bVzmIQbwrBA+c/F4tlK/DV07dsNExihqFoibnqDiVNTGombaU2dDup2gwKdL81ua8EIcGNExHe82kjF4zwfadHk3bQVvbfdAwxcDy4xBjs3L4raPLU3yenSzr/OEur1+jfOxnQSmEcMXKXgrAQ9U55gwjcOFKrgOxEdek/Sk1VfOjvS+nuM4eyEruFMfaZHzoQiuw4IqgGc45ohFH0UUyjYcuFxxDSU9lMCv8qdHKm+wnPRb0l9l5vXsCBDuhAGYD6ss+Ga+aDY6f/qXZuUCEUOH3QUNbbCUlviSz6+GiRnt1kA9N2Qachl+2yBfaqUqr8h7Z2gsx5LcIf5kYNsqJ0GavXTVyWh7PYiKX4bs354ZQLUwwa/cG++2+wNWP+HtBhVxMRNTdVhSm38AknZlD+PTAsWGu9GyLmhti2EnVwGybSD2Dxmhxk3IPCkhKAK+pl0eWYGZWG3tJ9mZ7SowcXLWDFAk0lRJnKGFMTggrWjV8GYpw5bq23VmIqqDLgkNzuoog==
为了更加保险,请移步,
IntelliJ IDEA官网:https://www.jetbrains.com
即可,得到。
其实啊,这里永久有效就是。
当然也许这里,以后也会失效,自己从网上搜索就好了,很多很多。
主题皮肤设置,看你喜欢哪一种吧!(当然后期,可以自己更改)
IntelliJ IDEA的黑白色背景切换(Ultimate和Community版本皆通用)
可以根据你的需要调整定制需要的特性:
这里可以安装Scala和IdeaVim支持,但我试了几次,根本安装不上;(其实啊,这里可以安装的上,当然,有时候会安装不上)
果然,IntelliJ IDEA(Ultimate版本)比IntelliJ IDEA(Community版本)多了好多功能啊!
由此可以看到,至2018年01月30日
先选择Create New Project 创建一个空项目看看吧
补安装scala插件(其实就是把它给调出来啦)
这里,以Maven方式,创建一个项目。
如何在Maven官网下载历史版本
Eclipse下Maven新建项目、自动打依赖jar包(包含普通项目和Web项目)
最后,这是我的本地maven的配置文件
别急,等待一会
点击 Got it!
即,在以上过程中,模仿JDK1.8.x和scala2.10.4。
但是,要说么的是,因为,我的本地是scala2.10.4,它默认是2.7.0
为了引起,不必要的麻烦,将自带的删除吧!
得到
Microsoft Windows [版本 6.1.]
版权所有 (c) Microsoft Corporation。保留所有权利。 D:\Code\IntelliJIDEAUltimateVersionCode\WordCount>mvn clean package
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for zhouls.bigdata:mySpark:jar:1.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for org.scala-tools:maven-scala-plugin is missing. @ line , column
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-eclipse-plugin is missing. @ line , column
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building mySpark 1.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/scala-tools/maven-scala-plugin/maven-metadata.xml
Downloading: http://scala-tools.org/repo-releases/org/scala-tools/maven-scala-plugin/maven-metadata.xml
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/scala-tools/maven-scala-plugin/maven-metadata.xml (2 KB at 1.7 KB/sec)
[WARNING] Could not transfer metadata org.scala-tools:maven-scala-plugin/maven-metadata.xml from/to scala-tools.org (http://scala-tools.org/repo-releases): Received fatal alert: protocol_version
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/scala-tools/maven-scala-plugin/2.15.2/maven-scala-plugin-2.15.2.pom
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/scala-tools/maven-scala-plugin/2.15.2/maven-scala-plugin-2.15.2.pom (15 KB at 35.5 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/scala-tools/maven-scala-plugin/2.15.2/maven-scala-plugin-2.15.2.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/scala-tools/maven-scala-plugin/2.15.2/maven-scala-plugin-2.15.2.jar (113 KB at 190.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-eclipse-plugin/maven-metadata.xml
Downloading: http://scala-tools.org/repo-releases/org/apache/maven/plugins/maven-eclipse-plugin/maven-metadata.xml
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-eclipse-plugin/maven-metadata.xml (741 B at 2.8 KB/sec)
[WARNING] Could not transfer metadata org.apache.maven.plugins:maven-eclipse-plugin/maven-metadata.xml from/to scala-tools.org (http://scala-tools.org/repo-releases): Received fatal alert: protocol_version
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-eclipse-plugin/2.10/maven-eclipse-plugin-2.10.pom
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-eclipse-plugin/2.10/maven-eclipse-plugin-2.10.pom (19 KB at 66.7 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-plugins/25/maven-plugins-25.pom
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-plugins/25/maven-plugins-25.pom (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-eclipse-plugin/2.10/maven-eclipse-plugin-2.10.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-eclipse-plugin/2.10/maven-eclipse-plugin-2.10.jar (219 KB at 429.1 KB/sec)
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ mySpark ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ mySpark ---
[WARNING] Using platform encoding (GBK actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory D:\Code\IntelliJIDEAUltimateVersionCode\WordCount\src\main\resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ mySpark ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-scala-plugin:2.15.:compile (default) @ mySpark ---
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/commons/commons-exec/1.0.1/commons-exec-1.0.1.pom
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/commons/commons-exec/1.0.1/commons-exec-1.0.1.pom (8 KB at 19.4 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/yaml/snakeyaml/1.4/snakeyaml-1.4.pom
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/yaml/snakeyaml/1.4/snakeyaml-1.4.pom (8 KB at 20.2 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-core-asl/1.6.1/jackson-core-asl-1.6.1.pom
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-core-asl/1.6.1/jackson-core-asl-1.6.1.pom (1016 B at 3.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-mapper-asl/1.6.1/jackson-mapper-asl-1.6.1.pom
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-mapper-asl/1.6.1/jackson-mapper-asl-1.6.1.pom (2 KB at 3.7 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-settings/2.2.1/maven-settings-2.2.1.jar
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-artifact-manager/2.2.1/maven-artifact-manager-2.2.1.jar
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-project/2.2.1/maven-project-2.2.1.jar
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-profile/2.2.1/maven-profile-2.2.1.jar
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-api/2.2.1/maven-plugin-api-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-artifact-manager/2.2.1/maven-artifact-manager-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/backport-util-concurrent/backport-util-concurrent/3.1/backport-util-concurrent-3.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-project/2.2.1/maven-project-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-registry/2.2.1/maven-plugin-registry-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-api/2.2.1/maven-plugin-api-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/plexus/plexus-interpolation/1.11/plexus-interpolation-1.11.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-settings/2.2.1/maven-settings-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/reporting/maven-reporting-api/2.2.1/maven-reporting-api-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-profile/2.2.1/maven-profile-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/doxia/doxia-logging-api/1.1/doxia-logging-api-1.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/backport-util-concurrent/backport-util-concurrent/3.1/backport-util-concurrent-3.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-core/2.2.1/maven-core-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/reporting/maven-reporting-api/2.2.1/maven-reporting-api-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-parameter-documenter/2.2.1/maven-plugin-parameter-documenter-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-registry/2.2.1/maven-plugin-registry-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/slf4j/slf4j-jdk14/1.5.6/slf4j-jdk14-1.5.6.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/plexus/plexus-interpolation/1.11/plexus-interpolation-1.11.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/slf4j/slf4j-api/1.5.6/slf4j-api-1.5.6.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/doxia/doxia-logging-api/1.1/doxia-logging-api-1.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/slf4j/jcl-over-slf4j/1.5.6/jcl-over-slf4j-1.5.6.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-core/2.2.1/maven-core-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-repository-metadata/2.2.1/maven-repository-metadata-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-parameter-documenter/2.2.1/maven-plugin-parameter-documenter-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-error-diagnostics/2.2.1/maven-error-diagnostics-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/slf4j/slf4j-jdk14/1.5.6/slf4j-jdk14-1.5.6.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-descriptor/2.2.1/maven-plugin-descriptor-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/slf4j/slf4j-api/1.5.6/slf4j-api-1.5.6.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-monitor/2.2.1/maven-monitor-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/slf4j/jcl-over-slf4j/1.5.6/jcl-over-slf4j-1.5.6.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/commons/commons-exec/1.0.1/commons-exec-1.0.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-repository-metadata/2.2.1/maven-repository-metadata-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/yaml/snakeyaml/1.4/snakeyaml-1.4.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-error-diagnostics/2.2.1/maven-error-diagnostics-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-model/2.2.1/maven-model-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-descriptor/2.2.1/maven-plugin-descriptor-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-core-asl/1.6.1/jackson-core-asl-1.6.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-monitor/2.2.1/maven-monitor-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-mapper-asl/1.6.1/jackson-mapper-asl-1.6.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-model/2.2.1/maven-model-2.2.1.jar (0 B at 0.0 KB/sec)
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/commons/commons-exec/1.0.1/commons-exec-1.0.1.jar (49 KB at 50.0 KB/sec)
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/yaml/snakeyaml/1.4/snakeyaml-1.4.jar (213 KB at 194.7 KB/sec)
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-core-asl/1.6.1/jackson-core-asl-1.6.1.jar (197 KB at 165.6 KB/sec)
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-mapper-asl/1.6.1/jackson-mapper-asl-1.6.1.jar (530 KB at 391.4 KB/sec)
[INFO] Checking for multiple versions of scala
[INFO] includes = [**/*.scala,**/*.java,]
[INFO] excludes = []
[WARNING] No source files found.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ mySpark ---
[WARNING] Using platform encoding (GBK actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory D:\Code\IntelliJIDEAUltimateVersionCode\WordCount\src\test\resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ mySpark ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-scala-plugin:2.15.:testCompile (default) @ mySpark ---
[INFO] Checking for multiple versions of scala
[INFO] includes = [**/*.scala,**/*.java,]
[INFO] excludes = []
[WARNING] No source files found.
[INFO]
[INFO] --- maven-surefire-plugin:2.12.:test (default-test) @ mySpark ---
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ mySpark ---
[INFO] Building jar: D:\Code\IntelliJIDEAUltimateVersionCode\WordCount\target\mySpark-1.0-SNAPSHOT.jar
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 25.673 s
[INFO] Finished at: --05T00::+:
[INFO] Final Memory: 14M/126M
[INFO] ------------------------------------------------------------------------ D:\Code\IntelliJIDEAUltimateVersionCode\WordCount>
本地模式和集群模式的代码,这里我不多赘述。
(1)本地运行
编写完Scala程序后,可以直接在IntelliJ IDEA中以本地(local)模式运行。
在IntelliJ IDEA中,点击Run 按钮,具体见如下
Spark编程环境搭建(基于Intellij IDEA的Ultimate版本)(包含Java和Scala版的WordCount)(博主强烈推荐)
同时,大家可以关注我的个人博客:
http://www.cnblogs.com/zlslch/ 和 http://www.cnblogs.com/lchzls/ http://www.cnblogs.com/sunnyDream/
详情请见:http://www.cnblogs.com/zlslch/p/7473861.html
人生苦短,我愿分享。本公众号将秉持活到老学到老学习无休止的交流分享开源精神,汇聚于互联网和个人学习工作的精华干货知识,一切来于互联网,反馈回互联网。
目前研究领域:大数据、机器学习、深度学习、人工智能、数据挖掘、数据分析。 语言涉及:Java、Scala、Python、Shell、Linux等 。同时还涉及平常所使用的手机、电脑和互联网上的使用技巧、问题和实用软件。 只要你一直关注和呆在群里,每天必须有收获
对应本平台的讨论和答疑QQ群:大数据和人工智能躺过的坑(总群)(161156071)
IntelliJ IDEA(Ultimate版本)的下载、安装和WordCount的初步使用(本地模式和集群模式)的更多相关文章
- IntelliJ IDEA(Community版本)的下载、安装和WordCount的初步使用(本地模式和集群模式)
不多说,直接上干货! 对于初学者来说,建议你先玩玩这个免费的社区版,但是,一段时间,还是去玩专业版吧,这个很简单哈,学聪明点,去搞到途径激活!可以看我的博客. 包括: IntelliJ IDEA(Co ...
- IntelliJ IDEA的下载、安装和WordCount的初步使用(本地模式和集群模式)
包括: IntelliJ IDEA的下载 IntelliJ IDEA的安装 IntelliJ IDEA中的scala插件安装 用SBT方式来创建工程 或 选择Scala方式来创建工程 本地模式或集群 ...
- Eclipse的下载、安装和WordCount的初步使用(本地模式和集群模式)
包括: Eclipse的下载 Eclipse的安装 Eclipse的使用 本地模式或集群模式 Scala IDE for Eclipse的下载.安装和WordCount的初步使用(本地模式和集群 ...
- Scala IDE for Eclipse的下载、安装和WordCount的初步使用(本地模式和集群模式)
包括: Scala IDE for Eclipse的下载 Scala IDE for Eclipse的安装 本地模式或集群模式 我们知道,对于开发而言,IDE是有很多个选择的版本.如我们大部分人经常 ...
- Centos7安装Nacos单机模式以及集群模式(包含nignx安装以及实现集群)的相关配置
Nacos 致力于帮助您发现.配置和管理微服务.Nacos 提供了一组简单易用的特性集,帮助您快速实现动态服务发现.服务配置.服务元数据及流量管理. Nacos支持三种部署模式 单机模式 - 用于测试 ...
- 5.Zookeeper的两种安装和配置(Windows):单机模式与集群模式
转自:https://blog.csdn.net/a906998248/article/details/50815031
- Spark Tachyon编译部署(含单机和集群模式安装)
Tachyon编译部署 编译Tachyon 单机部署Tachyon 集群模式部署Tachyon 1.Tachyon编译部署 Tachyon目前的最新发布版为0.7.1,其官方网址为http://tac ...
- Greenplum源码编译安装(单机及集群模式)完全攻略
公司有个项目需要安装greenplum数据库,让我这个gp小白很是受伤,在网上各种搜,结果找到的都是TMD坑货帖子,但是经过4日苦战,总算是把greenplum的安装弄了个明白,单机及集群模式都部署成 ...
- CentOS6安装各种大数据软件 第十章:Spark集群安装和部署
相关文章链接 CentOS6安装各种大数据软件 第一章:各个软件版本介绍 CentOS6安装各种大数据软件 第二章:Linux各个软件启动命令 CentOS6安装各种大数据软件 第三章:Linux基础 ...
随机推荐
- 微信小程序之弹框modal
官方文档 <modal hidden="{{hidden}}" title="这里是title" confirm-text="自定义确定按钮&q ...
- keepalive主从上同时出现VIP,且均无法消失
低版本bug 双主架构中,keepalived日志出现: more /var/log/messageOct 9 03:16:22 mysql-dzg-60-148 Keepalived_vrrp[85 ...
- DC画线
CClientDC hdc(this);//获取DC CPen pen(PS_SOLID,4,RGB(255,0,0));//创建一支红笔 CPen * pOldPen=hdc.SelectObjec ...
- 返回结点值为e的二叉树指针
题意为,如果二叉树某结点的值为e(假定是整型二叉树),返回这个结点的指针.初看这道题,联想到二叉树可以很简单的遍历,直接返回这个指针不就行了吗?如下图所示,假如要返回值为3的结点指针: 设计好了一个函 ...
- 安装BouncyCastle
对于Windows而言 将bcprov-jdk16-146.jar 复制到C:\Program Files\Java\jre6\lib\ext和C:\jdk1.6.0\jre\lib\ext目录下: ...
- MIT Molecular Biology 笔记2 DNA的突变和修复
视频 https://www.bilibili.com/video/av7973580?from=search&seid=16993146754254492690 教材 Molecular ...
- C#-委派和事件
委派代表一个方法.当不知道后面的方法名称时,可用委派先声明,待使用方法时,再在委派实例化时写入方法名称. 先声明, public delegate int delegateClassName (参数列 ...
- poj1321 DFS
棋盘问题 Time Limit: 1000 MS Memory Limit: 10000 KB 64-bit integer IO format: %I64d , %I64u Java class n ...
- CefSharp访问需要认证网页或接口(在Request的Headers中添加认证Token)
public class MyRequestHandler : DefaultRequestHandler { public static readonly string VersionNumberS ...
- [WPF]为旧版本的应用添加触控支持
之前做WPF开发时曾经遇到这样一个需求:为一个基于 .NET Framework 3.5开发的老旧WPF程序添加触控支持,以便于大屏触控展示. 接手之后发现这是一个大坑. 项目最初的时候完全没考虑过软 ...