IntelliJ IDEA 配置 Hadoop 源码阅读环境

Posted go-no-1

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了IntelliJ IDEA 配置 Hadoop 源码阅读环境相关的知识,希望对你有一定的参考价值。

1、下载安装IDEA

https://www.jetbrains.com/idea/download/#section=windows

2、下载hadoop源码

https://archive.apache.org/dist/hadoop/core/

3、使用IDEA打开hadoop源码

4、配置自定义Maven配置文件

file -> setting -> 如下图设置:

技术图片

 

附(需要使用aliyun的源,默认国外源基本用不了):

技术图片
  1 <?xml version="1.0" encoding="UTF-8"?>
  2 
  3 <!--
  4 Licensed to the Apache Software Foundation (ASF) under one
  5 or more contributor license agreements.  See the NOTICE file
  6 distributed with this work for additional information
  7 regarding copyright ownership.  The ASF licenses this file
  8 to you under the Apache License, Version 2.0 (the
  9 "License"); you may not use this file except in compliance
 10 with the License.  You may obtain a copy of the License at
 11 
 12     http://www.apache.org/licenses/LICENSE-2.0
 13 
 14 Unless required by applicable law or agreed to in writing,
 15 software distributed under the License is distributed on an
 16 "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
 17 KIND, either express or implied.  See the License for the
 18 specific language governing permissions and limitations
 19 under the License.
 20 -->
 21 
 22 <!--
 23  | This is the configuration file for Maven. It can be specified at two levels:
 24  |
 25  |  1. User Level. This settings.xml file provides configuration for a single user,
 26  |                 and is normally provided in $user.home/.m2/settings.xml.
 27  |
 28  |                 NOTE: This location can be overridden with the CLI option:
 29  |
 30  |                 -s /path/to/user/settings.xml
 31  |
 32  |  2. Global Level. This settings.xml file provides configuration for all Maven
 33  |                 users on a machine (assuming they‘re all using the same Maven
 34  |                 installation). It‘s normally provided in
 35  |                 $maven.conf/settings.xml.
 36  |
 37  |                 NOTE: This location can be overridden with the CLI option:
 38  |
 39  |                 -gs /path/to/global/settings.xml
 40  |
 41  | The sections in this sample file are intended to give you a running start at
 42  | getting the most out of your Maven installation. Where appropriate, the default
 43  | values (values used when the setting is not specified) are provided.
 44  |
 45  |-->
 46 <settings xmlns="http://maven.apache.org/SETTINGS/1.0.0"
 47           xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
 48           xsi:schemaLocation="http://maven.apache.org/SETTINGS/1.0.0 http://maven.apache.org/xsd/settings-1.0.0.xsd">
 49   <!-- localRepository
 50    | The path to the local repository maven will use to store artifacts.
 51    |
 52    | Default: $user.home/.m2/repository
 53   -->
 54   <localRepository>E:/software/apache-maven-3.6.1/repository</localRepository>
 55 
 56 
 57   <!-- interactiveMode
 58    | This will determine whether maven prompts you when it needs input. If set to false,
 59    | maven will use a sensible default value, perhaps based on some other setting, for
 60    | the parameter in question.
 61    |
 62    | Default: true
 63   <interactiveMode>true</interactiveMode>
 64   -->
 65 
 66   <!-- offline
 67    | Determines whether maven should attempt to connect to the network when executing a build.
 68    | This will have an effect on artifact downloads, artifact deployment, and others.
 69    |
 70    | Default: false
 71   <offline>false</offline>
 72   -->
 73 
 74   <!-- pluginGroups
 75    | This is a list of additional group identifiers that will be searched when resolving plugins by their prefix, i.e.
 76    | when invoking a command line like "mvn prefix:goal". Maven will automatically add the group identifiers
 77    | "org.apache.maven.plugins" and "org.codehaus.mojo" if these are not already contained in the list.
 78    |-->
 79   <pluginGroups>
 80     <!-- pluginGroup
 81      | Specifies a further group identifier to use for plugin lookup.
 82     <pluginGroup>com.your.plugins</pluginGroup>
 83     -->
 84   </pluginGroups>
 85 
 86   <!-- proxies
 87    | This is a list of proxies which can be used on this machine to connect to the network.
 88    | Unless otherwise specified (by system property or command-line switch), the first proxy
 89    | specification in this list marked as active will be used.
 90    |-->
 91   <proxies>
 92     <!-- proxy
 93      | Specification for one proxy, to be used in connecting to the network.
 94      |
 95     <proxy>
 96       <id>optional</id>
 97       <active>true</active>
 98       <protocol>http</protocol>
 99       <username>proxyuser</username>
100       <password>proxypass</password>
101       <host>proxy.host.net</host>
102       <port>80</port>
103       <nonProxyHosts>local.net|some.host.com</nonProxyHosts>
104     </proxy>
105     -->
106   </proxies>
107 
108   <!-- servers
109    | This is a list of authentication profiles, keyed by the server-id used within the system.
110    | Authentication profiles can be used whenever maven must make a connection to a remote server.
111    |-->
112   <servers>
113     <!-- server
114      | Specifies the authentication information to use when connecting to a particular server, identified by
115      | a unique name within the system (referred to by the ‘id‘ attribute below).
116      |
117      | NOTE: You should either specify username/password OR privateKey/passphrase, since these pairings are
118      |       used together.
119      |
120     <server>
121       <id>deploymentRepo</id>
122       <username>repouser</username>
123       <password>repopwd</password>
124     </server>
125     -->
126 
127     <!-- Another sample, using keys to authenticate.
128     <server>
129       <id>siteServer</id>
130       <privateKey>/path/to/private/key</privateKey>
131       <passphrase>optional; leave empty if not used.</passphrase>
132     </server>
133     -->
134   </servers>
135 
136   <!-- mirrors
137    | This is a list of mirrors to be used in downloading artifacts from remote repositories.
138    |
139    | It works like this: a POM may declare a repository to use in resolving certain artifacts.
140    | However, this repository may have problems with heavy traffic at times, so people have mirrored
141    | it to several places.
142    |
143    | That repository definition will have a unique id, so we can create a mirror reference for that
144    | repository, to be used as an alternate download site. The mirror site will be the preferred
145    | server for that repository.
146    |-->
147   <mirrors>
148     <!-- mirror
149      | Specifies a repository mirror site to use instead of a given repository. The repository that
150      | this mirror serves has an ID that matches the mirrorOf element of this mirror. IDs are used
151      | for inheritance and direct lookup purposes, and must be unique across the set of mirrors.
152      |
153     <mirror>
154       <id>mirrorId</id>
155       <mirrorOf>repositoryId</mirrorOf>
156       <name>Human Readable Name for this Mirror.</name>
157       <url>http://my.repository.com/repo/path</url>
158     </mirror>
159 
160     <mirror>
161         <id>nexus-aliyun</id>
162         <mirrorOf>*</mirrorOf>
163         <name>Nexus aliyun</name>
164         <url>http://maven.aliyun.com/nexus/content/groups/public</url>
165     </mirror>
166       -->
167 
168     <!-- 阿里云仓库 -->
169     <mirror>
170         <id>alimaven</id>
171         <mirrorOf>central</mirrorOf>
172         <name>aliyun maven</name>
173         <url>http://maven.aliyun.com/nexus/content/repositories/central/</url>
174     </mirror>
175 
176     <!-- 中央仓库1 -->
177     <mirror>
178         <id>repo1</id>
179         <mirrorOf>central</mirrorOf>
180         <name>Human Readable Name for this Mirror.</name>
181         <url>http://repo1.maven.org/maven2/</url>
182     </mirror>
183 
184     <!-- 中央仓库2 -->
185     <mirror>
186         <id>repo2</id>
187         <mirrorOf>central</mirrorOf>
188         <name>Human Readable Name for this Mirror.</name>
189         <url>http://repo2.maven.org/maven2/</url>
190     </mirror>
191 
192   </mirrors>
193 
194   <!-- profiles
195    | This is a list of profiles which can be activated in a variety of ways, and which can modify
196    | the build process. Profiles provided in the settings.xml are intended to provide local machine-
197    | specific paths and repository locations which allow the build to work in the local environment.
198    |
199    | For example, if you have an integration testing plugin - like cactus - that needs to know where
200    | your Tomcat instance is installed, you can provide a variable here such that the variable is
201    | dereferenced during the build process to configure the cactus plugin.
202    |
203    | As noted above, profiles can be activated in a variety of ways. One way - the activeProfiles
204    | section of this document (settings.xml) - will be discussed later. Another way essentially
205    | relies on the detection of a system property, either matching a particular value for the property,
206    | or merely testing its existence. Profiles can also be activated by JDK version prefix, where a
207    | value of ‘1.4‘ might activate a profile when the build is executed on a JDK version of ‘1.4.2_07‘.
208    | Finally, the list of active profiles can be specified directly from the command line.
209    |
210    | NOTE: For profiles defined in the settings.xml, you are restricted to specifying only artifact
211    |       repositories, plugin repositories, and free-form properties to be used as configuration
212    |       variables for plugins in the POM.
213    |
214    |-->
215   <profiles>
216     <!-- profile
217      | Specifies a set of introductions to the build process, to be activated using one or more of the
218      | mechanisms described above. For inheritance purposes, and to activate profiles via <activatedProfiles/>
219      | or the command line, profiles have to have an ID that is unique.
220      |
221      | An encouraged best practice for profile identification is to use a consistent naming convention
222      | for profiles, such as ‘env-dev‘, ‘env-test‘, ‘env-production‘, ‘user-jdcasey‘, ‘user-brett‘, etc.
223      | This will make it more intuitive to understand what the set of introduced profiles is attempting
224      | to accomplish, particularly when you only have a list of profile id‘s for debug.
225      |
226      | This profile example uses the JDK version to trigger activation, and provides a JDK-specific repo.
227     <profile>
228       <id>jdk-1.4</id>
229 
230       <activation>
231         <jdk>1.4</jdk>
232       </activation>
233 
234       <repositories>
235         <repository>
236           <id>jdk14</id>
237           <name>Repository for JDK 1.4 builds</name>
238           <url>http://www.myhost.com/maven/jdk14</url>
239           <layout>default</layout>
240           <snapshotPolicy>always</snapshotPolicy>
241         </repository>
242       </repositories>
243     </profile>
244     -->
245 
246     <!--
247      | Here is another profile, activated by the system property ‘target-env‘ with a value of ‘dev‘,
248      | which provides a specific path to the Tomcat instance. To use this, your plugin configuration
249      | might hypothetically look like:
250      |
251      | ...
252      | <plugin>
253      |   <groupId>org.myco.myplugins</groupId>
254      |   <artifactId>myplugin</artifactId>
255      |
256      |   <configuration>
257      |     <tomcatLocation>$tomcatPath</tomcatLocation>
258      |   </configuration>
259      | </plugin>
260      | ...
261      |
262      | NOTE: If you just wanted to inject this configuration whenever someone set ‘target-env‘ to
263      |       anything, you could just leave off the <value/> inside the activation-property.
264      |
265     <profile>
266       <id>env-dev</id>
267 
268       <activation>
269         <property>
270           <name>target-env</name>
271           <value>dev</value>
272         </property>
273       </activation>
274 
275       <properties>
276         <tomcatPath>/path/to/tomcat/instance</tomcatPath>
277       </properties>
278     </profile>
279     -->
280   </profiles>
281 
282   <!-- activeProfiles
283    | List of profiles that are active for all builds.
284    |
285   <activeProfiles>
286     <activeProfile>alwaysActiveProfile</activeProfile>
287     <activeProfile>anotherAlwaysActiveProfile</activeProfile>
288   </activeProfiles>
289   -->
290 </settings>
settings.xml

 

以上是关于IntelliJ IDEA 配置 Hadoop 源码阅读环境的主要内容,如果未能解决你的问题,请参考以下文章

转载MapReduce编程 Intellij Idea配置MapReduce编程环境

IntelliJ IDEA 中更改 maven 镜像源

IntelliJ IDEA搭建Hadoop开发环境

IntelliJ IDEA搭建Hadoop开发环境

如何在Windows中使用Intellij idea搭建远程Hadoop开发环境

Intellij IDEA:“从源滚动”的热键