Pom.xml The dependencies in are as follows:Īdd log4j.properties, the configuration file of log4j, in src/main/resources, as follows: log4j. There are two possibilities for MapReduce implementation, one is scala-sbt and other way is maven, I want to describe both of them. For hadoop version 2.7.3, the following jar packages are required:įor maven configuration, the configuration of Alibaba source and official source is as follows: By running ' jps ', you can be sure that hadoop has been installed properly. The complete project path is shown in the figure below:
If you want to create a web project or use a skeleton, you can check it.)Īfter Finish, the path of the blank project is shown in the figure below.
The community edition features: An intelligent code editor that understands Java code provides refactorings, code inspections and intentions, and allows for fast code navigation. (if you just run MapReduce to create a java project, you don't need to check "create from Archetype". IntelliJ IDEA is an advanced IDE developed by JetBrains and focused on developer productivity. Open idea, file > New > project, and select maven project in the left panel. You can build a single jar file with your program and all necessary dependencies (e.g, Hadoop libraries) so you can.
0 kommentar(er)
