Due Scala < 2.12 does not compiles on java 1.11 jdk and, scala 2.12
requires to change org.apache.kafka from `0.8.2.1` to at least `0.10.2.2`
This last kafka version will require to change/port the code of following classes:

* KafkaCollector.scala
* KafkaConsumer.scala
* MetricsUtil.scala

To avoid break the streaming benchmarks in scala 2.11 and 2.10 the following
changes are implemented:

* Added profile to skip compiling scala code by using `maven.assembly.plugin.goal` variable.
* Changed the goal in `scala-compile-first` to change in function of this added profile when no need to compile Kafka scala code.

Signed-off-by: Luis Ponce <[email protected]>

* Created method copyMerge in TestDFSIOEnh.java due hadoop-common-3.2.0
jar has deprecatted it. [Removed
FileUtil.copyMerge](https://issues.apache.org/jira/browse/HADOOP-12967).
* Created method checkDest in TestDFSIOEnh.java because is private in
org.apache.hadoop.fs.FileUtil and required for copyMerge.
* LoggerFactory changed to org.slf4j due org.slf4j.Logger cannot be
converted to org.apache.commons.logging.Log

Signed-off-by: Luis Ponce <[email protected]>

* sparkbench/assembly/pom.xml:
	* Changed property name activation on `allModules` profile.
	* Added new profile that excludes `sparkbench-streaming` artifact.

* sparkbench/pom.xml:
	* Changed property name activation on `allModules` profile.
        * Added new profile that excludes `streaming` module.
	* Added profile spark2.4 due spark-core_2.12 supports > 2.4.0 version.
	* Added profile scala 2.12. Scala < 2.12 does not compiles on java 1.11 jdk.
	* Added profile hadoop3.2 to propagate this variable to all spark benchmark.

* sparkbecnh/streaming/pom.xml:
        * Added profile spark2.4 on sparkbench-streaming POM with spark-streaming-kafka-0-8_2.11 version 2.4.0.

Signed-off-by: Luis Ponce <[email protected]>

* Moved mapred-site and yarn-site xml files to a created a folder that contains the artifacts for
either hadoop 2.6 or 3.2, those will be pickd up depending on the testing
needs in travis.yml

* Moved spark-env file to a created a folder that contains the artifacts for
either spark1.6 or 2.4, those will be pickd up depending on the testing
needs in travis.yml

* Created hadoop-env.sh file for Hadoop 3.2 to store required
environment variables to start hdfs and yarn services.

* Removed harcoded values from haddop.conf and spark.conf, this will be
filled up depending on the testing needs.

* Added an `install_hadoop_spark` script that will download hadoop and spark
binaries depending on the testing needs.

* Added a `config_hadoop_spark` script that will setup hadoop, spark and
hibench depending on the testing needs.

* Added a `jdk_ver` script to pick up the current java version installed for
travis CI.

* `restart_hadoop_spark` script modified to be agnostic to the required
binaries for testing.

* travis/config_hadoop_spark.sh:
	* for Java 8 and 11 skiping `sql` test since HIVE is no longer
used to perform queries. Newer Spark version perform queries using
`SparkSession` no longer used `import org.apache.spark.sql`

* .travis.yml:
	* Added `dist: trusty` to keep using this distro, Travis picks
up xenial if not especified.. If Any
greather Ubuntu version required in Travis won't support openjdk 7.
	* Refactored the CI flow to behave, download, setup, run and
test hadoop and spark depending on the jdk required either versions 7, 8 and
11.
	* Hibench will be configured depending on the jdk required
either versions 7, 8 and 11.
	* Hibench will be built depending on the jdk required
either versions 7, 8 and 11.
	* benchmarks will be run for all jdk versions set.

Signed-off-by: Luis Ponce <[email protected]>

* autogen/pom.xml
	* Add hadoop mr2 profile to be used for hadoop hdfs and client.

Signed-off-by: Luis Ponce <[email protected]>

* docs/build-hibench.md:
	* Update 2.4 version to specify Spark Version.
	* Add Specify Hadoop version documentation.
	* Add Build using JDK 11 documentation.

* README.md:
	* Update Supported Hadoop/Spark releases to hadoop 3.2 and spark
2.4

Signed-off-by: Luis Ponce <[email protected]>