Skip to content

Releases: cdapio/hadoop_cookbook

Release version 2.0.5

30 Jul 20:21
Compare
Choose a tag to compare

This is a small bug fix release to the HADOOP_CLASSPATH and also adds support for the latest HDP patch levels.

  • Support HDP 2.2.6.3 ( Issue: #212 )
  • Keep HADOOP_CLASSPATH before Tez's CLASSPATH ( Issue: #213 )
  • Support HDP 2.3.0.0 ( Issue: #214 )

Release version 2.0.4

23 Jul 22:45
Compare
Choose a tag to compare

This is a bug fix release for some issues with running on HDP 2.2 and running HiveServer2 with the new init scripts.

  • Fix ChefSpec ( Issue: #207 )
  • Support HDP 2.1.15.0, 2.2.4.4, and 2.2.6.0 ( Issue: #208 )
  • HiveServer2 process fix per @jsh2134 ( Issue: #210 )
  • Fix HDP 2.2 yarn.application.classpath ( Issue: #211 )

Release version 2.0.3

25 Jun 22:04
Compare
Choose a tag to compare

This is a small bug fix release. It fixes disabling Transparent Hugepage Compaction on all different instances of CentOS and Spark init, which use ampersand to background the startup command.

  • Config files should be root owned ( Issue: #204 )
  • Fix disable THP Compaction ( Issues: #205 COOK-57 )
  • Fix init for EXE_ARGS ending in ampersand ( Issues: #206 COOK-59 )

Release version 2.0.2

12 Jun 21:49
Compare
Choose a tag to compare

This is another bug fix release. Using start-stop-daemon on Ubuntu proved to be problematic. As such, we've switched the cookbook to using su to run commands, directly.

  • Don't make /etc/default files executable ( Issue: #201 )
  • Remove Vagrantfile ( Issue: #202 )
  • Fix Ubuntu init ( Issue: #203 )

Release version 2.0.1

10 Jun 00:17
Compare
Choose a tag to compare

This is a bug fix release. There was an issue with the 2.0.0 release with HDP versions prior to 2.2.0.0 which caused the hbase command to not work as expected.

  • Supply /etc/default/hbase for hbase binary ( Issue: #200 )

Release version 2.0.0

08 Jun 19:28
Compare
Choose a tag to compare

This release is a change from previous versions of the cookbook. Prior to this release, we tried our best to keep the cookbook-produced systems as close to "stock" as possible. Starting with this release, we're working to make the different distributions as similar as possible. This includes introducing our own init scripts, bypassing whatever is shipped with the distribution. This has also replaced many packages with simple templates.

Due to these changes, we've chosen to change to a new major version.

  • Transparent Hugepages are not universally available, per @jdecello and @taverentech ( Issue: #156 )
  • Support HDP 2.2.4.2 repo ( Issues: #160 #186 )
  • Fix YARN/Hive/Oozie PATHs for HDP 2.2 ( Issue: #161 )
  • Official CDH5 repo for Trusty ( Issue: #162 )
  • Set user limits by attribute ( Issues: #163 #165 COOK-35 )
  • Fix extjs link ( Issues: #164 COOK-36 )
  • Use HDP mysql-connector-java ( Issues: #166 COOK-34 )
  • Deprecate short versions ( Issue: #167 )
  • Correct status for #156 ( Issue: #168 )
  • Move SQL connectors to their own recipe ( Issue: #169 )
  • Testing updates ( Issues: #170 #171 )
  • Use Chef only_if guards over Ruby conditionals ( Issues: #172 #175 #176 #181 )
  • Disable SELinux ( Issue: #173 )
  • Install libhdfs ( Issue: #177 )
  • Support HDP 2.1.10.0 and 2.2.1.0 ( Issue: #178 )
  • Move compression libs to helper recipe ( Issues: #179 #187 COOK-44 )
  • Ensure zookeeper user has shell access ( Issue: #180 )
  • Use variables directly over local variable ( Issue: #181 )
  • HDP 2.2 MR DistributedCache ( Issue: #182 COOK-40 )
  • HDP 2.2 Tez DistributedCache ( Issue: #183 COOK-49 )
  • Sort XML configuration keys, per @mbautin ( Issue: #184 )
  • HDP 2.2 hadooplzo support ( Issue: #185 )
  • Fix Java 7 type checking, per @TD-4242 ( Issue: #188 )
  • Template-based init scripts ( Issues: #190 #194 #195 #196 COOK-52 COOK-53 )
  • Set debian repository priority ( Issues: #191 #198 )
  • Fix HDFS HA checkconfig, per @TD-4242 ( Issue: #192 )
  • Initialize ZooKeeper version-2 directories ( Issue: #193 )
  • Support hadoop-metrics2.properties ( Issue: #197 )
  • Remove guard on execute block with action :nothing ( Issue: #198 )

Release version 1.13.1

15 Apr 21:06
Compare
Choose a tag to compare

This is a small bug-fix release. It includes support for the latest HDP 2.0 patchlevel.

  • Fix YARN AM staging dir ( Issues: #157 COOK-30 )
  • Support HDP 2.0.13.0 and bump HDP-UTILS to 1.1.0.20 ( Issue: #158 )
  • Document issue tracker location ( Issues: #159 COOK-32 )

Release version 1.13.0

31 Mar 23:11
Compare
Choose a tag to compare

This release adds system tuning to the larger daemon recipes and includes a couple bug fixes.

  • Enable system tuning ( Issue: #148 )
  • Test against more Ruby versions ( Issue: #153 )
  • Fix guard on mapreduce.jobhistory.done-dir ( Issue: #154 )

Release version 1.12.0

20 Mar 20:20
Compare
Choose a tag to compare

This release improves support for secure clusters by setting up some YARN and JHS directories in HDFS for multi-user usage.

  • Support yarn.app.mapreduce.am.staging-dir ( Issue: #150 )
  • Support mapreduce.jobhistory.done-dir and mapreduce.jobhistory.intermediate-done-dir ( Issue: #151 )
  • Tests for #135 and #150 ( Issue: #152 )

Release version 1.11.2

09 Mar 17:45
Compare
Choose a tag to compare

This is a bug fix release.

  • Prefix internal recipes with underscore ( Issue: #147 )
  • Fix Java 7 check ( Issues: #149 COOK-27 )