Add HCatalog init action & typo fix

- Add Hive HCatalog initialization action
- Typo fix for Flink readme

Author: James Malone

README.md

@@ -30,6 +30,7 @@ This repository presently offers the following actions for use with Cloud Datapr
   * [Apache Zeppelin](http://zeppelin.apache.org)
   * [Apache ZooKeeper](http://zookeeper.apache.org)
   * [Google Cloud Datalab](https://cloud.google.com/datalab/)
+  * [Hive HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog)
   * [Hue](http://gethue.com)
   * [IPython](http://ipython.org)
   * [Presto](http://prestodb.io)

flink/flink.sh

@@ -19,7 +19,7 @@
 # To use this script, you will need to configure the following variables to
 # match your cluster. For information about which software components
 # (and their version) are included in Cloud Dataproc clusters, see the
-# Cloud Dataproc Image Version informayion:
+# Cloud Dataproc Image Version information:
 # https://cloud.google.com/dataproc/concepts/dataproc-versions
 
 set -x -e

hive-hcatalog/README.md

@@ -0,0 +1,18 @@
+# Apache Drill Initialization Action
+
+This initialization action installs [Hive HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog) on a [Google Cloud Dataproc](https://cloud.google.com/dataproc) cluster. The script will also configure Pig to use HCatalog.
+
+## Using this initialization action
+
+You can use this initialization action to create a new Cloud Dataproc cluster with HCatalog installed by doing the following.
+
+1. Uploading a copy of this initialization action (`hive-hcatalog.sh`) to [Google Cloud Storage](https://cloud.google.com/storage). Alternatively, you can use the Google-hosted copy of this initialization action at `gs://dataproc-initialization-actions/hive-hcatalog/hive-hcatalog.sh`
+2. Using the `gcloud` command to create a new cluster with this initialization action. The following command will create a new cluster named `<CLUSTER-NAME>`, specify the initialization action stored in `<GCS-BUCKET>`:
+
+    ```bash
+    gcloud dataproc clusters create <CLUSTER-NAME> \
+    --initialization-actions gs://<GCS-BUCKET>/hive-hcatalog.sh
+    ```
+3. Once the cluster has been created HCatalog should be installed and configured for use with Pig.
+
+You can find more information about using initialization actions with Dataproc in the [Dataproc documentation](https://cloud.google.com/dataproc/init-actions).

hive-hcatalog/hive-hcatalog.sh

@@ -0,0 +1,36 @@
+#!/bin/bash
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#      http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS-IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+# This script installs Hive HCatalog
+# (https://cwiki.apache.org/confluence/display/Hive/HCatalog) on a Google Cloud
+# Dataproc cluster.
+#
+# To use this script, you will need to configure the following variables to
+# match your cluster. For information about which software components
+# (and their version) are included in Cloud Dataproc clusters, see the
+# Cloud Dataproc Image Version information:
+# https://cloud.google.com/dataproc/concepts/dataproc-versions
+
+set -x -e
+
+# Install the hive-hcatalog package
+apt-get -q -y install hive-hcatalog
+
+# Configure Pig to use HCatalog
+cat >>/etc/pig/conf/pig-env.sh <<EOF
+#!/bin/bash
+
+includeHCatalog=true
+
+EOF