Pinned Loading

1. spark-on-kubernetes spark-on-kubernetes Public

   An Deployment and Setup of Apache Spark for multi-tenant usage in Kubernetes Clusters. This deploys 1 Executor per K8S POD , scales linearly.

   Python 1

2. project_lost_saturn project_lost_saturn Public

   This is the core of project lost_saturn . The project lost_saturn project is a modern approach to datascience, focus on enabling DataScience on containerised environments everywhere. Built first wi…

   Jupyter Notebook 2 3

3. airflow-executions airflow-executions Public

   Apache Airflow for K8s Clusters with Docker-compose orchestration. Example includes used in Workflows for Jobs like WebHooks and WebScrapers

   Python 1

4. DeepLearning-MalwareDetection DeepLearning-MalwareDetection Public

   Jupyter Notebook 1

5. jpac-sparklyr jpac-sparklyr Public

   H2O and sparklyr setup in Rstudio with demo/trials for Hadoop Spark

   Java 3

6. SparkElasticSearchPublisher SparkElasticSearchPublisher Public

   Elasticsearch publisher using Hadoop as source and Spark 1.6 as ETL engine :: Running package for Cloudera CDH 5.9.0 Cluster

   Scala 2