-
Notifications
You must be signed in to change notification settings - Fork 3
seyijava/HL7DataPipeline
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
HDFS ===================================================================================================== cd $HADOOP_HOME bin/start-all.sh hdfs dfs -mkdir /bigdata/healthcare/datalake/hl7/ Kafka ======================================================================================================= cd $Flume_HOME bin/kafka-topics --create --zookeeper localhost:2181 --partitions 1 --replication-factor 1 --topic HL7_Ingest Flume ===================================================================================================== cd $Flume_HOME bin/flume-ng agent -n lambda -c conf -f conf/lambda_hdfs_flume_conf.properties Spark ========================================================================================================== spark-submit --class com.bigdataconcept.bigdata.healthcare.processor.hL7.HL7ETLSparkProcessor --master local[2] spark-hL7-etl-jar-with-dependencies.jar
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published