Download Latest Version maven-wrapper.jar (48.3 kB)
Email in envelope

Get an email when there's a new version of luizot71

Home / marketplace / kafka-ingestor
Name Modified Size InfoDownloads / Week
Parent folder
Utils.java 2021-02-12 16.0 kB
0
ListenerCollectionVerticleTest.java 2021-02-12 15.0 kB
0
ListenerTest.java 2021-02-12 2.1 kB
0
KafkaVerticleTest.java 2021-02-12 10.7 kB
0
UtilsTest.java 2021-02-12 2.8 kB
0
KafkaVerticle.java 2021-02-12 6.2 kB
0
ListenerCollectionVerticle.java 2021-02-12 6.7 kB
0
EventBusConstants.java 2021-02-12 139 Bytes
0
WayRequest.avsc 2021-02-12 4.0 kB
0
log4j2.properties 2021-02-12 603 Bytes
0
deploy-strategy.json 2021-02-12 1.5 kB
0
env.conf 2021-02-12 951 Bytes
0
settings.xml 2021-02-12 1.8 kB
0
repositories 2021-02-12 303 Bytes
0
local.repo 2021-02-12 1.6 kB
0
pip.conf 2021-02-12 139 Bytes
0
ivysettings.xml 2021-02-12 848 Bytes
0
probes.conf 2021-02-12 515 Bytes
0
maven-wrapper.properties 2021-02-12 109 Bytes
0
maven-wrapper.jar 2021-02-12 47.6 kB
0
conf 2021-02-12 987 Bytes
0
service-terms.md 2021-02-12 905 Bytes
0
README.adoc 2021-02-12 2.1 kB
0
pom.xml.versionsBackup 2021-02-12 6.9 kB
0
mvnw.cmd 2021-02-12 5.1 kB
0
pom.xml 2021-02-12 6.9 kB
0
mvnw 2021-02-12 6.7 kB
0
entrypoint.sh 2021-02-12 642 Bytes
0
entrypoint.sh.old 2021-02-12 642 Bytes
0
Dockerfile 2021-02-12 2.4 kB
0
Dockerfile.old 2021-02-12 2.4 kB
0
_dockerignore 2021-02-12 29 Bytes
0
_gitignore 2021-02-12 80 Bytes
0
Totals: 33 Items   155.3 kB 0 
= vertx-kafka-ingestor

Recebe um JSON via fila e posta no Kafka

Tecnologias Utilizadas:

* Vert.x v3.8.1
* Vert.x Commons v2.0
* Rabbit MQ

== Building

-----------------
mvn clean package
-----------------

== Running

Main Verticle: br.com.santander.vertx.commons.deploy.DeployerVerticle

=== Configuring

deploy-strategy.json

-----------------
    "br.com.santander.ingestor.verticles.KafkaVerticle": {
    	"config": {
    		"schemas": {
    			"schemaNameA": "schemas/avro1.avsc",
    			"schemaNameB": "schemas/avro2.avsc",
    			"schemaNameC": "schemas/avro3.avsc"
    		}
    		"brokers" : "env:KAFKA_BROKERS",
			"topics" : {
				"failure" : "env:KAFKA_TOPIC_FAILURE",
				"success" : "env:KAFKA_TOPIC_SUCCESS"
			}
    }
-----------------

Folder:

-----------------
 - src/main/resources
    - schemas
        - avro1.avsc
        - avro2.avsc
        - avro3.avsc
-----------------


=== Eclipse running


* New Java Application
* Choose project `*vertx-kafka-ingestor*`
* Main class: `*io.vertx.core.Launcher*`
* Program Args: `*run br.com.santander.vertx.commons.deploy.DeployerVerticle*`
* Java args: 

-----------------
	-Dvertx.logger-delegate-factory-class-name=io.vertx.core.logging.Log4j2LogDelegateFactory 
	-Dvertx.disableDnsResolver=true 
	-Djava.net.useSystemProxies=false
-----------------
* Environments:

-----------------

QUEUE_LISTENER=way.telemetry.queue.listener
EXCHANGE=way.telemetry.exchange
ROUTINGKEY=way.telemetry.routingkey
RABBIT_HOST=localhost
RABBIT_VIRTUALHOST=/
RABBIT_PORT=5672
RABBIT_CONN_TIMEOUT=6000
DB_RABBIT_USER=/etc/credentials/secret-db-rabbit/username
DB_RABBIT_PASS=/etc/credentials/secret-db-rabbit/password
KAFKA_BROKERS=localhost
KAFKA_TOPIC_SUCCESS=BR.success
KAFKA_TOPIC_FAILURE=BR.failure
-----------------

=== Example of message on Rabbit


-----------------
{
    "schema": "schemaNameA",
    "data": {
        "myFieldA": "A",
        "myFieldB": "B"
        ...
    }
}
-----------------
Source: README.adoc, updated 2021-02-12