AvroIngestion App

This section explains how to configure the AvroIngestion App on Azure.

Prerequisite

The DES application should be configured with the azure eventhubnamespace.

Configure AvroIngestion App in Azure

1. Navigate to AvroIngestionApp.


By default, AvroIngestionApp is configured in Azure cloud. Ensure to navigate to the respective app based on current deployment.

2. Navigate inside configurations.



Below are the Ingestion properties.

PROPERTY	DEFAULT VALUE	DESCRIPTION	AZURE CONFIGURATION
RESOURCE_GROUP_NAME	party-ms	Env specific resource name can be appended	Resource Group Name
		Groups all the function app and configuration of the deployment
AVRO_INGESTION_APP_NAME	AvroIngestionApp	Env specific app name can be appended	Function App
AVRO_INGESTION_HUB_NAMESPACE	transactdes	Set the eventhubnamespace value mapped in the DES application	EventHub Namespace
AVRO_INGESTION_HUB_NAME	table-update	DES EventHub name.	eventHubName
REGISTRY_URL	http://schema-registry:8081	URL of the schema registry which is used to get the schema of the Backoffice(Transact) applications like CUSTOMER, CUSTOMER.GROUP etc.	temn_msf_schema_registry_urL
The below three properties AVRO_KAFKA_SERVER, eventHubConnection & SASL_JASS_CONFIG will be configured through the script. Note: If the values are known to the user, it can be overridden in the script.
AVRO_KAFKA_SERVER	${AVRO_INGESTION_HUB_NAMESPACE}.servicebus.windows.net:9093	Hostname of the eventHubnamespace	temn_msf_stream_kafka_bootstrap_servers
		eg: transactdes.servicebus.windows.net:9093
eventHubConnection	{eventHubConnection}	Kafka Connection string	eventHubConnection
SASL_JASS_CONFIG	{org.apache.kafka.common.security.plain.PlainLoginModule required username=\"\$ConnectionString\" password=\"${eventHubConnection}\";}	Property to stream or read the data from Event Hub Kafka	temn_msf_stream_kafka_sasl_jaas_config
eventHubConsumerGroup	\$Default	Kafka Consumer Group	eventHubConsumerGroup