addingMetricsSupportInKafkaConnector

[xinlian12]

Related to #38765

Design

azure-cosmos has metrics support, and exposed multiple API so that customer can config with metrics category, tags, percentiles etc.

In kafka connector, instead of exposing those capabilities through configs, we allow customers to configure through environment variable/system properties + enable metrics collection by using java agents.

Example with use AppInsights java agent
export KAFKA_OPTS="-javaagent:$base_dir/applicationinsights-agent-3.5.1.jar -DCOSMOS.METRICS_CONFIG={\"metricCategories\":\"[OperationDetails]\"}"

 System.setProperty(
            "COSMOS.METRICS_CONFIG",
           "{\"metricCategories\":\"[OperationSummary, RequestSummary]\","
               + "\"tagNames\":\"[Container, Operation]\","
               + "\"sampleRate\":0.5,"
               + "\"percentiles\":[0.90,0.99],"
               + "\"enableHistograms\":false,"
               + "\"applyDiagnosticThresholdsForTransportLevelMeters\":true}");

[FabianMeiswinkel]

LGTM

[kushagraThapar]

Overall looks good to me, thanks @xinlian12

[xinlian12]

/azp run java - cosmos - tests

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[xinlian12]

/azp run java - cosmos - kafka

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[azure-sdk]

API change check

API changes are not detected in this pull request.

[xinlian12]

/azp run java - cosmos - kafka

[xinlian12]

/azp run java - cosmos - tests

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[xinlian12]

/azp run java - cosmos - kafka

[xinlian12]

/azp run java - cosmos - tests

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[xinlian12]

/azp run java - cosmos - kafka

[xinlian12]

/azp run java - cosmos - tests

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[xinlian12]

/check-enforcer override