Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Elasticsearch Metrics #488

Merged
merged 2 commits into from
Jan 7, 2020
Merged

Elasticsearch Metrics #488

merged 2 commits into from
Jan 7, 2020

Conversation

steven-sheehy
Copy link
Member

@steven-sheehy steven-sheehy commented Jan 7, 2020

Detailed description:

  • Adds Micrometer to provide out of the box metrics for most cross cutting concerns:
    • Project reactor
    • Hibernate/JPA
    • Hikari connection pool
    • GRPC requests
    • R2DBC connection pool
    • CPU usage
    • File descriptors
    • JVM (memory)
    • Log4j2
    • Postgres server
  • Add table count metrics
  • Adds custom metrics hedera.mirror.transaction.size, hedera.mirror.transaction.latency and hedera.mirror.parse.duration

Which issue(s) this PR fixes:
Partially addresses #81

Special notes for your reviewer:
Still need to implement more metrics to close out the ticket, but this is a good first pass for this release.

Checklist

  • Documentation added
  • Tests updated

Signed-off-by: Steven Sheehy <steven.sheehy@hedera.com>
Signed-off-by: Steven Sheehy <steven.sheehy@hedera.com>
@steven-sheehy steven-sheehy added enhancement Type: New feature P2 process Build or test related tasks labels Jan 7, 2020
@steven-sheehy steven-sheehy added this to the Mirror 0.5.1 milestone Jan 7, 2020
@steven-sheehy steven-sheehy requested a review from Nana-EC January 7, 2020 21:24
@steven-sheehy steven-sheehy self-assigned this Jan 7, 2020
@steven-sheehy
Copy link
Member Author

Example metrics that the GRPC process produces in Prometheus export format:

executor_active_threads{name="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)-0",reactor_scheduler_id="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)",} 1.0
executor_active_threads{name="parallel(12,\"parallel\")-0",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_active_threads{name="parallel(12,\"parallel\")-1",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_active_threads{name="parallel(12,\"parallel\")-10",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_active_threads{name="parallel(12,\"parallel\")-11",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_active_threads{name="parallel(12,\"parallel\")-2",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_active_threads{name="parallel(12,\"parallel\")-3",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_active_threads{name="parallel(12,\"parallel\")-4",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_active_threads{name="parallel(12,\"parallel\")-5",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_active_threads{name="parallel(12,\"parallel\")-6",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_active_threads{name="parallel(12,\"parallel\")-7",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_active_threads{name="parallel(12,\"parallel\")-8",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_active_threads{name="parallel(12,\"parallel\")-9",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_completed_tasks_total{name="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)-0",reactor_scheduler_id="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)",} 0.0
executor_completed_tasks_total{name="parallel(12,\"parallel\")-0",reactor_scheduler_id="parallel(12,\"parallel\")",} 2.0
executor_completed_tasks_total{name="parallel(12,\"parallel\")-1",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_completed_tasks_total{name="parallel(12,\"parallel\")-10",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_completed_tasks_total{name="parallel(12,\"parallel\")-11",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_completed_tasks_total{name="parallel(12,\"parallel\")-2",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_completed_tasks_total{name="parallel(12,\"parallel\")-3",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_completed_tasks_total{name="parallel(12,\"parallel\")-4",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_completed_tasks_total{name="parallel(12,\"parallel\")-5",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_completed_tasks_total{name="parallel(12,\"parallel\")-6",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_completed_tasks_total{name="parallel(12,\"parallel\")-7",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_completed_tasks_total{name="parallel(12,\"parallel\")-8",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_completed_tasks_total{name="parallel(12,\"parallel\")-9",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_count{name="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)-0",reactor_scheduler_id="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)",} 1.0
executor_idle_seconds_count{name="parallel(12,\"parallel\")-0",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_count{name="parallel(12,\"parallel\")-1",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_count{name="parallel(12,\"parallel\")-10",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_count{name="parallel(12,\"parallel\")-11",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_count{name="parallel(12,\"parallel\")-2",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_count{name="parallel(12,\"parallel\")-3",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_count{name="parallel(12,\"parallel\")-4",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_count{name="parallel(12,\"parallel\")-5",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_count{name="parallel(12,\"parallel\")-6",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_count{name="parallel(12,\"parallel\")-7",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_count{name="parallel(12,\"parallel\")-8",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_count{name="parallel(12,\"parallel\")-9",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_max{name="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)-0",reactor_scheduler_id="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)",} 2.27187E-4
executor_idle_seconds_max{name="parallel(12,\"parallel\")-0",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_max{name="parallel(12,\"parallel\")-1",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_max{name="parallel(12,\"parallel\")-10",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_max{name="parallel(12,\"parallel\")-11",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_max{name="parallel(12,\"parallel\")-2",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_max{name="parallel(12,\"parallel\")-3",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_max{name="parallel(12,\"parallel\")-4",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_max{name="parallel(12,\"parallel\")-5",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_max{name="parallel(12,\"parallel\")-6",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_max{name="parallel(12,\"parallel\")-7",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_max{name="parallel(12,\"parallel\")-8",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_max{name="parallel(12,\"parallel\")-9",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_sum{name="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)-0",reactor_scheduler_id="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)",} 2.27187E-4
executor_idle_seconds_sum{name="parallel(12,\"parallel\")-0",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_sum{name="parallel(12,\"parallel\")-1",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_sum{name="parallel(12,\"parallel\")-10",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_sum{name="parallel(12,\"parallel\")-11",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_sum{name="parallel(12,\"parallel\")-2",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_sum{name="parallel(12,\"parallel\")-3",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_sum{name="parallel(12,\"parallel\")-4",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_sum{name="parallel(12,\"parallel\")-5",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_sum{name="parallel(12,\"parallel\")-6",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_sum{name="parallel(12,\"parallel\")-7",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_sum{name="parallel(12,\"parallel\")-8",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_idle_seconds_sum{name="parallel(12,\"parallel\")-9",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_pool_size_threads{name="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)-0",reactor_scheduler_id="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)",} 1.0
executor_pool_size_threads{name="parallel(12,\"parallel\")-0",reactor_scheduler_id="parallel(12,\"parallel\")",} 1.0
executor_pool_size_threads{name="parallel(12,\"parallel\")-1",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_pool_size_threads{name="parallel(12,\"parallel\")-10",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_pool_size_threads{name="parallel(12,\"parallel\")-11",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_pool_size_threads{name="parallel(12,\"parallel\")-2",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_pool_size_threads{name="parallel(12,\"parallel\")-3",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_pool_size_threads{name="parallel(12,\"parallel\")-4",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_pool_size_threads{name="parallel(12,\"parallel\")-5",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_pool_size_threads{name="parallel(12,\"parallel\")-6",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_pool_size_threads{name="parallel(12,\"parallel\")-7",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_pool_size_threads{name="parallel(12,\"parallel\")-8",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_pool_size_threads{name="parallel(12,\"parallel\")-9",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_queue_remaining_tasks{name="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)-0",reactor_scheduler_id="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)",} 2.147483647E9
executor_queue_remaining_tasks{name="parallel(12,\"parallel\")-0",reactor_scheduler_id="parallel(12,\"parallel\")",} 2.147483647E9
executor_queue_remaining_tasks{name="parallel(12,\"parallel\")-1",reactor_scheduler_id="parallel(12,\"parallel\")",} 2.147483647E9
executor_queue_remaining_tasks{name="parallel(12,\"parallel\")-10",reactor_scheduler_id="parallel(12,\"parallel\")",} 2.147483647E9
executor_queue_remaining_tasks{name="parallel(12,\"parallel\")-11",reactor_scheduler_id="parallel(12,\"parallel\")",} 2.147483647E9
executor_queue_remaining_tasks{name="parallel(12,\"parallel\")-2",reactor_scheduler_id="parallel(12,\"parallel\")",} 2.147483647E9
executor_queue_remaining_tasks{name="parallel(12,\"parallel\")-3",reactor_scheduler_id="parallel(12,\"parallel\")",} 2.147483647E9
executor_queue_remaining_tasks{name="parallel(12,\"parallel\")-4",reactor_scheduler_id="parallel(12,\"parallel\")",} 2.147483647E9
executor_queue_remaining_tasks{name="parallel(12,\"parallel\")-5",reactor_scheduler_id="parallel(12,\"parallel\")",} 2.147483647E9
executor_queue_remaining_tasks{name="parallel(12,\"parallel\")-6",reactor_scheduler_id="parallel(12,\"parallel\")",} 2.147483647E9
executor_queue_remaining_tasks{name="parallel(12,\"parallel\")-7",reactor_scheduler_id="parallel(12,\"parallel\")",} 2.147483647E9
executor_queue_remaining_tasks{name="parallel(12,\"parallel\")-8",reactor_scheduler_id="parallel(12,\"parallel\")",} 2.147483647E9
executor_queue_remaining_tasks{name="parallel(12,\"parallel\")-9",reactor_scheduler_id="parallel(12,\"parallel\")",} 2.147483647E9
executor_queued_tasks{name="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)-0",reactor_scheduler_id="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)",} 0.0
executor_queued_tasks{name="parallel(12,\"parallel\")-0",reactor_scheduler_id="parallel(12,\"parallel\")",} 1.0
executor_queued_tasks{name="parallel(12,\"parallel\")-1",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_queued_tasks{name="parallel(12,\"parallel\")-10",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_queued_tasks{name="parallel(12,\"parallel\")-11",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_queued_tasks{name="parallel(12,\"parallel\")-2",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_queued_tasks{name="parallel(12,\"parallel\")-3",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_queued_tasks{name="parallel(12,\"parallel\")-4",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_queued_tasks{name="parallel(12,\"parallel\")-5",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_queued_tasks{name="parallel(12,\"parallel\")-6",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_queued_tasks{name="parallel(12,\"parallel\")-7",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_queued_tasks{name="parallel(12,\"parallel\")-8",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_queued_tasks{name="parallel(12,\"parallel\")-9",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_once_total{name="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)-0",reactor_scheduler_id="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)",} 0.0
executor_scheduled_once_total{name="parallel(12,\"parallel\")-0",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_once_total{name="parallel(12,\"parallel\")-1",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_once_total{name="parallel(12,\"parallel\")-10",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_once_total{name="parallel(12,\"parallel\")-11",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_once_total{name="parallel(12,\"parallel\")-2",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_once_total{name="parallel(12,\"parallel\")-3",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_once_total{name="parallel(12,\"parallel\")-4",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_once_total{name="parallel(12,\"parallel\")-5",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_once_total{name="parallel(12,\"parallel\")-6",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_once_total{name="parallel(12,\"parallel\")-7",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_once_total{name="parallel(12,\"parallel\")-8",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_once_total{name="parallel(12,\"parallel\")-9",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_repetitively_total{name="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)-0",reactor_scheduler_id="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)",} 0.0
executor_scheduled_repetitively_total{name="parallel(12,\"parallel\")-0",reactor_scheduler_id="parallel(12,\"parallel\")",} 1.0
executor_scheduled_repetitively_total{name="parallel(12,\"parallel\")-1",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_repetitively_total{name="parallel(12,\"parallel\")-10",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_repetitively_total{name="parallel(12,\"parallel\")-11",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_repetitively_total{name="parallel(12,\"parallel\")-2",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_repetitively_total{name="parallel(12,\"parallel\")-3",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_repetitively_total{name="parallel(12,\"parallel\")-4",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_repetitively_total{name="parallel(12,\"parallel\")-5",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_repetitively_total{name="parallel(12,\"parallel\")-6",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_repetitively_total{name="parallel(12,\"parallel\")-7",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_repetitively_total{name="parallel(12,\"parallel\")-8",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_scheduled_repetitively_total{name="parallel(12,\"parallel\")-9",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_count{name="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)-0",reactor_scheduler_id="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)",} 0.0
executor_seconds_count{name="parallel(12,\"parallel\")-0",reactor_scheduler_id="parallel(12,\"parallel\")",} 2.0
executor_seconds_count{name="parallel(12,\"parallel\")-1",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_count{name="parallel(12,\"parallel\")-10",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_count{name="parallel(12,\"parallel\")-11",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_count{name="parallel(12,\"parallel\")-2",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_count{name="parallel(12,\"parallel\")-3",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_count{name="parallel(12,\"parallel\")-4",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_count{name="parallel(12,\"parallel\")-5",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_count{name="parallel(12,\"parallel\")-6",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_count{name="parallel(12,\"parallel\")-7",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_count{name="parallel(12,\"parallel\")-8",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_count{name="parallel(12,\"parallel\")-9",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_max{name="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)-0",reactor_scheduler_id="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)",} 0.0
executor_seconds_max{name="parallel(12,\"parallel\")-0",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.01674834
executor_seconds_max{name="parallel(12,\"parallel\")-1",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_max{name="parallel(12,\"parallel\")-10",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_max{name="parallel(12,\"parallel\")-11",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_max{name="parallel(12,\"parallel\")-2",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_max{name="parallel(12,\"parallel\")-3",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_max{name="parallel(12,\"parallel\")-4",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_max{name="parallel(12,\"parallel\")-5",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_max{name="parallel(12,\"parallel\")-6",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_max{name="parallel(12,\"parallel\")-7",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_max{name="parallel(12,\"parallel\")-8",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_max{name="parallel(12,\"parallel\")-9",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_sum{name="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)-0",reactor_scheduler_id="boundedElastic(\"boundedElastic\",maxThreads=120,maxTaskQueued=100000,ttl=60s)",} 0.0
executor_seconds_sum{name="parallel(12,\"parallel\")-0",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.019929798
executor_seconds_sum{name="parallel(12,\"parallel\")-1",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_sum{name="parallel(12,\"parallel\")-10",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_sum{name="parallel(12,\"parallel\")-11",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_sum{name="parallel(12,\"parallel\")-2",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_sum{name="parallel(12,\"parallel\")-3",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_sum{name="parallel(12,\"parallel\")-4",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_sum{name="parallel(12,\"parallel\")-5",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_sum{name="parallel(12,\"parallel\")-6",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_sum{name="parallel(12,\"parallel\")-7",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_sum{name="parallel(12,\"parallel\")-8",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
executor_seconds_sum{name="parallel(12,\"parallel\")-9",reactor_scheduler_id="parallel(12,\"parallel\")",} 0.0
grpc_server_processing_duration_seconds_count{method="subscribeTopic",methodType="SERVER_STREAMING",service="com.hedera.mirror.api.proto.ConsensusService",statusCode="OK",} 0.0
grpc_server_processing_duration_seconds_max{method="subscribeTopic",methodType="SERVER_STREAMING",service="com.hedera.mirror.api.proto.ConsensusService",statusCode="OK",} 0.0
grpc_server_processing_duration_seconds_sum{method="subscribeTopic",methodType="SERVER_STREAMING",service="com.hedera.mirror.api.proto.ConsensusService",statusCode="OK",} 0.0
grpc_server_requests_received_messages_total{method="subscribeTopic",methodType="SERVER_STREAMING",service="com.hedera.mirror.api.proto.ConsensusService",} 1.0
grpc_server_responses_sent_messages_total{method="subscribeTopic",methodType="SERVER_STREAMING",service="com.hedera.mirror.api.proto.ConsensusService",} 0.0
jvm_buffer_count_buffers{id="direct",} 20.0
jvm_buffer_count_buffers{id="mapped",} 0.0
jvm_buffer_memory_used_bytes{id="direct",} 2.34881312E8
jvm_buffer_memory_used_bytes{id="mapped",} 0.0
jvm_buffer_total_capacity_bytes{id="direct",} 2.3488131E8
jvm_buffer_total_capacity_bytes{id="mapped",} 0.0
jvm_classes_loaded_classes 11451.0
jvm_classes_unloaded_classes_total 0.0
jvm_gc_live_data_size_bytes 0.0
jvm_gc_max_data_size_bytes 0.0
jvm_gc_memory_allocated_bytes_total 1.49946368E8
jvm_gc_memory_promoted_bytes_total 1252208.0
jvm_gc_pause_seconds_count{action="end of minor GC",cause="G1 Evacuation Pause",} 1.0
jvm_gc_pause_seconds_max{action="end of minor GC",cause="G1 Evacuation Pause",} 0.011
jvm_gc_pause_seconds_sum{action="end of minor GC",cause="G1 Evacuation Pause",} 0.011
jvm_memory_committed_bytes{area="heap",id="G1 Eden Space",} 1.50994944E8
jvm_memory_committed_bytes{area="heap",id="G1 Old Gen",} 9.961472E7
jvm_memory_committed_bytes{area="heap",id="G1 Survivor Space",} 1.7825792E7
jvm_memory_committed_bytes{area="nonheap",id="CodeHeap 'non-nmethods'",} 3538944.0
jvm_memory_committed_bytes{area="nonheap",id="CodeHeap 'non-profiled nmethods'",} 9043968.0
jvm_memory_committed_bytes{area="nonheap",id="Compressed Class Space",} 8912896.0
jvm_memory_committed_bytes{area="nonheap",id="Metaspace",} 6.1161472E7
jvm_memory_max_bytes{area="heap",id="G1 Eden Space",} -1.0
jvm_memory_max_bytes{area="heap",id="G1 Old Gen",} 4.294967296E9
jvm_memory_max_bytes{area="heap",id="G1 Survivor Space",} -1.0
jvm_memory_max_bytes{area="nonheap",id="CodeHeap 'non-nmethods'",} 7553024.0
jvm_memory_max_bytes{area="nonheap",id="CodeHeap 'non-profiled nmethods'",} 2.44105216E8
jvm_memory_max_bytes{area="nonheap",id="Compressed Class Space",} 1.073741824E9
jvm_memory_max_bytes{area="nonheap",id="Metaspace",} -1.0
jvm_memory_used_bytes{area="heap",id="G1 Eden Space",} 3.7748736E7
jvm_memory_used_bytes{area="heap",id="G1 Old Gen",} 4558672.0
jvm_memory_used_bytes{area="heap",id="G1 Survivor Space",} 1.7825792E7
jvm_memory_used_bytes{area="nonheap",id="CodeHeap 'non-nmethods'",} 1824128.0
jvm_memory_used_bytes{area="nonheap",id="CodeHeap 'non-profiled nmethods'",} 8978304.0
jvm_memory_used_bytes{area="nonheap",id="Compressed Class Space",} 7886312.0
jvm_memory_used_bytes{area="nonheap",id="Metaspace",} 5.8484112E7
jvm_threads_daemon_threads 24.0
jvm_threads_live_threads 27.0
jvm_threads_peak_threads 27.0
jvm_threads_states_threads{state="blocked",} 0.0
jvm_threads_states_threads{state="new",} 0.0
jvm_threads_states_threads{state="runnable",} 20.0
jvm_threads_states_threads{state="terminated",} 0.0
jvm_threads_states_threads{state="timed-waiting",} 4.0
jvm_threads_states_threads{state="waiting",} 3.0
log4j2_events_total{level="debug",} 0.0
log4j2_events_total{level="error",} 0.0
log4j2_events_total{level="fatal",} 0.0
log4j2_events_total{level="info",} 4.0
log4j2_events_total{level="trace",} 0.0
log4j2_events_total{level="warn",} 0.0
process_cpu_usage 0.0
process_files_max_files 10240.0
process_files_open_files 286.0
process_start_time_seconds 1.578412529791E9
process_uptime_seconds 17.016
r2dbc_pool_acquired_connections{name="connectionFactory",} 0.0
r2dbc_pool_allocated_connections{name="connectionFactory",} 10.0
r2dbc_pool_idle_connections{name="connectionFactory",} 10.0
r2dbc_pool_max_allocated_connections{name="connectionFactory",} 10.0
r2dbc_pool_max_pending_connections{name="connectionFactory",} 2.147483647E9
r2dbc_pool_pending_connections{name="connectionFactory",} 0.0
reactor_flow_duration_seconds_count{exception="",flow="findByFilter",status="completed",type="Flux",} 3.0
reactor_flow_duration_seconds_max{exception="",flow="findByFilter",status="completed",type="Flux",} 0.195269865
reactor_flow_duration_seconds_sum{exception="",flow="findByFilter",status="completed",type="Flux",} 0.222540395
reactor_onNext_delay_seconds_count{flow="findByFilter",type="Flux",} 0.0
reactor_onNext_delay_seconds_count{flow="poll",type="Flux",} 0.0
reactor_onNext_delay_seconds_max{flow="findByFilter",type="Flux",} 0.0
reactor_onNext_delay_seconds_max{flow="poll",type="Flux",} 0.0
reactor_onNext_delay_seconds_sum{flow="findByFilter",type="Flux",} 0.0
reactor_onNext_delay_seconds_sum{flow="poll",type="Flux",} 0.0
reactor_requested_requested_amount_count{flow="findByFilter",type="Flux",} 3.0
reactor_requested_requested_amount_count{flow="poll",type="Flux",} 1.0
reactor_requested_requested_amount_max{flow="findByFilter",type="Flux",} 256.0
reactor_requested_requested_amount_max{flow="poll",type="Flux",} 256.0
reactor_requested_requested_amount_sum{flow="findByFilter",type="Flux",} 513.0
reactor_requested_requested_amount_sum{flow="poll",type="Flux",} 256.0
reactor_subscribed_subscribers_total{flow="findByFilter",type="Flux",} 3.0
reactor_subscribed_subscribers_total{flow="poll",type="Flux",} 1.0
system_cpu_count 12.0
system_cpu_usage 0.0
system_load_average_1m 1.6591796875

@steven-sheehy
Copy link
Member Author

Importer metrics:

db_table_size_rows{db="mirror_node",table="account_balance_sets",} 220.0
db_table_size_rows{db="mirror_node",table="account_balances",} 3411782.0
db_table_size_rows{db="mirror_node",table="entity_types",} 3.0
db_table_size_rows{db="mirror_node",table="flyway_schema_history",} 31.0
db_table_size_rows{db="mirror_node",table="t_application_status",} 9.0
db_table_size_rows{db="mirror_node",table="t_contract_result",} 0.0
db_table_size_rows{db="mirror_node",table="t_cryptotransferlists",} 139115.0
db_table_size_rows{db="mirror_node",table="t_entities",} 107.0
db_table_size_rows{db="mirror_node",table="t_entity_types",} 4.0
db_table_size_rows{db="mirror_node",table="t_events",} 0.0
db_table_size_rows{db="mirror_node",table="t_file_data",} 0.0
db_table_size_rows{db="mirror_node",table="t_livehashes",} 0.0
db_table_size_rows{db="mirror_node",table="t_record_files",} 2057.0
db_table_size_rows{db="mirror_node",table="t_transaction_results",} 118.0
db_table_size_rows{db="mirror_node",table="t_transaction_types",} 21.0
db_table_size_rows{db="mirror_node",table="t_transactions",} 19873.0
db_table_size_rows{db="mirror_node",table="topic_message",} 0.0
hedera_mirror_parse_duration_seconds_count{success="true",type="record",version="2",} 8.0
hedera_mirror_parse_duration_seconds_max{success="true",type="record",version="2",} 0.20964229
hedera_mirror_parse_duration_seconds_sum{success="true",type="record",version="2",} 0.414720804
hedera_mirror_transaction_latency_seconds_count{type="CRYPTOTRANSFER",} 96.0
hedera_mirror_transaction_latency_seconds_max{type="CRYPTOTRANSFER",} 9995961.733467
hedera_mirror_transaction_latency_seconds_sum{type="CRYPTOTRANSFER",} 9.596106829099009E8
hedera_mirror_transaction_size_bytes_count{type="CRYPTOTRANSFER",} 96.0
hedera_mirror_transaction_size_bytes_max{type="CRYPTOTRANSFER",} 196.0
hedera_mirror_transaction_size_bytes_sum{type="CRYPTOTRANSFER",} 18751.0
hibernate_cache_natural_id_puts_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_cache_natural_id_requests_total{entityManagerFactory="entityManagerFactory",result="hit",} 0.0
hibernate_cache_natural_id_requests_total{entityManagerFactory="entityManagerFactory",result="miss",} 0.0
hibernate_cache_query_puts_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_cache_query_requests_total{entityManagerFactory="entityManagerFactory",result="hit",} 0.0
hibernate_cache_query_requests_total{entityManagerFactory="entityManagerFactory",result="miss",} 0.0
hibernate_cache_update_timestamps_puts_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_cache_update_timestamps_requests_total{entityManagerFactory="entityManagerFactory",result="hit",} 0.0
hibernate_cache_update_timestamps_requests_total{entityManagerFactory="entityManagerFactory",result="miss",} 0.0
hibernate_collections_deletes_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_collections_fetches_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_collections_loads_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_collections_recreates_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_collections_updates_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_connections_obtained_total{entityManagerFactory="entityManagerFactory",} 50.0
hibernate_entities_deletes_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_entities_fetches_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_entities_inserts_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_entities_loads_total{entityManagerFactory="entityManagerFactory",} 26.0
hibernate_entities_updates_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_flushes_total{entityManagerFactory="entityManagerFactory",} 13.0
hibernate_optimistic_failures_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_query_executions_max_seconds{entityManagerFactory="entityManagerFactory",} 0.017
hibernate_query_executions_total{entityManagerFactory="entityManagerFactory",} 13.0
hibernate_query_natural_id_executions_max_seconds{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_query_natural_id_executions_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_second_level_cache_puts_total{entityManagerFactory="entityManagerFactory",} 0.0
hibernate_second_level_cache_requests_total{entityManagerFactory="entityManagerFactory",result="hit",} 0.0
hibernate_second_level_cache_requests_total{entityManagerFactory="entityManagerFactory",result="miss",} 0.0
hibernate_sessions_closed_total{entityManagerFactory="entityManagerFactory",} 96.0
hibernate_sessions_open_total{entityManagerFactory="entityManagerFactory",} 99.0
hibernate_statements_total{entityManagerFactory="entityManagerFactory",status="closed",} 0.0
hibernate_statements_total{entityManagerFactory="entityManagerFactory",status="prepared",} 38.0
hibernate_transactions_total{entityManagerFactory="entityManagerFactory",result="failure",} 0.0
hibernate_transactions_total{entityManagerFactory="entityManagerFactory",result="success",} 36.0
hikaricp_connections_acquire_seconds_count{pool="mirror_node",} 98.0
hikaricp_connections_acquire_seconds_max{pool="mirror_node",} 0.002
hikaricp_connections_acquire_seconds_sum{pool="mirror_node",} 0.017
hikaricp_connections_active{pool="mirror_node",} 1.0
hikaricp_connections_creation_seconds_count{pool="mirror_node",} 0.0
hikaricp_connections_creation_seconds_max{pool="mirror_node",} 0.0
hikaricp_connections_creation_seconds_sum{pool="mirror_node",} 0.0
hikaricp_connections_idle{pool="mirror_node",} 9.0
hikaricp_connections_max{pool="mirror_node",} 10.0
hikaricp_connections_min{pool="mirror_node",} 10.0
hikaricp_connections_pending{pool="mirror_node",} 0.0
hikaricp_connections_timeout_total{pool="mirror_node",} 0.0
hikaricp_connections_usage_seconds_count{pool="mirror_node",} 60.0
hikaricp_connections_usage_seconds_max{pool="mirror_node",} 2.146
hikaricp_connections_usage_seconds_sum{pool="mirror_node",} 4.193
hikaricp_connections{pool="mirror_node",} 10.0
jdbc_connections_active{name="dataSource",} 2.0
jdbc_connections_idle{name="dataSource",} 8.0
jdbc_connections_max{name="dataSource",} 10.0
jdbc_connections_min{name="dataSource",} 10.0
jvm_buffer_count_buffers{id="direct",} 46.0
jvm_buffer_count_buffers{id="mapped",} 0.0
jvm_buffer_memory_used_bytes{id="direct",} 4.02693292E8
jvm_buffer_memory_used_bytes{id="mapped",} 0.0
jvm_buffer_total_capacity_bytes{id="direct",} 4.03029733E8
jvm_buffer_total_capacity_bytes{id="mapped",} 0.0
jvm_classes_loaded_classes 15467.0
jvm_classes_unloaded_classes_total 1157.0
jvm_gc_live_data_size_bytes 0.0
jvm_gc_max_data_size_bytes 0.0
jvm_gc_memory_allocated_bytes_total 5.17996544E8
jvm_gc_memory_promoted_bytes_total 6.0264584E7
jvm_gc_pause_seconds_count{action="end of minor GC",cause="G1 Evacuation Pause",} 15.0
jvm_gc_pause_seconds_count{action="end of minor GC",cause="G1 Humongous Allocation",} 2.0
jvm_gc_pause_seconds_max{action="end of minor GC",cause="G1 Evacuation Pause",} 0.013
jvm_gc_pause_seconds_max{action="end of minor GC",cause="G1 Humongous Allocation",} 0.011
jvm_gc_pause_seconds_sum{action="end of minor GC",cause="G1 Evacuation Pause",} 0.062
jvm_gc_pause_seconds_sum{action="end of minor GC",cause="G1 Humongous Allocation",} 0.019
jvm_memory_committed_bytes{area="heap",id="G1 Eden Space",} 5.0331648E7
jvm_memory_committed_bytes{area="heap",id="G1 Old Gen",} 5.65182464E8
jvm_memory_committed_bytes{area="heap",id="G1 Survivor Space",} 3145728.0
jvm_memory_committed_bytes{area="nonheap",id="CodeHeap 'non-nmethods'",} 3407872.0
jvm_memory_committed_bytes{area="nonheap",id="CodeHeap 'non-profiled nmethods'",} 1.8874368E7
jvm_memory_committed_bytes{area="nonheap",id="Compressed Class Space",} 1.302528E7
jvm_memory_committed_bytes{area="nonheap",id="Metaspace",} 8.9165824E7
jvm_memory_max_bytes{area="heap",id="G1 Eden Space",} -1.0
jvm_memory_max_bytes{area="heap",id="G1 Old Gen",} 4.294967296E9
jvm_memory_max_bytes{area="heap",id="G1 Survivor Space",} -1.0
jvm_memory_max_bytes{area="nonheap",id="CodeHeap 'non-nmethods'",} 7553024.0
jvm_memory_max_bytes{area="nonheap",id="CodeHeap 'non-profiled nmethods'",} 2.44105216E8
jvm_memory_max_bytes{area="nonheap",id="Compressed Class Space",} 1.073741824E9
jvm_memory_max_bytes{area="nonheap",id="Metaspace",} -1.0
jvm_memory_used_bytes{area="heap",id="G1 Eden Space",} 3.8797312E7
jvm_memory_used_bytes{area="heap",id="G1 Old Gen",} 4.85972384E8
jvm_memory_used_bytes{area="heap",id="G1 Survivor Space",} 3145728.0
jvm_memory_used_bytes{area="nonheap",id="CodeHeap 'non-nmethods'",} 3057536.0
jvm_memory_used_bytes{area="nonheap",id="CodeHeap 'non-profiled nmethods'",} 1.8619648E7
jvm_memory_used_bytes{area="nonheap",id="Compressed Class Space",} 1.0892848E7
jvm_memory_used_bytes{area="nonheap",id="Metaspace",} 8.3486016E7
jvm_threads_daemon_threads 68.0
jvm_threads_live_threads 97.0
jvm_threads_peak_threads 97.0
jvm_threads_states_threads{state="blocked",} 0.0
jvm_threads_states_threads{state="new",} 0.0
jvm_threads_states_threads{state="runnable",} 31.0
jvm_threads_states_threads{state="terminated",} 0.0
jvm_threads_states_threads{state="timed-waiting",} 34.0
jvm_threads_states_threads{state="waiting",} 32.0
log4j2_events_total{level="debug",} 0.0
log4j2_events_total{level="error",} 0.0
log4j2_events_total{level="fatal",} 0.0
log4j2_events_total{level="info",} 56.0
log4j2_events_total{level="trace",} 0.0
log4j2_events_total{level="warn",} 0.0
postgres_blocks_hits_total{database="mirror_node",} 4.0046746E7
postgres_blocks_reads_total{database="mirror_node",} 164715.0
postgres_buffers_backend_total{database="mirror_node",} 118554.0
postgres_buffers_checkpoint_total{database="mirror_node",} 37022.0
postgres_buffers_clean_total{database="mirror_node",} 54815.0
postgres_checkpoints_requested_total{database="mirror_node",} 4.0
postgres_checkpoints_timed_total{database="mirror_node",} 43.0
postgres_connections{database="mirror_node",} 10.0
postgres_locks{database="mirror_node",} 11.0
postgres_rows_dead{database="mirror_node",} 0.0
postgres_rows_deleted_total{database="mirror_node",} 546.0
postgres_rows_fetched_total{database="mirror_node",} 227445.0
postgres_rows_inserted_total{database="mirror_node",} 3573602.0
postgres_rows_updated_total{database="mirror_node",} 9637.0
postgres_size{database="mirror_node",} 5.58955655E8
postgres_temp_writes_bytes_total{database="mirror_node",} 0.0
postgres_transactions_total{database="mirror_node",} 31171.0
process_cpu_usage 0.0
process_files_max_files 10240.0
process_files_open_files 765.0
process_start_time_seconds 1.578419101593E9
process_uptime_seconds 19.48
system_cpu_count 12.0
system_cpu_usage 0.0
system_load_average_1m 2.1953125

@steven-sheehy steven-sheehy merged commit 84eb218 into master Jan 7, 2020
@steven-sheehy steven-sheehy deleted the metrics branch January 7, 2020 22:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Type: New feature P2 process Build or test related tasks
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants