tracker issue : CF-4198343

select a category, or use search below
(searches all categories and all time range)
Title:

Analytics dashboard(kibana) throws Internal Server Server under high load.

| View in Tracker

Status/Resolution/Reason: Closed/Fixed/Fixed

Reporter/Name(from Bugbase): / ()

Created: 02/17/2017

Components: API Manager, Monitoring and Analytics

Versions: 2016

Failure Type: Crash

Found In Build/Fixed In Build: 301768 / 302889

Priority/Frequency: Critical / Some users will encounter

Locale/System: /

Vote Count: 0

Problem: Analytics dashboard(kibana) throws Internal Server Server under high load.

NOTE: It happens on CentOS where ulimit size is very limited.

Method:

1. Generate load on API Manager(Any Rest API call should be fine).
2. Open 3-4 instances of Publisher Analytics dashboard.
3. Set refresh interval to 5 seconds and Time interval to last 15 minutes.
3. Click on dashboard links randomly to put even more load on the analytics module.

Result:

Error: Unknown error while connecting to Elasticsearch
Error: Internal Server Error
    at respond (http://cfapi-d02/analytics/publisher/index.js?_b=6004:85795:10)
    at checkRespForFailure (http://cfapi-d02/analytics/publisher/index.js?_b=6004:85750:7)
    at http://cfapi-d02/analytics/publisher/index.js?_b=6004:84400:7
    at processQueue (http://cfapi-d02/analytics/publisher/index.js?_b=6004:22395:27)
    at http://cfapi-d02/analytics/publisher/index.js?_b=6004:22411:27
    at Scope.$eval (http://cfapi-d02/analytics/publisher/index.js?_b=6004:23607:28)
    at Scope.$digest (http://cfapi-d02/analytics/publisher/index.js?_b=6004:23423:31)
    at Scope.$apply (http://cfapi-d02/analytics/publisher/index.js?_b=6004:23712:24)
    at done (http://cfapi-d02/analytics/publisher/index.js?_b=6004:18865:47)
    at completeRequest (http://cfapi-d02/analytics/publisher/index.js?_b=6004:19055:7)


Expected: It should not throw Internal Server Error. It should work without any issue.

Workaround:

Note:

Attachments:

Comments: