5.8.3-rc.6

kernel 4+ won't error out on status now (#2640)

* checks for docker_dd_agent

* better conditional

5.8.3-rc.5

[status page] Remove proxy info from it (#2634)

Reading the proxy settings is a bit costly as it reparse the whole
config file and we do it every time we persist the forwarder status.

This information is not that valuable as it will be collected by a
flare anyway. Let’s just remove it

5.8.3-rc.4

fixes tests

5.8.3-rc.3

[service discovery] Improve logging, test coverage and template varia…

5.8.3-rc.2: Revert "Seek DATADOG_ID in kubernetes annotations"

This reverts commit fa30d9f314492dbc1bb7962844aa010543d4b08d.

5.8.3-rc.1

version bump to 5.8.3

5.8.2

5.8.2 / 05-24-2016

Windows only

Details

5.8.1...5.8.2

Changes

• [BUGFIX] Windows: Revert a change introduced in the 5.8.0 release, causing hostnames to change on EC2 hosts when no hostname is defined in datadog.conf, leading to potential backwards compatibility issues. See #2451, #2535

5.8.1

5.8.1 / 05-23-2016

Windows only

Details

5.8.0...5.8.1

Changes

• [BUGFIX] Windows: Fix an issue that was preventing checks from loading properly. See #2528

5.8.0

5.8.0 / 05-23-2016

All platforms

Details

5.7.4...5.8.0

New integrations

• Kong
• PowerDNS Recursor
• Spark

Updated integrations

• ActiveMQ
• Cassandra
• Directory
• Disk
• Docker
• Elasticsearch
• Ganglia
• Graphite
• HAProxy
• HTTP Check
• JMX
• Kubernetes
• MapReduce
• Marathon
• Memcached
• Mesos Master
• MongoDB
• MySQL
• Process
• RabbitMQ
• Riak
• TeamCity
• TokuMX
• Varnish
• vSphere
• Windows
• Windows Service
• WMI
• YARN

Service Discovery

Starting with the 5.8 release, the Datadog Agent ships with service discovery. This feature works for Docker containers and can run on platforms such as Kubernetes, Docker Swarm, and Amazon ECS.

Service discovery makes it possible to define configuration templates for a given Docker image in a configuration store, and to dynamically apply them to new containers on the fly. The Agent will then use these configuration templates combined with container metadata to enable, disable and reconfigure checks dynamically in response to container start/stop events.

For more details on Datadog Agent's Service Discovery, check out the wiki page.

See #2008, #2424, #2426, #2514.

Kong integration

Kong is an open-source management layer for APIs.

The checks collects metrics using /status endpoint part of Kong RESTful API. It retrieves usage information about the node, with some basic information about the connections being processed by the underlying NGINX process, and the number of entities stored in the datastore collections.
It also submits a service check to reflect the agent's ability to connect to the instance.

See #2241.

A big thank you @shashiranjan84 !

Spark integration

The Spark check runs from the Master Node and retrieves metrics from YARN's ResourceManager.
The collected metrics cover statistics about:

• Spark Jobs
• Spark Stages
• Spark Executors
• Spark Resilient Distributed Datasets (RDD)

See #2407.

PowerDNS Recursor integration

The PowerDNS Recursor check retrieves metrics using the /servers/localhost/statistics endpoint part of PowerDNS API when the experimental web server is active.
The collected metrics cover the Recursor statistics: (outgoing) queries, answers, cache and cache entries.
A service check reflects the agent's ability to connect to the instance.

For more details about the metrics collected, check out the PowerDNS documentation about Recursor Statistics.

See #2108, #2490.

A big thank you @AntoCard, @janeczku !

MapReduce & YARN updates

Hadoop MapReduce and YARN integrations have been updated to reduce and consolidate the metrics' tags.
In particular:

• cluster_name tag replaces cluster_id
• app_name tag replaces app_id

MapReduce metrics have received additional improvements and cleanups:

• Metric type rate replaces gauge when applicable
• The following metrics have been removed:
  • mapreduce.job.map.task.progress
  • mapreduce.job.reduce.task.progress

See #2473, #2474, #2487.

Source install: end of Python 2.6 compatibility support

For source installation, the Datadog Agent uses system's Python. Starting with the 5.8.0 release, the Datadog Agent does not enforce compatibility with Python 2.6 anymore and requires Python 2.7. Tests and code sections used to maintain compability have been removed.

Users running a different version of Python on their system are advised to install a packaged version of the Datadog Agent. If you have any questions, please contact our support team support(at)datadoghq(dot)com.

See #2377.

Changes

• [FEATURE] ActiveMQ: Add monitoring for standby hosts. See #2023, #2430 (Thanks @joelvanvelden)
• [FEATURE] Directory: Add Windows support. See #2410, #2508
• [FEATURE] Disk: Add an option to exclude disks based on their mountpoints. See #2359, #2476 (Thanks @rhwlo)
• [FEATURE] Docker: Add optional disk metrics. See #2405
• [FEATURE] Docker: Add the possibility to tag by container ID. See #2353, #2507
• [FEATURE] Elasticsearch: Add support for SSL and Elasticsearch Shield. See #2195 (Thanks @pabrahamsson)
• [FEATURE] Elasticsearch: Collect additional Thread Pool metrics. See #2321
• [FEATURE] HAProxy: Add option to disable SSL validation. See #2393.
• [FEATURE] JMX: Add user tags to service checks. See #96
• [FEATURE] JMX: Allow group name substitutions in attribute/alias parameters. See #94, #97 (Thanks @alz)
• [FEATURE] Kong: New check. See #2241, Kong integration (Thanks @shashiranjan84)
• [FEATURE] Kubernetes: Allow to blacklist labels. See #2512
• [FEATURE] Kubernetes: Tag pods metrics with replica sets. See #2444, #2446, #2512
• [FEATURE] Memcached: Add "items" and "slabs" statistic metrics as reported by the stats command. See #2491
• [FEATURE] PowerDNS Recursor: New check. See #2108, #2490, PowerDNS Recursor integration (Thanks @AntoCard, @janeczku)
• [FEATURE] Process: Add pagefault statistics to process metrics. See #2363, #2477 (Thanks @ovesh)
• [FEATURE] RabbitMQ: Tag queue based metrics with the queue name as queue_family. See #2259, #2468 (Thanks @rhwlo)
• [FEATURE] Riak: Collect Riak Search metrics. See #2243 (Thanks @gzysk8)
• [FEATURE] Service Discovery: Define configuration templates for a given Docker image in a configuration store, and to dynamically apply them to new containers on the fly. See #2008, #2424, #2426, #2514, Service Discovery
• [FEATURE] Spark: New check. See #2407, #2479, Spark integration
• [FEATURE] TeamCity: Support basic HTTP authentication. See #2266 (Thanks @mderomph-coolblue)
• [FEATURE] vSphere: Add the ability to set a custom field from the vSphere PowerCLI to mark the VMs to monitor. See #2459
• [FEATURE] Windows Event Log: Add an optional event_format parameter to instruct the check to generate Datadog's event bodies with the specified list of event properties. See #2441
• [FEATURE] Windows: Add opened handles statistics to system metrics. See #2403
• [FEATURE] Windows: Add swap -pagefile- statistics to system metrics. See #2422
• [IMPROVEMENT] Core: Allow AgentCheckTest facilities to be used on SDK check modules. See #2341
• [IMPROVEMENT] Core: Gracefully handle responses with HTTP status code 413. See #2418
• [IMPROVEMENT] Core: Update the configuration logic to look for checks in a 3rd-party directory. See #2273, #2467
• [IMPROVEMENT] Directory: Speed up the file count in a d...

5.8.0-rc.2

Merge pull request #2516 from DataDog/remh/jmxfetch

[jmxfetch] If statsd is bound to all interfaces, use localhost