Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EDU-576: Datadog integration #2422

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

franrob-projects
Copy link
Contributor

@franrob-projects franrob-projects commented Feb 12, 2025

This PR introduces documentation for the Ably Datadog integration, covering:

  • How the integration works.
  • Installation and configuration steps.
  • The type of data sent to Datadog.
  • Availability details (the feature is exclusive to enterprise-grade committed use customers; others should contact sales for upgrade options).
  • Additionally, this documentation includes details on Datadog-Lite trials.

EDU-576

Copy link

coderabbitai bot commented Feb 12, 2025

Important

Review skipped

Auto reviews are disabled on this repository.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share
🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>, please review it.
    • Generate unit testing code for this file.
    • Open a follow-up GitHub issue for this discussion.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    • @coderabbitai generate unit testing code for this file.
    • @coderabbitai modularize this function.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
    • @coderabbitai read src/utils.ts and generate unit testing code.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.
    • @coderabbitai help me debug CodeRabbit configuration file.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (Invoked using PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai full review to do a full review from scratch and review all the files again.
  • @coderabbitai summary to regenerate the summary of the PR.
  • @coderabbitai generate docstrings to generate docstrings for this PR.
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai configuration to show the current CodeRabbit configuration for the repository.
  • @coderabbitai help to get help.

Other keywords and placeholders

  • Add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.
  • Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
  • Add @coderabbitai anywhere in the PR title to generate the title automatically.

CodeRabbit Configuration File (.coderabbit.yaml)

  • You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
  • Please see the configuration documentation for more information.
  • If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json

Documentation and Community

  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

@ably-ci ably-ci temporarily deployed to ably-docs-edu-576-docs--f4vh5l February 12, 2025 10:34 Inactive
@franrob-projects franrob-projects temporarily deployed to ably-docs-edu-576-docs--f4vh5l February 12, 2025 19:31 Inactive
@franrob-projects franrob-projects force-pushed the EDU-576-Docs-for-datadog-integration branch from 0520c09 to 01c9958 Compare February 12, 2025 19:32
@franrob-projects franrob-projects temporarily deployed to ably-docs-edu-576-docs--f4vh5l February 12, 2025 19:33 Inactive
@franrob-projects franrob-projects marked this pull request as ready for review February 13, 2025 09:18
@franrob-projects franrob-projects temporarily deployed to ably-docs-edu-576-docs--f4vh5l February 13, 2025 15:09 Inactive
@franrob-projects franrob-projects force-pushed the EDU-576-Docs-for-datadog-integration branch from cff2dd9 to 62da7a0 Compare February 13, 2025 15:09
@franrob-projects franrob-projects temporarily deployed to ably-docs-edu-576-docs--f4vh5l February 13, 2025 15:10 Inactive
@franrob-projects franrob-projects temporarily deployed to ably-docs-edu-576-docs--f4vh5l February 13, 2025 15:17 Inactive
@franrob-projects franrob-projects force-pushed the EDU-576-Docs-for-datadog-integration branch from 5bb31d5 to f496832 Compare February 13, 2025 15:18
@franrob-projects franrob-projects temporarily deployed to ably-docs-edu-576-docs--f4vh5l February 13, 2025 15:18 Inactive
@m-hulbert m-hulbert temporarily deployed to ably-docs-edu-576-docs--tmqhm7 February 20, 2025 10:26 Inactive
@m-hulbert m-hulbert temporarily deployed to ably-docs-edu-576-docs--tmqhm7 February 21, 2025 12:05 Inactive
@m-hulbert m-hulbert temporarily deployed to ably-docs-edu-576-docs--idgjl1 March 13, 2025 10:40 Inactive
Copy link
Contributor

@m-hulbert m-hulbert left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The content mostly looks good here. I've made a few suggestions for improved readability and I think we should be more explicit about the metrics.

Also:

  • /docs/ into links now please
  • can we add this into the nav and add appropriate links (overview and pricing pages)

meta_keywords: "Datadog, integrations, metrics, monitoring, analytics, enterprise"
---

The Ably "Datadog":https://docs.datadoghq.com/integrations/ably/ integration allows "enterprise":/pricing/enterprise users to monitor realtime application metrics like "messages":/messages, "channels":/channels, and connections within Datadog. Data streams every 60 seconds make tracking key performance indicators easier in one place. If you require access, contact "support":https://ably.com/support to enable the integration feature via your "dashboard":https://ably.com/accounts/any.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
The Ably "Datadog":https://docs.datadoghq.com/integrations/ably/ integration allows "enterprise":/pricing/enterprise users to monitor realtime application metrics like "messages":/messages, "channels":/channels, and connections within Datadog. Data streams every 60 seconds make tracking key performance indicators easier in one place. If you require access, contact "support":https://ably.com/support to enable the integration feature via your "dashboard":https://ably.com/accounts/any.
The Ably "Datadog":https://docs.datadoghq.com/integrations/ably/ integration enables you to monitor your application's statistics metrics, such as "messages":/docs/messages, "channels":/docs/channels, and "connections":/docs/connect, within Datadog.

Comment on lines 9 to 21
If you're on the Ably "Pro plan":/pricing/pro, you can enable a limited Datadog-lite integration. "Standard plan":/pricing/standard users may request a 30-day trial to evaluate Datadog-lite before upgrading. This version includes a smaller set of metrics but still provides visibility into your Ably usage. If you need detailed analytics, per-channel breakdowns, custom dashboards, or advanced logging, upgrade to the full Datadog integration available on the Enterprise plan.

|_. Feature |_. Datadog-lite |_. Full Datadog (Enterprise) |
| Messages | ✅ | ✅ |
| Connections | ✅ | ✅ |
| Channels | ✅ | ✅ |
| Bandwidth | ✅ | ✅ |
| Message size | ✅ | ✅ |
| Message direction breakdown (Inbound vs. Outbound) | ❌ | ✅ |
| Per-Channel metrics | ❌ | ✅ |
| Usage analytics & trends | ❌ | ✅ |
| Custom dashboards & alerts | ❌ | ✅ |
| Advanced logging & debugging | ❌ | ✅ |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
If you're on the Ably "Pro plan":/pricing/pro, you can enable a limited Datadog-lite integration. "Standard plan":/pricing/standard users may request a 30-day trial to evaluate Datadog-lite before upgrading. This version includes a smaller set of metrics but still provides visibility into your Ably usage. If you need detailed analytics, per-channel breakdowns, custom dashboards, or advanced logging, upgrade to the full Datadog integration available on the Enterprise plan.
|_. Feature |_. Datadog-lite |_. Full Datadog (Enterprise) |
| Messages | ✅ | ✅ |
| Connections | ✅ | ✅ |
| Channels | ✅ | ✅ |
| Bandwidth | ✅ | ✅ |
| Message size | ✅ | ✅ |
| Message direction breakdown (Inbound vs. Outbound) | ❌ | ✅ |
| Per-Channel metrics | ❌ | ✅ |
| Usage analytics & trends | ❌ | ✅ |
| Custom dashboards & alerts | ❌ | ✅ |
| Advanced logging & debugging | ❌ | ✅ |
If you're on the Ably "Pro package":/docs/pricing/pro, you can set up a Datadog-lite integration. This streams a subset of the metrics that available with the full integration to Datadog.
If you're a "Standard package":/docs/pricing/standard user, you can request a 30-day trial to evaluate Datadog-lite.
|_. Feature |_. Datadog-lite |_. Full Datadog (Enterprise) |
| Messages | ✅ | ✅ |
| Connections | ✅ | ✅ |
| Channels | ✅ | ✅ |
| Bandwidth | ✅ | ✅ |
| Message size | ✅ | ✅ |
| Message direction breakdown (Inbound vs. Outbound) | ❌ | ✅ |
| Per-Channel metrics | ❌ | ✅ |
| Usage analytics & trends | ❌ | ✅ |
| Custom dashboards & alerts | ❌ | ✅ |
| Advanced logging & debugging | ❌ | ✅ |

I'd suggest moving this to the end under a 'Datadog Lite' heading. You can then link the mentions of Datadog Lite (and Datadog) from the pricing pages too.

Also I'm not sure this table is strictly correct in terms of what is available with the Lite offering. If you take a look at REA-2119 this has the list of metrics available which may be more beneficial to document.

| Advanced logging & debugging | ❌ | ✅ |


Ably includes @AppID@ and @AccountID@ tags with each metric to help with data organization. These ID tags enable you to filter, group, and analyze information efficiently, making it more manageable to spot trends and diagnose issues in your Datadog "dashboard":https://docs.datadoghq.com/dashboards/.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure this paragraph says much 🙂


Ably includes @AppID@ and @AccountID@ tags with each metric to help with data organization. These ID tags enable you to filter, group, and analyze information efficiently, making it more manageable to spot trends and diagnose issues in your Datadog "dashboard":https://docs.datadoghq.com/dashboards/.

To connect Ably and Datadog, you must authorize the integration through Datadog's "OAuth":https://docs.datadoghq.com/developers/integrations/oauth_for_integrations/ flow. This process requires the @api_keys_write@ scope, allowing Ably to push data to your Datadog account. Once the integration is active, Datadog provides a default Ably "dashboard":https://docs.datadoghq.com/integrations/ably/ so that you can monitor key metrics without extra setup.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this be under a 'Configure' or 'Setup' section?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd also suggest that would be a better place to mention that it needs to be requested to use.


h2. Set up the Ably Datadog integration

Initiate the integration from the Datadog:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Initiate the integration from the Datadog:
Initiate the integration from Datadog:


To connect Ably and Datadog, you must authorize the integration through Datadog's "OAuth":https://docs.datadoghq.com/developers/integrations/oauth_for_integrations/ flow. This process requires the @api_keys_write@ scope, allowing Ably to push data to your Datadog account. Once the integration is active, Datadog provides a default Ably "dashboard":https://docs.datadoghq.com/integrations/ably/ so that you can monitor key metrics without extra setup.

Every 60 seconds, Ably streams "statistics":https://ably.com/docs/metadata-stats/stats to the Datadog API using the generated API key. Metrics come from channels like @[meta]stats.minute@ and include App ID and Account ID tags. Datadog then displays these metrics in the Ably dashboard, giving you a clear view of messages, channels, and connections.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should link out to the metrics that are available (they're documented in stats) rather than referencing the meta channel.

Maybe something like:

The full list of which "statistics metrics":/docs/metadata-stats/stats#metrics are sent to Datadog are the same as those available from querying an application's statistics programmatically. These are streamed every 60 seconds to Datadog and include an App and Account ID to easily filter by.


If your connection remains in this state, your setup may have been interrupted.

For example, this can occur when a message is published while the connection is in a suspended state.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems unrelated to Datadog?


h3. Troubleshoot

If the provided information does not resolve your issue, contact Ably "support":https://ably.com/support. When contacting, include details such as your app ID, and any relevant logs to help troubleshoot.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This sort of message would normally go after the troubleshooting sections, but I'm not sure if it's relevant to include.

@@ -0,0 +1,83 @@
---
title: Ably Datadog integration
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe just 'Datadog integration' or 'Datadog'?

@franrob-projects franrob-projects temporarily deployed to ably-docs-edu-576-docs--idgjl1 March 17, 2025 14:06 Inactive
@franrob-projects franrob-projects force-pushed the EDU-576-Docs-for-datadog-integration branch from 113ebc0 to 4265efb Compare March 17, 2025 14:09
@franrob-projects franrob-projects temporarily deployed to ably-docs-edu-576-docs--idgjl1 March 17, 2025 14:09 Inactive
@franrob-projects franrob-projects temporarily deployed to ably-docs-edu-576-docs--idgjl1 March 20, 2025 15:11 Inactive
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants