#mongo-db #cluster #download #profiling #key #group #data

bin+lib ftdc

Crate to download ftdc data for mongodb clusters

5 releases

0.1.4 Sep 7, 2023
0.1.3 May 29, 2022
0.1.2 Nov 7, 2021
0.1.1 Nov 6, 2021
0.1.0 Nov 6, 2021

#1630 in Command line utilities

32 downloads per month

MIT license

28KB
549 lines

Download mongodb FTDC data

Lib crate to enable your application to download Full Time Diagnostic Data Capture (FTDC) data from mongodb clusters to investigate deeper (e.g. keyhole).

Usage

To download FTDC data from a mongodb cluster you need to provide some input to the CLI:

  1. Group key: The group key (or: project id) the respective cluster belongs too. It is encoded into the link you get from atlas when selecting the specific cluster on Atlas UI (e.g.cloud.mongodb.com/v2/{group key}/clusters)
  2. Replicaset name: The name of the replica set the data should be loaded from. You can either provide the direct targeted replica set name (e.g. atlas-<something>-shard-0) or the name of the shard (e.g some-name-shard-00). Do not forget the number here as it qualifies the shard in case you want data from a sharded cluster. For a standalone replica set it is 00 but lets say for a sharded cluster with 3 shards it would be 00, 01, 02.
  3. API key: You need to have a valid API key for at least the cluster you want to download FTDC data from.
use error::Error;
use reqwest::Client;
use service::{FtdcDataService, FtdcLoader};

#[tokio::main]
async fn main() -> Result<(), Error> {
  let group_key = "...";
  let replica_set_name = "...";
  let size = 10_000_000
  let public = "...";
  let private = "...";

  let service = FtdcDataService { client: Client::new() };

  service
    .get_ftdc_data(
      group_key,
      replica_set_name,
      size,
      public,
      private,
    )
    .await
    .map(|download_path| println!("Downloaded to: `{download_path}`"))
}

The data is downloaded to the current directory the application was executed in as a *.tar.gz file.

Dependencies

~6–19MB
~293K SLoC