Atlas Data Federation Overview
About Atlas Data Federation
Atlas Data Federation is a distributed query engine that allows you to natively query, transform, and move data across various sources inside & outside of MongoDB Atlas.
Sample Uses
You can use Atlas Data Federation to:
Copy Atlas cluster data into Parquet or CSV files written to AWS S3 buckets.
Query across multiple Atlas clusters to get a holistic view of your data.
Materialize aggregations across Atlas clusters and AWS S3 data.
Read and import data from your AWS S3 buckets into an Atlas cluster.
Key Concepts
Federated Database InstanceA federated database instance is a deployment of Atlas Data Federation. Each federated database instance contains virtual databases and collections that map to data in your data stores.
Data StoreData store refers to the location of your data. Atlas Data Federation supports the following data stores:
Atlas cluster
Atlas Data Lake datasets
AWS S3 buckets
HTTP endpoints
Storage ConfigurationStorage configuration contains mappings between your virtual databases and collections and data sources in JSON format. You can define these mappings in the storage configuration to access and run queries against your data.
Atlas Data Federation Regions
Note
To prevent excessive charges on your bill, create your Atlas Data Federation in the same AWS region as your S3 data source.
Atlas Data Federation routes your federated database requests through one of the following regions:
Data Federation Regions | AWS Regions |
|---|---|
Virginia, USA | us-east-1 |
Oregon, USA | us-west-2 |
Sao Paulo, Brazil | sa-east-1 |
Ireland | eu-west-1 |
London, England | eu-west-2 |
Frankfurt, Germany | eu-central-1 |
Mumbai, India | ap-south-1 |
Sydney, Australia | ap-southeast-2 |
Note
You will incur charges when running federated queries. For more information, see Data Federation Costs.