CloudQuery is a high-performance data movement framework that runs entirely on your infrastructure. Extract from any source, from cloud infrastructure to SaaS, powering AI applications with CloudQuery’s flexible, composable data movement framework.

Installation

brew install cloudquery/tap/cloudquery

Check out the quickstart guide for install guides for Linux and Windows and for step-by-step instructions on completing your first sync with CloudQuery.

Why CloudQuery?

• Composable and flexible - Use the languages, destinations, and orchestrators you want. CloudQuery is built to fit into your stack, not the other way around.
• Runs on your infrastructure - Your cloud data never touches CloudQuery's servers. Full privacy, built for regulated, secure, and performance-critical environments.
• Built for developers - Code-first, extensible plugins, multi-language, open plugin system, no lock-in. Write it, extend it, ship it. No black boxes, no unexplained failures.
• Fast, powerful data movement - Move large volumes of data with high performance and fine-grained control, powered by Apache Arrow. Perfect for feeding AI models, LLM pipelines, or large-scale data stores.
• Specialized plugin coverage - Support for complex, unique data sources such as cloud infrastructure, security, and FinOps data.

Use Cases

• Cloud Security Posture Management (CSPM): Use as a CSPM solution to monitor and enforce security policies across your cloud infrastructure for AWS, GCP, Azure and many more.
• Cloud Asset Inventory: First-class support for all major cloud infrastructure providers such as AWS, GCP, and Azure allows you to collect and unify your cloud configuration data.
• Cloud FinOps: Collect and unify billing data from cloud providers to save money on your cloud expenses.
• ELT Platform: With hundreds of integration combinations and an extensible architecture, CloudQuery can be used for reliable, efficient export from any API to any database or from one database to another.
• Attack Surface Management: Solution for continuous discovery, analysis, and monitoring of potential attack vectors that make up your organization's attack surface.
• Eliminate data silos: Eliminate data silos across your organization, unifying data between security, infrastructure, marketing, and finance teams.

Links

• Homepage: https://www.cloudquery.io
• Documentation: https://platform-docs.cloudquery.io/
• Integrations: https://hub.cloudquery.io
• Plugin SDK: https://github.com/cloudquery/plugin-sdk

License

By contributing to CloudQuery, you agree that your contributions will be licensed as defined in the LICENSE file.

Contribution

Feel free to open a pull request for small fixes and changes. For bigger changes and new integrations, please open an issue first to prevent duplicated work and to have the relevant discussions first.

Open source

The CloudQuery framework, SDK, CLI, and some integrations are open source - please file an issue before opening a PR.