A company needs to store petabytes of time-series IoT sensor data and query it with single-digit millisecond latency at millions of reads per second. The data has a simple key-value structure with timestamps. Which Google Cloud database is MOST appropriate?
Trap 1: Cloud Spanner
Cloud Spanner is a globally distributed, horizontally scalable relational database that provides external consistency and ACID transactions across regions. That transactional guarantee is expensive and unnecessary for append-only IoT sensor data, and Spanner's synchronous replication protocol adds latency that makes it unsuited to single-digit millisecond reads at millions of QPS. It also lacks Bigtable's native time-series-specific features such as row-key-driven range scans and automatic data compaction for event streams.
Trap 2: BigQuery
BigQuery is a serverless, columnar analytics data warehouse optimized for scanning petabytes of data in one SQL pass, with queries measured in seconds or minutes depending on data volume and slot availability. It is not built for point lookups of individual sensor readings or for the sub-10 millisecond read latency required by real-time IoT dashboards and edge applications. The overhead of executing even a tiny analytical query is far too high for millions of QPS, and its pricing model assumes large analytic scans, not high-frequency key-value access.
Trap 3: Firestore
Firestore is a document-oriented NoSQL database designed primarily for mobile and web applications, with data modeled as collections of documents and real-time synchronization features. Its document model and automatic multi-field indexing create write and read amplification that becomes prohibitive when continuously appending millions of time-series records per second. While Firestore scales for many concurrent users, it does not match Bigtable's ability to perform high-throughput, ordered scans over timestamp-based row keys with single-digit millisecond latency.
- A
Cloud Spanner
Why wrong: Cloud Spanner is a globally distributed, horizontally scalable relational database that provides external consistency and ACID transactions across regions. That transactional guarantee is expensive and unnecessary for append-only IoT sensor data, and Spanner's synchronous replication protocol adds latency that makes it unsuited to single-digit millisecond reads at millions of QPS. It also lacks Bigtable's native time-series-specific features such as row-key-driven range scans and automatic data compaction for event streams.
- B
BigQuery
Why wrong: BigQuery is a serverless, columnar analytics data warehouse optimized for scanning petabytes of data in one SQL pass, with queries measured in seconds or minutes depending on data volume and slot availability. It is not built for point lookups of individual sensor readings or for the sub-10 millisecond read latency required by real-time IoT dashboards and edge applications. The overhead of executing even a tiny analytical query is far too high for millions of QPS, and its pricing model assumes large analytic scans, not high-frequency key-value access.
- C
Firestore
Why wrong: Firestore is a document-oriented NoSQL database designed primarily for mobile and web applications, with data modeled as collections of documents and real-time synchronization features. Its document model and automatic multi-field indexing create write and read amplification that becomes prohibitive when continuously appending millions of time-series records per second. While Firestore scales for many concurrent users, it does not match Bigtable's ability to perform high-throughput, ordered scans over timestamp-based row keys with single-digit millisecond latency.
- D
Cloud Bigtable
Cloud Bigtable is a wide-column NoSQL database specifically engineered for large-scale analytical and operational workloads such as IoT telemetry, financial series, and ad tech event streams. Its sparse, lexicographically ordered row model allows sensors to be stored as row keys and timestamped columns, enabling highly efficient range scans within a single table with single-digit millisecond latency. Bigtable scales linearly by adding nodes, can sustain millions of reads and writes per second, deletes expired data via garbage-collection policies, and is designed for exactly the append-heavy, key-based access pattern that petabyte-scale IoT sensor data requires.