Write data from InfluxDB OSS to InfluxDB Cloud
To write data from InfluxDB OSS to InfluxDB Cloud, use the Flux
to() or
experimental.to() functions.
Write data once with a single query execution or use InfluxDB tasks
to routinely write data to InfluxDB Cloud.
InfluxDB Cloud rate limits
Write requests to InfluxDB Cloud are subject to the rate limits associated with your InfluxDB Cloud pricing plan.
-
Query data from InfluxDB OSS.
-
(Optional) Filter or process data to write to InfluxDB Cloud.
-
Use
toorexperimental.toto write data to InfluxDB Cloud. For most use cases,to()is the correct function to use, but depending on the structure of the data you’re writing,experimental.tomay be required.Use the following guidelines:
-
to(): Use to write data in field keys to the
_fieldcolumn and field values to the_valuecolumn. -
experimental.to(): Use to write data in column names to corresponding field keys and column values to field values.
-
-
Provide the following parameters to either function:
- bucket: InfluxDB Cloud bucket to write to
- host: InfluxDB Cloud region URL
- org: InfluxDB Cloud organization
- token: InfluxDB Cloud API Token
-
(Recommended) To keep your raw API token out of queries, store your InfluxDB Cloud API token as an InfluxDB secret in your InfluxDB OSS instance and use
secrets.get()to retrieve the secret value as shown in the following example (select the function you’re using to see the correct format):
import "influxdata/influxdb/secrets"
cloudToken = secrets.get(key: "INFLUX_CLOUD_API_TOKEN")
from(bucket: "example-oss-bucket")
|> range(start: -10m)
|> filter(fn: (r) => r._measurement == "example-measurement")
|> to(
bucket: "example-cloud-bucket",
host: "https://cloud2.influxdata.com",
org: "example-org",
token: cloudToken,
)
import "experimental"
import "influxdata/influxdb/secrets"
cloudToken = secrets.get(key: "INFLUX_CLOUD_API_TOKEN")
from(bucket: "example-oss-bucket")
|> range(start: -10m)
|> filter(fn: (r) => r._measurement == "example-measurement")
|> pivot(rowKey: ["_time"], columnKey: ["_field"], valueColumn: "_value")
|> experimental.to(
bucket: "example-cloud-bucket",
host: "https://cloud2.influxdata.com",
org: "example-org",
token: cloudToken,
)
Input and output data for to() functions
to()requires_time,_measurement,_field, and_valuecolumns.to()writes all other columns as tags where the column name is the tag key and the column value is the tag value.
Input data
| _time | _measurement | exampleTag | _field | _value |
|---|---|---|---|---|
| 2021-01-01T00:00:00Z | example-m | A | temp | 80.0 |
| 2021-01-01T00:01:00Z | example-m | A | temp | 80.3 |
| 2021-01-01T00:02:00Z | example-m | A | temp | 81.1 |
| _time | _measurement | exampleTag | _field | _value |
|---|---|---|---|---|
| 2021-01-01T00:00:00Z | example-m | A | rpm | 4023 |
| 2021-01-01T00:01:00Z | example-m | A | rpm | 4542 |
| 2021-01-01T00:02:00Z | example-m | A | rpm | 4901 |
Output line protocol
example-m,exampleTag=A temp=80.0,rpm=4023i 1609459200000000000
example-m,exampleTag=A temp=80.3,rpm=4542i 1609459260000000000
example-m,exampleTag=A temp=81.1,rpm=4901i 1609459320000000000
experimental.to()requires_timeand_measurementcolumns.- Columns in the group key
(other than
_measurement) are parsed as tags where the column name is the tag key and the column value is the tag value. - Columns not in the group key (other than
_time_) are parsed as fields where the column name is the field key and the column value is the field value.
Input data
Group key = [_measurement, exampleTag]
| _time | _measurement | exampleTag | temp | rpm |
|---|---|---|---|---|
| 2021-01-01T00:00:00Z | example-m | A | 80.0 | 4023 |
| 2021-01-01T00:01:00Z | example-m | A | 80.3 | 4542 |
| 2021-01-01T00:02:00Z | example-m | A | 81.1 | 4901 |
Output line protocol
example-m,exampleTag=A temp=80.0,rpm=4023i 1609459200000000000
example-m,exampleTag=A temp=80.3,rpm=4542i 1609459260000000000
example-m,exampleTag=A temp=81.1,rpm=4901i 1609459320000000000
Examples
Downsample and write data to InfluxDB Cloud
import "influxdata/influxdb/secrets"
cloudToken = secrets.get(key: "INFLUX_CLOUD_API_TOKEN")
from(bucket: "example-oss-bucket")
|> range(start: -10m)
|> filter(fn: (r) => r._measurement == "example-measurement")
|> aggregateWindow(every: 1m, fn: last)
|> to(
bucket: "example-cloud-bucket",
host: "https://cloud2.influxdata.com",
org: "example-org",
token: cloudToken,
)
Write min, max, and mean values to InfluxDB Cloud
import "influxdata/influxdb/secrets"
cloudToken = secrets.get(key: "INFLUX_CLOUD_API_TOKEN")
data = from(bucket: "example-oss-bucket")
|> range(start: -30m)
|> filter(fn: (r) => r._measurement == "example-measurement")
min = data |> aggregateWindow(every: 10m, fn: min) |> map(fn: (r) => ({ r with _field: "{$r._field}_min" }))
max = data |> aggregateWindow(every: 10m, fn: max) |> map(fn: (r) => ({ r with _field: "{$r._field}_max" }))
mean = data |> aggregateWindow(every: 10m, fn: mean) |> map(fn: (r) => ({ r with _field: "{$r._field}_mean" }))
union(tables: [min, max, mean])
|> to(
bucket: "example-cloud-bucket",
host: "https://cloud2.influxdata.com",
org: "example-org",
token: cloudToken,
)
Automate writing data from InfluxDB OSS to InfluxDB Cloud
To automatically and routinely write data from InfluxDB OSS to InfluxDB Cloud, create a task in your InfluxDB OSS instance that regularly queries, processes, and writes data to InfluxDB Cloud.
import "influxdata/influxdb/tasks"
option task = {
name: "Downsample to InfluxDB Cloud",
every: 1h,
}
from(bucket: "example-oss-bucket")
|> range(start: -10m)
|> filter(fn: (r) => r._measurement == "example-measurement")
|> aggregateWindow(every: 1m, fn: last)
|> to(
bucket: "example-cloud-bucket",
host: "https://cloud2.influxdata.com",
org: "example-org",
token: cloudToken,
)
Support and feedback
Thank you for being part of our community! We welcome and encourage your feedback and bug reports for InfluxDB and this documentation. To find support, the following resources are available:
InfluxDB Cloud and InfluxDB Enterprise customers can contact InfluxData Support.