Skip to content

Commit 62f691b

Browse files
authored
Update README.md
1 parent 23a7e4a commit 62f691b

File tree

1 file changed

+36
-17
lines changed

1 file changed

+36
-17
lines changed

README.md

+36-17
Original file line numberDiff line numberDiff line change
@@ -1,27 +1,29 @@
1-
# AWS IoT S3 importer
1+
# Arduino AWS S3 exporter
22

3-
This project provides a way to extract time series samples from Arduino cloud, publishing to an S3 destination bucket.
3+
This project provides a way to extract time series samples from Arduino cloud, publishing to a S3 destination bucket.
44
Things can be filterd by tags.
55

66
## Deployment schema
77

8-
Imported is based on a Go lambda function triggered by periodic events from EventBridge.
9-
Job is configured to extract samples for a 60min time window: trigger is configured accordingly on EventBridge.
8+
S3 exporter is based on a Go lambda function triggered by periodic events from EventBridge.
9+
Job is configured to extract samples for a 60min time window.
10+
One file is created per run, containing all samples for the given hour. Time series samples are exported in UTC.
1011

11-
### Policies
12-
13-
See policies defined in [cloud formation template](deployment/cloud-formation-template/deployment.yaml)
14-
15-
### Configuration parameters
12+
CSV produced has the following structure:
13+
```console
14+
timestamp,thing_id,thing_name,property_id,property_name,value
15+
2024-09-04T11:00:00Z,07846f3c-37ae-4722-a3f5-65d7b4449ad3,H7,137c02d0-b50f-47fb-a2eb-b6d23884ec51,m3,3.000
16+
2024-09-04T11:01:00Z,07846f3c-37ae-4722-a3f5-65d7b4449ad3,H7,137c02d0-b50f-47fb-a2eb-b6d23884ec51,m3,7.000
17+
2024-09-04T11:02:00Z,07846f3c-37ae-4722-a3f5-65d7b4449ad3,H7,137c02d0-b50f-47fb-a2eb-b6d23884ec51,m3,11.000
18+
2024-09-04T11:03:00Z,07846f3c-37ae-4722-a3f5-65d7b4449ad3,H7,137c02d0-b50f-47fb-a2eb-b6d23884ec51,m3,15.000
19+
```
1620

17-
| Parameter | Description |
18-
| --------- | ----------- |
19-
| /arduino/s3-importer/iot/api-key | IoT API key |
20-
| /arduino/s3-importer/iot/api-secret | IoT API secret |
21-
| /arduino/s3-importer/iot/org-id | (optional) organization id |
22-
| /arduino/s3-importer/iot/filter/tags | (optional) tags filtering. Syntax: tag=value,tag2=value2 |
23-
| /arduino/s3-importer/iot/samples-resolution-seconds | (optional) samples resolution (default: 300s) |
24-
| /arduino/s3-importer/destination-bucket | S3 destination bucket |
21+
Files are organized in S3 bucket by date and files of the same day are grouped.
22+
```
23+
<bucket>:2024-09-04/2024-09-04-10.csv
24+
<bucket>:2024-09-04/2024-09-04-11.csv
25+
<bucket>:2024-09-04/2024-09-04-12.csv
26+
```
2527

2628
## Deployment via Cloud Formation Template
2729

@@ -35,3 +37,20 @@ arduino-s3-integration-lambda.zip archive created
3537
* Save zip file on an S3 bucket accessible by the AWS account
3638
* Start creation of a new cloud formation stack provising the [cloud formation template](deployment/cloud-formation-template/deployment.yaml)
3739
* Fill all required parameters (mandatory: Arduino API key and secret, S3 bucket and key where code has been uploaded, destination S3 bucket. Optionally, tag filter for filtering things, organization identifier and samples resolution)
40+
41+
### Configuration parameters
42+
43+
Here is a list of all configuration properties available in 'Parameter store'.
44+
45+
| Parameter | Description |
46+
| --------- | ----------- |
47+
| /arduino/s3-importer/iot/api-key | IoT API key |
48+
| /arduino/s3-importer/iot/api-secret | IoT API secret |
49+
| /arduino/s3-importer/iot/org-id | (optional) organization id |
50+
| /arduino/s3-importer/iot/filter/tags | (optional) tags filtering. Syntax: tag=value,tag2=value2 |
51+
| /arduino/s3-importer/iot/samples-resolution-seconds | (optional) samples resolution (default: 300s) |
52+
| /arduino/s3-importer/destination-bucket | S3 destination bucket |
53+
54+
### Policies
55+
56+
See policies defined in [cloud formation template](deployment/cloud-formation-template/deployment.yaml)

0 commit comments

Comments
 (0)