Skip to content

Commit c2559e5

Browse files
Merge pull request #600 from mojtabaimani/develop
Multi update Data Processing Update for Platform
2 parents c4a6fbc + 005cf15 commit c2559e5

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

57 files changed

+221
-161
lines changed

pages/platform/data-processing/01_CONCEPTS_Capabilities/guide.en-asia.md

+8-7
Original file line numberDiff line numberDiff line change
@@ -17,15 +17,16 @@ In this document, we list all the features currently supported by the Data Proce
1717

1818
### Processing engine
1919

20-
- Currently the only available processing engine is [Apache Spark](http://spark.apache.org/).
21-
- During beta, the only available version of Apache Spark is 2.4.3
20+
- At this moment, OVHcloud Data Processing supports the following engines:
21+
22+
- Spark 2.4.3
23+
2224
- It is not possible to interact with Apache Spark cluster via command line.
2325

24-
### The Apache Spark job in Data Processing beta is limited to:
26+
### The Apache Spark job in Data Processing is limited to:
2527

26-
- Minimum 1 and maximum 30 GB of RAM per Executor
27-
- Minimum 1 and maximum 8 Cores of CPU per Executor
28-
- Minimum 1 and maximum 10 Executors per job
28+
- Minimum 1 and maximum 60 GB of RAM per Executor
29+
- Minimum 1 and maximum 16 Cores of CPU per Executor
2930
- Maximum 24 hours for the duration of each job
3031

3132
### Supported languages for Apache Spark code
@@ -53,7 +54,7 @@ In this document, we list all the features currently supported by the Data Proce
5354

5455
### OVHcloud vRack
5556

56-
Data Processing can not use or access OVHcloud vRack.
57+
- Data Processing can not use or access OVHcloud vRack.
5758

5859
### Available regions
5960

pages/platform/data-processing/01_CONCEPTS_Capabilities/guide.en-au.md

+8-7
Original file line numberDiff line numberDiff line change
@@ -17,15 +17,16 @@ In this document, we list all the features currently supported by the Data Proce
1717

1818
### Processing engine
1919

20-
- Currently the only available processing engine is [Apache Spark](http://spark.apache.org/).
21-
- During beta, the only available version of Apache Spark is 2.4.3
20+
- At this moment, OVHcloud Data Processing supports the following engines:
21+
22+
- Spark 2.4.3
23+
2224
- It is not possible to interact with Apache Spark cluster via command line.
2325

24-
### The Apache Spark job in Data Processing beta is limited to:
26+
### The Apache Spark job in Data Processing is limited to:
2527

26-
- Minimum 1 and maximum 30 GB of RAM per Executor
27-
- Minimum 1 and maximum 8 Cores of CPU per Executor
28-
- Minimum 1 and maximum 10 Executors per job
28+
- Minimum 1 and maximum 60 GB of RAM per Executor
29+
- Minimum 1 and maximum 16 Cores of CPU per Executor
2930
- Maximum 24 hours for the duration of each job
3031

3132
### Supported languages for Apache Spark code
@@ -53,7 +54,7 @@ In this document, we list all the features currently supported by the Data Proce
5354

5455
### OVHcloud vRack
5556

56-
Data Processing can not use or access OVHcloud vRack.
57+
- Data Processing can not use or access OVHcloud vRack.
5758

5859
### Available regions
5960

pages/platform/data-processing/01_CONCEPTS_Capabilities/guide.en-ca.md

+8-7
Original file line numberDiff line numberDiff line change
@@ -17,15 +17,16 @@ In this document, we list all the features currently supported by the Data Proce
1717

1818
### Processing engine
1919

20-
- Currently the only available processing engine is [Apache Spark](http://spark.apache.org/).
21-
- During beta, the only available version of Apache Spark is 2.4.3
20+
- At this moment, OVHcloud Data Processing supports the following engines:
21+
22+
- Spark 2.4.3
23+
2224
- It is not possible to interact with Apache Spark cluster via command line.
2325

24-
### The Apache Spark job in Data Processing beta is limited to:
26+
### The Apache Spark job in Data Processing is limited to:
2527

26-
- Minimum 1 and maximum 30 GB of RAM per Executor
27-
- Minimum 1 and maximum 8 Cores of CPU per Executor
28-
- Minimum 1 and maximum 10 Executors per job
28+
- Minimum 1 and maximum 60 GB of RAM per Executor
29+
- Minimum 1 and maximum 16 Cores of CPU per Executor
2930
- Maximum 24 hours for the duration of each job
3031

3132
### Supported languages for Apache Spark code
@@ -53,7 +54,7 @@ In this document, we list all the features currently supported by the Data Proce
5354

5455
### OVHcloud vRack
5556

56-
Data Processing can not use or access OVHcloud vRack.
57+
- Data Processing can not use or access OVHcloud vRack.
5758

5859
### Available regions
5960

pages/platform/data-processing/01_CONCEPTS_Capabilities/guide.en-gb.md

+8-7
Original file line numberDiff line numberDiff line change
@@ -17,15 +17,16 @@ In this document, we list all the features currently supported by the Data Proce
1717

1818
### Processing engine
1919

20-
- Currently the only available processing engine is [Apache Spark](http://spark.apache.org/).
21-
- During beta, the only available version of Apache Spark is 2.4.3
20+
- At this moment, OVHcloud Data Processing supports the following engines:
21+
22+
- Spark 2.4.3
23+
2224
- It is not possible to interact with Apache Spark cluster via command line.
2325

24-
### The Apache Spark job in Data Processing beta is limited to:
26+
### The Apache Spark job in Data Processing is limited to:
2527

26-
- Minimum 1 and maximum 30 GB of RAM per Executor
27-
- Minimum 1 and maximum 8 Cores of CPU per Executor
28-
- Minimum 1 and maximum 10 Executors per job
28+
- Minimum 1 and maximum 60 GB of RAM per Executor
29+
- Minimum 1 and maximum 16 Cores of CPU per Executor
2930
- Maximum 24 hours for the duration of each job
3031

3132
### Supported languages for Apache Spark code
@@ -53,7 +54,7 @@ In this document, we list all the features currently supported by the Data Proce
5354

5455
### OVHcloud vRack
5556

56-
Data Processing can not use or access OVHcloud vRack.
57+
- Data Processing can not use or access OVHcloud vRack.
5758

5859
### Available regions
5960

pages/platform/data-processing/01_CONCEPTS_Capabilities/guide.en-ie.md

+8-7
Original file line numberDiff line numberDiff line change
@@ -17,15 +17,16 @@ In this document, we list all the features currently supported by the Data Proce
1717

1818
### Processing engine
1919

20-
- Currently the only available processing engine is [Apache Spark](http://spark.apache.org/).
21-
- During beta, the only available version of Apache Spark is 2.4.3
20+
- At this moment, OVHcloud Data Processing supports the following engines:
21+
22+
- Spark 2.4.3
23+
2224
- It is not possible to interact with Apache Spark cluster via command line.
2325

24-
### The Apache Spark job in Data Processing beta is limited to:
26+
### The Apache Spark job in Data Processing is limited to:
2527

26-
- Minimum 1 and maximum 30 GB of RAM per Executor
27-
- Minimum 1 and maximum 8 Cores of CPU per Executor
28-
- Minimum 1 and maximum 10 Executors per job
28+
- Minimum 1 and maximum 60 GB of RAM per Executor
29+
- Minimum 1 and maximum 16 Cores of CPU per Executor
2930
- Maximum 24 hours for the duration of each job
3031

3132
### Supported languages for Apache Spark code
@@ -53,7 +54,7 @@ In this document, we list all the features currently supported by the Data Proce
5354

5455
### OVHcloud vRack
5556

56-
Data Processing can not use or access OVHcloud vRack.
57+
- Data Processing can not use or access OVHcloud vRack.
5758

5859
### Available regions
5960

pages/platform/data-processing/01_CONCEPTS_Capabilities/guide.en-sg.md

+8-7
Original file line numberDiff line numberDiff line change
@@ -17,15 +17,16 @@ In this document, we list all the features currently supported by the Data Proce
1717

1818
### Processing engine
1919

20-
- Currently the only available processing engine is [Apache Spark](http://spark.apache.org/).
21-
- During beta, the only available version of Apache Spark is 2.4.3
20+
- At this moment, OVHcloud Data Processing supports the following engines:
21+
22+
- Spark 2.4.3
23+
2224
- It is not possible to interact with Apache Spark cluster via command line.
2325

24-
### The Apache Spark job in Data Processing beta is limited to:
26+
### The Apache Spark job in Data Processing is limited to:
2527

26-
- Minimum 1 and maximum 30 GB of RAM per Executor
27-
- Minimum 1 and maximum 8 Cores of CPU per Executor
28-
- Minimum 1 and maximum 10 Executors per job
28+
- Minimum 1 and maximum 60 GB of RAM per Executor
29+
- Minimum 1 and maximum 16 Cores of CPU per Executor
2930
- Maximum 24 hours for the duration of each job
3031

3132
### Supported languages for Apache Spark code
@@ -53,7 +54,7 @@ In this document, we list all the features currently supported by the Data Proce
5354

5455
### OVHcloud vRack
5556

56-
Data Processing can not use or access OVHcloud vRack.
57+
- Data Processing can not use or access OVHcloud vRack.
5758

5859
### Available regions
5960

pages/platform/data-processing/22_GETTINGSTARTED_monitor/guide.en-asia.md

+17-7
Original file line numberDiff line numberDiff line change
@@ -50,20 +50,30 @@ After you submit a job to the Data Processing platform, follow these steps to mo
5050

5151
![Metrics token](images/token.png){.thumbnail}
5252

53-
- Copy the metrics token that is now displayed in the popup.
54-
- Open [https://grafana.com/grafana/dashboards/11844](https://grafana.com/grafana/dashboards/11844) and copy the Grafana ID by clicking the button `Copy ID to Clipboard`{.action}
53+
- Copy and save the metrics token that is now displayed in the popup.
5554
- Open [https://grafana.metrics.ovh.net/login](https://grafana.metrics.ovh.net/login) and login with your OVHcloud account.
56-
- From the main menu, click `Dashboards`{.action} -> `Import`{.action}
57-
55+
- Click on the Grafana logo at the upper left corner of the page and from the main menu select `Data Sources`{.action}
56+
- Click on the `Add data source`{.action} button.
57+
- Fill in the fields like in the pictures with the following data:
58+
- Name: Select a name for your data source (for example `My Data Source 1`).
59+
- Type: `Warp10`
60+
- URL: `https://warp10.gra1.metrics.ovh.net`
61+
- Access: `direct`
62+
63+
![datasource](images/datasource.png){.thumbnail}
64+
65+
- Click on the `Add`{.action} button.
66+
- Click on the `Save & Test`{.action} button.
67+
- Click on the Grafana logo at the upper left corner of the page and from the main menu select `Dashboards`{.action} -> `Import`{.action}
5868
![grafana](images/grafana.png){.thumbnail}
5969

60-
- In the import dashboard page, paste the Grafana ID that you copied before and click on the `Load`{.action} button.
70+
- In the import dashboard page, inside the `Grafana.com Dashboard` textbox write `11844` and click on the `Load`{.action} button. (11844 is the ID of a Grafana template that has been created specifically for Data Processing monitoring)
6171

6272
![grafana import](images/import.png){.thumbnail}
6373

6474
- Write a name for your dashboard
65-
- Paste the metrics token that you copied before.
66-
- For *datasource*, select `My Data Source 1`{.action} from the menu.
75+
- Paste the metrics token that you copied and saved before.
76+
- For *datasource*, select `My Data Source 1`{.action} from the menu (Or any other name that you selected for your data source).
6777
- Click on the `Import`{.action} button to open your dashboard.
6878

6979
![grafana import](images/import2.png){.thumbnail}

pages/platform/data-processing/22_GETTINGSTARTED_monitor/guide.en-au.md

+17-7
Original file line numberDiff line numberDiff line change
@@ -50,20 +50,30 @@ After you submit a job to the Data Processing platform, follow these steps to mo
5050

5151
![Metrics token](images/token.png){.thumbnail}
5252

53-
- Copy the metrics token that is now displayed in the popup.
54-
- Open [https://grafana.com/grafana/dashboards/11844](https://grafana.com/grafana/dashboards/11844) and copy the Grafana ID by clicking the button `Copy ID to Clipboard`{.action}
53+
- Copy and save the metrics token that is now displayed in the popup.
5554
- Open [https://grafana.metrics.ovh.net/login](https://grafana.metrics.ovh.net/login) and login with your OVHcloud account.
56-
- From the main menu, click `Dashboards`{.action} -> `Import`{.action}
57-
55+
- Click on the Grafana logo at the upper left corner of the page and from the main menu select `Data Sources`{.action}
56+
- Click on the `Add data source`{.action} button.
57+
- Fill in the fields like in the pictures with the following data:
58+
- Name: Select a name for your data source (for example `My Data Source 1`).
59+
- Type: `Warp10`
60+
- URL: `https://warp10.gra1.metrics.ovh.net`
61+
- Access: `direct`
62+
63+
![datasource](images/datasource.png){.thumbnail}
64+
65+
- Click on the `Add`{.action} button.
66+
- Click on the `Save & Test`{.action} button.
67+
- Click on the Grafana logo at the upper left corner of the page and from the main menu select `Dashboards`{.action} -> `Import`{.action}
5868
![grafana](images/grafana.png){.thumbnail}
5969

60-
- In the import dashboard page, paste the Grafana ID that you copied before and click on the `Load`{.action} button.
70+
- In the import dashboard page, inside the `Grafana.com Dashboard` textbox write `11844` and click on the `Load`{.action} button. (11844 is the ID of a Grafana template that has been created specifically for Data Processing monitoring)
6171

6272
![grafana import](images/import.png){.thumbnail}
6373

6474
- Write a name for your dashboard
65-
- Paste the metrics token that you copied before.
66-
- For *datasource*, select `My Data Source 1`{.action} from the menu.
75+
- Paste the metrics token that you copied and saved before.
76+
- For *datasource*, select `My Data Source 1`{.action} from the menu (Or any other name that you selected for your data source).
6777
- Click on the `Import`{.action} button to open your dashboard.
6878

6979
![grafana import](images/import2.png){.thumbnail}

pages/platform/data-processing/22_GETTINGSTARTED_monitor/guide.en-ca.md

+17-7
Original file line numberDiff line numberDiff line change
@@ -50,20 +50,30 @@ After you submit a job to the Data Processing platform, follow these steps to mo
5050

5151
![Metrics token](images/token.png){.thumbnail}
5252

53-
- Copy the metrics token that is now displayed in the popup.
54-
- Open [https://grafana.com/grafana/dashboards/11844](https://grafana.com/grafana/dashboards/11844) and copy the Grafana ID by clicking the button `Copy ID to Clipboard`{.action}
53+
- Copy and save the metrics token that is now displayed in the popup.
5554
- Open [https://grafana.metrics.ovh.net/login](https://grafana.metrics.ovh.net/login) and login with your OVHcloud account.
56-
- From the main menu, click `Dashboards`{.action} -> `Import`{.action}
57-
55+
- Click on the Grafana logo at the upper left corner of the page and from the main menu select `Data Sources`{.action}
56+
- Click on the `Add data source`{.action} button.
57+
- Fill in the fields like in the pictures with the following data:
58+
- Name: Select a name for your data source (for example `My Data Source 1`).
59+
- Type: `Warp10`
60+
- URL: `https://warp10.gra1.metrics.ovh.net`
61+
- Access: `direct`
62+
63+
![datasource](images/datasource.png){.thumbnail}
64+
65+
- Click on the `Add`{.action} button.
66+
- Click on the `Save & Test`{.action} button.
67+
- Click on the Grafana logo at the upper left corner of the page and from the main menu select `Dashboards`{.action} -> `Import`{.action}
5868
![grafana](images/grafana.png){.thumbnail}
5969

60-
- In the import dashboard page, paste the Grafana ID that you copied before and click on the `Load`{.action} button.
70+
- In the import dashboard page, inside the `Grafana.com Dashboard` textbox write `11844` and click on the `Load`{.action} button. (11844 is the ID of a Grafana template that has been created specifically for Data Processing monitoring)
6171

6272
![grafana import](images/import.png){.thumbnail}
6373

6474
- Write a name for your dashboard
65-
- Paste the metrics token that you copied before.
66-
- For *datasource*, select `My Data Source 1`{.action} from the menu.
75+
- Paste the metrics token that you copied and saved before.
76+
- For *datasource*, select `My Data Source 1`{.action} from the menu (Or any other name that you selected for your data source).
6777
- Click on the `Import`{.action} button to open your dashboard.
6878

6979
![grafana import](images/import2.png){.thumbnail}

pages/platform/data-processing/22_GETTINGSTARTED_monitor/guide.en-gb.md

+17-7
Original file line numberDiff line numberDiff line change
@@ -50,20 +50,30 @@ After you submit a job to the Data Processing platform, follow these steps to mo
5050

5151
![Metrics token](images/token.png){.thumbnail}
5252

53-
- Copy the metrics token that is now displayed in the popup.
54-
- Open [https://grafana.com/grafana/dashboards/11844](https://grafana.com/grafana/dashboards/11844) and copy the Grafana ID by clicking the button `Copy ID to Clipboard`{.action}
53+
- Copy and save the metrics token that is now displayed in the popup.
5554
- Open [https://grafana.metrics.ovh.net/login](https://grafana.metrics.ovh.net/login) and login with your OVHcloud account.
56-
- From the main menu, click `Dashboards`{.action} -> `Import`{.action}
57-
55+
- Click on the Grafana logo at the upper left corner of the page and from the main menu select `Data Sources`{.action}
56+
- Click on the `Add data source`{.action} button.
57+
- Fill in the fields like in the pictures with the following data:
58+
- Name: Select a name for your data source (for example `My Data Source 1`).
59+
- Type: `Warp10`
60+
- URL: `https://warp10.gra1.metrics.ovh.net`
61+
- Access: `direct`
62+
63+
![datasource](images/datasource.png){.thumbnail}
64+
65+
- Click on the `Add`{.action} button.
66+
- Click on the `Save & Test`{.action} button.
67+
- Click on the Grafana logo at the upper left corner of the page and from the main menu select `Dashboards`{.action} -> `Import`{.action}
5868
![grafana](images/grafana.png){.thumbnail}
5969

60-
- In the import dashboard page, paste the Grafana ID that you copied before and click on the `Load`{.action} button.
70+
- In the import dashboard page, inside the `Grafana.com Dashboard` textbox write `11844` and click on the `Load`{.action} button. (11844 is the ID of a Grafana template that has been created specifically for Data Processing monitoring)
6171

6272
![grafana import](images/import.png){.thumbnail}
6373

6474
- Write a name for your dashboard
65-
- Paste the metrics token that you copied before.
66-
- For *datasource*, select `My Data Source 1`{.action} from the menu.
75+
- Paste the metrics token that you copied and saved before.
76+
- For *datasource*, select `My Data Source 1`{.action} from the menu (Or any other name that you selected for your data source).
6777
- Click on the `Import`{.action} button to open your dashboard.
6878

6979
![grafana import](images/import2.png){.thumbnail}

pages/platform/data-processing/22_GETTINGSTARTED_monitor/guide.en-ie.md

+17-7
Original file line numberDiff line numberDiff line change
@@ -50,20 +50,30 @@ After you submit a job to the Data Processing platform, follow these steps to mo
5050

5151
![Metrics token](images/token.png){.thumbnail}
5252

53-
- Copy the metrics token that is now displayed in the popup.
54-
- Open [https://grafana.com/grafana/dashboards/11844](https://grafana.com/grafana/dashboards/11844) and copy the Grafana ID by clicking the button `Copy ID to Clipboard`{.action}
53+
- Copy and save the metrics token that is now displayed in the popup.
5554
- Open [https://grafana.metrics.ovh.net/login](https://grafana.metrics.ovh.net/login) and login with your OVHcloud account.
56-
- From the main menu, click `Dashboards`{.action} -> `Import`{.action}
57-
55+
- Click on the Grafana logo at the upper left corner of the page and from the main menu select `Data Sources`{.action}
56+
- Click on the `Add data source`{.action} button.
57+
- Fill in the fields like in the pictures with the following data:
58+
- Name: Select a name for your data source (for example `My Data Source 1`).
59+
- Type: `Warp10`
60+
- URL: `https://warp10.gra1.metrics.ovh.net`
61+
- Access: `direct`
62+
63+
![datasource](images/datasource.png){.thumbnail}
64+
65+
- Click on the `Add`{.action} button.
66+
- Click on the `Save & Test`{.action} button.
67+
- Click on the Grafana logo at the upper left corner of the page and from the main menu select `Dashboards`{.action} -> `Import`{.action}
5868
![grafana](images/grafana.png){.thumbnail}
5969

60-
- In the import dashboard page, paste the Grafana ID that you copied before and click on the `Load`{.action} button.
70+
- In the import dashboard page, inside the `Grafana.com Dashboard` textbox write `11844` and click on the `Load`{.action} button. (11844 is the ID of a Grafana template that has been created specifically for Data Processing monitoring)
6171

6272
![grafana import](images/import.png){.thumbnail}
6373

6474
- Write a name for your dashboard
65-
- Paste the metrics token that you copied before.
66-
- For *datasource*, select `My Data Source 1`{.action} from the menu.
75+
- Paste the metrics token that you copied and saved before.
76+
- For *datasource*, select `My Data Source 1`{.action} from the menu (Or any other name that you selected for your data source).
6777
- Click on the `Import`{.action} button to open your dashboard.
6878

6979
![grafana import](images/import2.png){.thumbnail}

0 commit comments

Comments
 (0)