You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.Rmd
+16-16Lines changed: 16 additions & 16 deletions
Original file line number
Diff line number
Diff line change
@@ -51,9 +51,9 @@ install.packages("mirai")
51
51
52
52
### Quick Start
53
53
54
-
→`mirai()`: Evaluate an R expression asynchronously in a parallel process.
54
+
-`mirai()`: Evaluate an R expression asynchronously in a parallel process.
55
55
56
-
→`daemons()`: Set and launch persistent background processes, local or remote, on which to run mirai tasks.
56
+
-`daemons()`: Set and launch persistent background processes, local or remote, on which to run mirai tasks.
57
57
58
58
```{r}
59
59
#| label: exec
@@ -79,6 +79,20 @@ mp[.flat]
79
79
daemons(0)
80
80
```
81
81
82
+
### Key Features
83
+
84
+
1. Distributed Execution: Run tasks across networks and clusters using various deployment methods (SSH, HPC clusters using Slurm, SGE, Torque, PBS, LSF, etc.)
85
+
86
+
1. Compute Profiles: Manage different sets of daemons independently, allowing tasks with different requirements to be executed on appropriate resources.
87
+
88
+
1. Promises Integration: An event-driven implementation performs actions on returned values as soon as tasks complete, with minimal latency.
89
+
90
+
1. Serialization Support: Native serialization support for reference objects such as Arrow Tables, Polars DataFrames or torch tensors.
91
+
92
+
1. Error Handling: Robust error handling and reporting, with full stack traces for debugging.
93
+
94
+
1. RNG Management: L'Ecuyer-CMRG RNG streams for reproducible parallel random number generation.
95
+
82
96
### Design Concepts
83
97
84
98
mirai is designed from the ground up to provide a production-grade experience.
@@ -103,20 +117,6 @@ mirai is designed from the ground up to provide a production-grade experience.
103
117
- Capacity for millions of tasks over thousands of connections
104
118
- Proven track record for heavy-duty workloads in the life sciences industry
105
119
106
-
### Key Features
107
-
108
-
→ Distributed Execution: Run tasks across networks and clusters using various deployment methods (SSH, HPC clusters using Slurm, SGE, Torque, PBS, LSF, etc.)
109
-
110
-
→ Compute Profiles: Manage different sets of daemons independently, allowing tasks with different requirements to be executed on appropriate resources.
111
-
112
-
→ Promises Integration: An event-driven implementation performs actions on returned values as soon as tasks complete, ensuring minimal latency.
113
-
114
-
→ Serialization Support: Native serialization support for reference objects such as Arrow Tables, Polars DataFrames or torch tensors.
115
-
116
-
→ Error Handling: Robust error handling and reporting, with full stack traces for debugging.
117
-
118
-
→ RNG Management: L'Ecuyer-CMRG RNG streams for reproducible parallel random number generation.
119
-
120
120
### Powering the Ecosystem
121
121
122
122
mirai serves as a foundation for asynchronous and parallel computing in the R ecosystem:
0 commit comments