1fi_rxm(7) Libfabric v1.6.1 fi_rxm(7)
2
3
4
6 fi_rxm - The RxM (RDM over MSG) Utility Provider
7
9 The RxM provider (ofi_rxm) is an utility provider that supports RDM
10 endpoint emulated over MSG endpoint of a core provider.
11
13 RxM provider requires the core provider to support the following fea‐
14 tures:
15
16 · MSG endpoints (FI_EP_MSG)
17
18 · RMA read/write (FI_RMA)
19
20 · FI_OPT_CM_DATA_SIZE of at least 24 bytes
21
23 The RxM provider currently supports FI_MSG, FI_TAGGED and FI_RMA capa‐
24 bilities.
25
26 Endpoint types : The provider supports only FI_EP_RDM.
27
28 Endpoint capabilities : The following data transfer interface is sup‐
29 ported: FI_MSG, FI_TAGGED, FI_RMA.
30
31 Progress : The RxM provider supports FI_PROGRESS_AUTO.
32
33 Addressing Formats : FI_SOCKADDR, FI_SOCKADDR_IN
34
35 Memory Region : FI_MR_VIRT_ADDR, FI_MR_ALLOCATED, FI_MR_PROV_KEY MR
36 mode bits would be required from the app in case the core provider
37 requires it.
38
40 When using RxM provider, some limitations from the underlying MSG
41 provider could also show up. Please refer to the corresponding MSG
42 provider man pages to find about those limitations.
43
44 Unsupported features
45 RxM provider does not support the following features:
46
47 · op_flags: FI_FENCE.
48
49 · FI_ATOMIC
50
51 · Scalable endpoints
52
53 · Shared contexts
54
55 · FABRIC_DIRECT
56
57 · FI_MR_SCALABLE
58
59 · Authorization keys
60
61 · Application error data buffers
62
63 · Multicast
64
65 · FI_ADDR_STR, FI_SYNC_ERR
66
67 · Reporting unknown source addr data as part of completions
68
69 · Triggered operations
70
71 Auto progress
72 When sending large messages, an app doing an sread or waiting on the CQ
73 file descriptor may not get a completion when reading the CQ after
74 being woken up from the wait. The app has to do sread or wait on the
75 file descriptor again.
76
78 The ofi_rxm provider checks for the following environment variables.
79
80 FI_OFI_RXM_BUFFER_SIZE : Defines the transmit buffer size / inject
81 size. Messages of size less than this would be transmitted via an
82 eager protocol and those above would be transmitted via a rendezvous
83 protocol. Transmit data would be copied up to this size (default:
84 ~16k).
85
86 FI_OFI_RXM_COMP_PER_PROGRESS : Defines the maximum number of MSG
87 provider CQ entries (default: 1) that would be read per progress (RxM
88 CQ read).
89
91 fabric(7), fi_provider(7), fi_getinfo(3)
92
94 OpenFabrics.
95
96
97
98Libfabric Programmer's Manual 2018-02-19 fi_rxm(7)