Skip to content
MARL in Cooperative Environments
Edit this page

2.12Communicate Worksheet

3 min read

This five-part digital activity consolidates the chapter’s communication concepts. You will match mechanisms to their applications, calculate the capacity of a discrete message and the effect of communication cost, then use an interactive graph to analyze how message loss changes task performance. The final prompt asks you to trade task success against bandwidth use. Every item except that short design judgment is automatically checkable.

What you will be able to do

  • Match communication mechanisms and constraints to their roles in MARL. Understand
  • Calculate message capacity and communication-adjusted rewards. Apply
  • Interpret how communication reliability affects cooperative performance. Analyse
  • Evaluate the trade-off between communication and task performance. Evaluate

Drag each block into a slot, or tap one and then tap a slot.

  1. An agent chooses one symbol from .

  2. A message is received only by nearby agents.

  3. A sent message may never arrive.

  4. The reward is reduced whenever an agent sends information.

  5. An agent sends a learned real-valued vector.

For a bb-bit message, ∣M∣=2b|\mathcal{M}| = 2^b.

A channel allows 3 bits per message. How many distinct messages can it represent?

distinct messages

You need at least 16 distinct messages. What is the minimum number of bits required?

bits

A team needs to distinguish 8 situations but has only 2 bits. On average, how many situations must share each message?

situations per message

A cost term charges the team for talking: rt′=rt−λctr'_t = r_t - \lambda c_t.

With rt=10r_t = 10, λ=0.5\lambda = 0.5 and ct=4c_t = 4, calculate rt′r'_t.

Now raise the price to λ=1\lambda = 1, keeping rt=10r_t = 10 and ct=4c_t = 4.

At λ=1\lambda = 1, how many bits could the team afford before the four sent bits stop being worth it, if those bits raise rtr_t from 7.5 to 10?

bits

Measured on the Communication Lab task: four dishes, four symbols, two tabular learners, 20 seeds, 8000 evaluation trials each.

Task success against Message loss (%). 0: 1, 10: 0.9, 20: 0.8, 30: 0.8, 40: 0.7, 50: 0.6 00.30.50.8101020304050Message loss (%)Task success

At what message-loss rate does success first fall below 0.80?

% loss

By how many percentage points does success fall between 0% and 40% loss?

percentage points

Protocol A achieves 94% task success and sends 20 messages per episode.

Protocol B achieves 91% success and sends 6 messages per episode.

Which would you choose for a bandwidth-constrained robot system, and why?

AnswersReveal
Answer to 1.

Discrete message · communication range · message loss · communication cost · continuous message, matched to the descriptions in order.

Answer to 2.1.

23=82^3 = 8.

Answer to 2.2.

4 bits. 24=162^4 = 16; three bits give only 8.

Answer to 2.3.

Two bits give 4 messages for 8 situations, so 2 situations share each message. The receiver disambiguates from context, and where it cannot, the team pays for the merge.

Answer to 3.1.

10−0.5×4=810 - 0.5 \times 4 = 8.

Answer to 3.2.

10−1×4=610 - 1 \times 4 = 6.

Answer to 3.3.

The messages bought 10−7.5=2.510 - 7.5 = 2.5 of task reward, which at a price of 1 per bit pays for 2.5 bits. Sending 4 costs 4 and returns 2.5, so those messages lose the team 1.5 per step.

Answer to 4.1.

30%, where success is 0.773. At 20% it is still 0.849.

Answer to 4.2.

1.000−0.695=0.3051.000 - 0.695 = 0.305, about 30.5 percentage points.

Answer to 5.1.

No single right answer.

B is the better default. It gives up 3 points of success and sends 70% fewer messages. Under a bandwidth constraint these are not comparable currencies: 3 points is a small bounded loss, while 20 messages per episode may simply not fit, making A’s 94% unavailable rather than expensive.

A is defensible if the channel carries it and the task is failure-sensitive.

A strong answer notes what the table omits: behaviour under message loss. A protocol sending 20 messages has redundancy; one sending 6 may need every one to arrive.

Revisit the 10 key concepts, equations, and intuitions from this chapter.

Open Communicate Flashcards