Blog
RF Coordination at Rio 2016 with Steve Caldwell
RF engineer, Steve Caldwell walks us through the difficult challenge of coordinating RF at one of the world's largest major events, the Olympic and Paralympic Games.
November, 23 2016 |
RF engineer, Steve Caldwell walks us through the difficult challenge of coordinating RF at one of the world's largest major events, the Olympic and Paralympic Games.
There are few major global events bigger than the Olympic Games held every four years. More than 11,000 athletes took part this year across 306 events in 28 sports — making the Rio games (from a sporting perspective at least) even bigger than London 2012.
On top of the main sporting attractions, it's easy to forget how much additional work goes on behind the scenes to help make sure the entire event runs smoothly from a technical and entertainment perspective. The opening and closing ceremonies, for example, require major planning and real skill to execute smoothly. Millions of viewers tune in to watch these events stream live, and with such high expectations, there is little (if not zero) room for error.
Few realise just how much RF technology is running behind the scenes at such major events. It's safe to say, much of it is practically invisible — unless, of course, something goes wrong. In such mission-critical applications, correct RF coordination and planning is imperative. To give us a flavour of the task at hand, Steve Caldwell walks us through the process he used to ensure the show at Rio went off without a hitch.
Preparation for Spectrum Management at the Rio 2016 Ceremonies began in February 2015, when the Technical Director of Ceremonias Cariocas (CC2016) got in touch. CC2016 were the organising body for Rio 2016 Olympic and Paralympic Opening and Closing Ceremonies. Knowing how challenging the process of managing spectrum at major events can be, CC2016 also approached representatives from ANATEL (the Brazilian spectrum regulator) to help manage this difficult resource. Being involved early in the proceedings (about 18 months out) allowed us to apply for — and ultimately obtain — ideal spectrum for use at the Ceremonies. Also, we were able to determine the best possible equipment — based on the spectrum acquired — long before any equipment tender process. Lastly, and perhaps most importantly, an early start allowed for a relationship to form with the spectrum regulators.
A visit to Maracanã Stadium (situated west of Rio de Janeiro city) was arranged during the early stages. This visit allowed spectrum scans to be taken at various positions. Also, it enabled me time to meet with the Spectrum Regulators so we could express our requirements and determine spectrum availability in Brazil. ANATEL were extremely flexible in allowing us access to several bands that aren't normally available.
Also at that time, an online spectrum request portal was set up by a third party (a private Brazilian management company brought on to manage auxiliary requirements). This portal would allow all the broadcasters — and anyone else wishing to obtain frequencies during the games — to log spectrum requests. Once all information was collected — including their intended location of operation, equipment capabilities, and time frame — frequencies were assigned and licenced. Even though a request cut-off date was specified, requests were still received and processed by ANATEL right up to the Opening Ceremony. This represents an outstanding commitment by the regulator.
After a week in Rio — scanning, meeting authorities, getting burnt on Copacabana beach, more scanning — I returned to Sydney and began the process of determining which equipment was best for the available spectrum. From this process, I was able to compile a frequency solution. The systems I was responsible for — both from a spectrum management point, and a compatible frequency standpoint — was essentially anything RF related destined for use in or around the Ceremony stadium and rehearsal site. The rehearsal space was less than a kilometre away from the stadium on the other side of the railway line, as it were. Anyone that visited the rehearsal site will understand the "other side of the tracks" reference.
Some of the systems that required spectrum management for use by Ceremonies production alone included:
This equipment was just for the Opening and Closing Olympics and Paralympics Ceremonies technical production (audio, lighting, comms, etc.). This list does not include the 300 or so Broadcasters, ENG crews, and other interested parties. By the time Ceremony rehearsals began in the venue, there were between 2,500 and 3,000 registered frequencies licenced for use. The spectrum requirements were bigger than London 2012, by far!
One of the first things I noticed upon landing in Rio (before I'd even so much as touched a scanner) was the huge variation in television broadcast quality from my hotel room. For the first time in many years, I had "snow" on some channels. This could only mean one thing – they still had Analogue TV. After a bit of investigation, I found that I could tune to the same broadcast in both analogue and digital. SHIT! Upon breaking out the analyser, I confirmed what I suspected: Rio (or more likely the whole of Brazil) was still in their analogue to digital transition period. For every analogue TV station that existed, there was probably a digital equivalent transmitting concurrently.
Calling the Brazilian Terrestrial Television Band crowded is a massive understatement. As of February, from the available 37 channels in the UHF TV band (US 6MHz raster), only 14 remained unused. The meeting that followed with ANATEL then revealed that of these 14 currently unused channels, 5 were slated for the energising of additional transmitters between now and the beginning of the games. We only had a total of nine 6MHz wide TV channels worth of space between 470 and 700MHz. As ANATEL were very generous in allowing us access to other spectrum, we were also allowed to use the free space between 700MHz and 806MHz, as their digital dividend was not yet finalised. Luckily, it was only radio microphones, IEM, and any UHF style duplex communications devices that would need to use this TV spectrum. And fortunately, because I could specify the equipment and frequency range that would be used for the Ceremonies production, I could move any of this equipment up into 700MHz. To complicate things further, all 42 of these existing — or soon to be energised TV transmitters — were positioned on a hill less than three kilometres away in very plain sight of the stadium. The measured field strength of most of these stations in the centre of Maracanã was more than -60dBm.
Brazil utilises the 450-470MHz band for its LMR two-way radio systems, and to say this portion of the spectrum was packed is another huge understatement. Fortunately, the Spectrum Regulators approved our request to use the 403-450MHz portion of the band for our production two-way radios, as we were essentially banned from using the conventional 450-470MHz band. This change presented challenges for the prospective communications contractor when providing the quantity of handheld radios required by Ceremonies, as equipment in this alternate lower band is less common. I also recommended — after providing significant precedence — that the use of digital trunking systems was not the best solution at Ceremonies for several reasons; not least being the latency experienced when using handhelds in earshot of comms panels. All two-way radios had to fit into a space in the spectrum wide enough to accommodate 90+ channels of 12.5kHz bandwidth analogue carriers. As all the transmitters used in the base radio systems for duplex and simplex were cavity aligned; we could not place those frequencies any closer than about 300kHz. The use of analogue carriers also allows for faster fault finding, and resolution of frequency related issues.
The FM Broadcast mass cast monitoring system was the next to receive its custom placement. During events of this size (in particular Olympics Ceremonies) there is a system employed called the Mass Cast Monitoring (or Level 3 IEM's as it's known in the industry). It is essentially one or more FM Broadcast transmitters set up to provide coverage of the entire performance (and/or rehearsal) spaces. Every single cast member involved in the show wears a low-cost FM receiver and earbuds. This process mainly provides time-zero program to the cast, but can also be used to deliver choreography cues, instructions, or click tracks. In Rio, we used six FM transmitters for the main stadium, and four FM transmitters for each of the two rehearsal spaces. Due to the (once again) very congested 88-108MHz FM Broadcast band in Rio, we requested — and were subsequently authorised to utilize — a portion of spectrum between 76-82MHz (US VHF TV ch5). This allocation allowed us to obtain sufficient spacing between each of the 14 FM frequencies to compensate for the poor adjacent channel rejection exhibited by the low-cost FM receivers. A total of 12,500 of these FM receivers was required, so each receiver had to be as low cost as possible. The only way to ensure adequate performance in this environment was to expose them to as little other RF energy as possible, while maintaining reasonable channel separation. The ability to occupy spectrum so far from the normal Broadcast band was invaluable. It also prevented the Ceremonies rehearsal audio program from being exposed on a public broadcast band.
There was also a requirement to provide 3 FM transmitters inside the normal FM 88-108MHz Broadcast band for use by transcription services during the ceremonies. However, as these transmissions would be received on somewhat higher quality receivers (most mobile phones sold in South America are fitted with FM receivers), adjacent channel rejection for these services was not an issue. As such, we managed to shoehorn three FM transmissions into the crowded band.
Planning the spectral layout of equipment was next. It was obvious which position the two-way LMR systems would occupy; the same goes for other equipment with restricted frequency options and limited switching bandwidth. Telemetry systems used for various functions such as pyro firing and special effects control were all limited to the 430MHz ISM bands. Wi-Fi devices (however bad an idea) were fixed, as were government and security TETRA systems used in the venue. The DECT systems adopted for the digital full duplex comms systems had some latitude, due to the fact we could arbitrarily choose the DECT bands we would like to occupy. The DECT band varies from country to country somewhat, and most hardware options were available (mainly by programming) in any of the bands. FM broadcast band transmitters were assigned their own private spectrum space, so the only systems left to assign were the radio microphones and IEM systems, for both Ceremonies and Broadcasters. We only had the nine free TV channels between 470 and 700MHz to use, however, some of the 700MHz band was at our disposal.
Pictured Above: The Spectrum Landscape from 30 to 950MHz - as seen when entered into Shure WWB 6.12
A decision was made early on to allow 30+ channels of IEM transmitters to occupy the 700MHz spectrum. The one drawback of utilising this spectrum was the recent global trend toward reassigning this band for use by TELCO's. As such, the availability of equipment in this frequency band is becoming somewhat limited. It's not such a problem if you're only after 10 or 15 IEM receiver packs, but when the specification calls for 370 IEM belt pack receivers fed from 24 channels of transmitter, it's a little trickier. This drawback was outweighed, however, by the advantages of placing the IEM systems up in this higher frequency spectrum, away from the TV transmissions and the majority of radio microphones.
With the above all sorted, I had the remaining nine clear 6MHz TV channels between 470-700MHz to position 80+ channels of Ceremonies Production and Broadcasters radio microphones — plus any UHF 'BTR' style full duplex comms systems. Later, it was agreed to move the newer digital audio full duplex comms systems to the 1900MHz DECT band, which left more space for the radio microphones.
It's now fairly standard practice (through a collective effort I've supported) to serve high priority spectrum users with the frequencies they need — within the limitations outlined by the regulator — before allocating spectrum to other parties. As the Olympics Ceremonies environment was a live global broadcast, live radio microphones and IEM's are considered the highest priority. Then in a decreasing order of priority; Ceremonies communications, rights holders' radio microphones and IEM, rights holders' communications, and then, Broadcasters radio microphones, IEM, and communications. Essentially, this allows the Ceremonies radio microphones and IEM frequency setup to be the most resilient solution possible. All other systems down the priority list are calculated AROUND each of the higher priority systems that precede it. As other systems (such as broadcasters' radio mics) are considered arbitrary, there is no preference given to its position based on usage. For instance, a broadcaster IEM (or IFB in the relevant nomenclature) is treated the same as a broadcaster radio microphone. At this level, they do not have the different interaction characteristics that form the basis of how we organise higher priority systems.
Once a frequency solution for the Ceremonies is calculated (considering all pre-existing contributors and the cautious inclusion of analogue TV), it is submitted to the Spectrum Regulator along with similar calculations for LMR two-way radio systems. From this point, all other frequency requests are then assessed, calculated, and provided to the applicant. Most often, the spectrum regulator will seek advice around the best way to calculate and resolve the applicants' requests, without compromising the integrity of the Ceremonies RF solution.
The process of calculating frequencies required to fulfill an event like this consists of several stages. The actual procedure is somewhat proprietary, and well beyond the scope of this article. However, the process is essential to provide a suitable and stable solution for this hostile environment. Any calculations must place a high emphasis on device usage at the frequency assigned to it. There are several ways to weight these calculations and allow segregation based on their usage. These processes allow for a more efficient use of the spectrum; some of them are outlined below, with advantages:
* Standard IMD calculations are used in conjunction with the above weightings
The three different types of segregations above carry various factors of reliability, and can be used separately, or together with one-another, depending on the circumstances. Due to the relative proximity of the Maracanã to the other venues involved in the RF solution (such as the rehearsal venues), these calculation procedures required great care. For this event, no fundamental frequencies were re-used at any stage over the period of 4 months — except for the same piece of equipment used during each of the four Ceremonies. Only intermodulation products and their proximity to fundamentals were calculated with the three assessments outlined above; frequency, position, and time. The level at which each piece of RF equipment was calculated — in respect to fundamental spacing requirements and susceptibility to IMD — was very much tailored to each type of device, considering both transmitter based and receiver based IMD. Eventually the 270 odd frequencies for Ceremonies alone were submitted to ANATEL. From this point, the remaining 2000+ frequency requests from other users would be resolved.
It should be noted that a percentage of the frequencies requested by a good portion of broadcasters are what are known as 'land grabs'. Essentially, at the time of request, the broadcasters often don't know what equipment they will be using at the event. The easiest way to ensure they still have a choice of frequency bands when the event comes about is to make a request for multiple frequencies in all portions of the spectrum. This way, they will have access to licenced frequencies regardless of the equipment they eventually use. Even though there is a good percentage of frequencies licenced that will never be used, at the time of calculation, there is no way to determine which ones, and thus, the situation must be calculated assuming they all will be used.
Pictured Above: 'Fat Albert' wideband receiving antenna in London
Monitoring the RF environment, or spectrum 'landscape', was the priority upon arriving back in Rio by late May 2016. I took over three large pelican cases of spectrum monitoring equipment and antennas with me on the flight, and this, of course, attracted a bit of attention at Rio international airport customs. Opening the cases prompted the appearance of at least half a dozen customs officers all seeking explanations but lacking the English language skills to comprehend any of my technical explanations. In fact, the more I tried to explain what the equipment did, the more dubious it all sounded. Luckily, I had with me a letter of introduction from the Olympics Ceremonies organisers outlining the conditions of my 6-month work visa. This gave a little credibility to my presence, if not actually explaining what the equipment did. They seemed happy with this, and I spent the next half hour re-packing all my shit.
Arriving at the stadium a couple of days later, I began my search for a position in which to set up my analyser antenna. One of the most important things to consider when monitoring spectrum, is not the absolute amplitude of measurements taken, but the relevant changes experienced over time. The one thing that will ruin all your relative measurements is the re-positioning of your measuring antenna. I knew that I would not be able to find an antenna position that would serve me for the following 4 months of stadium set construction, lighting and audio build, rehearsals, ceremonies, and of course periods in between when the entire stadium is handed over to the Olympics sports. For now, any position that would get me through the build period, or at least until my larger, less portable antenna turned up in the sea freight, would be great.
I eventually set up the antenna outside a glass control room at the rear of the upper seating in Maracanã. This room was slated for use by the live ground announcers during the ceremonies. This position would allow me to monitor the spectrum over a significant period, and ensure that all the calculations I had done, and all the frequencies submitted and licenced, would still be good to use. For the next couple of hours, my eyes were pinned to the screen. If there was an unexpected and significant change in the spectrum landscape from what I had measured 15 months ago — or at least accounted for based on information from ANATEL — then we could be in trouble. By this time, all the Communications, Audio, and a handful of other relevant contractors had been appointed. All these contractors had provided equipment to fit tender that was in turn determined from the spectrum as known. It was this point where we'd find out how much had changed. Luckily, except for a few analogue TV stations that had shut down early, there was no discrepancy. Thank God.
The weeks passed, with very few remarkable changes in the spectrum landscape. Eventually the real monitoring antenna (Fat Albert to those who have been introduced) arrived in the sea freight from Sydney, and I went about finding a more permanent position in the stadium — one that would not be compromised from now until the end of the event. The antenna was placed in the upper rows of seating, directly in front of the Ceremonies control room. This was an excellent position, as it was high enough to be sensitive to any RF activity outside of the stadium, but far enough from all the higher power LMR two-way, IEM, and FM transmitter antenna positions. Nothing upsets a landscape scan more than several high-power carriers mixing in the front end of your wideband receiver.
The equipment that I use to monitor the RF spectrum is nothing particularly exciting, nor expensive. I have found over the years that it's not how big it is, it's what you do with it. I have seen Spectrum Authorities bring very expensive AOA and TDOA receivers into these stadiums over the years, without the necessary skills to measure even a single carrier. Almost any reasonable spectrum monitoring device will be able to provide the information required to competently monitor the spectrum landscape. It's not about absolute measurements, it's about relative measurements. You don't need to own a wideband Bi-Conical or Discone antenna with a ruler flat bandwidth from DC to daylight, so long as you use the same antenna, in the same position, you will be able to detect changes in the spectrum.
The other thing is getting to know your equipment; is it deaf (has low RF sensitivity) at certain frequency bands? Does it have significant Image Response issues that need to be accounted for? Is the noise floor you are seeing measured or inherent? Once you are familiar with your receiver, you will be better equipped to know what is REALLY going on.
My weapons of choice for long term monitoring are not particularly expensive, nor are they difficult to use. I own two devices from the WinRadio stables in Melbourne, Australia. The first is a WinRadio G33WSM, which is probably the most common SDR (Software Defined Radio) receiver in this industry. It is an original Beta test unit sent to me by the guys at WinRadio almost ten years ago, and it's not missed a beat. The second is a WinRadio G39DDC, which is another SDR unit, but as an entire 16MHz of RF bandwidth is sampled in real time, it's capable of some amazing tricks.
Pictured Above: RF Monitoring screens. WinRadio receivers centre of image
One of the best things about both units (especially the G39DDC, as the RF, IF, and audio filtering is completely adjustable in real time), is the ability to monitor the audio that may be modulated on almost any carrier. Over the years I have seen a LOT of people — mainly spectrum police from local authorities — come in with very expensive fixed and portable direction finding devices trying to find a rogue transmitter. The thing about direction finding in a stadium, is the reflections can lead you on a very wild goose chase. Even with advanced Time Difference of Arrival (TDOA) devices. These RDF systems have their place in closer proximity, and I have used them on many occasions. The best procedure I have found for finding a rogue transmitter is not to physically go searching for the RF carrier, but to listen to the carrier. You can find out so much information about the transmitter from the audio demodulated from its carrier, and even the carrier itself.
Are their people talking on this carrier? Are they reporting the news? Can you hear the event PA system in the background? Can you hear anything that might give away who they are, and where they are transmitting from? Now look at the carrier itself – does it have side-tones, subcarriers, or audio tone-keys that give away the type of transmitter? Is the carrier on a frequency that suggests a brand or model of transmitter (if the carrier is on a 100kHz frequency step, you have a better than 4:1 chance it's a Lectrosonics). If there is a 19kHz pilot tone, then chances are it's an IEM/IFB unit. Most equipment has a signature that gives them away. Even determining the brand of the equipment will go a long way toward who might be using it, and where they might be.
Another trick I use often when tracking down rogue transmitters, is to use all the receivers at your disposal. If the rogue transmitter is on a frequency that your radio mic system is capable of (there is a very good chance your system is, as this is probably how you detected its presence in the first place), tune in one of your receivers. Even if you get no audio, knowing the signal strength indicated by the receivers' antennas, and the type and orientation of its antennas will give you a lot of useful information. Olympics ceremonies use multiple receiver 'nodes' positioned about the stadium for redundancy. These all have their own directional antennas, in different positions around the stadium, all pointing in different directions. A Lot of position information will be revealed by these different antenna/receiver positions.
The one thing to remember when put in charge of spectrum — either from a spectrum planning, or monitoring and policing perspective — is that most people you find who are using incorrect frequencies won't even know. The last thing you should do is to track them down, and turn up with a handful of analysers and licence listings while reading them the riot act. Most of the time, they are completely unaware of the frequency their kit is using, and even more unaware of any spectrum planning in place. 9 out of 10 people I have found in this situation are happy to be educated, and will do as you ask; a good portion will ask for your help. There is no better option than to ask them if they would like to be given a suitable frequency to use. After all, if you include them in the plan, it's better for them and you. Get their phone number, get them to call you if they have any issues, and most of them will become another set of eyes for you. After all, any other rogue transmitters have just as much chance of hitting them as they do you.
When I do a spectrum solution for an event — even one that does not necessarily attract the services of the local Spectrum authorities — I always include a handful of the most popular bands used for Broadcaster and ENG equipment in the frequency solution. This way, I already have a pool of compatible frequencies to hand out. This simple additional has saved much time and effort on so many jobs. Most of the broadcasters that are recurring on these events often drop me an email long before the event to obtain the situation on spectrum availability, and often ask to be included on my solutions.
Once the spectrum plan is in place with all the RF gear installed and running, the next thing to do is ensure that you have enough coverage for the event.
During an Olympic Ceremony, coverage tests used for the various types of equipment vary greatly. The one type of equipment that is afforded the most time for coverage is the two-way radio system — for no other reason than it is expected to work everywhere. Literally everywhere. The audio quality requirements for coverage are thankfully not as critical as a radio microphone or IEM, however. Two-way systems are only ever used for band limited speech, and the background noise floor is not too much of a concern. The key to obtaining good coverage of a two-way system using a simplex or semi-duplex base is antenna type and placement. In most Ceremony based two-way radio systems, a number of semi-duplex and simplex base radio repeaters are located in a room somewhere. The transmitters for these repeaters are combined via various methods into a single TX antenna. This antenna is then placed in a prominent position that compromises between height (to provide good coverage), and distance from the transmitters (to minimise cable loss). Similarly, the Receivers in the repeater system are fed from an RX antenna through a series of filters and distribution. Once a suitable compromise is obtained for the TX antenna, and suitable antenna is chosen, the RX antenna is then placed with suitable spacing from its transmitting brother.
The system is then walk tested to ensure sufficient coverage of both TX and RX. Hand-held radio reception can be somewhat massaged for best performance by changing the output power of the associated base transmitters, within reason. However, the performance of the base radio reception is somewhat dictated by the limited output power of the hand-held radios themselves. Minimal adjustments can be made to the hand-held transmitter power in this instance, so the difference must be made at the base receiver. The simplest way is to increase the natural gain of the antenna, however you run the risk of narrowing the beamwidth of the antenna and 'overshooting' the required coverage areas. The next requirement is to reduce the noise floor to the receivers. This is accomplished by fitting filtering to the receivers. As noise is proportional to bandwidth, any narrowing of the bandwidth admitted to a receiver will decrease the noise floor — allowing the weaker hand-held signals to be received.
The second most important coverage test is that of the performance systems – the radio mics and IEM. In the context of an event like this, it is common practice to allow the use of higher power carriers for the In-Ear Monitoring systems, even though it may not be required. Most spectrum authorities will allow the use of higher powers, or more commonly, higher gain antennas to improve the ERP. Therefore, the field strength on the performance area is increased. Rarely have we not had the ability to encompass an entire stadium with perfect coverage through the use of correct antenna alone. Use of suitably wide-band, low IMD, high IP3 combiners and amplifiers, along with high-gain antennas suited to a stadium will allow you to set and forget, and concentrate on the more important coverage tests – radio mics.
This is one area of RF where you really need to get things right. If one performer gets a dropout in their IEM, or if a stage manager ends up having to repeat something on the two-way, there is only one person whom this affects. Get even a single dropout or artefact on a radio mic during a live event broadcast to the entire planet, and everyone notices. Even the person holding the mic, because their IEM is perfect.
There is no secret to obtaining perfect radio mic coverage, especially in an extremely hostile RF environment such as an Olympic Stadium filled with 80,000 iPhones all looking for Wi-Fi. There is not one single piece of hardware, procedure, calculation, or advice that will provide you the key to perfect coverage. It is the combination of ALL these things, even in the smallest quantities. Certainly, correct spectrum management goes a long way, but absolutely everything must be considered; antenna position, type, and filtering, preamp gain, cable type and length, RF distribution and patch, receiver type, and transmitter power. All the small changes that may seem trivial add up in a BIG WAY in RF!
I will spend hours, and sometimes days contemplating, installing, and sometimes arguing with technical management about the positioning of radio mic antennas, it's that important. Entire audio system designs have changed due to the decision that the location of the radio rack is just not right. Sometimes I spend hours playing with different filters on antennas to gauge the impact on the noise floor in a system. I can easily spend an hour going around cleaning, and tightening up the grounding 'fingers' inside all my BNC and N-type connectors. This process alone can improve some systems beyond belief! Other examples include, the very simple act of placing all the higher frequency band devices earlier in a cascaded distribution system — or assigning body pack transmitters lower frequencies in lower frequency band equipment to minimize absorption. All these things add up.
However, probably the most important contributor in obtaining good RF performance, and this applies to almost all RF devices and not just radio mics, is transmitter power levels. My main goal in this respect is to use as little power as possible to obtain the coverage you need. No more.
Radio Mics – I could count on one hand the times that I have used a high-power setting on a radio mic transmitter. If you can't get the coverage through receiver antenna choice, placement, and gain, then there is something wrong. Save the high-power settings for the transmitter that gets buried under 10 layers of costume, or gets fitted to the guy who naturally absorbs all the RF on the planet. This just brings it into line with the remainder of the transmitters in use.
IEM – Often, the power output of our IEM combiner and amplifier systems is lower than the power output of an individual IEM transmitters connected to it. Its most often the antenna gain that does all the hard work for you, and its noise free gain.
Two-way Radios – the last system I designed, as used in Rio, had less than 5dB loss from any transmitter to the antenna, and it was combining the outputs of over 40 transmitters. Each transmitters output at the antenna equated to 800mW of conducted power, and was enough to cover the entire stadium from top to bottom.
All these systems worked with such low power, because they were not fighting each other. During the London 2012 Olympics Opening Ceremonies, the wideband noise floor increased an average of 22dB on the night of the Opening Ceremony. Rio's Opening Ceremony saw a noise floor increase of less than 10dB. Higher power does not improve anything, and should be used as a very last resort.
Pictured Above: Two-way radio combiner system
[caption id="attachment_6545" align="alignright" width="198"]Redundant IEM Amplifier Systems[/caption]
Working on these events over the period of 16 years has also allowed us to develop some serious RF toys for use with radio microphone and IEM systems. The name of the game with these events is redundancy. Apart from the practice of backing up the radio mic receivers with duplicate receiver positions in different parts of the stadium, there is a couple of aspects of a standard radio mic receive chain that presents a minimal, but present risk to a live performance. That is the distribution network. In most receive systems, the multitude of receiver channels are fed from a single antenna pair through a masthead amplifier that is powered by a single distributor, and in turn powered by a single power supply. If this single power supply fails, you lose all distribution and amplification to your entire suit of receivers. This scenario may sound unlikely, but it happened to me during the Singapore National Day Parade 2008. The switch mode PSU in a distribution amplifier overheated and failed. No backup, no RF, from ANY receiver. A distribution unit was subsequently built to overcome this situation. It is an 8-way device to allow the larger quantity of radio microphones to be used (8 pairs of outputs feeding 8 distribution amplifiers feeds a lot of receivers). It has the facility to accept a redundant set of antenna inputs, which automatically switch by detecting a change in the nominal impedance or power consumption on the main antenna feedline. Best of all, the distro is powered by accumulating all the +12v bias voltage from every device connected to it. The unit itself has no PSU to fail, and would require the failure of every device connected to it before the unit stops working. It has been in operation since Vancouver Winter Olympics in 2010.
We have also developed some clever automated redundancy systems for our IEM distribution systems that allow the failure of up to about 85% of the distribution chain, including two-thirds of the antennas before the RF stops.
The role of spectrum management at an event like this a complete job in itself. It's very different from being the RF Engineer and operator of all radio mics and IEM for the audio contractor. However, I was lucky enough to be spectrum manager and RF engineer for the Rio 2016 Olympics Ceremonies, and taking on both roles improved efficiency. I essentially prioritised my time toward spectrum management until the rehearsals were well underway, and then the focus moved to radio microphones and IEM. I kept an eye on the spectrum, but by this time I had become very familiar with what was out there, and any changes were noticeable. One occasional occurrence — in respect to the spectrum management role — was being asked to find spot frequencies for people who had a legitimate requirement, but their spectrum requests had fallen through the cracks, or they were returned with unsuitable frequency allocation or step sizing. However, considering the number of original requests made, and the number of real users occupying the spectrum, these requests were few and far between. All in all, considering how packed the spectrum was before we even started, it was a remarkably smooth process.
As far as two-way radio frequencies go, no changes were made to the solution at all, and this meant no re-programming of the hundreds of radios in the field. All frequencies worked as expected for the entire 4 months. A couple of channels suffered slightly with some IMD created from a nearby high power TETRA installation, but once we had the power of this TETRA base reduced, they came good again.
All radio microphone and IEM frequencies worked well for the entire event also. One radio microphone frequency was quarantined due to a slight amount of interference when its transmitter was taken into the dressing rooms under the seating, but other than that, they remained clean.
All the Mass Cast Monitoring FM frequencies performed perfectly, however this should not have been a surprise considering they were given their own spectrum. All the Telemetry, Pyro, special Effects, even Wi-Fi gear all performed without any drama. There was some digital transmission audio equipment that had some issues, but it was not spectrum related.
Based in Sydney Australia, Steve is the Technical Manager and RF engineer at Norwest Productions. He was the RF Consultant and Spectrum Coordinator at Rio 2016, and also played a fundamental role in the successful coordination of an ambitious wireless setup at London 2012. Read the interview with Steve Caldwell to learn more.
Foreword
There are few major global events bigger than the Olympic Games held every four years. More than 11,000 athletes took part this year across 306 events in 28 sports — making the Rio games (from a sporting perspective at least) even bigger than London 2012.
On top of the main sporting attractions, it's easy to forget how much additional work goes on behind the scenes to help make sure the entire event runs smoothly from a technical and entertainment perspective. The opening and closing ceremonies, for example, require major planning and real skill to execute smoothly. Millions of viewers tune in to watch these events stream live, and with such high expectations, there is little (if not zero) room for error.
Few realise just how much RF technology is running behind the scenes at such major events. It's safe to say, much of it is practically invisible — unless, of course, something goes wrong. In such mission-critical applications, correct RF coordination and planning is imperative. To give us a flavour of the task at hand, Steve Caldwell walks us through the process he used to ensure the show at Rio went off without a hitch.
Preparation
Preparation for Spectrum Management at the Rio 2016 Ceremonies began in February 2015, when the Technical Director of Ceremonias Cariocas (CC2016) got in touch. CC2016 were the organising body for Rio 2016 Olympic and Paralympic Opening and Closing Ceremonies. Knowing how challenging the process of managing spectrum at major events can be, CC2016 also approached representatives from ANATEL (the Brazilian spectrum regulator) to help manage this difficult resource. Being involved early in the proceedings (about 18 months out) allowed us to apply for — and ultimately obtain — ideal spectrum for use at the Ceremonies. Also, we were able to determine the best possible equipment — based on the spectrum acquired — long before any equipment tender process. Lastly, and perhaps most importantly, an early start allowed for a relationship to form with the spectrum regulators.
A visit to Maracanã Stadium (situated west of Rio de Janeiro city) was arranged during the early stages. This visit allowed spectrum scans to be taken at various positions. Also, it enabled me time to meet with the Spectrum Regulators so we could express our requirements and determine spectrum availability in Brazil. ANATEL were extremely flexible in allowing us access to several bands that aren't normally available.
Also at that time, an online spectrum request portal was set up by a third party (a private Brazilian management company brought on to manage auxiliary requirements). This portal would allow all the broadcasters — and anyone else wishing to obtain frequencies during the games — to log spectrum requests. Once all information was collected — including their intended location of operation, equipment capabilities, and time frame — frequencies were assigned and licenced. Even though a request cut-off date was specified, requests were still received and processed by ANATEL right up to the Opening Ceremony. This represents an outstanding commitment by the regulator.
Managing the Spectrum
After a week in Rio — scanning, meeting authorities, getting burnt on Copacabana beach, more scanning — I returned to Sydney and began the process of determining which equipment was best for the available spectrum. From this process, I was able to compile a frequency solution. The systems I was responsible for — both from a spectrum management point, and a compatible frequency standpoint — was essentially anything RF related destined for use in or around the Ceremony stadium and rehearsal site. The rehearsal space was less than a kilometre away from the stadium on the other side of the railway line, as it were. Anyone that visited the rehearsal site will understand the "other side of the tracks" reference.
Some of the systems that required spectrum management for use by Ceremonies production alone included:
- 30+ channel pairs of semi-duplex analogue UHF land mobile two-way radio (60+ frequencies)
- 30+ channels of simplex analogue UHF land mobile two-way radio
- 80+ channels of radio microphone (digital and analogue)
- 30+ channels of IEM
- 14 channels of FM broadcast (out of band)
- 3 channels of FM broadcast (in band)
- 10 channels of 1900MHz DECT for digital full duplex mobile communications
- 4 channels of 400MHz telemetry for Pyro firing
- 4 channels of 400MHz telemetry for special effects control
- Telemetry channels for multiple weather reporting systems
- In house TETRA systems
- Countless Wi-Fi devices
This equipment was just for the Opening and Closing Olympics and Paralympics Ceremonies technical production (audio, lighting, comms, etc.). This list does not include the 300 or so Broadcasters, ENG crews, and other interested parties. By the time Ceremony rehearsals began in the venue, there were between 2,500 and 3,000 registered frequencies licenced for use. The spectrum requirements were bigger than London 2012, by far!
Brazilian spectrum
One of the first things I noticed upon landing in Rio (before I'd even so much as touched a scanner) was the huge variation in television broadcast quality from my hotel room. For the first time in many years, I had "snow" on some channels. This could only mean one thing – they still had Analogue TV. After a bit of investigation, I found that I could tune to the same broadcast in both analogue and digital. SHIT! Upon breaking out the analyser, I confirmed what I suspected: Rio (or more likely the whole of Brazil) was still in their analogue to digital transition period. For every analogue TV station that existed, there was probably a digital equivalent transmitting concurrently.
Calling the Brazilian Terrestrial Television Band crowded is a massive understatement. As of February, from the available 37 channels in the UHF TV band (US 6MHz raster), only 14 remained unused. The meeting that followed with ANATEL then revealed that of these 14 currently unused channels, 5 were slated for the energising of additional transmitters between now and the beginning of the games. We only had a total of nine 6MHz wide TV channels worth of space between 470 and 700MHz. As ANATEL were very generous in allowing us access to other spectrum, we were also allowed to use the free space between 700MHz and 806MHz, as their digital dividend was not yet finalised. Luckily, it was only radio microphones, IEM, and any UHF style duplex communications devices that would need to use this TV spectrum. And fortunately, because I could specify the equipment and frequency range that would be used for the Ceremonies production, I could move any of this equipment up into 700MHz. To complicate things further, all 42 of these existing — or soon to be energised TV transmitters — were positioned on a hill less than three kilometres away in very plain sight of the stadium. The measured field strength of most of these stations in the centre of Maracanã was more than -60dBm.
Brazil utilises the 450-470MHz band for its LMR two-way radio systems, and to say this portion of the spectrum was packed is another huge understatement. Fortunately, the Spectrum Regulators approved our request to use the 403-450MHz portion of the band for our production two-way radios, as we were essentially banned from using the conventional 450-470MHz band. This change presented challenges for the prospective communications contractor when providing the quantity of handheld radios required by Ceremonies, as equipment in this alternate lower band is less common. I also recommended — after providing significant precedence — that the use of digital trunking systems was not the best solution at Ceremonies for several reasons; not least being the latency experienced when using handhelds in earshot of comms panels. All two-way radios had to fit into a space in the spectrum wide enough to accommodate 90+ channels of 12.5kHz bandwidth analogue carriers. As all the transmitters used in the base radio systems for duplex and simplex were cavity aligned; we could not place those frequencies any closer than about 300kHz. The use of analogue carriers also allows for faster fault finding, and resolution of frequency related issues.
The FM Broadcast mass cast monitoring system was the next to receive its custom placement. During events of this size (in particular Olympics Ceremonies) there is a system employed called the Mass Cast Monitoring (or Level 3 IEM's as it's known in the industry). It is essentially one or more FM Broadcast transmitters set up to provide coverage of the entire performance (and/or rehearsal) spaces. Every single cast member involved in the show wears a low-cost FM receiver and earbuds. This process mainly provides time-zero program to the cast, but can also be used to deliver choreography cues, instructions, or click tracks. In Rio, we used six FM transmitters for the main stadium, and four FM transmitters for each of the two rehearsal spaces. Due to the (once again) very congested 88-108MHz FM Broadcast band in Rio, we requested — and were subsequently authorised to utilize — a portion of spectrum between 76-82MHz (US VHF TV ch5). This allocation allowed us to obtain sufficient spacing between each of the 14 FM frequencies to compensate for the poor adjacent channel rejection exhibited by the low-cost FM receivers. A total of 12,500 of these FM receivers was required, so each receiver had to be as low cost as possible. The only way to ensure adequate performance in this environment was to expose them to as little other RF energy as possible, while maintaining reasonable channel separation. The ability to occupy spectrum so far from the normal Broadcast band was invaluable. It also prevented the Ceremonies rehearsal audio program from being exposed on a public broadcast band.
There was also a requirement to provide 3 FM transmitters inside the normal FM 88-108MHz Broadcast band for use by transcription services during the ceremonies. However, as these transmissions would be received on somewhat higher quality receivers (most mobile phones sold in South America are fitted with FM receivers), adjacent channel rejection for these services was not an issue. As such, we managed to shoehorn three FM transmissions into the crowded band.
Planning the spectral layout of equipment was next. It was obvious which position the two-way LMR systems would occupy; the same goes for other equipment with restricted frequency options and limited switching bandwidth. Telemetry systems used for various functions such as pyro firing and special effects control were all limited to the 430MHz ISM bands. Wi-Fi devices (however bad an idea) were fixed, as were government and security TETRA systems used in the venue. The DECT systems adopted for the digital full duplex comms systems had some latitude, due to the fact we could arbitrarily choose the DECT bands we would like to occupy. The DECT band varies from country to country somewhat, and most hardware options were available (mainly by programming) in any of the bands. FM broadcast band transmitters were assigned their own private spectrum space, so the only systems left to assign were the radio microphones and IEM systems, for both Ceremonies and Broadcasters. We only had the nine free TV channels between 470 and 700MHz to use, however, some of the 700MHz band was at our disposal.
Pictured Above: The Spectrum Landscape from 30 to 950MHz - as seen when entered into Shure WWB 6.12
A decision was made early on to allow 30+ channels of IEM transmitters to occupy the 700MHz spectrum. The one drawback of utilising this spectrum was the recent global trend toward reassigning this band for use by TELCO's. As such, the availability of equipment in this frequency band is becoming somewhat limited. It's not such a problem if you're only after 10 or 15 IEM receiver packs, but when the specification calls for 370 IEM belt pack receivers fed from 24 channels of transmitter, it's a little trickier. This drawback was outweighed, however, by the advantages of placing the IEM systems up in this higher frequency spectrum, away from the TV transmissions and the majority of radio microphones.
With the above all sorted, I had the remaining nine clear 6MHz TV channels between 470-700MHz to position 80+ channels of Ceremonies Production and Broadcasters radio microphones — plus any UHF 'BTR' style full duplex comms systems. Later, it was agreed to move the newer digital audio full duplex comms systems to the 1900MHz DECT band, which left more space for the radio microphones.
Calculation, Interference, & Intermodulation
It's now fairly standard practice (through a collective effort I've supported) to serve high priority spectrum users with the frequencies they need — within the limitations outlined by the regulator — before allocating spectrum to other parties. As the Olympics Ceremonies environment was a live global broadcast, live radio microphones and IEM's are considered the highest priority. Then in a decreasing order of priority; Ceremonies communications, rights holders' radio microphones and IEM, rights holders' communications, and then, Broadcasters radio microphones, IEM, and communications. Essentially, this allows the Ceremonies radio microphones and IEM frequency setup to be the most resilient solution possible. All other systems down the priority list are calculated AROUND each of the higher priority systems that precede it. As other systems (such as broadcasters' radio mics) are considered arbitrary, there is no preference given to its position based on usage. For instance, a broadcaster IEM (or IFB in the relevant nomenclature) is treated the same as a broadcaster radio microphone. At this level, they do not have the different interaction characteristics that form the basis of how we organise higher priority systems.
Once a frequency solution for the Ceremonies is calculated (considering all pre-existing contributors and the cautious inclusion of analogue TV), it is submitted to the Spectrum Regulator along with similar calculations for LMR two-way radio systems. From this point, all other frequency requests are then assessed, calculated, and provided to the applicant. Most often, the spectrum regulator will seek advice around the best way to calculate and resolve the applicants' requests, without compromising the integrity of the Ceremonies RF solution.
The process of calculating frequencies required to fulfill an event like this consists of several stages. The actual procedure is somewhat proprietary, and well beyond the scope of this article. However, the process is essential to provide a suitable and stable solution for this hostile environment. Any calculations must place a high emphasis on device usage at the frequency assigned to it. There are several ways to weight these calculations and allow segregation based on their usage. These processes allow for a more efficient use of the spectrum; some of them are outlined below, with advantages:
Spectral segregation | Utilising different frequencies in the same physical location at any one time | The most common and reliable form of segregation. The ability to monitor each carrier independently allows security. Carriers not part of an RF solution can easily be detected. |
Spatial segregation | Utilising the same frequencies in different physical locations at any one time | Used most often for solutions that have high numbers of carriers over a large physical area. Cross-contamination of segregated areas more difficult to detect. |
Temporal segregation | Utilising the same frequencies, in the same physical location at different times | The least reliable of all three methods, as it requires carriers to be turned on or off at pre-defined times. There is no 2nd level of safety for this form. Contamination is a high risk. |
* Standard IMD calculations are used in conjunction with the above weightings
The three different types of segregations above carry various factors of reliability, and can be used separately, or together with one-another, depending on the circumstances. Due to the relative proximity of the Maracanã to the other venues involved in the RF solution (such as the rehearsal venues), these calculation procedures required great care. For this event, no fundamental frequencies were re-used at any stage over the period of 4 months — except for the same piece of equipment used during each of the four Ceremonies. Only intermodulation products and their proximity to fundamentals were calculated with the three assessments outlined above; frequency, position, and time. The level at which each piece of RF equipment was calculated — in respect to fundamental spacing requirements and susceptibility to IMD — was very much tailored to each type of device, considering both transmitter based and receiver based IMD. Eventually the 270 odd frequencies for Ceremonies alone were submitted to ANATEL. From this point, the remaining 2000+ frequency requests from other users would be resolved.
It should be noted that a percentage of the frequencies requested by a good portion of broadcasters are what are known as 'land grabs'. Essentially, at the time of request, the broadcasters often don't know what equipment they will be using at the event. The easiest way to ensure they still have a choice of frequency bands when the event comes about is to make a request for multiple frequencies in all portions of the spectrum. This way, they will have access to licenced frequencies regardless of the equipment they eventually use. Even though there is a good percentage of frequencies licenced that will never be used, at the time of calculation, there is no way to determine which ones, and thus, the situation must be calculated assuming they all will be used.
Pictured Above: 'Fat Albert' wideband receiving antenna in London
Monitoring the RF Environment
Monitoring the RF environment, or spectrum 'landscape', was the priority upon arriving back in Rio by late May 2016. I took over three large pelican cases of spectrum monitoring equipment and antennas with me on the flight, and this, of course, attracted a bit of attention at Rio international airport customs. Opening the cases prompted the appearance of at least half a dozen customs officers all seeking explanations but lacking the English language skills to comprehend any of my technical explanations. In fact, the more I tried to explain what the equipment did, the more dubious it all sounded. Luckily, I had with me a letter of introduction from the Olympics Ceremonies organisers outlining the conditions of my 6-month work visa. This gave a little credibility to my presence, if not actually explaining what the equipment did. They seemed happy with this, and I spent the next half hour re-packing all my shit.
Arriving at the stadium a couple of days later, I began my search for a position in which to set up my analyser antenna. One of the most important things to consider when monitoring spectrum, is not the absolute amplitude of measurements taken, but the relevant changes experienced over time. The one thing that will ruin all your relative measurements is the re-positioning of your measuring antenna. I knew that I would not be able to find an antenna position that would serve me for the following 4 months of stadium set construction, lighting and audio build, rehearsals, ceremonies, and of course periods in between when the entire stadium is handed over to the Olympics sports. For now, any position that would get me through the build period, or at least until my larger, less portable antenna turned up in the sea freight, would be great.
I eventually set up the antenna outside a glass control room at the rear of the upper seating in Maracanã. This room was slated for use by the live ground announcers during the ceremonies. This position would allow me to monitor the spectrum over a significant period, and ensure that all the calculations I had done, and all the frequencies submitted and licenced, would still be good to use. For the next couple of hours, my eyes were pinned to the screen. If there was an unexpected and significant change in the spectrum landscape from what I had measured 15 months ago — or at least accounted for based on information from ANATEL — then we could be in trouble. By this time, all the Communications, Audio, and a handful of other relevant contractors had been appointed. All these contractors had provided equipment to fit tender that was in turn determined from the spectrum as known. It was this point where we'd find out how much had changed. Luckily, except for a few analogue TV stations that had shut down early, there was no discrepancy. Thank God.
The weeks passed, with very few remarkable changes in the spectrum landscape. Eventually the real monitoring antenna (Fat Albert to those who have been introduced) arrived in the sea freight from Sydney, and I went about finding a more permanent position in the stadium — one that would not be compromised from now until the end of the event. The antenna was placed in the upper rows of seating, directly in front of the Ceremonies control room. This was an excellent position, as it was high enough to be sensitive to any RF activity outside of the stadium, but far enough from all the higher power LMR two-way, IEM, and FM transmitter antenna positions. Nothing upsets a landscape scan more than several high-power carriers mixing in the front end of your wideband receiver.
Equipment and Policing
The equipment that I use to monitor the RF spectrum is nothing particularly exciting, nor expensive. I have found over the years that it's not how big it is, it's what you do with it. I have seen Spectrum Authorities bring very expensive AOA and TDOA receivers into these stadiums over the years, without the necessary skills to measure even a single carrier. Almost any reasonable spectrum monitoring device will be able to provide the information required to competently monitor the spectrum landscape. It's not about absolute measurements, it's about relative measurements. You don't need to own a wideband Bi-Conical or Discone antenna with a ruler flat bandwidth from DC to daylight, so long as you use the same antenna, in the same position, you will be able to detect changes in the spectrum.
The other thing is getting to know your equipment; is it deaf (has low RF sensitivity) at certain frequency bands? Does it have significant Image Response issues that need to be accounted for? Is the noise floor you are seeing measured or inherent? Once you are familiar with your receiver, you will be better equipped to know what is REALLY going on.
My weapons of choice for long term monitoring are not particularly expensive, nor are they difficult to use. I own two devices from the WinRadio stables in Melbourne, Australia. The first is a WinRadio G33WSM, which is probably the most common SDR (Software Defined Radio) receiver in this industry. It is an original Beta test unit sent to me by the guys at WinRadio almost ten years ago, and it's not missed a beat. The second is a WinRadio G39DDC, which is another SDR unit, but as an entire 16MHz of RF bandwidth is sampled in real time, it's capable of some amazing tricks.
Pictured Above: RF Monitoring screens. WinRadio receivers centre of image
One of the best things about both units (especially the G39DDC, as the RF, IF, and audio filtering is completely adjustable in real time), is the ability to monitor the audio that may be modulated on almost any carrier. Over the years I have seen a LOT of people — mainly spectrum police from local authorities — come in with very expensive fixed and portable direction finding devices trying to find a rogue transmitter. The thing about direction finding in a stadium, is the reflections can lead you on a very wild goose chase. Even with advanced Time Difference of Arrival (TDOA) devices. These RDF systems have their place in closer proximity, and I have used them on many occasions. The best procedure I have found for finding a rogue transmitter is not to physically go searching for the RF carrier, but to listen to the carrier. You can find out so much information about the transmitter from the audio demodulated from its carrier, and even the carrier itself.
Are their people talking on this carrier? Are they reporting the news? Can you hear the event PA system in the background? Can you hear anything that might give away who they are, and where they are transmitting from? Now look at the carrier itself – does it have side-tones, subcarriers, or audio tone-keys that give away the type of transmitter? Is the carrier on a frequency that suggests a brand or model of transmitter (if the carrier is on a 100kHz frequency step, you have a better than 4:1 chance it's a Lectrosonics). If there is a 19kHz pilot tone, then chances are it's an IEM/IFB unit. Most equipment has a signature that gives them away. Even determining the brand of the equipment will go a long way toward who might be using it, and where they might be.
Another trick I use often when tracking down rogue transmitters, is to use all the receivers at your disposal. If the rogue transmitter is on a frequency that your radio mic system is capable of (there is a very good chance your system is, as this is probably how you detected its presence in the first place), tune in one of your receivers. Even if you get no audio, knowing the signal strength indicated by the receivers' antennas, and the type and orientation of its antennas will give you a lot of useful information. Olympics ceremonies use multiple receiver 'nodes' positioned about the stadium for redundancy. These all have their own directional antennas, in different positions around the stadium, all pointing in different directions. A Lot of position information will be revealed by these different antenna/receiver positions.
The one thing to remember when put in charge of spectrum — either from a spectrum planning, or monitoring and policing perspective — is that most people you find who are using incorrect frequencies won't even know. The last thing you should do is to track them down, and turn up with a handful of analysers and licence listings while reading them the riot act. Most of the time, they are completely unaware of the frequency their kit is using, and even more unaware of any spectrum planning in place. 9 out of 10 people I have found in this situation are happy to be educated, and will do as you ask; a good portion will ask for your help. There is no better option than to ask them if they would like to be given a suitable frequency to use. After all, if you include them in the plan, it's better for them and you. Get their phone number, get them to call you if they have any issues, and most of them will become another set of eyes for you. After all, any other rogue transmitters have just as much chance of hitting them as they do you.
When I do a spectrum solution for an event — even one that does not necessarily attract the services of the local Spectrum authorities — I always include a handful of the most popular bands used for Broadcaster and ENG equipment in the frequency solution. This way, I already have a pool of compatible frequencies to hand out. This simple additional has saved much time and effort on so many jobs. Most of the broadcasters that are recurring on these events often drop me an email long before the event to obtain the situation on spectrum availability, and often ask to be included on my solutions.
Walk Tests and System Performance
Once the spectrum plan is in place with all the RF gear installed and running, the next thing to do is ensure that you have enough coverage for the event.
During an Olympic Ceremony, coverage tests used for the various types of equipment vary greatly. The one type of equipment that is afforded the most time for coverage is the two-way radio system — for no other reason than it is expected to work everywhere. Literally everywhere. The audio quality requirements for coverage are thankfully not as critical as a radio microphone or IEM, however. Two-way systems are only ever used for band limited speech, and the background noise floor is not too much of a concern. The key to obtaining good coverage of a two-way system using a simplex or semi-duplex base is antenna type and placement. In most Ceremony based two-way radio systems, a number of semi-duplex and simplex base radio repeaters are located in a room somewhere. The transmitters for these repeaters are combined via various methods into a single TX antenna. This antenna is then placed in a prominent position that compromises between height (to provide good coverage), and distance from the transmitters (to minimise cable loss). Similarly, the Receivers in the repeater system are fed from an RX antenna through a series of filters and distribution. Once a suitable compromise is obtained for the TX antenna, and suitable antenna is chosen, the RX antenna is then placed with suitable spacing from its transmitting brother.
The system is then walk tested to ensure sufficient coverage of both TX and RX. Hand-held radio reception can be somewhat massaged for best performance by changing the output power of the associated base transmitters, within reason. However, the performance of the base radio reception is somewhat dictated by the limited output power of the hand-held radios themselves. Minimal adjustments can be made to the hand-held transmitter power in this instance, so the difference must be made at the base receiver. The simplest way is to increase the natural gain of the antenna, however you run the risk of narrowing the beamwidth of the antenna and 'overshooting' the required coverage areas. The next requirement is to reduce the noise floor to the receivers. This is accomplished by fitting filtering to the receivers. As noise is proportional to bandwidth, any narrowing of the bandwidth admitted to a receiver will decrease the noise floor — allowing the weaker hand-held signals to be received.
The second most important coverage test is that of the performance systems – the radio mics and IEM. In the context of an event like this, it is common practice to allow the use of higher power carriers for the In-Ear Monitoring systems, even though it may not be required. Most spectrum authorities will allow the use of higher powers, or more commonly, higher gain antennas to improve the ERP. Therefore, the field strength on the performance area is increased. Rarely have we not had the ability to encompass an entire stadium with perfect coverage through the use of correct antenna alone. Use of suitably wide-band, low IMD, high IP3 combiners and amplifiers, along with high-gain antennas suited to a stadium will allow you to set and forget, and concentrate on the more important coverage tests – radio mics.
This is one area of RF where you really need to get things right. If one performer gets a dropout in their IEM, or if a stage manager ends up having to repeat something on the two-way, there is only one person whom this affects. Get even a single dropout or artefact on a radio mic during a live event broadcast to the entire planet, and everyone notices. Even the person holding the mic, because their IEM is perfect.
There is no secret to obtaining perfect radio mic coverage, especially in an extremely hostile RF environment such as an Olympic Stadium filled with 80,000 iPhones all looking for Wi-Fi. There is not one single piece of hardware, procedure, calculation, or advice that will provide you the key to perfect coverage. It is the combination of ALL these things, even in the smallest quantities. Certainly, correct spectrum management goes a long way, but absolutely everything must be considered; antenna position, type, and filtering, preamp gain, cable type and length, RF distribution and patch, receiver type, and transmitter power. All the small changes that may seem trivial add up in a BIG WAY in RF!
I will spend hours, and sometimes days contemplating, installing, and sometimes arguing with technical management about the positioning of radio mic antennas, it's that important. Entire audio system designs have changed due to the decision that the location of the radio rack is just not right. Sometimes I spend hours playing with different filters on antennas to gauge the impact on the noise floor in a system. I can easily spend an hour going around cleaning, and tightening up the grounding 'fingers' inside all my BNC and N-type connectors. This process alone can improve some systems beyond belief! Other examples include, the very simple act of placing all the higher frequency band devices earlier in a cascaded distribution system — or assigning body pack transmitters lower frequencies in lower frequency band equipment to minimize absorption. All these things add up.
However, probably the most important contributor in obtaining good RF performance, and this applies to almost all RF devices and not just radio mics, is transmitter power levels. My main goal in this respect is to use as little power as possible to obtain the coverage you need. No more.
Radio Mics – I could count on one hand the times that I have used a high-power setting on a radio mic transmitter. If you can't get the coverage through receiver antenna choice, placement, and gain, then there is something wrong. Save the high-power settings for the transmitter that gets buried under 10 layers of costume, or gets fitted to the guy who naturally absorbs all the RF on the planet. This just brings it into line with the remainder of the transmitters in use.
IEM – Often, the power output of our IEM combiner and amplifier systems is lower than the power output of an individual IEM transmitters connected to it. Its most often the antenna gain that does all the hard work for you, and its noise free gain.
Two-way Radios – the last system I designed, as used in Rio, had less than 5dB loss from any transmitter to the antenna, and it was combining the outputs of over 40 transmitters. Each transmitters output at the antenna equated to 800mW of conducted power, and was enough to cover the entire stadium from top to bottom.
All these systems worked with such low power, because they were not fighting each other. During the London 2012 Olympics Opening Ceremonies, the wideband noise floor increased an average of 22dB on the night of the Opening Ceremony. Rio's Opening Ceremony saw a noise floor increase of less than 10dB. Higher power does not improve anything, and should be used as a very last resort.
Pictured Above: Two-way radio combiner system
[caption id="attachment_6545" align="alignright" width="198"]Redundant IEM Amplifier Systems[/caption]
Working on these events over the period of 16 years has also allowed us to develop some serious RF toys for use with radio microphone and IEM systems. The name of the game with these events is redundancy. Apart from the practice of backing up the radio mic receivers with duplicate receiver positions in different parts of the stadium, there is a couple of aspects of a standard radio mic receive chain that presents a minimal, but present risk to a live performance. That is the distribution network. In most receive systems, the multitude of receiver channels are fed from a single antenna pair through a masthead amplifier that is powered by a single distributor, and in turn powered by a single power supply. If this single power supply fails, you lose all distribution and amplification to your entire suit of receivers. This scenario may sound unlikely, but it happened to me during the Singapore National Day Parade 2008. The switch mode PSU in a distribution amplifier overheated and failed. No backup, no RF, from ANY receiver. A distribution unit was subsequently built to overcome this situation. It is an 8-way device to allow the larger quantity of radio microphones to be used (8 pairs of outputs feeding 8 distribution amplifiers feeds a lot of receivers). It has the facility to accept a redundant set of antenna inputs, which automatically switch by detecting a change in the nominal impedance or power consumption on the main antenna feedline. Best of all, the distro is powered by accumulating all the +12v bias voltage from every device connected to it. The unit itself has no PSU to fail, and would require the failure of every device connected to it before the unit stops working. It has been in operation since Vancouver Winter Olympics in 2010.
We have also developed some clever automated redundancy systems for our IEM distribution systems that allow the failure of up to about 85% of the distribution chain, including two-thirds of the antennas before the RF stops.
In Practice
The role of spectrum management at an event like this a complete job in itself. It's very different from being the RF Engineer and operator of all radio mics and IEM for the audio contractor. However, I was lucky enough to be spectrum manager and RF engineer for the Rio 2016 Olympics Ceremonies, and taking on both roles improved efficiency. I essentially prioritised my time toward spectrum management until the rehearsals were well underway, and then the focus moved to radio microphones and IEM. I kept an eye on the spectrum, but by this time I had become very familiar with what was out there, and any changes were noticeable. One occasional occurrence — in respect to the spectrum management role — was being asked to find spot frequencies for people who had a legitimate requirement, but their spectrum requests had fallen through the cracks, or they were returned with unsuitable frequency allocation or step sizing. However, considering the number of original requests made, and the number of real users occupying the spectrum, these requests were few and far between. All in all, considering how packed the spectrum was before we even started, it was a remarkably smooth process.
As far as two-way radio frequencies go, no changes were made to the solution at all, and this meant no re-programming of the hundreds of radios in the field. All frequencies worked as expected for the entire 4 months. A couple of channels suffered slightly with some IMD created from a nearby high power TETRA installation, but once we had the power of this TETRA base reduced, they came good again.
All radio microphone and IEM frequencies worked well for the entire event also. One radio microphone frequency was quarantined due to a slight amount of interference when its transmitter was taken into the dressing rooms under the seating, but other than that, they remained clean.
All the Mass Cast Monitoring FM frequencies performed perfectly, however this should not have been a surprise considering they were given their own spectrum. All the Telemetry, Pyro, special Effects, even Wi-Fi gear all performed without any drama. There was some digital transmission audio equipment that had some issues, but it was not spectrum related.
About Steve Caldwell
Based in Sydney Australia, Steve is the Technical Manager and RF engineer at Norwest Productions. He was the RF Consultant and Spectrum Coordinator at Rio 2016, and also played a fundamental role in the successful coordination of an ambitious wireless setup at London 2012. Read the interview with Steve Caldwell to learn more.
Shure UK
Ignite is a resource created by Shure to raise the profile of sound across all aspects of personal and professional life. Through the expertise and insights of Ignite's regular contributors, you will find helpful info, hints, and tips for better sound.