I've rented some of these lines as part of a financial trading infrastructure.
What's immediately obvious is the line is much faster than going over the public internet, and there's no jitter: every time you ping it comes back in the same amount of time, whereas the internet pings will vary by several ms.
You also become acutely aware of cable breaks. Somehow this happens quite often under the English Channel. The network operator will start sending you emails that say
>You also become acutely aware of cable breaks. Somehow this happens quite often under the English Channel.
You're not lying. :) When the internet is down in the ROI (Republic of Ireland), it's always because something was dragging along the seabed and cut the cable[s].
Given that the ROI doesn't have many IX's for international connection[0,1,2], it's quite hard to miss when it does happen.
I had always had the illusion that Ireland was well connected to US and EU. Given how many tech company have Data Centre in there. Quite Strange its IX isn't as good as it could be.
Off Topic:
Is the short form (Republic of Ireland) ROI used often? Because the first thing that springs to mind reading ROI is Return of Investment.
Isn't Ireland short enough as a word? I understand there is Northern Ireland, but people will actually put Northern In front of it to be specific. Like North Korea instead of Korea.
It's a good way of easily differentiating between whether you're talking about Ireland the island, or Ireland the country, which currently excludes the six counties of Northern Ireland (NI) which are still part of the UK.
The term Ireland is often used to refer to the island as a whole, but obviously this can depend on the political leaning of who you're talking to.
Northern Ireland, depending on context and/or who is speaking can otherwise be referred to as Ulster (problematic, as the province of Ulster has 9 counties, only 6 of which are in Northern Ireland). It is also common in some circles to refer to the 6 counties currently occupied by the British simply as "the north".
In short, Ireland is a hot geopolitical mess and when talking about Ireland, it is useful to be as specific and as neutral as is possible.
> The five most recent opinion polls taken in the North show similar results, with support for the North staying in the UK ranging from 45 per cent to 55 per cent, and averaging around the 50 per cent mark. [0]
Way closer than you think. (Using desire for a united Ireland as a proxy here)
You're not wrong. There is a loyalist majority in NI. But those that would refer to Northern Ireland as "the north" would generally be among those that definitely would refer to the six counties as occupied.
Ireland is the same length as America, which people often abbreviate to USA or US. This also cuts the confusion of America's multiple potential meanings (North/South continents, etc).
Its a touchy and pedantic subject. 95% of people will understand what you mean when you say "Ireland", the last 5% will want to start a flame war over it because reasons.
It's easy to remain oblivious and treat any mention as pedantry when you're not among those affected. Even if 95% of people are like that, denying their reality is still a form of soft bigotry. Here's an essay that might help to explain why some people care more than you do, and rightly so.
I understand what you're saying, but it's not just pedantry.
You do have to be specific about what you mean when you say "Ireland" in any context where it is important that you are understood.
"Ireland" can quite correctly either mean the island of Ireland or the country called Ireland (aka The Republic of Ireland). In a political or business context you are likely to be specifically referencing one or the other.
That wasn't the question ksec asked though was it.
"Off Topic: Is the short form (Republic of Ireland) ROI used often?"
But also no. Cables landing in ROI would be under completely different regulatory control to cables landing in NI which would be under United Kingdom regulatory control.
Since they're geopolitically separate and have their own infrastructures, the distinction is quite apt for understanding the "who" of who is impacted when the specific cables are cut.
In other words, based on your assumption that "Ireland" is precise enough and since Belfast (NI) has it's own IX, that would mean that you would have dichotomy where "Ireland" could connect to the internet and "Ireland" could not, yeah?
>"I've rented some of these lines as part of a financial trading infrastructure."
Unless you were lighting that fiber yourself you were renting wavelengths and not the physical fiber.
>"What's immediately obvious is the line is much faster than going over the public internet, and there's no jitter: every time you ping it comes back in the same amount of time, whereas the internet pings will vary by several ms"
Jitter is caused by congestion which happens at router interfaces. The absence of jitter is not due to the use of dedicated submarine fiber spans per se as the speed of light in fiber is a constant. What you are likely seeing is the result of a network operator who has optimized for low and consistent latency by having fewer hops in their network before and after the cable landing stations.
You're unlikely to rent the whole thing so it just depends on how much bandwidth you need. If it's only a couple of TB per month it's not that expensive.
Maybe it is expensive. They could be seeing "trading" and charge more because those folks have deeper pockets. Like how the DLSR industry is suddenly charging astronomical prices when the feature set of their devices is for cinematographers.
Edit: Why the downvotes? Adjusting the price to how much the customer is ready to pay instead of just offering the cheapest possible price is usual business practice.
It depends on what you want. Starts at maybe a couple of thousand bucks a month I would guess, I haven't looked for the cheapest in the market. Depends on the link and availability and so on.
One thing I’ve consistently noticed is that a “network” can tell the tale of natural or man-made disasters in terms of how it first manifests in alarms and breakage in various systems, the human response manifested to respond to it (sometimes across many national boundaries), culminating with the sometimes peculiar “hacks” and temporary solutions conjured up to restore connectivity. The network sees everything and no one ever tells these stories in any meaningful detail.
General purpose computers networks and software are far from optimal for high speed trading. A few years back ACM Communications published a comprehensive white paper of trading communications bottlenecks including the effect of virtual memory page faults and TCP/IP collisions. Dedicated trade networks want custom software without virtualization features. Or if you dont want to develop that much, use the ancient real time UNIX NASA has in its space probes like VxWorks.
In a few weeks there is annindie film called The Hummingbird Project about avrace between firms to build the fastest dedicated trading line.
The book Flash Boys by Michael Lewis covers HFT in general and a similar fiber optic line built by Spread Networks in 2010. It's definitely a fascinating world.
There is some discussion to be had as to whether there are other sections of water that are more active and have been for some years, but even if the channel isn't the busiest it is certainly very busy.
-Educated guess is that cargo vessels aren't much of a problem. Anything dropping anchor, dredging or somehow doing stuff on the bottom, on the other hand...
Further, I'd wager that initially buried cable in the Channel often is exposed on the bottom due to strong currents, rendering it more vulnerable - but this is just a guess, mind.
I have a certain admiration and appreciation for this sort of thing, and every article that describes how the internet is physically interconnected.
Having seen internet connectivity in India slowly grow from only satellite-based connectivity, to having private internal interconnecting hubs within the country for bandwidth providers and ISPs to reduce latency, then news of every new submarine line improving bandwidth and latency, thereby reducing pricing. Going from getting 135ms - 200ms via dialup locally, to getting 60ms to Singapore and Hong Kong while playing Counter Strike and Quake 3. It was such a high!
Each development was so critical and it brought me great joy, and excitement. Still does!
If anyone is interested in a really well written travel essay about how one of those cables was installed in the 90s, this one never seems to get old: https://www.wired.com/1996/12/ffglass/
Cryptonomicon really hammered home how very much we depend on undersea cables to power the internet. Great read for those who have not had the pleasure. Plus you get to learn something.
I have a quite good book on the shelves on the very same subject, but I am unable to locate it at present.
For a slightly wider take, Arthur C. Clarke's "How the world was one" is a most readable account of how telecommunications has made the world smaller, starting with the first submarine cables, proceeding with satellites (of course he would!) before devoting a section to fibre optics at the end. Brilliant account.
There is a museum on the cape cod massachusetts called the "French Cable Station Museum", that has a lot of the old euqipment used back to transmit telegraph data from Europe to America. Its not open year round apparently.
I did the tour a few year ago, run be retired engineer who was enthusiastic and excellent at explaining the difficulties in getting it all working.
For more on the history of the telegraph, I recommend The Victorian Internet by Tom Standage, which also covers in detail the laying of the first trans-Atlantic cables. Fascinating stuff.
Can't tell you the number of times I've had someone insist that the internet was on satellites.
Using terms like "the cloud" and with everything bring wireless definitely doesnt help with people's misconceptions.
Even after I carefully explain that the internet uses under sea cables and generally either buried wires or above ground stuff I get dubious looks they say "yeah, right. You're probably just confused..."
I’ve blown a few minds explaining that the Internet is delivered via light, sent through very long fiber optic cables under the sea.
I thought this was common knowledge until the first time I explained it, and the disbelief... Everyone had a revelation that day.
I always knew about fiber optics, growing up with dial up and dreaming of one day having a fiber connection. But I guess now that everyone is focused on mobile that piece of infrastructure is abstracted from even reasonably tech savvy people.
I recently visited friend at his lab. I cannot say much but they work on patent for something he calls “pantone fiber”. Basically within one cable they are able to squeeze about 16,000 different shades of R/G/B “working” next to each other. When I grasp the idea it blew my mind - he looked at me and smiled saying - “yeah about 10,000 times faster than current fiber”. He said two things tho - one state of tech is not ready for such speeds and latency - unlesn you have 16K def TV. Second he said they wont release it until much more cable has been layed out. So that of course they can restart relaying new cable again and make more $ ;)
Did your friend say 10,000 times faster or 10,000 times bandwidth? By using different color simultaneously , you can stuff more data but I can’t imagine it becoming faster than speed of light it already travels at.
While you're technically correct, isn't it pretty much an accepted fact that when people refer to the "speed" of internet, they are actually talking about bandwidth?
E.g. "how fast is your internet", etc.
It's of little value to the end user to know how fast a bit travels, all they care about is how fast they can download.
I asked this question to a class of smart 18-19 yo college students a few years ago. Almost everyone thought it was done with some kind of wireless transmission (e.g. "by satellite"). The idea that it was physical cables lying in the mud of the sea bed was a revelation.
I distinctly remember "learning" this in K12, before getting deeper into the technology industry. One of our textbooks had a diagram with lines showing signals flowing from continent to satellite to continent. It wasn't until I got deeper into the industry that I learned satellite latency is awful, bandwidth is limited, and everyone uses cables or microwave point-to-point links when they can. (Actually, the role of those point-to-point links is drastically undersold for how ubiquitous they are in our cities. Worked with some Ubiquiti gear professionally once, and now notice them everywhere).
It's actually a very reasonable assumption, as most people don't really know about the limits of fiber, but they do own mobile phones which seem to work almost wherever they are thanks to wireless technology.
"Normal" people don't know that kinda stuff.. Let's be honest, they make many of their assumptions from TV and Movies - and often those disaster movies focus on the world grinding to a halt because "the satellite network is down" (I do the same with other industries!)
>Inside the ship, workers spool the cable into cavernous tanks. One person walks the cable swiftly in a circle, as if laying out a massive garden hose, while others lie down to hold it in place to ensure it doesn’t snag or knot. Even with teams working around the clock, it takes about four weeks before the ship is loaded up with enough cable to hit the open sea.
How is that not automated? I cant believe that companies would rely on humans doing a boring and repetitive task without error for weeks on end when a single error could cause double digit percentage of time at port. Is this is just such an uncommon task that automating this wasnt worth the time saved at port?
edit: Even in the picture in the article you can see a single worker has removed their shoe covers that all the other employees are wearing[1]. Doesnt that degrade the cable right there?
I work for a company which make the full deployment line for submarine cable laying ships; first time I visited one -Incidentally, a sister ship of the CS Durable referenced in this article- I wondered about the precise same thing you did, beginning to sketch solutions in my mind while looking down into the tanks.
A supervisor comes over to me and says something like "I can see what you are thinking. There's no use - it is cheaper this way."
The point was that while the ship was in port taking on cable, it was fully manned anyway. Crews need something to do - so might as well stow cable.
That's our kit in the topside photos. Small world!
) We do all sorts of other things as well - relying on cable laying alone would be too much of a niche market!
I guess that depends on how fast you can make the cable; I have no idea how that pans out - but the cable is put onto the vessel straight from the production line (which, I guess, may have had its speed optimised to the speed at which crews can reliably put down cable.)
I am now curious; I'll fire off an email with a few questions to my liaison at TE SubCom. With any luck, answers arrive in time to be relevant to this thread.
The cable will never again have the rest of the cable on top of it. I'd be slightly worried about sand/dirt facilitating chafing/abrasion in the outer layers of cable on its way to its final resting place. Shoes shouldn't be an issue as long as you can keep mud caked work boots out.
This is so neat! Few questions though, if anyone can answer:
1) The cable still looks pretty thin, is it being housed in some sort of protective layer/tube before it is laid? Seems like an anchor snag could easily break that line. If that happens, is it possible to 'patch' a fiber cable?
2) Once it nears the coast, how deep is the line being buried?
3) This may be a dumb question (I'm no engineer), but does the light travel from the source all the way to end without any "relay" mechanism?
4) How much bandwidth can travel through one of these lines?
1) The fibre pairs are housed in multiple layers of armor to protect against the elements, supply power to inline amplifiers and -most notably- provide the structural strength needed to survive being deployed. Outside diameter is still less than one inch, though.
2) Depends, but a metre or two (tops!) would be the right ballpark.
3) Not a dumb question; while loss in fibre optic cable is very low, repeaters are installed at regular intervals along the cable. they are powered by high-voltage DC supplied through the cable armor. The ocean acts as the return path.
3) is wrong. The amplifiers are powered by DC, but one side of the fiber provides positive voltage and the other negative - the ocean is not a part of the circuit.
I was under the impression that cable systems are best understood as constant-current systems. As a side effect of this, they can withstand a power failure at either end, in which case the ground path is part of the circuit. (Essentially "single rail" operation.)
If nothing else, both ends still share a common ground reference, yeah?
-You are right; I just looked it up. I guess (not that it makes much of a difference!) I picked this up from a book on earlier days of submarine cables.
>"3) Not a dumb question; while loss in fibre optic cable is very low, repeaters are installed at regular intervals along the cable. they are powered by high-voltage DC supplied through the cable armor. The ocean acts as the return path."
That's incorrect, amplification is done via Erbium doping, it is part of the core of the cable. There are no external repeaters.
So to clear this up a bit.
EDFAs (which are the in-line amplifiers which use erbium doping) work by having a section of a fiber doped with erbium ions. Only the part which is going to amplify the signal is doped, the rest of the fiber is supposed to be as clean as it gets.
Those erbium ions get shot with a laser (that's the part that needs power from the shore) and get excited. The source signal then hits the ions, which then emit more photons of the same exact properties, but just way more of them - therefore the amplification part.
Continue 80km down the line, and the same thing has to happen again, as enough light has been attenuated.
I mostly work with land systems, where the EDFAs are pieces of equipment completely separated from the fiber - you get a normal strand of fiber dug into the ground, and once you want to amplify it, you've got to plug it into an EDFA line card with the erbium-doped fiber already contained in it.
In the sea, those systems are way more integrated and the fiber is usually spliced right into the amplifier.
I might be able to dig up a card tomorrow if you're curious as to how the system looks.
1: I think they don't put that thin cable on the seafloor, they are bunched together, in a much bigger cable with a lot of stuff around it [0] to protect it.
About the patching, they say that in the article: they sometimes cut the cable (in case of a bad weather) and attach it to a buoy. So they can "patch it" ;)
1) The fiber is pretty thin, but there are several fibers combined in one transoceanic cable, see here https://en.wikipedia.org/wiki/Submarine_communications_cable. They don't patch them, but splice the fibers. Patching introduces a little loss, so it should be avoided.
2) Not sure how deep they are buried, but I think to remember that the shore end of a submarine cable is better protected than the part in the deep ocean. Due to more ship traffic at the coast etc.
3) Good question. The loss of an optical fiber is roughly 0.2 dB/km. Across the ocean the optical signal must be amplified several times (every 80-100km). Nowadays the amplification is all optical (EDFA or Raman). Before there were electrical regeneration schemes. Check out the history of the field, it's is quite interesting [1].
4) Not sure how much data such a cable can carry, since it depends on how many fibers are deployed within. However, there are multiple interesting things to look into here. In research labs, people are investigating multicore/multimode fibers (space division multiplexing) [2], these fiber have incredible capacity. Personally, I think the most interesting metric is the spectral efficiency, so how much data can be transmitted per second per Herz. Such a metric is independent of multiplexing schemes over space/wavelength/time, and improvements have to come from better devices, signal processing or signal shaping methods [3]. Another mind-blowing area is using the nonlinear Fourier transform for better signaling methods [4].
Feel free to ask more questions :)
and checkout the two biggest conferences for more in depth info.
With a degree in Optical Communications, are you trying to go into Optical Engineering or pursue further education in academia? How is the salary for the engineer compared to software?
I received my PhD in December, so I already pursued further education. My masters was in telecommunications, starting my PhD with a background in signal processing/information theory rather than optics/physics. All the master students I supervised either had similar background like me or an optics/physics background. That said, optical communications combines multiple disciplines, which makes it so fascinating, and I think that a PhD is inevitable if you want to pursue a career here. There are so many steps to understand to get from bits to electrical signal to optical signal and all the way back to bits. I don't think a masters degree can cover all of it in depth. Further, a PhD is in particular helpful due to the conferences where all the big players are looking out to hire you, or where one meets senior researchers for potential postdoc positions.
Salary-wise it's difficult for me to answer, as most of the big industry players are in the US or Canada, but I'm in Europe. From hearsay a fresh PhD with reasonable publication list will get around 10k per month in the bay area. However, glassdoor might give you a better idea. Look for companies like: Infinera/ciena/acacia communications/juniper/mellanox/finisar/keysight...
After my PhD, I probably could have pursued a postdoc somewhere in Europe, but I decided to leave academia. I wanted to stay in Copenhagen and therefore had to change my field of work and will be working for a hearing aid company in their signal processing department.
Make window fullscreen, press Windows-G on a Windows 10 computer with halfway good graphics card. Pump it into VLC and crop away the stuff you don't want ... and profit? :-)
That animated image is made up of a canvas background of the world and an SVG foreground of the cables. Both are created using js from downloaded json data, ne_110m.json and fusion-cables-2019-02-27-simplified.json. Quite tough to get that into something that's not using pixel graphics and self-contained (aka only displaying the stuff in the page).
I'm on an iPad at the moment so I can't give you a direct link to any videos, but search for Hibernia Atlantic on Youtube. They have some short videos showing how the cables are laid, repaired, and so on.
I don't think it's right to say data is in the ocean though. They are stored in datacenters on land. And they travel through the ocean. Unless when we start putting more of these datacenters in the ocean like how some company has been experimenting with.
Aside: Is it just me, or do others find animated charts annoying? It takes me time to understand what's being shown, and before the realization has sunk in, the graphic restarts causing the whole mental process to restart. Rather like a strobe light.
Agreed. I'd love to examine the map as of today, or 2021, say, in some detail and whoops - it's gone. Wait for it, wait for it, wait for it, there - aaaand gone. No controls to stop it or skip to a specific year. Very annoying.
Orange is a big player on this market, probably thanks to the fact that (as another user mentioned) Alcatel is one of the largest manufacturer (both historical french companies).
You can follow Jean-Luc Vuillemin [0] on Twitter for very interesting pictures of ships laying cables around the world.
One of the largest undersea cables plant is Alcatel in Calais, France (Dover straits). The factory is linked to the port by huge tunnels under the city. Unfortunately the Wikipedia page is only available in french but contains nice pictures[1]
I wouldn't say they're that hidden. Marea (MS & FB trans atlantic cable) has a nice promotional site with videos and suchlike: https://news.microsoft.com/marea/
When I went to Fiji a few years back I was astounded by the quality of the internet considering we were in a remote part of the South Pacific. Turns out Fiji is a "layover" for all the underground cables coming from the US West coast to Australia...
Nice visualization at the intro on desktop+. I wonder if Rich Harris and his team were behind it? See recent changelog podcast featuring Rich Harris on being 'a javascript journalist'[0]. Harris is author of the 'magical disappearing UI framework', svelte[1].
Interesting stuff. Just as important to education as "how to make a car" was 50 years ago.
Things not covered in this article:
Expected carrying capacity?
How much dark fiber (initially unused capacity)?
How much extra cable is required to make sure it stays on the bottom even when going over oceanic mountain ranges?
How much of the ocean-floor survey data is open, how much is proprietary, and how much is (military-style) secret?
Is there any sabotage?
Do nav charts warn about these things?
> Last year, Australia stepped in to block the Chinese technology giant Huawei from building a cable connecting Australia to the Solomon Islands, for fear it would give the Chinese government an entry point into its networks.
I don't really understand this move. Surely the way that the Internet is designed, you can connect any network to any network. Why would this be any different with a physical cable in terms of security?
kinda funny that the headline reads "Russian Spy Submarines Are Tampering with Undersea Cables" while the article does not provide actual evidence that Russian Spy Submarines Are Tampering with Undersea Cables. maybe they were just trying to sow discord into the cables.
Interestingly I was just thinking about this the other day, and hoping that someone here would have the answer. I'm really curious what is the total bandwidth per second across different continently globally without accounting for intra-continent bandwidth?
That's exactly what I was thinking as well. And what's more, it seems like they are laying more new cables than what "public" infrastructure is, going forward.
That can literally mean GooFaceAma has better global performance than competitors. Or that competitors will be forced to get hosted on one of those cloud providers to get similar performance.
It makes me feel a bit worried that "the internet" is not as neutral as I would like it to be. (Or that I thought it was before)
Weird, the article always mentions Google, Facebook, Microsoft, and Amazon, but then once at the end in a footnote does mention "Apple, Google, Microsoft or Netflix".
I'm left wondering whether it's Amazon or Apple or both that own some of those cables.
What I find fascinating is that they also have many repeaters given the massive distances covered by these cables so they need to provide electricity through the cables on such long distances.
I remember discovering them when I was young and thinking how mundane it is. I also thought that satellites are a integral part of the internet just like the TV network.
What happens when they reach the edges of tectonic plates (like in the middle of the Atlantic)? I'd imagine the heat would melt the cables quite easily.
Unlike data cables which cary information with a voltage, fiber optic cables carry information through light impulses. An advantage being that light is not susceptible to electromagnetic interference or radio frequencies. Having multiple fiber optic cables next to each other doesn't cause any issues.
The electromagnetic interference between cables is the reason why you shouldn't wire a house with data cables and power cables next to each other.
I think his thoughts are more like "what if you need to do something with the cable that lays under the other one?" At least that's what I'm wondering about. ;-)
I'm not certain but it seems if two wires were crossing and you absolutely needed to move the one under you could cut the wire and fusion splice[1] the two ends together afterwards.
When people colloquially say "speed of light" it understood to mean the speed of light in a vacuum. Light travels slower the higher the refractive index of the medium its travelling through. Saying "nearly the speed of light" indicates that the light is travelling through a medium with a refractive index very close to 1.
To say that light travels at “nearly the speed of light” in any medium is a bad choice of words. Also with refraction coefficient of 1.40 - 1.45 in fiber, the term “nearly” is not appropriate if the intention was to compare with vacuum.
Fiber optic cabling won't transmit at the speed of light due to the refractive index of the medium. So it's slower than the speed of light in a vacuum or atmosphere.
The first undersea cable was laid in 1858 and what's funny is the two guys on either end couldn't agree on voltages and currents etc. and would destroy each other's equipment. It seems silly until you remember that the only way they could communicate is via post, which took 7 days, or the very cable they were working on.
What's immediately obvious is the line is much faster than going over the public internet, and there's no jitter: every time you ping it comes back in the same amount of time, whereas the internet pings will vary by several ms.
You also become acutely aware of cable breaks. Somehow this happens quite often under the English Channel. The network operator will start sending you emails that say
- Cable break detected
- Loading ship (can take ages)
- Found the break
- Patched it
- Back up
Occasionally bad weather would delay it.