1

no_mpls.png
no_mpls.png800×561 171 KB

That’s right our ISP and MPLS provider is down! Can’t even contact them as their phone line is down (guessing using VoIP).

And before people mention Backup lines etc, we are in mid wales so lines aren’t cheap or reliable. :slight_smile:

But we will be looking at redundant solutions once FTTC arrives in the local exchange (hopefully in the next 6 months).

53 Spice ups
2

Oops!

3

Been there, done that, look busy so the boss doesn’t think you don’t care :wink:

As far as cost effective links, have you looked into cellular as an option? If only for your main site and just for essential users

2 Spice ups
4

Shit. Single point of failure - maybe something to look at sorting out once you’re back - one of those DR/BCP projects. :frowning:

1 Spice up
5

Didn’t think of SPOF with MPLS.

Check the SLA.

6

No chance with cellular :slight_smile: don’t even get full 3G speeds in the hills :slight_smile:

@oliver - yeah once back up we will be checking the options :slight_smile:

At least out access to the Dynamics system is nice and quick as over half the traffic on the server has disappeared lol.

We have always said “we will be in shit if the Fibre fails” but never thought the ISP would fail completely

2 Spice ups
7

High Level Network Issue. So a main connection to the backbone blah blah blah is having routing issues/or Dead.

8

Been in a similar position at a previous company, although I was able to contact our ISP. After about 3 hours waiting for an engineer to do some diagnostics, it turned out the it was the Fibre tails in the termination box in our server room which had failed, which is apparently extremely unlucky. But it might as well have been the entire ISP, as the fault started at around 15:00 and they didn’t come out to fix the fault until 23:00 that day, and it took them until 01:00 to repair all of the fibre pairs.

Nightmare of a day/night.

Luckily our phone system was still running over an ISDN 30 Line, so we could still send/receive calls.

After everything was fixed, we looked at our contract between them in great detail, and turned out that even though the problem was extremely rare, they still broke their SLA with us, and after several letters/meetings we actually received quite a large compensation settlement from them. :slight_smile:

And yes, after that occurrence we quickly implemented a backup/fail-over line with a separate ISP.

1 Spice up
9

Who are you using?

We are in south wales and backup lines arent THAT expensive down here

Also paragraph above has a good idea get a gsm gateway and setup some backup sims in it

If your looking into some backup lines etc, try cactus business on 03303332333 ask for simon cartwright and say John from insureyourmotor sent you, they are nice guys up there and bend over backwards to help out

1 Spice up
10

We are based in Mid Wales, so any “leased” line in near the £500/month mark that we have looked at :slight_smile:

GSM lol you have to hold your phone at 21degrees pointing in a North North West direction to get a signal let alone any data connection.

Never the less lessons learnt and questions will be asked like “What happened to your 3 incoming lines from different providers?”

11

3 incoming lines and all went down? Whats going on over there

We are at the bottom of a valley and got no signal in the building yet we had a mast put up (was quite cheap) and the gsm gets brilliant signal all the time now

12

Whereabouts in Wales, we provide wireless connections to some hotels in Wales and maybe able to hook you up :smiley:

13

Well… that’s awkward!

1 Spice up
14

That’s lovely. Be sure to give them hell!

15

That’s happened to my company several times and while it’s great to know that we can’t get the phone calls of complainers until they search the company directory for the IT cell phone numbers.

16

Exactly. Tossing a long range directional antenna on the roof is cheap and effective.

And even if you’re not getting “Full 3G speeds” anything is always better than nothing, if only to allow the big boss to send emails out.

1 Spice up
17

Neil, I feel for you.

We are 4 miles from our town centre and it cost a fortune to get leased line in as before both ADSL and Phone lines went the same way …

One incident on the poles (which we did have) and we lost everything.

We now have Leased line, VDSL, 3G & soon WiMax to cover all eventualities, we also have UPS’s on all comms kit and a huge generator with auto start after 60 seconds.

No matter how much you plan with DR the bean counters will knock you back until it hits the fan, and now you are in a position to ask for money to sort it.

Hope your day gets better

2 Spice ups
18

Not for me as i changed my gateway to our ADSL line :slight_smile:

Awkward for the stores lol

19

Well internet here seems to be working now. But waiting for MPLS links to sites to come back up now.

20

If people complain about lack of internet just go “Remember the days when all this work was done by hand, and not everyone even had a phone number?” It works best if you can actually remember those days… but it isn’t required.

Sometimes all you need is to remind the people sure out fancy tech just let us down but there was a time when you’d be working a heck of a lot harder with a lot less.

And sometimes you just point to the purposed and rejected plan to prevent this and say “I tried” and wait for the budget to be reviewed… once they have access to the systems again. :slight_smile:

1 Spice up