PNW-E and other Spokane Based Services Down

UPDATE: 5-11-22 @ 0710: At this time, most of the DMR services are without connectivity. All MMDVM servers should be operational as are the Tri-Cities and Bremerton c-Bridges. Unknown issue and unknown when it will be resolved.

Hits: 87

Mike - NO7RF

For more information, contact Jenny at 867-5309 --- Jenny will tell you that, "Every Life Owes a Death" or said another way...We have yet to die... /// Been fiddling with DMR since 2008

This Post Has 8 Comments

  1. UPDATE 5-22-22 @ 1114: Most of the Eastern Washington/Idaho repeaters have been off network since May 11th due to a CentruyLink failure to correctly route our 44 net IP blocks as part of their Level3 responsibilities. We did not envision that 12 days later it still would not be fixed. They are not communicating and we still have no resolution for the fix.

    A few days into this mess, Rod KC7AAD took advantage of the down time and moved the PNW-E c-Bridge to a better Internet location and routed around the CT break to some degree. It brought the the Krells and Lookout repeaters back onto the network and allowed some of the out of network talkgroups to work again.

    So I went ahead and fired up another c-Bridge to act as a mirror of PNW-E. We have a few repeaters now on PNW-S. Once the routing issue is fixed, the repeaters and the PNW-E c-Bridge will automatically come back online and likely will work better due to the location change.

    The new PNW-S will stay in service though and become part of the network. It is available now if any repeater owners wish to switch to it now to get back on the network rather than wait for when CT fixes the issue. If interested please write to me off-list for more detail. If you move, you may move back or stay put, it is your choice.

    The new c-Bridge PNW-S Callwatch is:

  2. 5-20-22 @ 0720: Still down. Seems CenturyStink “lost the ticket”. New ticket went in yesterday, now 9 days after the original breakdown during their upgrade. I recommend that you guys buy stock in Lumen (latest owner of this POS company).

  3. Still no corrective action from CenturyStink and no ETA.

    KC7AAD is moving the c-Bridge to a better location today during this down time.

    While it can’t fix our upstream problem, it will help to improve our connectivity and should provide us lower loss rates overall…once we are reconnected.

    By way of background, CenturyStink shows no disruptions in their services but still show the planned upgrade on Tuesday. CenturyStink has a bit of history mucking up their BGP as well.

  4. Hi Mike,
    Thanks for this post. Any idea which repeaters might or might not work on the network?
    I’ve been trying Wenatchee’s and I can’t see that it is functional as of yesterday.

    1. Dale, Only Krells and Lookout Pt. Repeaters on D and A are fine, including Tri-Cities and Yakima. But nothing else on the East side that resides on PNW-E.

      No Update as to when that Upstream provider will have this fixed.

  5. UPDATE: 1641: Rod, KC7AAD did some manual re-routing and now has the c-Bridge on network with a few repeaters that are on the Spokane HamWAN via their WiFI. Connectivity between c-Bridges is restored.

    But the upstream connection is still broken and not serving our 44 Net block…and still no ETA of that restoration.

  6. This was posted to our IO Group this morning:

    Around 2230 last night, some upgrades were made by the Internet provider upstream from out ISP. They killed our BGP routing and have taken down all our 44 net connectivity.

    This issue has caused no flow of services out of Spokane at this time. This includes the PNW-E c-Bridge, most repeaters on WA eastside and Idaho. It includes and any talkgroups that flow into Spokane from Brandmeister and other DMR organizations.

    The service ticket went in this morning around 0830. They have no ETA for restoration of our services.

    This was reported earlier on the home page of the web site via Post, which is first point of notifications for PNWDigital. Updates will continue to be made there.

  7. UPDATE: Upstream Internet provider did some updates and now they are no longer passing our BGP announcements for our 44 net blocks. Ticket is in, no ETA on them fixing the issue. It is out of our hands and not a failure of our network, for whatever that is worth. 🙂

Leave a Reply