Page MenuHomePhabricator

Cloud-ServicesUmbrella
ActivePublic

Details

Description

Cloud-Services is the umbrella project for tasks related to the products managed by the Wikimedia Cloud Services team. A general overview of services offered can be found at wikitech:Help:Cloud Services Introduction

Subprojects:

The team itself has a separate project at cloud-services-team that is used to track the backlog and current priorities of the team.

Recent Activity

Fri, Dec 20

bking updated the task description for T382601: Object storage quota increase request for search project.
Fri, Dec 20, 4:13 PM · Wikidata, Cloud-VPS (Quota-requests), Wikidata-Query-Service, Data-Platform-SRE
bking created T382601: Object storage quota increase request for search project.

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Fri, Dec 20, 4:11 PM · Wikidata, Cloud-VPS (Quota-requests), Wikidata-Query-Service, Data-Platform-SRE

Fri, Dec 13

Susannaanas added a project to T382138: Why have all images disappeared from https://wikidocumentaries.wmcloud.org/?: Cloud-Services.

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Fri, Dec 13, 12:10 PM · VPS-Projects, Wikidocumentaries

Dec 4 2024

VRiley-WMF closed T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54 as Resolved.
Dec 4 2024, 7:13 PM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations
VRiley-WMF added a comment to T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54.

Understood, I will close this this and ask for a replacement!

Dec 4 2024, 7:13 PM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations

Nov 26 2024

cmooney reopened T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54 as "Open".

Has this still been performing as expected? If so, are we able to close it?

Nov 26 2024, 4:14 PM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations
VRiley-WMF closed T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54 as Resolved.
Nov 26 2024, 3:33 PM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations
dcaro added a comment to T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54.

Looks good on my side 👍

Nov 26 2024, 3:30 PM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations
VRiley-WMF added a comment to T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54.

Has this still been performing as expected? If so, are we able to close it?

Nov 26 2024, 3:19 PM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations

Nov 25 2024

cmooney added a comment to T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54.

Ok the BGP downpref policy has been reverted, and we have routed traffic back running over the link. So far so good few Gbps of traffic in either direction and still no errors either side.

Nov 25 2024, 11:31 AM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations
cmooney added a comment to T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54.

Link has been clean since the optic was replaced:

Nov 25 2024, 10:21 AM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations

Nov 22 2024

cmooney added a comment to T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54.

Thanks @VRiley-WMF! Seems ok so far but we can make a call Monday based on if we see errors on the link or not (clean since the swap).

Nov 22 2024, 5:59 PM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations
VRiley-WMF added a comment to T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54.

Replaced the transciever in cloudsw1-e4-eqiad et-0/0/54. Will test to see if that works. Trying to locate another one for cloudsw1-d5-eqiad et-0/0/52

Nov 22 2024, 5:33 PM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations
ops-monitoring-bot added a comment to T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54.

Icinga downtime and Alertmanager silence (ID=6b283bec-74b8-4f8c-9a46-f9f60c9c4026) set by cmooney@cumin1002 for 1:00:00 on 2 host(s) and their services with reason: replace optics on faulty WMCS link from D5 to E4

cloudsw1-d5-eqiad.mgmt,cloudsw1-e4-eqiad.mgmt
Nov 22 2024, 5:23 PM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations
cmooney added a comment to T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54.

This port bounced again overnight:

cmooney@cloudsw1-d5-eqiad> show log messages.1.gz | match "10.64.147.5|2620:0:861:fe0e::2|et-0/0/52" | match "ifOper" | except ".0$" 
Nov 22 00:22:55  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_DOWN: ifIndex 682, ifAdminStatus up(1), ifOperStatus down(2), ifName et-0/0/52
Nov 22 00:22:56  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_UP: ifIndex 682, ifAdminStatus up(1), ifOperStatus up(1), ifName et-0/0/52
Nov 22 00:22:58  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_DOWN: ifIndex 682, ifAdminStatus up(1), ifOperStatus down(2), ifName et-0/0/52
Nov 22 00:22:59  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_UP: ifIndex 682, ifAdminStatus up(1), ifOperStatus up(1), ifName et-0/0/52
Nov 22 00:23:04  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_DOWN: ifIndex 682, ifAdminStatus up(1), ifOperStatus down(2), ifName et-0/0/52
Nov 22 00:23:06  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_UP: ifIndex 682, ifAdminStatus up(1), ifOperStatus up(1), ifName et-0/0/52
Nov 22 00:23:06  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_DOWN: ifIndex 682, ifAdminStatus up(1), ifOperStatus down(2), ifName et-0/0/52
Nov 22 00:23:07  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_UP: ifIndex 682, ifAdminStatus up(1), ifOperStatus up(1), ifName et-0/0/52
Nov 22 00:23:11  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_DOWN: ifIndex 682, ifAdminStatus up(1), ifOperStatus down(2), ifName et-0/0/52
Nov 22 00:23:13  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_UP: ifIndex 682, ifAdminStatus up(1), ifOperStatus up(1), ifName et-0/0/52
Nov 22 00:23:14  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_DOWN: ifIndex 682, ifAdminStatus up(1), ifOperStatus down(2), ifName et-0/0/52
Nov 22 00:23:16  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_UP: ifIndex 682, ifAdminStatus up(1), ifOperStatus up(1), ifName et-0/0/52
Nov 22 00:23:20  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_DOWN: ifIndex 682, ifAdminStatus up(1), ifOperStatus down(2), ifName et-0/0/52
Nov 22 00:23:20  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_UP: ifIndex 682, ifAdminStatus up(1), ifOperStatus up(1), ifName et-0/0/52
Nov 22 00:23:21  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_DOWN: ifIndex 682, ifAdminStatus up(1), ifOperStatus down(2), ifName et-0/0/52
Nov 22 00:23:22  cloudsw1-d5-eqiad mib2d[17046]: SNMP_TRAP_LINK_UP: ifIndex 682, ifAdminStatus up(1), ifOperStatus up(1), ifName et-0/0/52
Nov 22 2024, 9:57 AM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations

Nov 21 2024

dancy created T380531: Interfaces tab of deployment-deploy04.deployment-prep VM never finishes loading.

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Nov 21 2024, 7:06 PM · Horizon, Cloud-Services-Origin-User
dcaro added a parent task for T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54: T380489: CephSlowOps Ceph cluster in eqiad has 253 slow ops.
Nov 21 2024, 5:47 PM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations
Maintenance_bot added a project to T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54: SRE.
Nov 21 2024, 5:29 PM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations
dcaro added a parent task for T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54: T380239: CephSlowOps Ceph cluster in eqiad has 1 slow ops.
Nov 21 2024, 4:42 PM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations
JJMC89 updated the task description for T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54.
Nov 21 2024, 4:35 PM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations
cmooney triaged T380503: Replace optics in cloudsw1-d5-eqiad et-0/0/52 and cloudsw1-e4-eqiad et-0/0/54 as High priority.

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Nov 21 2024, 4:32 PM · SRE, ops-eqiad, Cloud-Services, netops, DC-Ops, Infrastructure-Foundations

Nov 10 2024

Stashbot added a comment to T379501: Improve documentation how to set up a project puppetserver.

Mentioned in SAL (#wikimedia-cloud) [2024-11-10T18:22:58Z] <physikerwelt> start setting up puppet Project_puppetserver attempt 2 -> T379501

Nov 10 2024, 6:23 PM · cloud-services-team, Cloud-VPS, Documentation
Physikerwelt created T379501: Improve documentation how to set up a project puppetserver.

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Nov 10 2024, 6:19 PM · cloud-services-team, Cloud-VPS, Documentation

Nov 7 2024

jijiki moved T273950: Modernise memcached systemd unit / sync, and make it presentable from 🙈🙉🙊Backlog to 🛎 Services & Oids on the serviceops board.
Nov 7 2024, 11:52 AM · cloud-services-team, serviceops, User-jijiki, SRE

Oct 24 2024

Maintenance_bot removed a project from T196633: cloudvps: eqiad1 deployment: Patch-For-Review.
Oct 24 2024, 2:31 PM · cloud-services-team (Kanban), Cloud-Services, Epic
gerritbot added a comment to T196633: cloudvps: eqiad1 deployment.

Change #445023 abandoned by Ssingh:

[operations/dns@master] openstack: add labnet100[34] VLAN 1120 reservations

Reason:

No longer required.

https://gerrit.wikimedia.org/r/445023

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Oct 24 2024, 1:47 PM · cloud-services-team (Kanban), Cloud-Services, Epic

Oct 2 2024

bd808 closed T373159: Prepare "What's new with Wikimedia Cloud Services" presentation for WikiConNA 2024 as Resolved.

https://commons.wikimedia.org/wiki/File:What%27s_new_with_Wikimedia_Cloud_Services,_WikiConNA_2024.pdf

Oct 2 2024, 10:42 PM · Cloud-Services, User-bd808
taavi closed T91226: Monitor for wikitech logins failing as Declined.

Wikitech is less of a special case these days so I don't think that is needed

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Oct 2 2024, 8:30 AM · observability, wikitech.wikimedia.org, Cloud-Services

Oct 1 2024

Bugreporter merged task T158614: Cleanup $wgObjectCaches for wikitech into T371374: mediawiki-config: consolidate labswiki.

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Oct 1 2024, 3:35 PM · Cloud-Services, wikitech.wikimedia.org

Sep 30 2024

bd808 added a comment to T373159: Prepare "What's new with Wikimedia Cloud Services" presentation for WikiConNA 2024.

Draft slides at https://docs.google.com/presentation/d/1hBrl_bOcpkYldoIS50hFUU8hrX3kDcokO2CeIVojJ-s. I will export a PDF and upload it to commons once I finish reviewing them.

Sep 30 2024, 10:12 PM · Cloud-Services, User-bd808
Liz updated the task description for T375988: Quarry shows error: This web service cannot be reached.
Sep 30 2024, 3:07 AM · Quarry
Liz created T375988: Quarry shows error: This web service cannot be reached.

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Sep 30 2024, 3:04 AM · Quarry

Sep 11 2024

fgiunchedi created T374513: Lint problems for NeutronAgentDownForLong and NeutronAgentDown.

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Sep 11 2024, 7:52 AM · cloud-services-team (FY2024/2025-Q1-Q2)

Sep 5 2024

Maintenance_bot removed a project from T158099: Upgrade Openstack Horizon to Mitaka: Patch-For-Review.
Sep 5 2024, 3:31 PM · Horizon, cloud-services-team
Lucas_Werkmeister_WMDE closed T158103: Horizon Mitaka 'remember me' checkbox immune to keyboard focus, a subtask of T158099: Upgrade Openstack Horizon to Mitaka, as Invalid.

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Sep 5 2024, 3:17 PM · Horizon, cloud-services-team

Aug 26 2024

jnuche closed T370080: Moving proxies across wmcs projects for patchdemo.wmflabs.org as Resolved.

Done during the switchover on 2024-08-19

Aug 26 2024, 4:10 PM · Catalyst (PatchDemo GoLive), Cloud-Services
jnuche moved T370080: Moving proxies across wmcs projects for patchdemo.wmflabs.org from Ready to Waiting for review on the Catalyst (PatchDemo GoLive) board.
Aug 26 2024, 4:09 PM · Catalyst (PatchDemo GoLive), Cloud-Services
bd808 added a comment to T373159: Prepare "What's new with Wikimedia Cloud Services" presentation for WikiConNA 2024.

The tech spike I have been working on in T372498: Figure out how to provision a Kubernetes cluster using Magnum and OpenTofu could be a good hook for talking about Cloud VPS changes in the last couple of years. That spike is touching OpenTofu, Magnum, object storage, and GitLab CI on a quest to create a k8s cluster managed via gitops.

Aug 26 2024, 3:49 PM · Cloud-Services, User-bd808

Aug 23 2024

bd808 updated subscribers of T373159: Prepare "What's new with Wikimedia Cloud Services" presentation for WikiConNA 2024.

@Andrew, @dcaro, @Slst2020, @komla, @taavi: ideas for topics to cover are very welcome.

Aug 23 2024, 12:32 AM · Cloud-Services, User-bd808
bd808 claimed T373159: Prepare "What's new with Wikimedia Cloud Services" presentation for WikiConNA 2024.
Aug 23 2024, 12:18 AM · Cloud-Services, User-bd808
bd808 created T373159: Prepare "What's new with Wikimedia Cloud Services" presentation for WikiConNA 2024.

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Aug 23 2024, 12:14 AM · Cloud-Services, User-bd808

Aug 22 2024

rook created T373094: Redeploy bastion for tf-infra-test in codfw1dev.

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Aug 22 2024, 12:05 PM · VPS-Projects
ABran-WMF created T373082: Horizon nova generated ssh key undeletable.

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Aug 22 2024, 9:25 AM · Horizon, Cloud-Services-Origin-User

Aug 19 2024

thcipriani moved T370080: Moving proxies across wmcs projects for patchdemo.wmflabs.org from Backlog to Ready on the Catalyst (PatchDemo GoLive) board.
Aug 19 2024, 4:41 PM · Catalyst (PatchDemo GoLive), Cloud-Services

Aug 7 2024

Magnus closed T371955: PetScan not responding as Resolved.

Works again

Aug 7 2024, 9:00 AM · Cloud-VPS
Magnus triaged T371955: PetScan not responding as Unbreak Now! priority.
Aug 7 2024, 8:41 AM · Cloud-VPS
Magnus created T371955: PetScan not responding.

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Aug 7 2024, 8:40 AM · Cloud-VPS

Aug 5 2024

thcipriani added a comment to T370080: Moving proxies across wmcs projects for patchdemo.wmflabs.org.

Current status:

Aug 5 2024, 4:35 PM · Catalyst (PatchDemo GoLive), Cloud-Services
thcipriani edited projects for T370080: Moving proxies across wmcs projects for patchdemo.wmflabs.org, added: Catalyst (PatchDemo GoLive); removed Catalyst.
Aug 5 2024, 4:13 PM · Catalyst (PatchDemo GoLive), Cloud-Services

Aug 1 2024

gerritbot added a comment to T371573: puppet problems mounting cinder volumes (and suggested fixes).

Change #1056606 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] cinderutils: add --allow-unattended-format when preparing volumes

https://gerrit.wikimedia.org/r/1056606

Aug 1 2024, 1:52 AM · cloud-services-team, collaboration-services, Cloud-VPS
pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy