May 21 20:35:54.754242 ip-10-0-133-110 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 20:35:54.754253 ip-10-0-133-110 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 20:35:54.754260 ip-10-0-133-110 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 20:35:54.754495 ip-10-0-133-110 systemd[1]: Failed to start Kubernetes Kubelet. May 21 20:36:04.906064 ip-10-0-133-110 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 20:36:04.906080 ip-10-0-133-110 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot df8d0f8a9757446ea68fcc5899f0ab8b -- May 21 20:38:28.984732 ip-10-0-133-110 systemd[1]: Starting Kubernetes Kubelet... May 21 20:38:29.432737 ip-10-0-133-110 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:38:29.432737 ip-10-0-133-110 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 20:38:29.432737 ip-10-0-133-110 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:38:29.432737 ip-10-0-133-110 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 20:38:29.432737 ip-10-0-133-110 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:38:29.434606 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.434514 2573 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 20:38:29.437405 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437382 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:29.437441 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437409 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:29.437441 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437413 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:29.437441 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437416 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:29.437441 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437420 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:29.437441 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437423 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:29.437441 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437426 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:29.437441 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437429 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:29.437441 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437431 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:29.437441 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437434 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:29.437441 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437436 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:29.437441 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437439 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:29.437441 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437443 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:29.437441 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437446 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437449 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437452 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437455 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437458 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437460 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437463 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437465 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437468 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437470 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437473 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437476 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437479 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437481 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437484 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437486 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437489 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437492 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437494 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437497 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:29.437752 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437499 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437502 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437505 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437507 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437510 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437512 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437515 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437517 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437520 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437522 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437525 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437528 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437531 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437533 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437538 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437541 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437543 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437546 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437549 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437552 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:29.438219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437555 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437557 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437560 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437563 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437565 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437568 2573 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437570 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437573 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437575 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437578 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437580 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437585 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437589 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437592 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437595 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437599 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437608 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437612 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437615 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:29.438760 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437618 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437621 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437623 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437626 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437629 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437632 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437636 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437639 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437642 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437645 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437648 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437650 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437653 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.437656 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438086 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438092 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438094 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438097 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438100 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438102 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:29.439219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438106 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438108 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438111 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438113 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438116 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438119 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438122 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438124 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438127 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438130 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438132 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438135 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438137 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438140 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438143 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438145 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438148 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438151 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438154 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438165 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:29.439716 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438168 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438171 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438173 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438176 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438179 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438181 2573 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438184 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438187 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438189 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438192 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438195 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438197 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438200 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438202 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438205 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438208 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438214 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438219 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438223 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438228 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:29.440289 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438253 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438274 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438280 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438287 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438291 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438294 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438297 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438300 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438303 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438306 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438309 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438311 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438316 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438318 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438321 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438324 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438327 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438330 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438333 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438335 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:29.440800 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438338 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438341 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438344 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438347 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438349 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438352 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438354 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438357 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438359 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438362 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438365 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438368 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438373 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438376 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438379 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438381 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438384 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438387 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438390 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.438393 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:29.441296 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439180 2573 flags.go:64] FLAG: --address="0.0.0.0" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439189 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439197 2573 flags.go:64] FLAG: --anonymous-auth="true" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439202 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439207 2573 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439211 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439216 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439221 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439224 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439228 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439232 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439235 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439238 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439241 2573 flags.go:64] FLAG: --cgroup-root="" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439244 2573 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439248 2573 flags.go:64] FLAG: --client-ca-file="" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439251 2573 flags.go:64] FLAG: --cloud-config="" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439254 2573 flags.go:64] FLAG: --cloud-provider="external" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439257 2573 flags.go:64] FLAG: --cluster-dns="[]" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439261 2573 flags.go:64] FLAG: --cluster-domain="" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439264 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439268 2573 flags.go:64] FLAG: --config-dir="" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439270 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439274 2573 flags.go:64] FLAG: --container-log-max-files="5" May 21 20:38:29.441803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439278 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439282 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439285 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439288 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439291 2573 flags.go:64] FLAG: --contention-profiling="false" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439295 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439298 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439301 2573 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439304 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439308 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439311 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439314 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439317 2573 flags.go:64] FLAG: --enable-load-reader="false" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439320 2573 flags.go:64] FLAG: --enable-server="true" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439324 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439329 2573 flags.go:64] FLAG: --event-burst="100" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439332 2573 flags.go:64] FLAG: --event-qps="50" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439335 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439339 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439342 2573 flags.go:64] FLAG: --eviction-hard="" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439346 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439349 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439352 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439355 2573 flags.go:64] FLAG: --eviction-soft="" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439358 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 20:38:29.442372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439361 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439364 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439368 2573 flags.go:64] FLAG: --experimental-mounter-path="" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439371 2573 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439374 2573 flags.go:64] FLAG: --fail-swap-on="true" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439377 2573 flags.go:64] FLAG: --feature-gates="" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439381 2573 flags.go:64] FLAG: --file-check-frequency="20s" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439384 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439387 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439391 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439411 2573 flags.go:64] FLAG: --healthz-port="10248" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439414 2573 flags.go:64] FLAG: --help="false" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439417 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-133-110.ec2.internal" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439421 2573 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439424 2573 flags.go:64] FLAG: --http-check-frequency="20s" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439427 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439430 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439434 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439437 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439440 2573 flags.go:64] FLAG: --image-service-endpoint="" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439443 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439446 2573 flags.go:64] FLAG: --kube-api-burst="100" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439449 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439452 2573 flags.go:64] FLAG: --kube-api-qps="50" May 21 20:38:29.442977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439455 2573 flags.go:64] FLAG: --kube-reserved="" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439462 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439466 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439469 2573 flags.go:64] FLAG: --kubelet-cgroups="" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439473 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439476 2573 flags.go:64] FLAG: --lock-file="" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439478 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439481 2573 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439484 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439490 2573 flags.go:64] FLAG: --log-json-split-stream="false" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439493 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439496 2573 flags.go:64] FLAG: --log-text-split-stream="false" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439499 2573 flags.go:64] FLAG: --logging-format="text" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439502 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439505 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439508 2573 flags.go:64] FLAG: --manifest-url="" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439512 2573 flags.go:64] FLAG: --manifest-url-header="" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439517 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439520 2573 flags.go:64] FLAG: --max-open-files="1000000" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439524 2573 flags.go:64] FLAG: --max-pods="110" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439528 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439531 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439534 2573 flags.go:64] FLAG: --memory-manager-policy="None" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439537 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439541 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 20:38:29.443598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439544 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439547 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439555 2573 flags.go:64] FLAG: --node-status-max-images="50" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439558 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439561 2573 flags.go:64] FLAG: --oom-score-adj="-999" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439564 2573 flags.go:64] FLAG: --pod-cidr="" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439568 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439572 2573 flags.go:64] FLAG: --pod-manifest-path="" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439575 2573 flags.go:64] FLAG: --pod-max-pids="-1" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439580 2573 flags.go:64] FLAG: --pods-per-core="0" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439584 2573 flags.go:64] FLAG: --port="10250" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439587 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439590 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0821d13cd45c463cd" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439593 2573 flags.go:64] FLAG: --qos-reserved="" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439596 2573 flags.go:64] FLAG: --read-only-port="10255" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439599 2573 flags.go:64] FLAG: --register-node="true" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439602 2573 flags.go:64] FLAG: --register-schedulable="true" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439606 2573 flags.go:64] FLAG: --register-with-taints="" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439609 2573 flags.go:64] FLAG: --registry-burst="10" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439612 2573 flags.go:64] FLAG: --registry-qps="5" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439615 2573 flags.go:64] FLAG: --reserved-cpus="" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439618 2573 flags.go:64] FLAG: --reserved-memory="" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439627 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439633 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439636 2573 flags.go:64] FLAG: --rotate-certificates="false" May 21 20:38:29.444191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439639 2573 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439642 2573 flags.go:64] FLAG: --runonce="false" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439645 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439648 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439651 2573 flags.go:64] FLAG: --seccomp-default="false" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439653 2573 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439656 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439660 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439663 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439666 2573 flags.go:64] FLAG: --storage-driver-password="root" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439669 2573 flags.go:64] FLAG: --storage-driver-secure="false" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439672 2573 flags.go:64] FLAG: --storage-driver-table="stats" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439675 2573 flags.go:64] FLAG: --storage-driver-user="root" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439678 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439681 2573 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439684 2573 flags.go:64] FLAG: --system-cgroups="" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439689 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439694 2573 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439697 2573 flags.go:64] FLAG: --tls-cert-file="" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439700 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439704 2573 flags.go:64] FLAG: --tls-min-version="" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439706 2573 flags.go:64] FLAG: --tls-private-key-file="" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439709 2573 flags.go:64] FLAG: --topology-manager-policy="none" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439713 2573 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439716 2573 flags.go:64] FLAG: --topology-manager-scope="container" May 21 20:38:29.444834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439719 2573 flags.go:64] FLAG: --v="2" May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439723 2573 flags.go:64] FLAG: --version="false" May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439728 2573 flags.go:64] FLAG: --vmodule="" May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439732 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.439736 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439834 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439838 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439841 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439844 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439847 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439849 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439852 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439854 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439857 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439859 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439862 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439865 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439868 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439872 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439876 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:29.445450 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439879 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439881 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439884 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439889 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439892 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439895 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439898 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439900 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439903 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439905 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439908 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439911 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439913 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439916 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439918 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439921 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439923 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439926 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439929 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439932 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:29.445938 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439934 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439938 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439942 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439945 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439948 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439951 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439954 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439956 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439959 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439962 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439964 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439967 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439970 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439973 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439976 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439980 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439983 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439985 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439988 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:29.446461 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439990 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439993 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439996 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.439998 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440001 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440004 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440006 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440009 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440012 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440014 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440017 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440019 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440022 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440025 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440027 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440030 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440032 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440035 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440037 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440040 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:29.447083 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440042 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:29.447855 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440045 2573 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:29.447855 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440047 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:29.447855 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440050 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:29.447855 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440052 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:29.447855 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440055 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:29.447855 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440058 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:29.447855 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440060 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:29.447855 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440064 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:29.447855 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440067 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:29.447855 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440070 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:29.447855 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.440072 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:29.447855 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.440842 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:38:29.448894 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.448875 2573 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 20:38:29.448936 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.448895 2573 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 20:38:29.448965 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448943 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:29.448965 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448949 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:29.448965 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448952 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:29.448965 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448955 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:29.448965 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448957 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:29.448965 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448960 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:29.448965 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448963 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:29.448965 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448966 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:29.448965 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448969 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448972 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448975 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448978 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448980 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448983 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448986 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448988 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448991 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448994 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448996 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.448999 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449001 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449004 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449007 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449010 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449012 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449015 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449018 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449020 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:29.449194 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449023 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449026 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449029 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449031 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449034 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449037 2573 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449039 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449042 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449044 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449047 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449049 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449052 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449054 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449057 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449060 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449063 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449065 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449068 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449070 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449073 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:29.449692 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449077 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449081 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449085 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449088 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449091 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449094 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449096 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449099 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449102 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449104 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449107 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449110 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449113 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449116 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449119 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449121 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449124 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449126 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449129 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:29.450174 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449131 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449134 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449136 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449147 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449150 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449152 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449155 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449159 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449161 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449164 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449167 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449170 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449172 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449175 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449178 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449180 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449183 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449185 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:29.450652 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449188 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.449193 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449308 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449313 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449317 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449320 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449323 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449327 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449331 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449334 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449337 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449340 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449344 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449348 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449351 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:29.451087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449354 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449357 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449360 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449363 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449366 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449369 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449372 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449375 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449377 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449381 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449383 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449386 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449389 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449391 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449394 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449408 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449411 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449414 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449416 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449419 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:29.451527 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449421 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449424 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449427 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449430 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449432 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449435 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449438 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449441 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449443 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449446 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449448 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449451 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449454 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449456 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449459 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449462 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449464 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449467 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449469 2573 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449472 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:29.452017 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449475 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449477 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449481 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449484 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449486 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449489 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449491 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449494 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449496 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449499 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449501 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449504 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449506 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449509 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449511 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449514 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449517 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449519 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449522 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449524 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:29.452591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449527 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449529 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449532 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449534 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449537 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449540 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449542 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449545 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449547 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449550 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449552 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449555 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:29.449558 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.449562 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.450266 2573 server.go:962] "Client rotation is on, will bootstrap in background" May 21 20:38:29.453087 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.453021 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 20:38:29.453963 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.453952 2573 server.go:1019] "Starting client certificate rotation" May 21 20:38:29.454070 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.454053 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 20:38:29.454099 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.454088 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 20:38:29.478770 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.478750 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 20:38:29.480638 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.480618 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 20:38:29.494869 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.494845 2573 log.go:25] "Validated CRI v1 runtime API" May 21 20:38:29.499947 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.499927 2573 log.go:25] "Validated CRI v1 image API" May 21 20:38:29.501517 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.501493 2573 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 20:38:29.504813 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.504753 2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 82850b4f-9679-427c-a74b-957b3ac8cd25:/dev/nvme0n1p4 9db87148-f555-4009-85f9-e97316a444af:/dev/nvme0n1p3] May 21 20:38:29.504945 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.504801 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 20:38:29.509489 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.509468 2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 20:38:29.511133 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.511024 2573 manager.go:217] Machine: {Timestamp:2026-05-21 20:38:29.510493293 +0000 UTC m=+0.402355883 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100193 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28c568bf2886fe3e3d32c58b9e78c0 SystemUUID:ec28c568-bf28-86fe-3e3d-32c58b9e78c0 BootID:df8d0f8a-9757-446e-a68f-cc5899f0ab8b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1e:a5:29:71:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1e:a5:29:71:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:86:a5:ac:28:7d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 20:38:29.511965 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.511950 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 20:38:29.512078 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.512063 2573 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 20:38:29.515627 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.515600 2573 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 20:38:29.515802 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.515631 2573 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-110.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 20:38:29.515895 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.515817 2573 topology_manager.go:138] "Creating topology manager with none policy" May 21 20:38:29.515895 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.515831 2573 container_manager_linux.go:306] "Creating device plugin manager" May 21 20:38:29.515895 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.515842 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 20:38:29.515895 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.515861 2573 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 20:38:29.517815 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.517801 2573 state_mem.go:36] "Initialized new in-memory state store" May 21 20:38:29.517960 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.517949 2573 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 20:38:29.520473 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.520461 2573 kubelet.go:491] "Attempting to sync node with API server" May 21 20:38:29.520544 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.520480 2573 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 20:38:29.520544 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.520497 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 20:38:29.520544 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.520509 2573 kubelet.go:397] "Adding apiserver pod source" May 21 20:38:29.520544 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.520522 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 20:38:29.521842 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.521827 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 20:38:29.521940 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.521851 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 20:38:29.525578 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.525550 2573 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 20:38:29.527198 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.527173 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s6snx" May 21 20:38:29.527578 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.527561 2573 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 20:38:29.528552 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.528536 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 20:38:29.528552 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.528561 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 20:38:29.528688 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.528575 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 20:38:29.528688 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.528585 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 20:38:29.528688 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.528598 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 20:38:29.528688 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.528606 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 20:38:29.528688 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.528615 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 20:38:29.528688 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.528623 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 20:38:29.528688 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.528634 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 20:38:29.528688 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.528643 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 20:38:29.528688 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.528655 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 20:38:29.528946 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.528907 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 20:38:29.529641 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.529629 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 20:38:29.529706 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.529645 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 20:38:29.531998 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.531931 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 20:38:29.532094 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.532017 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 20:38:29.532517 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.532499 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s6snx" May 21 20:38:29.533442 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.533427 2573 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 20:38:29.533529 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.533477 2573 server.go:1295] "Started kubelet" May 21 20:38:29.533581 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.533534 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 20:38:29.533682 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.533632 2573 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 20:38:29.533770 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.533713 2573 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 20:38:29.534512 ip-10-0-133-110 systemd[1]: Started Kubernetes Kubelet. May 21 20:38:29.536228 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.536207 2573 server.go:317] "Adding debug handlers to kubelet server" May 21 20:38:29.537890 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.537866 2573 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 20:38:29.542431 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.542391 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 20:38:29.542943 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.542924 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 20:38:29.543081 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.543061 2573 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 20:38:29.543081 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.543078 2573 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 20:38:29.543238 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.543151 2573 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 20:38:29.545331 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.545131 2573 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 20:38:29.545424 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.545410 2573 reconstruct.go:97] "Volume reconstruction finished" May 21 20:38:29.545491 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.545434 2573 reconciler.go:26] "Reconciler: start to sync state" May 21 20:38:29.545639 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.545618 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:29.545883 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.545868 2573 factory.go:55] Registering systemd factory May 21 20:38:29.545959 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.545930 2573 factory.go:223] Registration of the systemd container factory successfully May 21 20:38:29.546188 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.546177 2573 factory.go:153] Registering CRI-O factory May 21 20:38:29.546258 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.546199 2573 factory.go:223] Registration of the crio container factory successfully May 21 20:38:29.546323 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.546306 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 20:38:29.546373 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.546349 2573 factory.go:103] Registering Raw factory May 21 20:38:29.546440 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.546377 2573 manager.go:1196] Started watching for new ooms in manager May 21 20:38:29.546776 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.546764 2573 manager.go:319] Starting recovery of all containers May 21 20:38:29.551131 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.551095 2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:29.552312 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.552289 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-110.ec2.internal" not found May 21 20:38:29.552685 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.552661 2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-110.ec2.internal\" not found" node="ip-10-0-133-110.ec2.internal" May 21 20:38:29.552819 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.552791 2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 20:38:29.558425 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.558392 2573 manager.go:324] Recovery completed May 21 20:38:29.562645 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.562632 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:29.564686 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.564671 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:29.564743 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.564700 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:29.564743 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.564712 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:29.565217 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.565203 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 20:38:29.565217 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.565215 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 20:38:29.565323 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.565234 2573 state_mem.go:36] "Initialized new in-memory state store" May 21 20:38:29.567025 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.567011 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-110.ec2.internal" not found May 21 20:38:29.567563 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.567552 2573 policy_none.go:49] "None policy: Start" May 21 20:38:29.567601 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.567568 2573 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 20:38:29.567601 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.567578 2573 state_mem.go:35] "Initializing new in-memory state store" May 21 20:38:29.607061 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.607042 2573 manager.go:341] "Starting Device Plugin manager" May 21 20:38:29.618259 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.607084 2573 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 20:38:29.618259 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.607095 2573 server.go:85] "Starting device plugin registration server" May 21 20:38:29.618259 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.607323 2573 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 20:38:29.618259 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.607333 2573 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 20:38:29.618259 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.607450 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 20:38:29.618259 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.607533 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 20:38:29.618259 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.607539 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 20:38:29.618259 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.608059 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 20:38:29.618259 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.608101 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:29.623735 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.623717 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-110.ec2.internal" not found May 21 20:38:29.676607 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.676569 2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 20:38:29.676607 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.676596 2573 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 20:38:29.676776 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.676616 2573 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 20:38:29.676776 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.676623 2573 kubelet.go:2451] "Starting kubelet main sync loop" May 21 20:38:29.676776 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.676665 2573 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 20:38:29.679971 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.679948 2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:29.708086 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.708030 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:29.709370 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.709352 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:29.709468 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.709381 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:29.709468 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.709392 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:29.709468 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.709436 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-110.ec2.internal" May 21 20:38:29.718345 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.718324 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-110.ec2.internal" May 21 20:38:29.718392 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.718349 2573 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-110.ec2.internal\": node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:29.730617 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.730596 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:29.777449 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.777416 2573 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-110.ec2.internal"] May 21 20:38:29.777530 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.777510 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:29.779108 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.779092 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:29.779179 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.779132 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:29.779179 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.779142 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:29.780381 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.780368 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:29.780605 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.780591 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal" May 21 20:38:29.780646 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.780627 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:29.781188 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.781168 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:29.781188 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.781185 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:29.781312 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.781201 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:29.781312 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.781209 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:29.781312 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.781214 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:29.781312 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.781223 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:29.782483 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.782463 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.ec2.internal" May 21 20:38:29.782560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.782488 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:29.783172 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.783157 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:29.783228 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.783187 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:29.783228 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.783211 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:29.807265 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.807240 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-110.ec2.internal\" not found" node="ip-10-0-133-110.ec2.internal" May 21 20:38:29.811824 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.811809 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-110.ec2.internal\" not found" node="ip-10-0-133-110.ec2.internal" May 21 20:38:29.830860 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.830837 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:29.846860 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.846831 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c02b281b5099bbf12eeec7ce05b614e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal\" (UID: \"8c02b281b5099bbf12eeec7ce05b614e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal" May 21 20:38:29.846965 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.846867 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c02b281b5099bbf12eeec7ce05b614e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal\" (UID: \"8c02b281b5099bbf12eeec7ce05b614e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal" May 21 20:38:29.846965 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.846907 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ded2943643923fe492defbee7ce9d57-config\") pod \"kube-apiserver-proxy-ip-10-0-133-110.ec2.internal\" (UID: \"1ded2943643923fe492defbee7ce9d57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.ec2.internal" May 21 20:38:29.931692 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:29.931664 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:29.947118 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.947094 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c02b281b5099bbf12eeec7ce05b614e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal\" (UID: \"8c02b281b5099bbf12eeec7ce05b614e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal" May 21 20:38:29.947184 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.947134 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c02b281b5099bbf12eeec7ce05b614e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal\" (UID: \"8c02b281b5099bbf12eeec7ce05b614e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal" May 21 20:38:29.947184 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.947156 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ded2943643923fe492defbee7ce9d57-config\") pod \"kube-apiserver-proxy-ip-10-0-133-110.ec2.internal\" (UID: \"1ded2943643923fe492defbee7ce9d57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.ec2.internal" May 21 20:38:29.947271 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.947195 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ded2943643923fe492defbee7ce9d57-config\") pod \"kube-apiserver-proxy-ip-10-0-133-110.ec2.internal\" (UID: \"1ded2943643923fe492defbee7ce9d57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.ec2.internal" May 21 20:38:29.947271 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.947216 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c02b281b5099bbf12eeec7ce05b614e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal\" (UID: \"8c02b281b5099bbf12eeec7ce05b614e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal" May 21 20:38:29.947271 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:29.947221 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c02b281b5099bbf12eeec7ce05b614e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal\" (UID: \"8c02b281b5099bbf12eeec7ce05b614e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal" May 21 20:38:30.032600 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:30.032513 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:30.110125 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.110097 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal" May 21 20:38:30.114976 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.114951 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.ec2.internal" May 21 20:38:30.133623 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:30.133588 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:30.234223 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:30.234179 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:30.334813 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:30.334727 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:30.435461 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:30.435429 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:30.454051 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.454027 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 20:38:30.454224 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.454203 2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 20:38:30.454262 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.454212 2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 20:38:30.521008 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.520981 2573 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:30.534778 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.534715 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 20:33:29 +0000 UTC" deadline="2027-11-18 12:54:02.889772324 +0000 UTC" May 21 20:38:30.534778 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.534762 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13096h15m32.355012527s" May 21 20:38:30.535802 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:30.535776 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:30.542963 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.542932 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 20:38:30.555988 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.555968 2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 20:38:30.574796 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.574749 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dcfmc" May 21 20:38:30.583229 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.583203 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dcfmc" May 21 20:38:30.636217 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:30.636130 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:30.649511 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:30.649477 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ded2943643923fe492defbee7ce9d57.slice/crio-ce5333698f80c1d7235fe7794d662615ac540af28d3bc776f712166ad397378a WatchSource:0}: Error finding container ce5333698f80c1d7235fe7794d662615ac540af28d3bc776f712166ad397378a: Status 404 returned error can't find the container with id ce5333698f80c1d7235fe7794d662615ac540af28d3bc776f712166ad397378a May 21 20:38:30.649749 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:30.649720 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c02b281b5099bbf12eeec7ce05b614e.slice/crio-c360943099e69a40ee98b294960b4f0383047f5c53e052d5381ebfcd496fcef3 WatchSource:0}: Error finding container c360943099e69a40ee98b294960b4f0383047f5c53e052d5381ebfcd496fcef3: Status 404 returned error can't find the container with id c360943099e69a40ee98b294960b4f0383047f5c53e052d5381ebfcd496fcef3 May 21 20:38:30.653999 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.653567 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:38:30.679560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.679499 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal" event={"ID":"8c02b281b5099bbf12eeec7ce05b614e","Type":"ContainerStarted","Data":"c360943099e69a40ee98b294960b4f0383047f5c53e052d5381ebfcd496fcef3"} May 21 20:38:30.680475 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.680451 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.ec2.internal" event={"ID":"1ded2943643923fe492defbee7ce9d57","Type":"ContainerStarted","Data":"ce5333698f80c1d7235fe7794d662615ac540af28d3bc776f712166ad397378a"} May 21 20:38:30.736666 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:30.736631 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:30.837272 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:30.837241 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-110.ec2.internal\" not found" May 21 20:38:30.854373 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.854352 2573 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:30.943800 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.943731 2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal" May 21 20:38:30.955635 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.955613 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 20:38:30.956501 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.956489 2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.ec2.internal" May 21 20:38:30.963628 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:30.963614 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 20:38:31.490672 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.490630 2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:31.521249 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.521212 2573 apiserver.go:52] "Watching apiserver" May 21 20:38:31.530415 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.530207 2573 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 20:38:31.531030 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.530640 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal","openshift-multus/multus-additional-cni-plugins-wqj25","openshift-multus/multus-tvvlr","openshift-multus/network-metrics-daemon-8jlfz","openshift-network-operator/iptables-alerter-lpjb2","openshift-ovn-kubernetes/ovnkube-node-5zmnk","kube-system/konnectivity-agent-rbpj6","kube-system/kube-apiserver-proxy-ip-10-0-133-110.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd","openshift-cluster-node-tuning-operator/tuned-29bft","openshift-dns/node-resolver-xb8nw","openshift-image-registry/node-ca-vf548","openshift-network-diagnostics/network-check-target-n9xvd"] May 21 20:38:31.533037 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.533006 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rbpj6" May 21 20:38:31.536451 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.535899 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.536451 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.536039 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 20:38:31.536451 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.536098 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9j9ft\"" May 21 20:38:31.536451 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.536328 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 20:38:31.537193 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.537170 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tvvlr" May 21 20:38:31.538826 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.538655 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 20:38:31.538826 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.538655 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 20:38:31.538826 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.538734 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 20:38:31.539032 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.538876 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qj84r\"" May 21 20:38:31.539032 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.538877 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 20:38:31.539032 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.538970 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 20:38:31.539167 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.539046 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:31.539167 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:31.539131 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:38:31.539167 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.539163 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lpjb2" May 21 20:38:31.540383 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.540242 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gfml6\"" May 21 20:38:31.540383 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.540259 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 20:38:31.540832 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.540781 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.543515 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.542976 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 20:38:31.543515 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.543081 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q4fz6\"" May 21 20:38:31.543515 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.542379 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 20:38:31.543680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.543378 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 20:38:31.544640 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.543988 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.545097 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.544862 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 20:38:31.545191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.545170 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 20:38:31.545365 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.545345 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jdphn\"" May 21 20:38:31.545721 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.545696 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 20:38:31.545963 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.545944 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 20:38:31.546069 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.546052 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.547939 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.547923 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 20:38:31.548176 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.547966 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 20:38:31.548262 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.548188 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7dcsz\"" May 21 20:38:31.548262 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.548209 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 20:38:31.548262 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.548253 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 20:38:31.548475 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.548057 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 20:38:31.548475 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.548053 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 20:38:31.548808 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.548766 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-88bm8\"" May 21 20:38:31.548940 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.548922 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xb8nw" May 21 20:38:31.549868 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.549850 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 20:38:31.551015 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.550997 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vf548" May 21 20:38:31.552147 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.552001 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qs6q6\"" May 21 20:38:31.552147 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.552032 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 20:38:31.552147 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.552039 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 20:38:31.553938 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.553919 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jq7r2\"" May 21 20:38:31.554019 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.553964 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:31.554019 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554010 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 20:38:31.554105 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:31.554024 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:31.554139 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554125 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 20:38:31.554338 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554323 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 20:38:31.554604 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554586 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe481af-318e-4d07-8f20-b9444f36f745-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.554664 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554618 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-run\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.554727 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554660 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71766548-f776-4156-bfd3-486b8af99ab8-host-slash\") pod \"iptables-alerter-lpjb2\" (UID: \"71766548-f776-4156-bfd3-486b8af99ab8\") " pod="openshift-network-operator/iptables-alerter-lpjb2" May 21 20:38:31.554727 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554688 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe481af-318e-4d07-8f20-b9444f36f745-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.554827 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554732 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e251c5e-f46c-46ad-be14-c2db03260a1c-agent-certs\") pod \"konnectivity-agent-rbpj6\" (UID: \"7e251c5e-f46c-46ad-be14-c2db03260a1c\") " pod="kube-system/konnectivity-agent-rbpj6" May 21 20:38:31.554827 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554783 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33e24c13-2fea-4546-8f05-a510637a3947-cni-binary-copy\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.554827 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-cni-netd\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.554971 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554835 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-sys-fs\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.554971 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554874 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsgq7\" (UniqueName: \"kubernetes.io/projected/018cb627-5cf2-4fce-b8ef-7463df565a15-kube-api-access-bsgq7\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.554971 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554900 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-modprobe-d\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.554971 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554923 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-var-lib-kubelet\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.554971 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.554949 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-log-socket\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.555186 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555003 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-os-release\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.555186 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555042 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-multus-socket-dir-parent\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.555186 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555086 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-var-lib-cni-bin\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.555186 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555121 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-etc-kubernetes\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.555373 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555197 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-var-lib-openvswitch\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.555373 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555232 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-run-openvswitch\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.555373 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555266 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-run-netns\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.555373 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555295 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-hostroot\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.555373 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555322 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71766548-f776-4156-bfd3-486b8af99ab8-iptables-alerter-script\") pod \"iptables-alerter-lpjb2\" (UID: \"71766548-f776-4156-bfd3-486b8af99ab8\") " pod="openshift-network-operator/iptables-alerter-lpjb2" May 21 20:38:31.555373 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555346 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-run-ovn\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.555678 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555370 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.555678 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555422 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-device-dir\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.555678 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555448 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-lib-modules\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.555678 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555481 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-282pk\" (UniqueName: \"kubernetes.io/projected/33e24c13-2fea-4546-8f05-a510637a3947-kube-api-access-282pk\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.555678 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555519 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-kubelet\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.555678 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555554 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-systemd-units\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.555678 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555598 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-run-netns\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.555678 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555663 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-node-log\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.556092 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555697 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffe481af-318e-4d07-8f20-b9444f36f745-os-release\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.556092 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555731 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mptgs\" (UniqueName: \"kubernetes.io/projected/ffe481af-318e-4d07-8f20-b9444f36f745-kube-api-access-mptgs\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.556092 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555758 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-registration-dir\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.556092 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555783 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-cni-bin\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.556092 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555808 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.556092 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555834 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-host\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.556092 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555859 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gzsb\" (UniqueName: \"kubernetes.io/projected/bf971c67-e639-4e28-bb08-9dabf323dcb8-kube-api-access-6gzsb\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.556092 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-multus-conf-dir\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.556092 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555910 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwcb4\" (UniqueName: \"kubernetes.io/projected/71766548-f776-4156-bfd3-486b8af99ab8-kube-api-access-qwcb4\") pod \"iptables-alerter-lpjb2\" (UID: \"71766548-f776-4156-bfd3-486b8af99ab8\") " pod="openshift-network-operator/iptables-alerter-lpjb2" May 21 20:38:31.556092 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555933 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-etc-openvswitch\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.556092 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.555957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ffe481af-318e-4d07-8f20-b9444f36f745-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.556092 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556046 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-etc-selinux\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.556092 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556074 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf971c67-e639-4e28-bb08-9dabf323dcb8-tmp\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556114 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-system-cni-dir\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556136 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-cnibin\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556160 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-run-multus-certs\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556184 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556223 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw2zg\" (UniqueName: \"kubernetes.io/projected/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-kube-api-access-tw2zg\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556262 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe481af-318e-4d07-8f20-b9444f36f745-cnibin\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556290 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-sysctl-d\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556315 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-sys\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556339 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e251c5e-f46c-46ad-be14-c2db03260a1c-konnectivity-ca\") pod \"konnectivity-agent-rbpj6\" (UID: \"7e251c5e-f46c-46ad-be14-c2db03260a1c\") " pod="kube-system/konnectivity-agent-rbpj6" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556393 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-multus-cni-dir\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556437 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-slash\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556462 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-run-ovn-kubernetes\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556565 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c149b399-f275-4534-9b50-410a8df81fad-ovn-node-metrics-cert\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556603 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c149b399-f275-4534-9b50-410a8df81fad-ovnkube-script-lib\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556648 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-kubernetes\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.556680 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556685 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-sysctl-conf\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.557371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556712 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-var-lib-kubelet\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.557371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556737 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-tuned\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.557371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556765 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33e24c13-2fea-4546-8f05-a510637a3947-multus-daemon-config\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.557371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556800 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhbbb\" (UniqueName: \"kubernetes.io/projected/c149b399-f275-4534-9b50-410a8df81fad-kube-api-access-vhbbb\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.557371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556839 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-socket-dir\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.557371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556880 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-var-lib-cni-multus\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.557371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556917 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe481af-318e-4d07-8f20-b9444f36f745-system-cni-dir\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.557371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556952 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ffe481af-318e-4d07-8f20-b9444f36f745-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.557371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.556983 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-sysconfig\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.557371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.557006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-run-k8s-cni-cncf-io\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.557371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.557030 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-run-systemd\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.557371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.557054 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c149b399-f275-4534-9b50-410a8df81fad-env-overrides\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.557371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.557076 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-systemd\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.557371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.557099 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c149b399-f275-4534-9b50-410a8df81fad-ovnkube-config\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.584031 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.583863 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 20:33:30 +0000 UTC" deadline="2027-12-28 17:04:04.966339484 +0000 UTC" May 21 20:38:31.584031 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.583893 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14060h25m33.382451098s" May 21 20:38:31.646610 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.646581 2573 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 20:38:31.657606 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.657575 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe481af-318e-4d07-8f20-b9444f36f745-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.657766 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.657609 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e251c5e-f46c-46ad-be14-c2db03260a1c-agent-certs\") pod \"konnectivity-agent-rbpj6\" (UID: \"7e251c5e-f46c-46ad-be14-c2db03260a1c\") " pod="kube-system/konnectivity-agent-rbpj6" May 21 20:38:31.657766 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.657639 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33e24c13-2fea-4546-8f05-a510637a3947-cni-binary-copy\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.657881 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.657784 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-cni-netd\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.657881 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.657867 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-cni-netd\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.657988 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.657915 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-sys-fs\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.658027 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.657998 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-sys-fs\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.658076 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.657944 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsgq7\" (UniqueName: \"kubernetes.io/projected/018cb627-5cf2-4fce-b8ef-7463df565a15-kube-api-access-bsgq7\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.658076 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658014 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 20:38:31.658076 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658057 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-modprobe-d\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.658286 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658269 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33e24c13-2fea-4546-8f05-a510637a3947-cni-binary-copy\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.658286 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658270 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe481af-318e-4d07-8f20-b9444f36f745-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.658417 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658357 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-var-lib-kubelet\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.658417 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658386 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-log-socket\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.658515 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658432 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/432776d9-7c1f-4742-bd20-da704e768581-tmp-dir\") pod \"node-resolver-xb8nw\" (UID: \"432776d9-7c1f-4742-bd20-da704e768581\") " pod="openshift-dns/node-resolver-xb8nw" May 21 20:38:31.658515 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658469 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-modprobe-d\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.658611 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658472 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-var-lib-kubelet\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.658611 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658519 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-log-socket\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.658611 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658541 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nltpm\" (UniqueName: \"kubernetes.io/projected/1daa7f15-874e-4696-802f-f7505865a63b-kube-api-access-nltpm\") pod \"node-ca-vf548\" (UID: \"1daa7f15-874e-4696-802f-f7505865a63b\") " pod="openshift-image-registry/node-ca-vf548" May 21 20:38:31.658611 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658570 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-os-release\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.658611 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658589 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-multus-socket-dir-parent\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.658838 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658614 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-var-lib-cni-bin\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.658838 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658640 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-etc-kubernetes\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.658838 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658660 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-multus-socket-dir-parent\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.658838 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658665 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-var-lib-openvswitch\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.658838 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658670 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-os-release\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.658838 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658688 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-run-openvswitch\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.658838 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658717 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-etc-kubernetes\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.658838 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658724 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-var-lib-cni-bin\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.658838 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658747 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-var-lib-openvswitch\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.658838 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658749 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-run-openvswitch\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.658838 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658796 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-run-netns\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.658838 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658824 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-run-netns\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.658838 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658826 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-hostroot\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658856 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-hostroot\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658859 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71766548-f776-4156-bfd3-486b8af99ab8-iptables-alerter-script\") pod \"iptables-alerter-lpjb2\" (UID: \"71766548-f776-4156-bfd3-486b8af99ab8\") " pod="openshift-network-operator/iptables-alerter-lpjb2" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658885 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-run-ovn\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658901 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658916 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-device-dir\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658935 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-lib-modules\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658959 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-282pk\" (UniqueName: \"kubernetes.io/projected/33e24c13-2fea-4546-8f05-a510637a3947-kube-api-access-282pk\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658972 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.658999 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-kubelet\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-run-ovn\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659009 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-device-dir\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659025 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-systemd-units\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659058 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-run-netns\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659108 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-node-log\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659126 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-run-netns\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659138 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gsj7\" (UniqueName: \"kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7\") pod \"network-check-target-n9xvd\" (UID: \"d83f554e-2053-4eff-9e99-f6e6761a4156\") " pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:31.659380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659064 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-systemd-units\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659152 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-lib-modules\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659074 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-kubelet\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659170 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-node-log\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659169 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffe481af-318e-4d07-8f20-b9444f36f745-os-release\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659223 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffe481af-318e-4d07-8f20-b9444f36f745-os-release\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659228 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mptgs\" (UniqueName: \"kubernetes.io/projected/ffe481af-318e-4d07-8f20-b9444f36f745-kube-api-access-mptgs\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659258 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-registration-dir\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659308 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-cni-bin\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659337 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659354 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-registration-dir\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659362 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-host\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659388 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gzsb\" (UniqueName: \"kubernetes.io/projected/bf971c67-e639-4e28-bb08-9dabf323dcb8-kube-api-access-6gzsb\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659392 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71766548-f776-4156-bfd3-486b8af99ab8-iptables-alerter-script\") pod \"iptables-alerter-lpjb2\" (UID: \"71766548-f776-4156-bfd3-486b8af99ab8\") " pod="openshift-network-operator/iptables-alerter-lpjb2" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659409 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-cni-bin\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659428 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-multus-conf-dir\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659465 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-multus-conf-dir\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.660182 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659465 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwcb4\" (UniqueName: \"kubernetes.io/projected/71766548-f776-4156-bfd3-486b8af99ab8-kube-api-access-qwcb4\") pod \"iptables-alerter-lpjb2\" (UID: \"71766548-f776-4156-bfd3-486b8af99ab8\") " pod="openshift-network-operator/iptables-alerter-lpjb2" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659501 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659516 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-etc-openvswitch\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659560 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/432776d9-7c1f-4742-bd20-da704e768581-hosts-file\") pod \"node-resolver-xb8nw\" (UID: \"432776d9-7c1f-4742-bd20-da704e768581\") " pod="openshift-dns/node-resolver-xb8nw" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659589 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ffe481af-318e-4d07-8f20-b9444f36f745-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659608 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-etc-openvswitch\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659620 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-etc-selinux\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659608 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-host\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659678 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf971c67-e639-4e28-bb08-9dabf323dcb8-tmp\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659732 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-system-cni-dir\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659750 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-etc-selinux\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659801 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-cnibin\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659847 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-run-multus-certs\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659862 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-cnibin\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659873 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659912 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tw2zg\" (UniqueName: \"kubernetes.io/projected/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-kube-api-access-tw2zg\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659932 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-run-multus-certs\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659938 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe481af-318e-4d07-8f20-b9444f36f745-cnibin\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.661096 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:31.659959 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659977 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-sysctl-d\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660020 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-sys\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660031 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ffe481af-318e-4d07-8f20-b9444f36f745-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:31.660054 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs podName:b0cabb11-fb0d-4a2a-b250-f4cc748429ba nodeName:}" failed. No retries permitted until 2026-05-21 20:38:32.160023025 +0000 UTC m=+3.051885621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs") pod "network-metrics-daemon-8jlfz" (UID: "b0cabb11-fb0d-4a2a-b250-f4cc748429ba") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660065 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-sys\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660088 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e251c5e-f46c-46ad-be14-c2db03260a1c-konnectivity-ca\") pod \"konnectivity-agent-rbpj6\" (UID: \"7e251c5e-f46c-46ad-be14-c2db03260a1c\") " pod="kube-system/konnectivity-agent-rbpj6" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660105 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe481af-318e-4d07-8f20-b9444f36f745-cnibin\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660120 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1daa7f15-874e-4696-802f-f7505865a63b-serviceca\") pod \"node-ca-vf548\" (UID: \"1daa7f15-874e-4696-802f-f7505865a63b\") " pod="openshift-image-registry/node-ca-vf548" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660162 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-sysctl-d\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660214 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-multus-cni-dir\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660261 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-slash\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660287 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-run-ovn-kubernetes\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660312 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c149b399-f275-4534-9b50-410a8df81fad-ovn-node-metrics-cert\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660336 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-slash\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660365 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-host-run-ovn-kubernetes\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660367 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-multus-cni-dir\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.662014 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660337 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c149b399-f275-4534-9b50-410a8df81fad-ovnkube-script-lib\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660462 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-kubernetes\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660489 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-sysctl-conf\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660516 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-var-lib-kubelet\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660540 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-tuned\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660571 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33e24c13-2fea-4546-8f05-a510637a3947-multus-daemon-config\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660597 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhbbb\" (UniqueName: \"kubernetes.io/projected/c149b399-f275-4534-9b50-410a8df81fad-kube-api-access-vhbbb\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660623 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e251c5e-f46c-46ad-be14-c2db03260a1c-konnectivity-ca\") pod \"konnectivity-agent-rbpj6\" (UID: \"7e251c5e-f46c-46ad-be14-c2db03260a1c\") " pod="kube-system/konnectivity-agent-rbpj6" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660628 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1daa7f15-874e-4696-802f-f7505865a63b-host\") pod \"node-ca-vf548\" (UID: \"1daa7f15-874e-4696-802f-f7505865a63b\") " pod="openshift-image-registry/node-ca-vf548" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660680 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-kubernetes\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660690 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-socket-dir\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660718 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-var-lib-cni-multus\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660751 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe481af-318e-4d07-8f20-b9444f36f745-system-cni-dir\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660782 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ffe481af-318e-4d07-8f20-b9444f36f745-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660809 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-sysconfig\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660833 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-run-k8s-cni-cncf-io\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660888 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-run-systemd\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.663211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660915 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c149b399-f275-4534-9b50-410a8df81fad-env-overrides\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660954 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-systemd\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660972 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c149b399-f275-4534-9b50-410a8df81fad-ovnkube-script-lib\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.660983 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c149b399-f275-4534-9b50-410a8df81fad-ovnkube-config\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661017 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe481af-318e-4d07-8f20-b9444f36f745-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661041 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-run\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661046 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-sysconfig\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661064 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71766548-f776-4156-bfd3-486b8af99ab8-host-slash\") pod \"iptables-alerter-lpjb2\" (UID: \"71766548-f776-4156-bfd3-486b8af99ab8\") " pod="openshift-network-operator/iptables-alerter-lpjb2" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661116 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsll7\" (UniqueName: \"kubernetes.io/projected/432776d9-7c1f-4742-bd20-da704e768581-kube-api-access-vsll7\") pod \"node-resolver-xb8nw\" (UID: \"432776d9-7c1f-4742-bd20-da704e768581\") " pod="openshift-dns/node-resolver-xb8nw" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661153 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/018cb627-5cf2-4fce-b8ef-7463df565a15-socket-dir\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661194 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33e24c13-2fea-4546-8f05-a510637a3947-multus-daemon-config\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661197 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-var-lib-cni-multus\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661224 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-host-run-k8s-cni-cncf-io\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661228 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe481af-318e-4d07-8f20-b9444f36f745-system-cni-dir\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661275 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c149b399-f275-4534-9b50-410a8df81fad-run-systemd\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661681 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c149b399-f275-4534-9b50-410a8df81fad-env-overrides\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661680 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ffe481af-318e-4d07-8f20-b9444f36f745-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.664337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661765 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-systemd\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.665210 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661792 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-sysctl-conf\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.665210 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661847 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-var-lib-kubelet\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.665210 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661898 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf971c67-e639-4e28-bb08-9dabf323dcb8-run\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.665210 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.661896 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e251c5e-f46c-46ad-be14-c2db03260a1c-agent-certs\") pod \"konnectivity-agent-rbpj6\" (UID: \"7e251c5e-f46c-46ad-be14-c2db03260a1c\") " pod="kube-system/konnectivity-agent-rbpj6" May 21 20:38:31.665210 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.662017 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe481af-318e-4d07-8f20-b9444f36f745-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.665210 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.662018 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71766548-f776-4156-bfd3-486b8af99ab8-host-slash\") pod \"iptables-alerter-lpjb2\" (UID: \"71766548-f776-4156-bfd3-486b8af99ab8\") " pod="openshift-network-operator/iptables-alerter-lpjb2" May 21 20:38:31.665210 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.662217 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c149b399-f275-4534-9b50-410a8df81fad-ovnkube-config\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.665210 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.659790 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33e24c13-2fea-4546-8f05-a510637a3947-system-cni-dir\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.665210 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.662459 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf971c67-e639-4e28-bb08-9dabf323dcb8-tmp\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.665210 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.662938 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c149b399-f275-4534-9b50-410a8df81fad-ovn-node-metrics-cert\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.665210 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.663479 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf971c67-e639-4e28-bb08-9dabf323dcb8-etc-tuned\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.667545 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.667468 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsgq7\" (UniqueName: \"kubernetes.io/projected/018cb627-5cf2-4fce-b8ef-7463df565a15-kube-api-access-bsgq7\") pod \"aws-ebs-csi-driver-node-m8wrd\" (UID: \"018cb627-5cf2-4fce-b8ef-7463df565a15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.667757 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.667737 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gzsb\" (UniqueName: \"kubernetes.io/projected/bf971c67-e639-4e28-bb08-9dabf323dcb8-kube-api-access-6gzsb\") pod \"tuned-29bft\" (UID: \"bf971c67-e639-4e28-bb08-9dabf323dcb8\") " pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.668687 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.668662 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-282pk\" (UniqueName: \"kubernetes.io/projected/33e24c13-2fea-4546-8f05-a510637a3947-kube-api-access-282pk\") pod \"multus-tvvlr\" (UID: \"33e24c13-2fea-4546-8f05-a510637a3947\") " pod="openshift-multus/multus-tvvlr" May 21 20:38:31.668947 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.668898 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwcb4\" (UniqueName: \"kubernetes.io/projected/71766548-f776-4156-bfd3-486b8af99ab8-kube-api-access-qwcb4\") pod \"iptables-alerter-lpjb2\" (UID: \"71766548-f776-4156-bfd3-486b8af99ab8\") " pod="openshift-network-operator/iptables-alerter-lpjb2" May 21 20:38:31.669767 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.669744 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhbbb\" (UniqueName: \"kubernetes.io/projected/c149b399-f275-4534-9b50-410a8df81fad-kube-api-access-vhbbb\") pod \"ovnkube-node-5zmnk\" (UID: \"c149b399-f275-4534-9b50-410a8df81fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.669869 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.669844 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mptgs\" (UniqueName: \"kubernetes.io/projected/ffe481af-318e-4d07-8f20-b9444f36f745-kube-api-access-mptgs\") pod \"multus-additional-cni-plugins-wqj25\" (UID: \"ffe481af-318e-4d07-8f20-b9444f36f745\") " pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.670032 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.670012 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw2zg\" (UniqueName: \"kubernetes.io/projected/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-kube-api-access-tw2zg\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:31.762222 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.762193 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/432776d9-7c1f-4742-bd20-da704e768581-hosts-file\") pod \"node-resolver-xb8nw\" (UID: \"432776d9-7c1f-4742-bd20-da704e768581\") " pod="openshift-dns/node-resolver-xb8nw" May 21 20:38:31.762368 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.762240 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1daa7f15-874e-4696-802f-f7505865a63b-serviceca\") pod \"node-ca-vf548\" (UID: \"1daa7f15-874e-4696-802f-f7505865a63b\") " pod="openshift-image-registry/node-ca-vf548" May 21 20:38:31.762368 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.762338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/432776d9-7c1f-4742-bd20-da704e768581-hosts-file\") pod \"node-resolver-xb8nw\" (UID: \"432776d9-7c1f-4742-bd20-da704e768581\") " pod="openshift-dns/node-resolver-xb8nw" May 21 20:38:31.762491 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.762365 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1daa7f15-874e-4696-802f-f7505865a63b-host\") pod \"node-ca-vf548\" (UID: \"1daa7f15-874e-4696-802f-f7505865a63b\") " pod="openshift-image-registry/node-ca-vf548" May 21 20:38:31.762491 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.762436 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1daa7f15-874e-4696-802f-f7505865a63b-host\") pod \"node-ca-vf548\" (UID: \"1daa7f15-874e-4696-802f-f7505865a63b\") " pod="openshift-image-registry/node-ca-vf548" May 21 20:38:31.762491 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.762455 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vsll7\" (UniqueName: \"kubernetes.io/projected/432776d9-7c1f-4742-bd20-da704e768581-kube-api-access-vsll7\") pod \"node-resolver-xb8nw\" (UID: \"432776d9-7c1f-4742-bd20-da704e768581\") " pod="openshift-dns/node-resolver-xb8nw" May 21 20:38:31.762630 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.762495 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/432776d9-7c1f-4742-bd20-da704e768581-tmp-dir\") pod \"node-resolver-xb8nw\" (UID: \"432776d9-7c1f-4742-bd20-da704e768581\") " pod="openshift-dns/node-resolver-xb8nw" May 21 20:38:31.762630 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.762517 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nltpm\" (UniqueName: \"kubernetes.io/projected/1daa7f15-874e-4696-802f-f7505865a63b-kube-api-access-nltpm\") pod \"node-ca-vf548\" (UID: \"1daa7f15-874e-4696-802f-f7505865a63b\") " pod="openshift-image-registry/node-ca-vf548" May 21 20:38:31.762630 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.762553 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gsj7\" (UniqueName: \"kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7\") pod \"network-check-target-n9xvd\" (UID: \"d83f554e-2053-4eff-9e99-f6e6761a4156\") " pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:31.762845 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.762790 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1daa7f15-874e-4696-802f-f7505865a63b-serviceca\") pod \"node-ca-vf548\" (UID: \"1daa7f15-874e-4696-802f-f7505865a63b\") " pod="openshift-image-registry/node-ca-vf548" May 21 20:38:31.762845 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.762802 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/432776d9-7c1f-4742-bd20-da704e768581-tmp-dir\") pod \"node-resolver-xb8nw\" (UID: \"432776d9-7c1f-4742-bd20-da704e768581\") " pod="openshift-dns/node-resolver-xb8nw" May 21 20:38:31.768806 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:31.768783 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:31.768806 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:31.768810 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:31.769008 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:31.768822 2573 projected.go:194] Error preparing data for projected volume kube-api-access-9gsj7 for pod openshift-network-diagnostics/network-check-target-n9xvd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:31.769008 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:31.768891 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7 podName:d83f554e-2053-4eff-9e99-f6e6761a4156 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:32.268870184 +0000 UTC m=+3.160732761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9gsj7" (UniqueName: "kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7") pod "network-check-target-n9xvd" (UID: "d83f554e-2053-4eff-9e99-f6e6761a4156") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:31.770848 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.770824 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsll7\" (UniqueName: \"kubernetes.io/projected/432776d9-7c1f-4742-bd20-da704e768581-kube-api-access-vsll7\") pod \"node-resolver-xb8nw\" (UID: \"432776d9-7c1f-4742-bd20-da704e768581\") " pod="openshift-dns/node-resolver-xb8nw" May 21 20:38:31.770848 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.770846 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nltpm\" (UniqueName: \"kubernetes.io/projected/1daa7f15-874e-4696-802f-f7505865a63b-kube-api-access-nltpm\") pod \"node-ca-vf548\" (UID: \"1daa7f15-874e-4696-802f-f7505865a63b\") " pod="openshift-image-registry/node-ca-vf548" May 21 20:38:31.848371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.848339 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rbpj6" May 21 20:38:31.858293 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.858262 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqj25" May 21 20:38:31.859765 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.859745 2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:31.865870 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.865840 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xb8nw" May 21 20:38:31.873489 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.873464 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tvvlr" May 21 20:38:31.880058 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.880032 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lpjb2" May 21 20:38:31.887630 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.887610 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:31.896320 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.896292 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" May 21 20:38:31.900997 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.900976 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-29bft" May 21 20:38:31.905482 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:31.905459 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vf548" May 21 20:38:32.165662 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.165578 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:32.165801 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:32.165704 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:32.165801 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:32.165768 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs podName:b0cabb11-fb0d-4a2a-b250-f4cc748429ba nodeName:}" failed. No retries permitted until 2026-05-21 20:38:33.16575008 +0000 UTC m=+4.057612671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs") pod "network-metrics-daemon-8jlfz" (UID: "b0cabb11-fb0d-4a2a-b250-f4cc748429ba") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:32.273292 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:32.273069 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e24c13_2fea_4546_8f05_a510637a3947.slice/crio-b795d4e6bab6f09100865b35418da4e7a723624b7a186b69f22b087da4a2d0ea WatchSource:0}: Error finding container b795d4e6bab6f09100865b35418da4e7a723624b7a186b69f22b087da4a2d0ea: Status 404 returned error can't find the container with id b795d4e6bab6f09100865b35418da4e7a723624b7a186b69f22b087da4a2d0ea May 21 20:38:32.274149 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:32.274114 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc149b399_f275_4534_9b50_410a8df81fad.slice/crio-b657cba450c43e52410db3ad0ebab0a2a82c93de1bc2140a76aced719382a7ab WatchSource:0}: Error finding container b657cba450c43e52410db3ad0ebab0a2a82c93de1bc2140a76aced719382a7ab: Status 404 returned error can't find the container with id b657cba450c43e52410db3ad0ebab0a2a82c93de1bc2140a76aced719382a7ab May 21 20:38:32.275872 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:32.275846 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf971c67_e639_4e28_bb08_9dabf323dcb8.slice/crio-2996dbeecc891caba22a27285a61e6c4e329fd2d6f3bfe9a26b1eb7efe74d8e8 WatchSource:0}: Error finding container 2996dbeecc891caba22a27285a61e6c4e329fd2d6f3bfe9a26b1eb7efe74d8e8: Status 404 returned error can't find the container with id 2996dbeecc891caba22a27285a61e6c4e329fd2d6f3bfe9a26b1eb7efe74d8e8 May 21 20:38:32.277703 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:32.277501 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe481af_318e_4d07_8f20_b9444f36f745.slice/crio-b3aacbe0943d7459a984a2183861c612cfcbde4ca1eeb6c28de88e92e6f99514 WatchSource:0}: Error finding container b3aacbe0943d7459a984a2183861c612cfcbde4ca1eeb6c28de88e92e6f99514: Status 404 returned error can't find the container with id b3aacbe0943d7459a984a2183861c612cfcbde4ca1eeb6c28de88e92e6f99514 May 21 20:38:32.280231 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:32.280209 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432776d9_7c1f_4742_bd20_da704e768581.slice/crio-3426b6a8eaa1b05d611cc2d6032b0299b08d0e1c52b1bd35e3fc65ceb9c7d601 WatchSource:0}: Error finding container 3426b6a8eaa1b05d611cc2d6032b0299b08d0e1c52b1bd35e3fc65ceb9c7d601: Status 404 returned error can't find the container with id 3426b6a8eaa1b05d611cc2d6032b0299b08d0e1c52b1bd35e3fc65ceb9c7d601 May 21 20:38:32.282725 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:32.282666 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod018cb627_5cf2_4fce_b8ef_7463df565a15.slice/crio-9c7319124c7b10829b6b0c5f1bd552b962498868db91981d5c5cc117643e2f4a WatchSource:0}: Error finding container 9c7319124c7b10829b6b0c5f1bd552b962498868db91981d5c5cc117643e2f4a: Status 404 returned error can't find the container with id 9c7319124c7b10829b6b0c5f1bd552b962498868db91981d5c5cc117643e2f4a May 21 20:38:32.284088 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:32.284067 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e251c5e_f46c_46ad_be14_c2db03260a1c.slice/crio-b23dca6e95942f5881b9e082e48891bfbc61dd3f61382ce85ae380a5c904ac86 WatchSource:0}: Error finding container b23dca6e95942f5881b9e082e48891bfbc61dd3f61382ce85ae380a5c904ac86: Status 404 returned error can't find the container with id b23dca6e95942f5881b9e082e48891bfbc61dd3f61382ce85ae380a5c904ac86 May 21 20:38:32.285505 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:32.285300 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71766548_f776_4156_bfd3_486b8af99ab8.slice/crio-f23cae0062ad8b1ca80e472b47f26b32a0d93739bbab3306e2385add18c17096 WatchSource:0}: Error finding container f23cae0062ad8b1ca80e472b47f26b32a0d93739bbab3306e2385add18c17096: Status 404 returned error can't find the container with id f23cae0062ad8b1ca80e472b47f26b32a0d93739bbab3306e2385add18c17096 May 21 20:38:32.287153 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:38:32.287126 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1daa7f15_874e_4696_802f_f7505865a63b.slice/crio-9c918dccdc3538c1db01a0b8fd100f1fb9acb90f16c48dc39d6eb65678235565 WatchSource:0}: Error finding container 9c918dccdc3538c1db01a0b8fd100f1fb9acb90f16c48dc39d6eb65678235565: Status 404 returned error can't find the container with id 9c918dccdc3538c1db01a0b8fd100f1fb9acb90f16c48dc39d6eb65678235565 May 21 20:38:32.366642 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.366618 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gsj7\" (UniqueName: \"kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7\") pod \"network-check-target-n9xvd\" (UID: \"d83f554e-2053-4eff-9e99-f6e6761a4156\") " pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:32.366770 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:32.366754 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:32.366828 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:32.366778 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:32.366828 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:32.366790 2573 projected.go:194] Error preparing data for projected volume kube-api-access-9gsj7 for pod openshift-network-diagnostics/network-check-target-n9xvd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:32.366913 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:32.366846 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7 podName:d83f554e-2053-4eff-9e99-f6e6761a4156 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:33.366826899 +0000 UTC m=+4.258689493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9gsj7" (UniqueName: "kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7") pod "network-check-target-n9xvd" (UID: "d83f554e-2053-4eff-9e99-f6e6761a4156") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:32.584965 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.584920 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 20:33:30 +0000 UTC" deadline="2027-11-15 05:35:30.602123207 +0000 UTC" May 21 20:38:32.584965 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.584957 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13016h56m58.017168047s" May 21 20:38:32.684168 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.684109 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rbpj6" event={"ID":"7e251c5e-f46c-46ad-be14-c2db03260a1c","Type":"ContainerStarted","Data":"b23dca6e95942f5881b9e082e48891bfbc61dd3f61382ce85ae380a5c904ac86"} May 21 20:38:32.686281 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.686158 2573 generic.go:358] "Generic (PLEG): container finished" podID="8c02b281b5099bbf12eeec7ce05b614e" containerID="dfe2b4c453fdb31d691dd84f59c6bec1f36b726e2c3f82d832801f9e4f27e509" exitCode=0 May 21 20:38:32.686281 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.686240 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal" event={"ID":"8c02b281b5099bbf12eeec7ce05b614e","Type":"ContainerDied","Data":"dfe2b4c453fdb31d691dd84f59c6bec1f36b726e2c3f82d832801f9e4f27e509"} May 21 20:38:32.687581 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.687520 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vf548" event={"ID":"1daa7f15-874e-4696-802f-f7505865a63b","Type":"ContainerStarted","Data":"9c918dccdc3538c1db01a0b8fd100f1fb9acb90f16c48dc39d6eb65678235565"} May 21 20:38:32.688983 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.688951 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" event={"ID":"018cb627-5cf2-4fce-b8ef-7463df565a15","Type":"ContainerStarted","Data":"9c7319124c7b10829b6b0c5f1bd552b962498868db91981d5c5cc117643e2f4a"} May 21 20:38:32.689945 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.689923 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xb8nw" event={"ID":"432776d9-7c1f-4742-bd20-da704e768581","Type":"ContainerStarted","Data":"3426b6a8eaa1b05d611cc2d6032b0299b08d0e1c52b1bd35e3fc65ceb9c7d601"} May 21 20:38:32.691497 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.691430 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqj25" event={"ID":"ffe481af-318e-4d07-8f20-b9444f36f745","Type":"ContainerStarted","Data":"b3aacbe0943d7459a984a2183861c612cfcbde4ca1eeb6c28de88e92e6f99514"} May 21 20:38:32.693814 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.693461 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-29bft" event={"ID":"bf971c67-e639-4e28-bb08-9dabf323dcb8","Type":"ContainerStarted","Data":"2996dbeecc891caba22a27285a61e6c4e329fd2d6f3bfe9a26b1eb7efe74d8e8"} May 21 20:38:32.695003 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.694948 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" event={"ID":"c149b399-f275-4534-9b50-410a8df81fad","Type":"ContainerStarted","Data":"b657cba450c43e52410db3ad0ebab0a2a82c93de1bc2140a76aced719382a7ab"} May 21 20:38:32.696963 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.696936 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tvvlr" event={"ID":"33e24c13-2fea-4546-8f05-a510637a3947","Type":"ContainerStarted","Data":"b795d4e6bab6f09100865b35418da4e7a723624b7a186b69f22b087da4a2d0ea"} May 21 20:38:32.698868 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.698844 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.ec2.internal" event={"ID":"1ded2943643923fe492defbee7ce9d57","Type":"ContainerStarted","Data":"46a2e824eef0c273cb9ec202dc06a3c7414fea788f5d7acb50e911e1d3ee886f"} May 21 20:38:32.701498 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.701475 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lpjb2" event={"ID":"71766548-f776-4156-bfd3-486b8af99ab8","Type":"ContainerStarted","Data":"f23cae0062ad8b1ca80e472b47f26b32a0d93739bbab3306e2385add18c17096"} May 21 20:38:32.714678 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:32.714624 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.ec2.internal" podStartSLOduration=2.71460577 podStartE2EDuration="2.71460577s" podCreationTimestamp="2026-05-21 20:38:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:38:32.714244269 +0000 UTC m=+3.606106868" watchObservedRunningTime="2026-05-21 20:38:32.71460577 +0000 UTC m=+3.606468372" May 21 20:38:33.172899 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:33.172807 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:33.173074 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:33.172971 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:33.173074 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:33.173036 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs podName:b0cabb11-fb0d-4a2a-b250-f4cc748429ba nodeName:}" failed. No retries permitted until 2026-05-21 20:38:35.173017652 +0000 UTC m=+6.064880233 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs") pod "network-metrics-daemon-8jlfz" (UID: "b0cabb11-fb0d-4a2a-b250-f4cc748429ba") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:33.374776 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:33.374731 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gsj7\" (UniqueName: \"kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7\") pod \"network-check-target-n9xvd\" (UID: \"d83f554e-2053-4eff-9e99-f6e6761a4156\") " pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:33.374952 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:33.374940 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:33.375028 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:33.374961 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:33.375028 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:33.374975 2573 projected.go:194] Error preparing data for projected volume kube-api-access-9gsj7 for pod openshift-network-diagnostics/network-check-target-n9xvd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:33.375128 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:33.375051 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7 podName:d83f554e-2053-4eff-9e99-f6e6761a4156 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:35.375032059 +0000 UTC m=+6.266894639 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9gsj7" (UniqueName: "kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7") pod "network-check-target-n9xvd" (UID: "d83f554e-2053-4eff-9e99-f6e6761a4156") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:33.677745 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:33.677095 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:33.677745 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:33.677254 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:33.677745 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:33.677632 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:33.678327 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:33.677752 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:38:33.722551 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:33.722482 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal" event={"ID":"8c02b281b5099bbf12eeec7ce05b614e","Type":"ContainerStarted","Data":"252ced15eb30060e7449cd4c7a1bc3f9a6ee6183c5197ec835c06cee1ad5dd32"} May 21 20:38:33.736213 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:33.735812 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.ec2.internal" podStartSLOduration=3.735792365 podStartE2EDuration="3.735792365s" podCreationTimestamp="2026-05-21 20:38:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:38:33.735579353 +0000 UTC m=+4.627441952" watchObservedRunningTime="2026-05-21 20:38:33.735792365 +0000 UTC m=+4.627654964" May 21 20:38:35.192677 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:35.192635 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:35.193185 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:35.192793 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:35.193185 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:35.192858 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs podName:b0cabb11-fb0d-4a2a-b250-f4cc748429ba nodeName:}" failed. No retries permitted until 2026-05-21 20:38:39.192837745 +0000 UTC m=+10.084700328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs") pod "network-metrics-daemon-8jlfz" (UID: "b0cabb11-fb0d-4a2a-b250-f4cc748429ba") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:35.394689 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:35.394646 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gsj7\" (UniqueName: \"kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7\") pod \"network-check-target-n9xvd\" (UID: \"d83f554e-2053-4eff-9e99-f6e6761a4156\") " pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:35.394867 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:35.394836 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:35.394867 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:35.394857 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:35.394867 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:35.394869 2573 projected.go:194] Error preparing data for projected volume kube-api-access-9gsj7 for pod openshift-network-diagnostics/network-check-target-n9xvd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:35.395014 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:35.394930 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7 podName:d83f554e-2053-4eff-9e99-f6e6761a4156 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:39.394909493 +0000 UTC m=+10.286772086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9gsj7" (UniqueName: "kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7") pod "network-check-target-n9xvd" (UID: "d83f554e-2053-4eff-9e99-f6e6761a4156") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:35.678387 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:35.678300 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:35.678571 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:35.678439 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:35.678641 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:35.678611 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:35.678757 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:35.678736 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:38:37.677463 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:37.677423 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:37.677933 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:37.677573 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:37.677933 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:37.677426 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:37.677933 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:37.677791 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:38:39.226596 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:39.226553 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:39.227064 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:39.226729 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:39.227064 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:39.226816 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs podName:b0cabb11-fb0d-4a2a-b250-f4cc748429ba nodeName:}" failed. No retries permitted until 2026-05-21 20:38:47.22679204 +0000 UTC m=+18.118654634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs") pod "network-metrics-daemon-8jlfz" (UID: "b0cabb11-fb0d-4a2a-b250-f4cc748429ba") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:39.428358 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:39.428259 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gsj7\" (UniqueName: \"kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7\") pod \"network-check-target-n9xvd\" (UID: \"d83f554e-2053-4eff-9e99-f6e6761a4156\") " pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:39.428553 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:39.428469 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:39.428553 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:39.428498 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:39.428553 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:39.428513 2573 projected.go:194] Error preparing data for projected volume kube-api-access-9gsj7 for pod openshift-network-diagnostics/network-check-target-n9xvd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:39.428732 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:39.428579 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7 podName:d83f554e-2053-4eff-9e99-f6e6761a4156 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:47.428559381 +0000 UTC m=+18.320421962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9gsj7" (UniqueName: "kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7") pod "network-check-target-n9xvd" (UID: "d83f554e-2053-4eff-9e99-f6e6761a4156") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:39.678060 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:39.677862 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:39.678060 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:39.677915 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:39.678060 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:39.678012 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:38:39.678318 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:39.678130 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:41.676884 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:41.676840 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:41.677354 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:41.676975 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:41.677354 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:41.677050 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:41.677354 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:41.677168 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:38:43.676842 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:43.676792 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:43.677325 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:43.676928 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:43.677325 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:43.676792 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:43.677325 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:43.677064 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:38:45.677343 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:45.677301 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:45.677763 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:45.677301 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:45.677763 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:45.677439 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:38:45.677763 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:45.677515 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:47.286575 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:47.286531 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:47.287059 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:47.286710 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:47.287059 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:47.286798 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs podName:b0cabb11-fb0d-4a2a-b250-f4cc748429ba nodeName:}" failed. No retries permitted until 2026-05-21 20:39:03.286777376 +0000 UTC m=+34.178639956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs") pod "network-metrics-daemon-8jlfz" (UID: "b0cabb11-fb0d-4a2a-b250-f4cc748429ba") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:47.487389 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:47.487346 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gsj7\" (UniqueName: \"kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7\") pod \"network-check-target-n9xvd\" (UID: \"d83f554e-2053-4eff-9e99-f6e6761a4156\") " pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:47.487601 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:47.487524 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:47.487601 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:47.487552 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:47.487601 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:47.487565 2573 projected.go:194] Error preparing data for projected volume kube-api-access-9gsj7 for pod openshift-network-diagnostics/network-check-target-n9xvd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:47.487791 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:47.487618 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7 podName:d83f554e-2053-4eff-9e99-f6e6761a4156 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:03.487604578 +0000 UTC m=+34.379467154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9gsj7" (UniqueName: "kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7") pod "network-check-target-n9xvd" (UID: "d83f554e-2053-4eff-9e99-f6e6761a4156") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:47.677475 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:47.677372 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:47.677475 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:47.677442 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:47.677696 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:47.677522 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:47.677752 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:47.677696 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:38:49.678678 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:49.678634 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:49.679177 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:49.678754 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:49.679177 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:49.678843 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:49.679177 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:49.678954 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:38:50.757037 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:50.756658 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" event={"ID":"018cb627-5cf2-4fce-b8ef-7463df565a15","Type":"ContainerStarted","Data":"51059ed662aa53504bce0dd7395895e398f1c02571f6ef41bb91a90adcbfe22d"} May 21 20:38:50.758124 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:50.758082 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xb8nw" event={"ID":"432776d9-7c1f-4742-bd20-da704e768581","Type":"ContainerStarted","Data":"92c4c08a1e217553cd3a0ab86de707dc0268057aef056d2d6422f0d3a68b250f"} May 21 20:38:50.759811 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:50.759782 2573 generic.go:358] "Generic (PLEG): container finished" podID="ffe481af-318e-4d07-8f20-b9444f36f745" containerID="53c9c8d54bb4c2002a8dbbcc2c5769871c87875b99ef015614208a509d22d563" exitCode=0 May 21 20:38:50.759942 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:50.759830 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqj25" event={"ID":"ffe481af-318e-4d07-8f20-b9444f36f745","Type":"ContainerDied","Data":"53c9c8d54bb4c2002a8dbbcc2c5769871c87875b99ef015614208a509d22d563"} May 21 20:38:50.761348 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:50.761241 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-29bft" event={"ID":"bf971c67-e639-4e28-bb08-9dabf323dcb8","Type":"ContainerStarted","Data":"c117875dfdfac1f495b761d563f6de06a0eb71fe5c5de84043f80e7953febcfb"} May 21 20:38:50.763488 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:50.763464 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" event={"ID":"c149b399-f275-4534-9b50-410a8df81fad","Type":"ContainerStarted","Data":"c522bd6091196ed73f053ae504ee0af5b20b798b4b80efbee71e949a513598d1"} May 21 20:38:50.763599 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:50.763495 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" event={"ID":"c149b399-f275-4534-9b50-410a8df81fad","Type":"ContainerStarted","Data":"2cb821645bb812790b5e591e74f7e6d6b81791c7f2df0965c9319e5bf30d1d21"} May 21 20:38:50.765130 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:50.765106 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tvvlr" event={"ID":"33e24c13-2fea-4546-8f05-a510637a3947","Type":"ContainerStarted","Data":"aa14758352822e3ebd5ba13f135593395afc6c12b20220ca6776357e22905f3f"} May 21 20:38:50.766657 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:50.766611 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rbpj6" event={"ID":"7e251c5e-f46c-46ad-be14-c2db03260a1c","Type":"ContainerStarted","Data":"77d9b0b48dbdd92aa04295f720040cfa5aa3d4ed986ac716472ad6910e927c7b"} May 21 20:38:50.768599 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:50.768574 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vf548" event={"ID":"1daa7f15-874e-4696-802f-f7505865a63b","Type":"ContainerStarted","Data":"ad1b74605aa5970c8fe31982558a575088e8924ef04328c897a6d70145e9423d"} May 21 20:38:50.777804 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:50.777757 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-xb8nw" podStartSLOduration=3.698255665 podStartE2EDuration="21.777738859s" podCreationTimestamp="2026-05-21 20:38:29 +0000 UTC" firstStartedPulling="2026-05-21 20:38:32.284240072 +0000 UTC m=+3.176102650" lastFinishedPulling="2026-05-21 20:38:50.363723253 +0000 UTC m=+21.255585844" observedRunningTime="2026-05-21 20:38:50.777523113 +0000 UTC m=+21.669385761" watchObservedRunningTime="2026-05-21 20:38:50.777738859 +0000 UTC m=+21.669601462" May 21 20:38:50.820956 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:50.820912 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-tvvlr" podStartSLOduration=3.541036225 podStartE2EDuration="21.820897724s" podCreationTimestamp="2026-05-21 20:38:29 +0000 UTC" firstStartedPulling="2026-05-21 20:38:32.27492878 +0000 UTC m=+3.166791355" lastFinishedPulling="2026-05-21 20:38:50.554790277 +0000 UTC m=+21.446652854" observedRunningTime="2026-05-21 20:38:50.82043917 +0000 UTC m=+21.712301764" watchObservedRunningTime="2026-05-21 20:38:50.820897724 +0000 UTC m=+21.712760321" May 21 20:38:50.838367 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:50.838322 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-29bft" podStartSLOduration=3.750370697 podStartE2EDuration="21.838306932s" podCreationTimestamp="2026-05-21 20:38:29 +0000 UTC" firstStartedPulling="2026-05-21 20:38:32.278116576 +0000 UTC m=+3.169979166" lastFinishedPulling="2026-05-21 20:38:50.366052818 +0000 UTC m=+21.257915401" observedRunningTime="2026-05-21 20:38:50.837903919 +0000 UTC m=+21.729766531" watchObservedRunningTime="2026-05-21 20:38:50.838306932 +0000 UTC m=+21.730169529" May 21 20:38:50.853147 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:50.853097 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vf548" podStartSLOduration=8.5430276 podStartE2EDuration="21.853081191s" podCreationTimestamp="2026-05-21 20:38:29 +0000 UTC" firstStartedPulling="2026-05-21 20:38:32.288800807 +0000 UTC m=+3.180663384" lastFinishedPulling="2026-05-21 20:38:45.598854396 +0000 UTC m=+16.490716975" observedRunningTime="2026-05-21 20:38:50.852862663 +0000 UTC m=+21.744725262" watchObservedRunningTime="2026-05-21 20:38:50.853081191 +0000 UTC m=+21.744943788" May 21 20:38:51.676928 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:51.676844 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:51.676928 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:51.676888 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:51.677141 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:51.676980 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:51.677436 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:51.677385 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:38:51.744384 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:51.744352 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 20:38:51.772705 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:51.772661 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" event={"ID":"018cb627-5cf2-4fce-b8ef-7463df565a15","Type":"ContainerStarted","Data":"7ba437fa2acbeb785423d9f1e4942f2c15b0303b2135fac23f7268c1b722aded"} May 21 20:38:51.775608 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:51.775570 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" event={"ID":"c149b399-f275-4534-9b50-410a8df81fad","Type":"ContainerStarted","Data":"7a142a66f6dc56f91429c2c7920a2516066fd2998ab62cf8f20844241cf577ac"} May 21 20:38:51.775608 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:51.775609 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" event={"ID":"c149b399-f275-4534-9b50-410a8df81fad","Type":"ContainerStarted","Data":"6d6a01a35a6759875ce7b25651adca79736b3620c2a247fe4e166856ed93591b"} May 21 20:38:51.775809 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:51.775618 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" event={"ID":"c149b399-f275-4534-9b50-410a8df81fad","Type":"ContainerStarted","Data":"622e4dcb2bba9beeaf9d5efaea91265d955b73338bb0c0a8c211a36d734f764d"} May 21 20:38:51.775809 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:51.775627 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" event={"ID":"c149b399-f275-4534-9b50-410a8df81fad","Type":"ContainerStarted","Data":"5e63bbccf4fe185e3f2d77641503155b57c538a25c521e247370c156a8b1b155"} May 21 20:38:51.776950 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:51.776914 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lpjb2" event={"ID":"71766548-f776-4156-bfd3-486b8af99ab8","Type":"ContainerStarted","Data":"9ba00481ea7ed32d850619c99506f19ade0054ed6b99d712b84a599714183c9a"} May 21 20:38:51.793995 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:51.793931 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lpjb2" podStartSLOduration=9.482728917 podStartE2EDuration="22.793916057s" podCreationTimestamp="2026-05-21 20:38:29 +0000 UTC" firstStartedPulling="2026-05-21 20:38:32.287753189 +0000 UTC m=+3.179615765" lastFinishedPulling="2026-05-21 20:38:45.598940327 +0000 UTC m=+16.490802905" observedRunningTime="2026-05-21 20:38:51.793465276 +0000 UTC m=+22.685327871" watchObservedRunningTime="2026-05-21 20:38:51.793916057 +0000 UTC m=+22.685778655" May 21 20:38:51.794196 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:51.794168 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rbpj6" podStartSLOduration=4.737447401 podStartE2EDuration="22.794161485s" podCreationTimestamp="2026-05-21 20:38:29 +0000 UTC" firstStartedPulling="2026-05-21 20:38:32.286260399 +0000 UTC m=+3.178122977" lastFinishedPulling="2026-05-21 20:38:50.342974469 +0000 UTC m=+21.234837061" observedRunningTime="2026-05-21 20:38:50.866720508 +0000 UTC m=+21.758583107" watchObservedRunningTime="2026-05-21 20:38:51.794161485 +0000 UTC m=+22.686024128" May 21 20:38:52.619837 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:52.619493 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T20:38:51.744379295Z","UUID":"6e1f5e31-f2c2-4670-a298-c3d84b8052fe","Handler":null,"Name":"","Endpoint":""} May 21 20:38:52.621252 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:52.621213 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 20:38:52.621252 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:52.621243 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 20:38:52.781557 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:52.781464 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" event={"ID":"018cb627-5cf2-4fce-b8ef-7463df565a15","Type":"ContainerStarted","Data":"963dfc008dd27d93ea69287681d991860827b8c7e93e705cce0ad4a725c8123b"} May 21 20:38:52.799602 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:52.799542 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8wrd" podStartSLOduration=3.572742148 podStartE2EDuration="23.799525747s" podCreationTimestamp="2026-05-21 20:38:29 +0000 UTC" firstStartedPulling="2026-05-21 20:38:32.285849415 +0000 UTC m=+3.177712006" lastFinishedPulling="2026-05-21 20:38:52.512633025 +0000 UTC m=+23.404495605" observedRunningTime="2026-05-21 20:38:52.799501229 +0000 UTC m=+23.691363828" watchObservedRunningTime="2026-05-21 20:38:52.799525747 +0000 UTC m=+23.691388328" May 21 20:38:53.677529 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:53.677492 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:53.677719 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:53.677492 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:53.677719 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:53.677616 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:38:53.677719 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:53.677705 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:53.786734 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:53.786691 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" event={"ID":"c149b399-f275-4534-9b50-410a8df81fad","Type":"ContainerStarted","Data":"51e25700232e827175de8da6863064a2faea9fb26f31b99b54e92253152f38e7"} May 21 20:38:55.677669 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:55.677451 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:55.678286 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:55.677476 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:55.678286 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:55.677750 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:55.678286 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:55.677818 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:38:55.742125 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:55.742091 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rbpj6" May 21 20:38:55.742766 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:55.742746 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rbpj6" May 21 20:38:55.792447 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:55.792380 2573 generic.go:358] "Generic (PLEG): container finished" podID="ffe481af-318e-4d07-8f20-b9444f36f745" containerID="e3fbcd76946bf2fd45f28b0b9562779df9ba892a4da82c1f39a57171ced4428a" exitCode=0 May 21 20:38:55.792589 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:55.792468 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqj25" event={"ID":"ffe481af-318e-4d07-8f20-b9444f36f745","Type":"ContainerDied","Data":"e3fbcd76946bf2fd45f28b0b9562779df9ba892a4da82c1f39a57171ced4428a"} May 21 20:38:55.795881 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:55.795852 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" event={"ID":"c149b399-f275-4534-9b50-410a8df81fad","Type":"ContainerStarted","Data":"0050a246b64b44b537da40a2ea6e965d2c3dc6d7bf5770430e7fe2b2704bc8fc"} May 21 20:38:55.796152 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:55.796133 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:55.796251 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:55.796161 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:55.812866 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:55.812842 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:55.838221 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:55.838171 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" podStartSLOduration=8.71267967 podStartE2EDuration="26.838156234s" podCreationTimestamp="2026-05-21 20:38:29 +0000 UTC" firstStartedPulling="2026-05-21 20:38:32.27642851 +0000 UTC m=+3.168291098" lastFinishedPulling="2026-05-21 20:38:50.401905074 +0000 UTC m=+21.293767662" observedRunningTime="2026-05-21 20:38:55.837740463 +0000 UTC m=+26.729603073" watchObservedRunningTime="2026-05-21 20:38:55.838156234 +0000 UTC m=+26.730018832" May 21 20:38:56.800012 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:56.799921 2573 generic.go:358] "Generic (PLEG): container finished" podID="ffe481af-318e-4d07-8f20-b9444f36f745" containerID="a9f6ca5d83d4f1e37a76b4588a12beee987c32c8a0062c1122283ce5be923602" exitCode=0 May 21 20:38:56.800416 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:56.800057 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqj25" event={"ID":"ffe481af-318e-4d07-8f20-b9444f36f745","Type":"ContainerDied","Data":"a9f6ca5d83d4f1e37a76b4588a12beee987c32c8a0062c1122283ce5be923602"} May 21 20:38:56.800601 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:56.800583 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:56.816531 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:56.816503 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:38:57.202175 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:57.201862 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n9xvd"] May 21 20:38:57.202335 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:57.202233 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:57.202335 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:57.202318 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:57.206524 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:57.206490 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8jlfz"] May 21 20:38:57.206657 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:57.206607 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:57.206723 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:57.206691 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:38:57.384679 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:57.384641 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rbpj6" May 21 20:38:57.384907 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:57.384810 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 20:38:57.385417 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:57.385379 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rbpj6" May 21 20:38:57.803834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:57.803743 2573 generic.go:358] "Generic (PLEG): container finished" podID="ffe481af-318e-4d07-8f20-b9444f36f745" containerID="62ffdf3fc03af5b31c8d72cc7bd1470f25e6ace914fe9fad0bad31d93114efe7" exitCode=0 May 21 20:38:57.804272 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:57.803827 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqj25" event={"ID":"ffe481af-318e-4d07-8f20-b9444f36f745","Type":"ContainerDied","Data":"62ffdf3fc03af5b31c8d72cc7bd1470f25e6ace914fe9fad0bad31d93114efe7"} May 21 20:38:58.677088 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:58.677051 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:38:58.677294 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:38:58.677096 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:38:58.677294 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:58.677186 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:38:58.677494 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:38:58.677313 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:39:00.677558 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:00.677517 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:39:00.678425 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:00.677530 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:39:00.678425 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:00.677650 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:39:00.678425 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:00.677752 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:39:02.676904 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:02.676869 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:39:02.676904 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:02.676901 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:39:02.677591 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:02.676989 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xvd" podUID="d83f554e-2053-4eff-9e99-f6e6761a4156" May 21 20:39:02.677591 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:02.677160 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:39:03.307705 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:03.307662 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:39:03.308051 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:03.307821 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:39:03.308051 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:03.307889 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs podName:b0cabb11-fb0d-4a2a-b250-f4cc748429ba nodeName:}" failed. No retries permitted until 2026-05-21 20:39:35.307871172 +0000 UTC m=+66.199733748 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs") pod "network-metrics-daemon-8jlfz" (UID: "b0cabb11-fb0d-4a2a-b250-f4cc748429ba") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:39:03.509546 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:03.509503 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gsj7\" (UniqueName: \"kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7\") pod \"network-check-target-n9xvd\" (UID: \"d83f554e-2053-4eff-9e99-f6e6761a4156\") " pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:39:03.509782 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:03.509669 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:39:03.509782 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:03.509692 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:39:03.509782 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:03.509702 2573 projected.go:194] Error preparing data for projected volume kube-api-access-9gsj7 for pod openshift-network-diagnostics/network-check-target-n9xvd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:39:03.509782 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:03.509755 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7 podName:d83f554e-2053-4eff-9e99-f6e6761a4156 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:35.509740135 +0000 UTC m=+66.401602711 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9gsj7" (UniqueName: "kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7") pod "network-check-target-n9xvd" (UID: "d83f554e-2053-4eff-9e99-f6e6761a4156") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:39:03.818485 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:03.818443 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqj25" event={"ID":"ffe481af-318e-4d07-8f20-b9444f36f745","Type":"ContainerStarted","Data":"f3425a1fca5d11233ec5c7da05973c6fb300d1b294335eb3a178638588a829c0"} May 21 20:39:04.470726 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.470529 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-110.ec2.internal" event="NodeReady" May 21 20:39:04.470906 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.470824 2573 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 20:39:04.514462 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.514419 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mmgbz"] May 21 20:39:04.529338 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.529309 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bvldf"] May 21 20:39:04.529509 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.529468 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mmgbz" May 21 20:39:04.532389 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.532360 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 20:39:04.532889 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.532873 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-25972\"" May 21 20:39:04.533275 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.533255 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 20:39:04.543284 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.543253 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mmgbz"] May 21 20:39:04.543416 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.543290 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bvldf"] May 21 20:39:04.543456 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.543414 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:39:04.546157 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.546129 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 20:39:04.546282 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.546196 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f4n69\"" May 21 20:39:04.546282 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.546143 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 20:39:04.546282 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.546143 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 20:39:04.617070 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.617042 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert\") pod \"ingress-canary-bvldf\" (UID: \"a5622334-2813-4e89-8705-ddb46c4132cd\") " pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:39:04.617272 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.617089 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1760ef7c-0c3a-4255-b303-0bf5ccace164-config-volume\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:04.617272 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.617108 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1760ef7c-0c3a-4255-b303-0bf5ccace164-tmp-dir\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:04.617272 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.617149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kktvq\" (UniqueName: \"kubernetes.io/projected/a5622334-2813-4e89-8705-ddb46c4132cd-kube-api-access-kktvq\") pod \"ingress-canary-bvldf\" (UID: \"a5622334-2813-4e89-8705-ddb46c4132cd\") " pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:39:04.617272 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.617173 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:04.617272 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.617188 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km6rf\" (UniqueName: \"kubernetes.io/projected/1760ef7c-0c3a-4255-b303-0bf5ccace164-kube-api-access-km6rf\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:04.677629 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.677594 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:39:04.680514 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.680492 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cjf7l\"" May 21 20:39:04.680653 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.680494 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 20:39:04.703935 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.703904 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:39:04.706781 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.706758 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 20:39:04.706781 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.706772 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hrp5p\"" May 21 20:39:04.706935 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.706797 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 20:39:04.717511 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.717485 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1760ef7c-0c3a-4255-b303-0bf5ccace164-config-volume\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:04.717615 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.717517 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1760ef7c-0c3a-4255-b303-0bf5ccace164-tmp-dir\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:04.717615 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.717537 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kktvq\" (UniqueName: \"kubernetes.io/projected/a5622334-2813-4e89-8705-ddb46c4132cd-kube-api-access-kktvq\") pod \"ingress-canary-bvldf\" (UID: \"a5622334-2813-4e89-8705-ddb46c4132cd\") " pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:39:04.717615 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.717558 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:04.717615 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.717579 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-km6rf\" (UniqueName: \"kubernetes.io/projected/1760ef7c-0c3a-4255-b303-0bf5ccace164-kube-api-access-km6rf\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:04.717762 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.717635 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert\") pod \"ingress-canary-bvldf\" (UID: \"a5622334-2813-4e89-8705-ddb46c4132cd\") " pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:39:04.717762 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:04.717669 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:39:04.717762 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:04.717731 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls podName:1760ef7c-0c3a-4255-b303-0bf5ccace164 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:05.217711239 +0000 UTC m=+36.109573832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls") pod "dns-default-mmgbz" (UID: "1760ef7c-0c3a-4255-b303-0bf5ccace164") : secret "dns-default-metrics-tls" not found May 21 20:39:04.717762 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:04.717730 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:39:04.717894 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:04.717764 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert podName:a5622334-2813-4e89-8705-ddb46c4132cd nodeName:}" failed. No retries permitted until 2026-05-21 20:39:05.217755174 +0000 UTC m=+36.109617764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert") pod "ingress-canary-bvldf" (UID: "a5622334-2813-4e89-8705-ddb46c4132cd") : secret "canary-serving-cert" not found May 21 20:39:04.717933 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.717899 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1760ef7c-0c3a-4255-b303-0bf5ccace164-tmp-dir\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:04.718016 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.718000 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1760ef7c-0c3a-4255-b303-0bf5ccace164-config-volume\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:04.728185 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.728102 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-km6rf\" (UniqueName: \"kubernetes.io/projected/1760ef7c-0c3a-4255-b303-0bf5ccace164-kube-api-access-km6rf\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:04.728185 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.728168 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kktvq\" (UniqueName: \"kubernetes.io/projected/a5622334-2813-4e89-8705-ddb46c4132cd-kube-api-access-kktvq\") pod \"ingress-canary-bvldf\" (UID: \"a5622334-2813-4e89-8705-ddb46c4132cd\") " pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:39:04.822648 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.822613 2573 generic.go:358] "Generic (PLEG): container finished" podID="ffe481af-318e-4d07-8f20-b9444f36f745" containerID="f3425a1fca5d11233ec5c7da05973c6fb300d1b294335eb3a178638588a829c0" exitCode=0 May 21 20:39:04.823001 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:04.822657 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqj25" event={"ID":"ffe481af-318e-4d07-8f20-b9444f36f745","Type":"ContainerDied","Data":"f3425a1fca5d11233ec5c7da05973c6fb300d1b294335eb3a178638588a829c0"} May 21 20:39:05.221868 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:05.221828 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:05.222027 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:05.221893 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert\") pod \"ingress-canary-bvldf\" (UID: \"a5622334-2813-4e89-8705-ddb46c4132cd\") " pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:39:05.222027 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:05.222006 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:39:05.222027 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:05.222014 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:39:05.222120 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:05.222065 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert podName:a5622334-2813-4e89-8705-ddb46c4132cd nodeName:}" failed. No retries permitted until 2026-05-21 20:39:06.222050814 +0000 UTC m=+37.113913390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert") pod "ingress-canary-bvldf" (UID: "a5622334-2813-4e89-8705-ddb46c4132cd") : secret "canary-serving-cert" not found May 21 20:39:05.222120 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:05.222077 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls podName:1760ef7c-0c3a-4255-b303-0bf5ccace164 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:06.22207205 +0000 UTC m=+37.113934625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls") pod "dns-default-mmgbz" (UID: "1760ef7c-0c3a-4255-b303-0bf5ccace164") : secret "dns-default-metrics-tls" not found May 21 20:39:05.827508 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:05.827473 2573 generic.go:358] "Generic (PLEG): container finished" podID="ffe481af-318e-4d07-8f20-b9444f36f745" containerID="a6f5c54ae53bd701e2f49d7578c34ccc626c714d914bd75f5aee70e3845dc347" exitCode=0 May 21 20:39:05.827891 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:05.827532 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqj25" event={"ID":"ffe481af-318e-4d07-8f20-b9444f36f745","Type":"ContainerDied","Data":"a6f5c54ae53bd701e2f49d7578c34ccc626c714d914bd75f5aee70e3845dc347"} May 21 20:39:06.228679 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:06.228641 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:06.228873 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:06.228712 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert\") pod \"ingress-canary-bvldf\" (UID: \"a5622334-2813-4e89-8705-ddb46c4132cd\") " pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:39:06.228873 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:06.228790 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:39:06.228873 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:06.228816 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:39:06.228873 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:06.228865 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls podName:1760ef7c-0c3a-4255-b303-0bf5ccace164 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:08.228845493 +0000 UTC m=+39.120708089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls") pod "dns-default-mmgbz" (UID: "1760ef7c-0c3a-4255-b303-0bf5ccace164") : secret "dns-default-metrics-tls" not found May 21 20:39:06.229035 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:06.228880 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert podName:a5622334-2813-4e89-8705-ddb46c4132cd nodeName:}" failed. No retries permitted until 2026-05-21 20:39:08.228873854 +0000 UTC m=+39.120736430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert") pod "ingress-canary-bvldf" (UID: "a5622334-2813-4e89-8705-ddb46c4132cd") : secret "canary-serving-cert" not found May 21 20:39:06.833042 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:06.832998 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqj25" event={"ID":"ffe481af-318e-4d07-8f20-b9444f36f745","Type":"ContainerStarted","Data":"bd6d4059b87d601dc0514af26090291e4a0985e19af337ab078e3e5777544929"} May 21 20:39:06.858987 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:06.858938 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wqj25" podStartSLOduration=6.48119367 podStartE2EDuration="37.858921188s" podCreationTimestamp="2026-05-21 20:38:29 +0000 UTC" firstStartedPulling="2026-05-21 20:38:32.279335495 +0000 UTC m=+3.171198085" lastFinishedPulling="2026-05-21 20:39:03.657063023 +0000 UTC m=+34.548925603" observedRunningTime="2026-05-21 20:39:06.857419198 +0000 UTC m=+37.749281791" watchObservedRunningTime="2026-05-21 20:39:06.858921188 +0000 UTC m=+37.750783786" May 21 20:39:08.242156 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:08.242117 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:08.242663 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:08.242272 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:39:08.242663 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:08.242274 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert\") pod \"ingress-canary-bvldf\" (UID: \"a5622334-2813-4e89-8705-ddb46c4132cd\") " pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:39:08.242663 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:08.242340 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls podName:1760ef7c-0c3a-4255-b303-0bf5ccace164 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:12.242319093 +0000 UTC m=+43.134181682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls") pod "dns-default-mmgbz" (UID: "1760ef7c-0c3a-4255-b303-0bf5ccace164") : secret "dns-default-metrics-tls" not found May 21 20:39:08.242663 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:08.242353 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:39:08.242663 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:08.242424 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert podName:a5622334-2813-4e89-8705-ddb46c4132cd nodeName:}" failed. No retries permitted until 2026-05-21 20:39:12.242386536 +0000 UTC m=+43.134249112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert") pod "ingress-canary-bvldf" (UID: "a5622334-2813-4e89-8705-ddb46c4132cd") : secret "canary-serving-cert" not found May 21 20:39:12.268532 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:12.268483 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:12.268901 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:12.268544 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert\") pod \"ingress-canary-bvldf\" (UID: \"a5622334-2813-4e89-8705-ddb46c4132cd\") " pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:39:12.268901 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:12.268645 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:39:12.268901 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:12.268716 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls podName:1760ef7c-0c3a-4255-b303-0bf5ccace164 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:20.268699387 +0000 UTC m=+51.160561962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls") pod "dns-default-mmgbz" (UID: "1760ef7c-0c3a-4255-b303-0bf5ccace164") : secret "dns-default-metrics-tls" not found May 21 20:39:12.268901 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:12.268650 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:39:12.268901 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:12.268780 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert podName:a5622334-2813-4e89-8705-ddb46c4132cd nodeName:}" failed. No retries permitted until 2026-05-21 20:39:20.268767531 +0000 UTC m=+51.160630107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert") pod "ingress-canary-bvldf" (UID: "a5622334-2813-4e89-8705-ddb46c4132cd") : secret "canary-serving-cert" not found May 21 20:39:17.620703 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.620670 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9"] May 21 20:39:17.633464 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.633432 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9"] May 21 20:39:17.633670 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.633652 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9" May 21 20:39:17.636080 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.636054 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-hsmnz\"" May 21 20:39:17.637383 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.637356 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 20:39:17.637501 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.637361 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 20:39:17.637501 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.637361 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 20:39:17.637501 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.637431 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 20:39:17.808083 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.808041 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aafe0a53-f382-4ddf-83d7-f043e1aa5be1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b7d45f4db-fssw9\" (UID: \"aafe0a53-f382-4ddf-83d7-f043e1aa5be1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9" May 21 20:39:17.808266 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.808151 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdltf\" (UniqueName: \"kubernetes.io/projected/aafe0a53-f382-4ddf-83d7-f043e1aa5be1-kube-api-access-hdltf\") pod \"managed-serviceaccount-addon-agent-6b7d45f4db-fssw9\" (UID: \"aafe0a53-f382-4ddf-83d7-f043e1aa5be1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9" May 21 20:39:17.908936 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.908839 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aafe0a53-f382-4ddf-83d7-f043e1aa5be1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b7d45f4db-fssw9\" (UID: \"aafe0a53-f382-4ddf-83d7-f043e1aa5be1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9" May 21 20:39:17.908936 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.908911 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdltf\" (UniqueName: \"kubernetes.io/projected/aafe0a53-f382-4ddf-83d7-f043e1aa5be1-kube-api-access-hdltf\") pod \"managed-serviceaccount-addon-agent-6b7d45f4db-fssw9\" (UID: \"aafe0a53-f382-4ddf-83d7-f043e1aa5be1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9" May 21 20:39:17.912166 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.912127 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aafe0a53-f382-4ddf-83d7-f043e1aa5be1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b7d45f4db-fssw9\" (UID: \"aafe0a53-f382-4ddf-83d7-f043e1aa5be1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9" May 21 20:39:17.918142 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.918113 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdltf\" (UniqueName: \"kubernetes.io/projected/aafe0a53-f382-4ddf-83d7-f043e1aa5be1-kube-api-access-hdltf\") pod \"managed-serviceaccount-addon-agent-6b7d45f4db-fssw9\" (UID: \"aafe0a53-f382-4ddf-83d7-f043e1aa5be1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9" May 21 20:39:17.955708 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:17.955663 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9" May 21 20:39:18.110478 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:18.110447 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9"] May 21 20:39:18.114582 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:39:18.114550 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaafe0a53_f382_4ddf_83d7_f043e1aa5be1.slice/crio-1201a1eb1adfe5b88365e605b8beb55745298ecfd45dcffdf2f6bc4252232b30 WatchSource:0}: Error finding container 1201a1eb1adfe5b88365e605b8beb55745298ecfd45dcffdf2f6bc4252232b30: Status 404 returned error can't find the container with id 1201a1eb1adfe5b88365e605b8beb55745298ecfd45dcffdf2f6bc4252232b30 May 21 20:39:18.856884 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:18.856848 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9" event={"ID":"aafe0a53-f382-4ddf-83d7-f043e1aa5be1","Type":"ContainerStarted","Data":"1201a1eb1adfe5b88365e605b8beb55745298ecfd45dcffdf2f6bc4252232b30"} May 21 20:39:20.327528 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:20.327482 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:20.328022 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:20.327568 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert\") pod \"ingress-canary-bvldf\" (UID: \"a5622334-2813-4e89-8705-ddb46c4132cd\") " pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:39:20.328022 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:20.327646 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:39:20.328022 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:20.327711 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:39:20.328022 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:20.327716 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls podName:1760ef7c-0c3a-4255-b303-0bf5ccace164 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:36.327695117 +0000 UTC m=+67.219557695 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls") pod "dns-default-mmgbz" (UID: "1760ef7c-0c3a-4255-b303-0bf5ccace164") : secret "dns-default-metrics-tls" not found May 21 20:39:20.328022 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:20.327797 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert podName:a5622334-2813-4e89-8705-ddb46c4132cd nodeName:}" failed. No retries permitted until 2026-05-21 20:39:36.327779265 +0000 UTC m=+67.219641856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert") pod "ingress-canary-bvldf" (UID: "a5622334-2813-4e89-8705-ddb46c4132cd") : secret "canary-serving-cert" not found May 21 20:39:21.863740 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:21.863699 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9" event={"ID":"aafe0a53-f382-4ddf-83d7-f043e1aa5be1","Type":"ContainerStarted","Data":"c882c8246b252d8ff9fe23cd3cd42cc5de0488a2601520b0820d364dc934d357"} May 21 20:39:21.879380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:21.879329 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9" podStartSLOduration=2.144546112 podStartE2EDuration="4.879314664s" podCreationTimestamp="2026-05-21 20:39:17 +0000 UTC" firstStartedPulling="2026-05-21 20:39:18.116023325 +0000 UTC m=+49.007885904" lastFinishedPulling="2026-05-21 20:39:20.85079188 +0000 UTC m=+51.742654456" observedRunningTime="2026-05-21 20:39:21.878738627 +0000 UTC m=+52.770601221" watchObservedRunningTime="2026-05-21 20:39:21.879314664 +0000 UTC m=+52.771177261" May 21 20:39:28.817245 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:28.817214 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zmnk" May 21 20:39:35.328901 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:35.328860 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:39:35.331747 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:35.331725 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 20:39:35.340025 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:35.339998 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 20:39:35.340161 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:35.340108 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs podName:b0cabb11-fb0d-4a2a-b250-f4cc748429ba nodeName:}" failed. No retries permitted until 2026-05-21 20:40:39.340084872 +0000 UTC m=+130.231947467 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs") pod "network-metrics-daemon-8jlfz" (UID: "b0cabb11-fb0d-4a2a-b250-f4cc748429ba") : secret "metrics-daemon-secret" not found May 21 20:39:35.530847 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:35.530807 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gsj7\" (UniqueName: \"kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7\") pod \"network-check-target-n9xvd\" (UID: \"d83f554e-2053-4eff-9e99-f6e6761a4156\") " pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:39:35.533717 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:35.533697 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 20:39:35.544215 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:35.544192 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 20:39:35.554921 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:35.554881 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gsj7\" (UniqueName: \"kubernetes.io/projected/d83f554e-2053-4eff-9e99-f6e6761a4156-kube-api-access-9gsj7\") pod \"network-check-target-n9xvd\" (UID: \"d83f554e-2053-4eff-9e99-f6e6761a4156\") " pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:39:35.614930 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:35.614842 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hrp5p\"" May 21 20:39:35.622166 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:35.622140 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:39:35.747059 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:35.747023 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n9xvd"] May 21 20:39:35.750905 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:39:35.750879 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83f554e_2053_4eff_9e99_f6e6761a4156.slice/crio-107b268c931f1718fac18d0d66d2acea247e57c815f40f9d76789f9306df0dfe WatchSource:0}: Error finding container 107b268c931f1718fac18d0d66d2acea247e57c815f40f9d76789f9306df0dfe: Status 404 returned error can't find the container with id 107b268c931f1718fac18d0d66d2acea247e57c815f40f9d76789f9306df0dfe May 21 20:39:35.888795 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:35.888711 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n9xvd" event={"ID":"d83f554e-2053-4eff-9e99-f6e6761a4156","Type":"ContainerStarted","Data":"107b268c931f1718fac18d0d66d2acea247e57c815f40f9d76789f9306df0dfe"} May 21 20:39:36.336671 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:36.336638 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert\") pod \"ingress-canary-bvldf\" (UID: \"a5622334-2813-4e89-8705-ddb46c4132cd\") " pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:39:36.337114 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:36.336703 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:39:36.337114 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:36.336805 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:39:36.337114 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:36.336810 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:39:36.337114 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:36.336863 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls podName:1760ef7c-0c3a-4255-b303-0bf5ccace164 nodeName:}" failed. No retries permitted until 2026-05-21 20:40:08.33684766 +0000 UTC m=+99.228710239 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls") pod "dns-default-mmgbz" (UID: "1760ef7c-0c3a-4255-b303-0bf5ccace164") : secret "dns-default-metrics-tls" not found May 21 20:39:36.337114 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:39:36.336877 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert podName:a5622334-2813-4e89-8705-ddb46c4132cd nodeName:}" failed. No retries permitted until 2026-05-21 20:40:08.336871376 +0000 UTC m=+99.228733952 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert") pod "ingress-canary-bvldf" (UID: "a5622334-2813-4e89-8705-ddb46c4132cd") : secret "canary-serving-cert" not found May 21 20:39:38.896375 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:38.896284 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n9xvd" event={"ID":"d83f554e-2053-4eff-9e99-f6e6761a4156","Type":"ContainerStarted","Data":"71128d0133d9f25f0c2c1b3dc3a1bd028aee23aa77b1babf89a3900079fa85a8"} May 21 20:39:38.896727 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:38.896424 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:39:38.912832 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:39:38.912691 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n9xvd" podStartSLOduration=67.19356851 podStartE2EDuration="1m9.912674981s" podCreationTimestamp="2026-05-21 20:38:29 +0000 UTC" firstStartedPulling="2026-05-21 20:39:35.752866508 +0000 UTC m=+66.644729084" lastFinishedPulling="2026-05-21 20:39:38.471972966 +0000 UTC m=+69.363835555" observedRunningTime="2026-05-21 20:39:38.912082882 +0000 UTC m=+69.803945490" watchObservedRunningTime="2026-05-21 20:39:38.912674981 +0000 UTC m=+69.804537579" May 21 20:40:08.351878 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:08.351831 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert\") pod \"ingress-canary-bvldf\" (UID: \"a5622334-2813-4e89-8705-ddb46c4132cd\") " pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:40:08.352300 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:08.351918 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:40:08.352300 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:08.351990 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:40:08.352300 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:08.352003 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:40:08.352300 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:08.352077 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert podName:a5622334-2813-4e89-8705-ddb46c4132cd nodeName:}" failed. No retries permitted until 2026-05-21 20:41:12.352058846 +0000 UTC m=+163.243921427 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert") pod "ingress-canary-bvldf" (UID: "a5622334-2813-4e89-8705-ddb46c4132cd") : secret "canary-serving-cert" not found May 21 20:40:08.352300 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:08.352092 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls podName:1760ef7c-0c3a-4255-b303-0bf5ccace164 nodeName:}" failed. No retries permitted until 2026-05-21 20:41:12.352086154 +0000 UTC m=+163.243948729 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls") pod "dns-default-mmgbz" (UID: "1760ef7c-0c3a-4255-b303-0bf5ccace164") : secret "dns-default-metrics-tls" not found May 21 20:40:09.900138 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:09.900108 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n9xvd" May 21 20:40:39.358897 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:39.358844 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:40:39.359390 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:39.359001 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 20:40:39.359390 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:39.359078 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs podName:b0cabb11-fb0d-4a2a-b250-f4cc748429ba nodeName:}" failed. No retries permitted until 2026-05-21 20:42:41.359061941 +0000 UTC m=+252.250924526 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs") pod "network-metrics-daemon-8jlfz" (UID: "b0cabb11-fb0d-4a2a-b250-f4cc748429ba") : secret "metrics-daemon-secret" not found May 21 20:40:55.377332 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.377295 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-vxk5c"] May 21 20:40:55.379153 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.379132 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64d5bdf8dd-c826d"] May 21 20:40:55.379285 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.379273 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:40:55.381085 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.381064 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.382925 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.382651 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 20:40:55.382925 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.382740 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 20:40:55.383105 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.382998 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 20:40:55.383959 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.383937 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rwf94\"" May 21 20:40:55.384172 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.384002 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 20:40:55.384307 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.384287 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 20:40:55.385322 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.385305 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f29vq\"" May 21 20:40:55.385651 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.385634 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 20:40:55.385992 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.385977 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 20:40:55.389515 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.389494 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 20:40:55.391769 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.391688 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 20:40:55.394391 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.394369 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-vxk5c"] May 21 20:40:55.409035 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.409008 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64d5bdf8dd-c826d"] May 21 20:40:55.468450 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.468414 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c4cdce4-9c75-428f-98a8-debfde2f010c-trusted-ca\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.468450 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.468454 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.468653 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.468513 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c4cdce4-9c75-428f-98a8-debfde2f010c-ca-trust-extracted\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.468653 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.468557 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh4z8\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-kube-api-access-mh4z8\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.468653 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.468594 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c4cdce4-9c75-428f-98a8-debfde2f010c-installation-pull-secrets\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.468653 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.468617 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e10707ec-cbb2-40ec-a5d6-be05b057b517-config\") pod \"console-operator-76dff48d59-vxk5c\" (UID: \"e10707ec-cbb2-40ec-a5d6-be05b057b517\") " pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:40:55.468653 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.468646 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhpkx\" (UniqueName: \"kubernetes.io/projected/e10707ec-cbb2-40ec-a5d6-be05b057b517-kube-api-access-zhpkx\") pod \"console-operator-76dff48d59-vxk5c\" (UID: \"e10707ec-cbb2-40ec-a5d6-be05b057b517\") " pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:40:55.468800 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.468666 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c4cdce4-9c75-428f-98a8-debfde2f010c-image-registry-private-configuration\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.468800 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.468683 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-certificates\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.468800 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.468724 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e10707ec-cbb2-40ec-a5d6-be05b057b517-serving-cert\") pod \"console-operator-76dff48d59-vxk5c\" (UID: \"e10707ec-cbb2-40ec-a5d6-be05b057b517\") " pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:40:55.468800 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.468739 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e10707ec-cbb2-40ec-a5d6-be05b057b517-trusted-ca\") pod \"console-operator-76dff48d59-vxk5c\" (UID: \"e10707ec-cbb2-40ec-a5d6-be05b057b517\") " pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:40:55.468800 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.468767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-bound-sa-token\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.485968 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.485931 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-r9kfc"] May 21 20:40:55.487665 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.487647 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-7zrjp"] May 21 20:40:55.487834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.487807 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.489410 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.489380 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68"] May 21 20:40:55.489521 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.489504 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7zrjp" May 21 20:40:55.490836 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.490815 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h564q\"" May 21 20:40:55.490930 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.490865 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 20:40:55.490930 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.490913 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 20:40:55.490930 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.490916 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 20:40:55.491077 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.491031 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4mxqf"] May 21 20:40:55.491131 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.491119 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:40:55.491175 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.491150 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 20:40:55.491841 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.491822 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4zcpr\"" May 21 20:40:55.493048 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.493032 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4mxqf" May 21 20:40:55.494553 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.494531 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 21 20:40:55.495956 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.495937 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 20:40:55.496167 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.496147 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 20:40:55.496236 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.496018 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rc7ld\"" May 21 20:40:55.496976 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.496952 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nswr7\"" May 21 20:40:55.497459 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.497440 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 20:40:55.498050 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.498007 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 20:40:55.499855 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.499829 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 21 20:40:55.502113 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.502097 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-r9kfc"] May 21 20:40:55.503140 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.502865 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-7zrjp"] May 21 20:40:55.503140 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.503111 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 20:40:55.503903 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.503876 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68"] May 21 20:40:55.504854 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.504831 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4mxqf"] May 21 20:40:55.569877 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.569842 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-snapshots\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.570050 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.569889 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.570050 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.569942 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mh4z8\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-kube-api-access-mh4z8\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.570050 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.569963 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-tmp\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.570050 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.569986 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e10707ec-cbb2-40ec-a5d6-be05b057b517-config\") pod \"console-operator-76dff48d59-vxk5c\" (UID: \"e10707ec-cbb2-40ec-a5d6-be05b057b517\") " pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:40:55.570206 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570053 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd4vn\" (UniqueName: \"kubernetes.io/projected/64c42161-d041-4a84-addc-fa4b5c52e2f0-kube-api-access-cd4vn\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:40:55.570206 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570099 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e10707ec-cbb2-40ec-a5d6-be05b057b517-trusted-ca\") pod \"console-operator-76dff48d59-vxk5c\" (UID: \"e10707ec-cbb2-40ec-a5d6-be05b057b517\") " pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:40:55.570206 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/64c42161-d041-4a84-addc-fa4b5c52e2f0-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:40:55.570206 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570141 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:40:55.570206 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570181 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c4cdce4-9c75-428f-98a8-debfde2f010c-installation-pull-secrets\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.570492 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570251 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.570492 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570287 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c4cdce4-9c75-428f-98a8-debfde2f010c-ca-trust-extracted\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.570492 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570347 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtw9g\" (UniqueName: \"kubernetes.io/projected/5a9a50e3-fc4b-42a3-bbb6-a67dbe7c7bb6-kube-api-access-dtw9g\") pod \"volume-data-source-validator-5cf8c89d64-4mxqf\" (UID: \"5a9a50e3-fc4b-42a3-bbb6-a67dbe7c7bb6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4mxqf" May 21 20:40:55.570492 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:55.570368 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:40:55.570492 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:55.570383 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d5bdf8dd-c826d: secret "image-registry-tls" not found May 21 20:40:55.570492 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570382 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-serving-cert\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.570492 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570457 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-686qk\" (UniqueName: \"kubernetes.io/projected/8c475002-a64b-4061-8d77-4c3088640d50-kube-api-access-686qk\") pod \"network-check-source-7f44b6dd87-7zrjp\" (UID: \"8c475002-a64b-4061-8d77-4c3088640d50\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7zrjp" May 21 20:40:55.570492 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:55.570473 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls podName:9c4cdce4-9c75-428f-98a8-debfde2f010c nodeName:}" failed. No retries permitted until 2026-05-21 20:40:56.070451833 +0000 UTC m=+146.962314425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls") pod "image-registry-64d5bdf8dd-c826d" (UID: "9c4cdce4-9c75-428f-98a8-debfde2f010c") : secret "image-registry-tls" not found May 21 20:40:55.570938 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570513 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhpkx\" (UniqueName: \"kubernetes.io/projected/e10707ec-cbb2-40ec-a5d6-be05b057b517-kube-api-access-zhpkx\") pod \"console-operator-76dff48d59-vxk5c\" (UID: \"e10707ec-cbb2-40ec-a5d6-be05b057b517\") " pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:40:55.570938 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570545 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-service-ca-bundle\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.570938 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570578 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c4cdce4-9c75-428f-98a8-debfde2f010c-image-registry-private-configuration\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.570938 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570614 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-certificates\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.570938 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570638 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e10707ec-cbb2-40ec-a5d6-be05b057b517-serving-cert\") pod \"console-operator-76dff48d59-vxk5c\" (UID: \"e10707ec-cbb2-40ec-a5d6-be05b057b517\") " pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:40:55.570938 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570675 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-bound-sa-token\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.570938 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570697 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c4cdce4-9c75-428f-98a8-debfde2f010c-ca-trust-extracted\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.570938 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570758 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e10707ec-cbb2-40ec-a5d6-be05b057b517-config\") pod \"console-operator-76dff48d59-vxk5c\" (UID: \"e10707ec-cbb2-40ec-a5d6-be05b057b517\") " pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:40:55.570938 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570843 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g5k5\" (UniqueName: \"kubernetes.io/projected/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-kube-api-access-7g5k5\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.570938 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.570889 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c4cdce4-9c75-428f-98a8-debfde2f010c-trusted-ca\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.571436 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.571021 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e10707ec-cbb2-40ec-a5d6-be05b057b517-trusted-ca\") pod \"console-operator-76dff48d59-vxk5c\" (UID: \"e10707ec-cbb2-40ec-a5d6-be05b057b517\") " pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:40:55.571436 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.571161 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-certificates\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.571900 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.571867 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c4cdce4-9c75-428f-98a8-debfde2f010c-trusted-ca\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.572959 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.572940 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e10707ec-cbb2-40ec-a5d6-be05b057b517-serving-cert\") pod \"console-operator-76dff48d59-vxk5c\" (UID: \"e10707ec-cbb2-40ec-a5d6-be05b057b517\") " pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:40:55.573051 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.573038 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c4cdce4-9c75-428f-98a8-debfde2f010c-image-registry-private-configuration\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.573088 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.573038 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c4cdce4-9c75-428f-98a8-debfde2f010c-installation-pull-secrets\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.578594 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.578576 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh4z8\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-kube-api-access-mh4z8\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.579920 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.579900 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhpkx\" (UniqueName: \"kubernetes.io/projected/e10707ec-cbb2-40ec-a5d6-be05b057b517-kube-api-access-zhpkx\") pod \"console-operator-76dff48d59-vxk5c\" (UID: \"e10707ec-cbb2-40ec-a5d6-be05b057b517\") " pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:40:55.580024 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.580009 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-bound-sa-token\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:55.671318 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.671218 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cd4vn\" (UniqueName: \"kubernetes.io/projected/64c42161-d041-4a84-addc-fa4b5c52e2f0-kube-api-access-cd4vn\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:40:55.671318 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.671264 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/64c42161-d041-4a84-addc-fa4b5c52e2f0-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:40:55.671318 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.671281 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:40:55.671626 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.671327 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtw9g\" (UniqueName: \"kubernetes.io/projected/5a9a50e3-fc4b-42a3-bbb6-a67dbe7c7bb6-kube-api-access-dtw9g\") pod \"volume-data-source-validator-5cf8c89d64-4mxqf\" (UID: \"5a9a50e3-fc4b-42a3-bbb6-a67dbe7c7bb6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4mxqf" May 21 20:40:55.671626 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.671345 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-serving-cert\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.671626 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.671365 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-686qk\" (UniqueName: \"kubernetes.io/projected/8c475002-a64b-4061-8d77-4c3088640d50-kube-api-access-686qk\") pod \"network-check-source-7f44b6dd87-7zrjp\" (UID: \"8c475002-a64b-4061-8d77-4c3088640d50\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7zrjp" May 21 20:40:55.671626 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.671386 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-service-ca-bundle\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.671626 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.671455 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7g5k5\" (UniqueName: \"kubernetes.io/projected/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-kube-api-access-7g5k5\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.671626 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:55.671496 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 20:40:55.671626 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:55.671587 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls podName:64c42161-d041-4a84-addc-fa4b5c52e2f0 nodeName:}" failed. No retries permitted until 2026-05-21 20:40:56.171563822 +0000 UTC m=+147.063426398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-bzg68" (UID: "64c42161-d041-4a84-addc-fa4b5c52e2f0") : secret "cluster-monitoring-operator-tls" not found May 21 20:40:55.671954 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.671502 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-snapshots\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.671954 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.671703 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.671954 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.671745 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-tmp\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.672137 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.672117 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-tmp\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.672177 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.672159 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-snapshots\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.672211 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.672167 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/64c42161-d041-4a84-addc-fa4b5c52e2f0-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:40:55.672295 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.672266 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-service-ca-bundle\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.672834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.672816 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.673728 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.673710 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-serving-cert\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.680876 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.680851 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g5k5\" (UniqueName: \"kubernetes.io/projected/30eadc96-7cda-4e4c-978f-173a0ef6ceaa-kube-api-access-7g5k5\") pod \"insights-operator-78bdfb888c-r9kfc\" (UID: \"30eadc96-7cda-4e4c-978f-173a0ef6ceaa\") " pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.681327 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.681306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd4vn\" (UniqueName: \"kubernetes.io/projected/64c42161-d041-4a84-addc-fa4b5c52e2f0-kube-api-access-cd4vn\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:40:55.681565 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.681544 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-686qk\" (UniqueName: \"kubernetes.io/projected/8c475002-a64b-4061-8d77-4c3088640d50-kube-api-access-686qk\") pod \"network-check-source-7f44b6dd87-7zrjp\" (UID: \"8c475002-a64b-4061-8d77-4c3088640d50\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7zrjp" May 21 20:40:55.681669 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.681652 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtw9g\" (UniqueName: \"kubernetes.io/projected/5a9a50e3-fc4b-42a3-bbb6-a67dbe7c7bb6-kube-api-access-dtw9g\") pod \"volume-data-source-validator-5cf8c89d64-4mxqf\" (UID: \"5a9a50e3-fc4b-42a3-bbb6-a67dbe7c7bb6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4mxqf" May 21 20:40:55.689649 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.689625 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:40:55.800506 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.800471 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" May 21 20:40:55.809978 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.809949 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7zrjp" May 21 20:40:55.811256 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.811232 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-vxk5c"] May 21 20:40:55.816207 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:40:55.816178 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10707ec_cbb2_40ec_a5d6_be05b057b517.slice/crio-2198a30c5177d2ecef220966e1b69b36283bebce5e47624348b7c1850811a3bf WatchSource:0}: Error finding container 2198a30c5177d2ecef220966e1b69b36283bebce5e47624348b7c1850811a3bf: Status 404 returned error can't find the container with id 2198a30c5177d2ecef220966e1b69b36283bebce5e47624348b7c1850811a3bf May 21 20:40:55.821811 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.821512 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4mxqf" May 21 20:40:55.943706 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.943597 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-r9kfc"] May 21 20:40:55.947110 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:40:55.947081 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30eadc96_7cda_4e4c_978f_173a0ef6ceaa.slice/crio-112d83a9166f821020c0e94e8ae7b8a246f96d7233a6f9a273976bbce3bb8f38 WatchSource:0}: Error finding container 112d83a9166f821020c0e94e8ae7b8a246f96d7233a6f9a273976bbce3bb8f38: Status 404 returned error can't find the container with id 112d83a9166f821020c0e94e8ae7b8a246f96d7233a6f9a273976bbce3bb8f38 May 21 20:40:55.967251 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.967220 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-7zrjp"] May 21 20:40:55.969653 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:40:55.969628 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c475002_a64b_4061_8d77_4c3088640d50.slice/crio-e23001516f9b7514272bcde1d56811cd4c894c4392bae0632fcdc0443b503241 WatchSource:0}: Error finding container e23001516f9b7514272bcde1d56811cd4c894c4392bae0632fcdc0443b503241: Status 404 returned error can't find the container with id e23001516f9b7514272bcde1d56811cd4c894c4392bae0632fcdc0443b503241 May 21 20:40:55.979144 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:55.979115 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4mxqf"] May 21 20:40:55.982183 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:40:55.982160 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a9a50e3_fc4b_42a3_bbb6_a67dbe7c7bb6.slice/crio-a6aed7351c909f2009a5ffdb15b719678c516e7aa5891ab098f90d3561bfa2c3 WatchSource:0}: Error finding container a6aed7351c909f2009a5ffdb15b719678c516e7aa5891ab098f90d3561bfa2c3: Status 404 returned error can't find the container with id a6aed7351c909f2009a5ffdb15b719678c516e7aa5891ab098f90d3561bfa2c3 May 21 20:40:56.044883 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:56.044844 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4mxqf" event={"ID":"5a9a50e3-fc4b-42a3-bbb6-a67dbe7c7bb6","Type":"ContainerStarted","Data":"a6aed7351c909f2009a5ffdb15b719678c516e7aa5891ab098f90d3561bfa2c3"} May 21 20:40:56.046106 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:56.046064 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7zrjp" event={"ID":"8c475002-a64b-4061-8d77-4c3088640d50","Type":"ContainerStarted","Data":"de6ad1bc17c91610377ec55f0277372e51227c2f7899567ed0ea44c19882b289"} May 21 20:40:56.046106 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:56.046101 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7zrjp" event={"ID":"8c475002-a64b-4061-8d77-4c3088640d50","Type":"ContainerStarted","Data":"e23001516f9b7514272bcde1d56811cd4c894c4392bae0632fcdc0443b503241"} May 21 20:40:56.047161 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:56.047133 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" event={"ID":"30eadc96-7cda-4e4c-978f-173a0ef6ceaa","Type":"ContainerStarted","Data":"112d83a9166f821020c0e94e8ae7b8a246f96d7233a6f9a273976bbce3bb8f38"} May 21 20:40:56.048070 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:56.048049 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" event={"ID":"e10707ec-cbb2-40ec-a5d6-be05b057b517","Type":"ContainerStarted","Data":"2198a30c5177d2ecef220966e1b69b36283bebce5e47624348b7c1850811a3bf"} May 21 20:40:56.062002 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:56.061959 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-7zrjp" podStartSLOduration=1.061946486 podStartE2EDuration="1.061946486s" podCreationTimestamp="2026-05-21 20:40:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:40:56.061028391 +0000 UTC m=+146.952890989" watchObservedRunningTime="2026-05-21 20:40:56.061946486 +0000 UTC m=+146.953809084" May 21 20:40:56.076386 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:56.076358 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:56.076559 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:56.076538 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:40:56.076627 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:56.076562 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d5bdf8dd-c826d: secret "image-registry-tls" not found May 21 20:40:56.076627 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:56.076623 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls podName:9c4cdce4-9c75-428f-98a8-debfde2f010c nodeName:}" failed. No retries permitted until 2026-05-21 20:40:57.076604967 +0000 UTC m=+147.968467548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls") pod "image-registry-64d5bdf8dd-c826d" (UID: "9c4cdce4-9c75-428f-98a8-debfde2f010c") : secret "image-registry-tls" not found May 21 20:40:56.177548 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:56.177512 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:40:56.177736 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:56.177674 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 20:40:56.177786 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:56.177748 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls podName:64c42161-d041-4a84-addc-fa4b5c52e2f0 nodeName:}" failed. No retries permitted until 2026-05-21 20:40:57.177726222 +0000 UTC m=+148.069588817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-bzg68" (UID: "64c42161-d041-4a84-addc-fa4b5c52e2f0") : secret "cluster-monitoring-operator-tls" not found May 21 20:40:57.086441 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:57.086385 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:57.086894 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:57.086565 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:40:57.086894 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:57.086592 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d5bdf8dd-c826d: secret "image-registry-tls" not found May 21 20:40:57.086894 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:57.086681 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls podName:9c4cdce4-9c75-428f-98a8-debfde2f010c nodeName:}" failed. No retries permitted until 2026-05-21 20:40:59.086658618 +0000 UTC m=+149.978521202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls") pod "image-registry-64d5bdf8dd-c826d" (UID: "9c4cdce4-9c75-428f-98a8-debfde2f010c") : secret "image-registry-tls" not found May 21 20:40:57.187319 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:57.187269 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:40:57.187505 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:57.187452 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 20:40:57.187581 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:57.187527 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls podName:64c42161-d041-4a84-addc-fa4b5c52e2f0 nodeName:}" failed. No retries permitted until 2026-05-21 20:40:59.187509674 +0000 UTC m=+150.079372269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-bzg68" (UID: "64c42161-d041-4a84-addc-fa4b5c52e2f0") : secret "cluster-monitoring-operator-tls" not found May 21 20:40:59.057018 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:59.056976 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4mxqf" event={"ID":"5a9a50e3-fc4b-42a3-bbb6-a67dbe7c7bb6","Type":"ContainerStarted","Data":"e8c5f1bfc00ba40c113d6ae15594d5f0ad59582ac24d954c246c96337249602b"} May 21 20:40:59.058435 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:59.058381 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" event={"ID":"30eadc96-7cda-4e4c-978f-173a0ef6ceaa","Type":"ContainerStarted","Data":"9ee393d87fe1f711c176975bba060723f3c71e6c63e46174632582bea409545c"} May 21 20:40:59.059673 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:59.059651 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/0.log" May 21 20:40:59.059800 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:59.059690 2573 generic.go:358] "Generic (PLEG): container finished" podID="e10707ec-cbb2-40ec-a5d6-be05b057b517" containerID="901c4d8be5c9d4d6058162a8aab92d6d7b8a5ef2cf47a50b1b66f1793a0b16ab" exitCode=255 May 21 20:40:59.059800 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:59.059738 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" event={"ID":"e10707ec-cbb2-40ec-a5d6-be05b057b517","Type":"ContainerDied","Data":"901c4d8be5c9d4d6058162a8aab92d6d7b8a5ef2cf47a50b1b66f1793a0b16ab"} May 21 20:40:59.059896 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:59.059881 2573 scope.go:117] "RemoveContainer" containerID="901c4d8be5c9d4d6058162a8aab92d6d7b8a5ef2cf47a50b1b66f1793a0b16ab" May 21 20:40:59.081697 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:59.081393 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4mxqf" podStartSLOduration=1.713421867 podStartE2EDuration="4.081373348s" podCreationTimestamp="2026-05-21 20:40:55 +0000 UTC" firstStartedPulling="2026-05-21 20:40:55.984253338 +0000 UTC m=+146.876115914" lastFinishedPulling="2026-05-21 20:40:58.352204813 +0000 UTC m=+149.244067395" observedRunningTime="2026-05-21 20:40:59.080822249 +0000 UTC m=+149.972684848" watchObservedRunningTime="2026-05-21 20:40:59.081373348 +0000 UTC m=+149.973235947" May 21 20:40:59.098845 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:59.098789 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" podStartSLOduration=1.6909635760000001 podStartE2EDuration="4.098770376s" podCreationTimestamp="2026-05-21 20:40:55 +0000 UTC" firstStartedPulling="2026-05-21 20:40:55.949045695 +0000 UTC m=+146.840908270" lastFinishedPulling="2026-05-21 20:40:58.356852473 +0000 UTC m=+149.248715070" observedRunningTime="2026-05-21 20:40:59.098009803 +0000 UTC m=+149.989872403" watchObservedRunningTime="2026-05-21 20:40:59.098770376 +0000 UTC m=+149.990632977" May 21 20:40:59.103440 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:59.103413 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:40:59.103566 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:59.103513 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:40:59.103566 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:59.103533 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d5bdf8dd-c826d: secret "image-registry-tls" not found May 21 20:40:59.103671 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:59.103596 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls podName:9c4cdce4-9c75-428f-98a8-debfde2f010c nodeName:}" failed. No retries permitted until 2026-05-21 20:41:03.103577336 +0000 UTC m=+153.995439912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls") pod "image-registry-64d5bdf8dd-c826d" (UID: "9c4cdce4-9c75-428f-98a8-debfde2f010c") : secret "image-registry-tls" not found May 21 20:40:59.204669 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:40:59.204629 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:40:59.204869 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:59.204832 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 20:40:59.205290 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:40:59.205191 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls podName:64c42161-d041-4a84-addc-fa4b5c52e2f0 nodeName:}" failed. No retries permitted until 2026-05-21 20:41:03.205156715 +0000 UTC m=+154.097019301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-bzg68" (UID: "64c42161-d041-4a84-addc-fa4b5c52e2f0") : secret "cluster-monitoring-operator-tls" not found May 21 20:41:00.063918 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:00.063887 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 20:41:00.064317 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:00.064259 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/0.log" May 21 20:41:00.064317 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:00.064293 2573 generic.go:358] "Generic (PLEG): container finished" podID="e10707ec-cbb2-40ec-a5d6-be05b057b517" containerID="573cbf943684ec7fb6b2605318396a04ac0544fb8b9a0803cd0ece915a76c62d" exitCode=255 May 21 20:41:00.064463 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:00.064327 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" event={"ID":"e10707ec-cbb2-40ec-a5d6-be05b057b517","Type":"ContainerDied","Data":"573cbf943684ec7fb6b2605318396a04ac0544fb8b9a0803cd0ece915a76c62d"} May 21 20:41:00.064463 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:00.064383 2573 scope.go:117] "RemoveContainer" containerID="901c4d8be5c9d4d6058162a8aab92d6d7b8a5ef2cf47a50b1b66f1793a0b16ab" May 21 20:41:00.064815 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:00.064793 2573 scope.go:117] "RemoveContainer" containerID="573cbf943684ec7fb6b2605318396a04ac0544fb8b9a0803cd0ece915a76c62d" May 21 20:41:00.064971 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:00.064948 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-vxk5c_openshift-console-operator(e10707ec-cbb2-40ec-a5d6-be05b057b517)\"" pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" podUID="e10707ec-cbb2-40ec-a5d6-be05b057b517" May 21 20:41:01.068479 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:01.068443 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 20:41:01.068871 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:01.068787 2573 scope.go:117] "RemoveContainer" containerID="573cbf943684ec7fb6b2605318396a04ac0544fb8b9a0803cd0ece915a76c62d" May 21 20:41:01.068979 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:01.068961 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-vxk5c_openshift-console-operator(e10707ec-cbb2-40ec-a5d6-be05b057b517)\"" pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" podUID="e10707ec-cbb2-40ec-a5d6-be05b057b517" May 21 20:41:02.175843 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.175806 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lnx8p"] May 21 20:41:02.178477 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.178459 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-lnx8p" May 21 20:41:02.181205 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.181180 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 21 20:41:02.181321 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.181277 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rzkcx\"" May 21 20:41:02.181321 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.181293 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 21 20:41:02.182354 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.182332 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 21 20:41:02.182465 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.182385 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 21 20:41:02.187802 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.187784 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lnx8p"] May 21 20:41:02.329424 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.329370 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5d194dd6-c5f1-4aee-9c5c-6bea70cdc661-signing-cabundle\") pod \"service-ca-67d667c7d-lnx8p\" (UID: \"5d194dd6-c5f1-4aee-9c5c-6bea70cdc661\") " pod="openshift-service-ca/service-ca-67d667c7d-lnx8p" May 21 20:41:02.329620 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.329433 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5d194dd6-c5f1-4aee-9c5c-6bea70cdc661-signing-key\") pod \"service-ca-67d667c7d-lnx8p\" (UID: \"5d194dd6-c5f1-4aee-9c5c-6bea70cdc661\") " pod="openshift-service-ca/service-ca-67d667c7d-lnx8p" May 21 20:41:02.329620 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.329497 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p682k\" (UniqueName: \"kubernetes.io/projected/5d194dd6-c5f1-4aee-9c5c-6bea70cdc661-kube-api-access-p682k\") pod \"service-ca-67d667c7d-lnx8p\" (UID: \"5d194dd6-c5f1-4aee-9c5c-6bea70cdc661\") " pod="openshift-service-ca/service-ca-67d667c7d-lnx8p" May 21 20:41:02.430898 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.430811 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p682k\" (UniqueName: \"kubernetes.io/projected/5d194dd6-c5f1-4aee-9c5c-6bea70cdc661-kube-api-access-p682k\") pod \"service-ca-67d667c7d-lnx8p\" (UID: \"5d194dd6-c5f1-4aee-9c5c-6bea70cdc661\") " pod="openshift-service-ca/service-ca-67d667c7d-lnx8p" May 21 20:41:02.431047 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.430902 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5d194dd6-c5f1-4aee-9c5c-6bea70cdc661-signing-cabundle\") pod \"service-ca-67d667c7d-lnx8p\" (UID: \"5d194dd6-c5f1-4aee-9c5c-6bea70cdc661\") " pod="openshift-service-ca/service-ca-67d667c7d-lnx8p" May 21 20:41:02.431047 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.430921 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5d194dd6-c5f1-4aee-9c5c-6bea70cdc661-signing-key\") pod \"service-ca-67d667c7d-lnx8p\" (UID: \"5d194dd6-c5f1-4aee-9c5c-6bea70cdc661\") " pod="openshift-service-ca/service-ca-67d667c7d-lnx8p" May 21 20:41:02.431533 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.431508 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5d194dd6-c5f1-4aee-9c5c-6bea70cdc661-signing-cabundle\") pod \"service-ca-67d667c7d-lnx8p\" (UID: \"5d194dd6-c5f1-4aee-9c5c-6bea70cdc661\") " pod="openshift-service-ca/service-ca-67d667c7d-lnx8p" May 21 20:41:02.433319 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.433292 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5d194dd6-c5f1-4aee-9c5c-6bea70cdc661-signing-key\") pod \"service-ca-67d667c7d-lnx8p\" (UID: \"5d194dd6-c5f1-4aee-9c5c-6bea70cdc661\") " pod="openshift-service-ca/service-ca-67d667c7d-lnx8p" May 21 20:41:02.438574 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.438550 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p682k\" (UniqueName: \"kubernetes.io/projected/5d194dd6-c5f1-4aee-9c5c-6bea70cdc661-kube-api-access-p682k\") pod \"service-ca-67d667c7d-lnx8p\" (UID: \"5d194dd6-c5f1-4aee-9c5c-6bea70cdc661\") " pod="openshift-service-ca/service-ca-67d667c7d-lnx8p" May 21 20:41:02.486802 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.486773 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-lnx8p" May 21 20:41:02.612500 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:02.612469 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lnx8p"] May 21 20:41:02.616614 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:41:02.616586 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d194dd6_c5f1_4aee_9c5c_6bea70cdc661.slice/crio-6c57a4eee13f745936acc5b6bc854108ad9f782005f165ce5546fc53a10a5a7f WatchSource:0}: Error finding container 6c57a4eee13f745936acc5b6bc854108ad9f782005f165ce5546fc53a10a5a7f: Status 404 returned error can't find the container with id 6c57a4eee13f745936acc5b6bc854108ad9f782005f165ce5546fc53a10a5a7f May 21 20:41:03.074993 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:03.074956 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-lnx8p" event={"ID":"5d194dd6-c5f1-4aee-9c5c-6bea70cdc661","Type":"ContainerStarted","Data":"6c57a4eee13f745936acc5b6bc854108ad9f782005f165ce5546fc53a10a5a7f"} May 21 20:41:03.137067 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:03.137025 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:41:03.137246 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:03.137222 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:41:03.137297 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:03.137246 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d5bdf8dd-c826d: secret "image-registry-tls" not found May 21 20:41:03.137337 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:03.137318 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls podName:9c4cdce4-9c75-428f-98a8-debfde2f010c nodeName:}" failed. No retries permitted until 2026-05-21 20:41:11.137294417 +0000 UTC m=+162.029156997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls") pod "image-registry-64d5bdf8dd-c826d" (UID: "9c4cdce4-9c75-428f-98a8-debfde2f010c") : secret "image-registry-tls" not found May 21 20:41:03.237764 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:03.237727 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:41:03.238144 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:03.237903 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 20:41:03.238144 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:03.237999 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls podName:64c42161-d041-4a84-addc-fa4b5c52e2f0 nodeName:}" failed. No retries permitted until 2026-05-21 20:41:11.237976105 +0000 UTC m=+162.129838695 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-bzg68" (UID: "64c42161-d041-4a84-addc-fa4b5c52e2f0") : secret "cluster-monitoring-operator-tls" not found May 21 20:41:03.353011 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:03.352927 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xb8nw_432776d9-7c1f-4742-bd20-da704e768581/dns-node-resolver/0.log" May 21 20:41:04.153492 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:04.153459 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vf548_1daa7f15-874e-4696-802f-f7505865a63b/node-ca/0.log" May 21 20:41:05.082360 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:05.082322 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-lnx8p" event={"ID":"5d194dd6-c5f1-4aee-9c5c-6bea70cdc661","Type":"ContainerStarted","Data":"c6cf37f557a461be050b27d516e3e94c7ee8cb17d015f37d397ac2217a1c5c47"} May 21 20:41:05.098567 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:05.098517 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-lnx8p" podStartSLOduration=1.4647913350000001 podStartE2EDuration="3.098503744s" podCreationTimestamp="2026-05-21 20:41:02 +0000 UTC" firstStartedPulling="2026-05-21 20:41:02.618525786 +0000 UTC m=+153.510388362" lastFinishedPulling="2026-05-21 20:41:04.252238193 +0000 UTC m=+155.144100771" observedRunningTime="2026-05-21 20:41:05.097389776 +0000 UTC m=+155.989252375" watchObservedRunningTime="2026-05-21 20:41:05.098503744 +0000 UTC m=+155.990366342" May 21 20:41:05.689903 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:05.689862 2573 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:41:05.689903 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:05.689908 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:41:05.690372 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:05.690358 2573 scope.go:117] "RemoveContainer" containerID="573cbf943684ec7fb6b2605318396a04ac0544fb8b9a0803cd0ece915a76c62d" May 21 20:41:05.690638 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:05.690617 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-vxk5c_openshift-console-operator(e10707ec-cbb2-40ec-a5d6-be05b057b517)\"" pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" podUID="e10707ec-cbb2-40ec-a5d6-be05b057b517" May 21 20:41:07.539801 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:07.539751 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mmgbz" podUID="1760ef7c-0c3a-4255-b303-0bf5ccace164" May 21 20:41:07.551957 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:07.551920 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-bvldf" podUID="a5622334-2813-4e89-8705-ddb46c4132cd" May 21 20:41:07.686362 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:07.686322 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8jlfz" podUID="b0cabb11-fb0d-4a2a-b250-f4cc748429ba" May 21 20:41:08.089824 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:08.089788 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mmgbz" May 21 20:41:11.205501 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:11.205456 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:41:11.208015 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:11.207991 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls\") pod \"image-registry-64d5bdf8dd-c826d\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:41:11.294505 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:11.294454 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:41:11.306512 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:11.306480 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:41:11.306663 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:11.306645 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 20:41:11.306749 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:11.306739 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls podName:64c42161-d041-4a84-addc-fa4b5c52e2f0 nodeName:}" failed. No retries permitted until 2026-05-21 20:41:27.306718118 +0000 UTC m=+178.198580699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-bzg68" (UID: "64c42161-d041-4a84-addc-fa4b5c52e2f0") : secret "cluster-monitoring-operator-tls" not found May 21 20:41:11.419559 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:11.419532 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64d5bdf8dd-c826d"] May 21 20:41:11.422219 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:41:11.422192 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4cdce4_9c75_428f_98a8_debfde2f010c.slice/crio-4e7b29ddc90b2b0554956f4690ae6d39ea72277c8326276f49ca73a5eca16c78 WatchSource:0}: Error finding container 4e7b29ddc90b2b0554956f4690ae6d39ea72277c8326276f49ca73a5eca16c78: Status 404 returned error can't find the container with id 4e7b29ddc90b2b0554956f4690ae6d39ea72277c8326276f49ca73a5eca16c78 May 21 20:41:12.100724 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:12.100689 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" event={"ID":"9c4cdce4-9c75-428f-98a8-debfde2f010c","Type":"ContainerStarted","Data":"6b1525beebeaa9e6d76a1944c0470e628b93e37d85d620f1c048fa44d0287c75"} May 21 20:41:12.100724 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:12.100725 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" event={"ID":"9c4cdce4-9c75-428f-98a8-debfde2f010c","Type":"ContainerStarted","Data":"4e7b29ddc90b2b0554956f4690ae6d39ea72277c8326276f49ca73a5eca16c78"} May 21 20:41:12.100945 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:12.100818 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:41:12.121056 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:12.121005 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" podStartSLOduration=17.120990087 podStartE2EDuration="17.120990087s" podCreationTimestamp="2026-05-21 20:40:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:41:12.119925262 +0000 UTC m=+163.011787862" watchObservedRunningTime="2026-05-21 20:41:12.120990087 +0000 UTC m=+163.012852685" May 21 20:41:12.413562 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:12.413458 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert\") pod \"ingress-canary-bvldf\" (UID: \"a5622334-2813-4e89-8705-ddb46c4132cd\") " pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:41:12.413562 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:12.413547 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:41:12.415945 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:12.415912 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1760ef7c-0c3a-4255-b303-0bf5ccace164-metrics-tls\") pod \"dns-default-mmgbz\" (UID: \"1760ef7c-0c3a-4255-b303-0bf5ccace164\") " pod="openshift-dns/dns-default-mmgbz" May 21 20:41:12.416127 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:12.416103 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5622334-2813-4e89-8705-ddb46c4132cd-cert\") pod \"ingress-canary-bvldf\" (UID: \"a5622334-2813-4e89-8705-ddb46c4132cd\") " pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:41:12.593733 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:12.593696 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-25972\"" May 21 20:41:12.601197 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:12.601167 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mmgbz" May 21 20:41:12.727227 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:12.727187 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mmgbz"] May 21 20:41:12.731231 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:41:12.731196 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1760ef7c_0c3a_4255_b303_0bf5ccace164.slice/crio-d1480c9e6f58635ad1e9e3f8b0f3a3a9dc8cde7459ac32601ed01d942f6e9dfe WatchSource:0}: Error finding container d1480c9e6f58635ad1e9e3f8b0f3a3a9dc8cde7459ac32601ed01d942f6e9dfe: Status 404 returned error can't find the container with id d1480c9e6f58635ad1e9e3f8b0f3a3a9dc8cde7459ac32601ed01d942f6e9dfe May 21 20:41:13.105257 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:13.105219 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mmgbz" event={"ID":"1760ef7c-0c3a-4255-b303-0bf5ccace164","Type":"ContainerStarted","Data":"d1480c9e6f58635ad1e9e3f8b0f3a3a9dc8cde7459ac32601ed01d942f6e9dfe"} May 21 20:41:15.111386 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:15.111351 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mmgbz" event={"ID":"1760ef7c-0c3a-4255-b303-0bf5ccace164","Type":"ContainerStarted","Data":"a28f00ca07f8e67b4be90c414748937bdc11ca75fc1d548ca7b47ac1684f4732"} May 21 20:41:15.111386 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:15.111389 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mmgbz" event={"ID":"1760ef7c-0c3a-4255-b303-0bf5ccace164","Type":"ContainerStarted","Data":"a7cb54c14ae1696b9f5f05accfb4444ca801a0fa30c44f5a3645a39d0b21319e"} May 21 20:41:15.111809 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:15.111506 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mmgbz" May 21 20:41:15.128863 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:15.128817 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-mmgbz" podStartSLOduration=129.766418508 podStartE2EDuration="2m11.128802826s" podCreationTimestamp="2026-05-21 20:39:04 +0000 UTC" firstStartedPulling="2026-05-21 20:41:12.735432777 +0000 UTC m=+163.627295352" lastFinishedPulling="2026-05-21 20:41:14.097817087 +0000 UTC m=+164.989679670" observedRunningTime="2026-05-21 20:41:15.127453961 +0000 UTC m=+166.019316559" watchObservedRunningTime="2026-05-21 20:41:15.128802826 +0000 UTC m=+166.020665476" May 21 20:41:17.677861 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:17.677824 2573 scope.go:117] "RemoveContainer" containerID="573cbf943684ec7fb6b2605318396a04ac0544fb8b9a0803cd0ece915a76c62d" May 21 20:41:18.122062 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:18.122034 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 20:41:18.122228 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:18.122126 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" event={"ID":"e10707ec-cbb2-40ec-a5d6-be05b057b517","Type":"ContainerStarted","Data":"391f081353ae6fc44ae24af43bc797ff34ec0de767135dab4e2d73b2cf38fe57"} May 21 20:41:18.122454 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:18.122433 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:41:18.138518 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:18.138461 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" podStartSLOduration=20.600532212 podStartE2EDuration="23.138443597s" podCreationTimestamp="2026-05-21 20:40:55 +0000 UTC" firstStartedPulling="2026-05-21 20:40:55.817942295 +0000 UTC m=+146.709804870" lastFinishedPulling="2026-05-21 20:40:58.355853675 +0000 UTC m=+149.247716255" observedRunningTime="2026-05-21 20:41:18.137651971 +0000 UTC m=+169.029514566" watchObservedRunningTime="2026-05-21 20:41:18.138443597 +0000 UTC m=+169.030306197" May 21 20:41:18.179194 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:18.179162 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-vxk5c" May 21 20:41:21.135162 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:21.135128 2573 generic.go:358] "Generic (PLEG): container finished" podID="aafe0a53-f382-4ddf-83d7-f043e1aa5be1" containerID="c882c8246b252d8ff9fe23cd3cd42cc5de0488a2601520b0820d364dc934d357" exitCode=255 May 21 20:41:21.135538 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:21.135187 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9" event={"ID":"aafe0a53-f382-4ddf-83d7-f043e1aa5be1","Type":"ContainerDied","Data":"c882c8246b252d8ff9fe23cd3cd42cc5de0488a2601520b0820d364dc934d357"} May 21 20:41:21.140969 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:21.140949 2573 scope.go:117] "RemoveContainer" containerID="c882c8246b252d8ff9fe23cd3cd42cc5de0488a2601520b0820d364dc934d357" May 21 20:41:22.139051 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:22.139014 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b7d45f4db-fssw9" event={"ID":"aafe0a53-f382-4ddf-83d7-f043e1aa5be1","Type":"ContainerStarted","Data":"6358b7cbf1c940ff2692f38dadc2169cb84b703845825bf6560c6a5799444861"} May 21 20:41:22.677671 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:22.677636 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:41:22.677858 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:22.677748 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:41:22.680410 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:22.680375 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f4n69\"" May 21 20:41:22.688586 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:22.688567 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bvldf" May 21 20:41:22.809585 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:22.809552 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bvldf"] May 21 20:41:22.812714 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:41:22.812684 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5622334_2813_4e89_8705_ddb46c4132cd.slice/crio-0d2fc2c7833e10ffee845ac4127cb620b35cc1e6c6a5b6f6e8035bebbc5d719c WatchSource:0}: Error finding container 0d2fc2c7833e10ffee845ac4127cb620b35cc1e6c6a5b6f6e8035bebbc5d719c: Status 404 returned error can't find the container with id 0d2fc2c7833e10ffee845ac4127cb620b35cc1e6c6a5b6f6e8035bebbc5d719c May 21 20:41:23.142480 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.142441 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bvldf" event={"ID":"a5622334-2813-4e89-8705-ddb46c4132cd","Type":"ContainerStarted","Data":"0d2fc2c7833e10ffee845ac4127cb620b35cc1e6c6a5b6f6e8035bebbc5d719c"} May 21 20:41:23.813758 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.813726 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xqzpt"] May 21 20:41:23.816183 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.816154 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:23.818923 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.818900 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 20:41:23.820027 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.820006 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f9jgq\"" May 21 20:41:23.820135 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.820010 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 20:41:23.827387 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.827362 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xqzpt"] May 21 20:41:23.891528 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.891494 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-8g7vs"] May 21 20:41:23.893860 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.893838 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-8g7vs" May 21 20:41:23.896911 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.896877 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-s52xt\"" May 21 20:41:23.897128 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.897106 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 20:41:23.897512 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.897491 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 20:41:23.898337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.898293 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64d5bdf8dd-c826d"] May 21 20:41:23.904001 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.903548 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-8g7vs"] May 21 20:41:23.905001 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.904966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e95ccacb-4317-4de3-a158-3219fb67bc07-data-volume\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:23.905120 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.905030 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e95ccacb-4317-4de3-a158-3219fb67bc07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:23.905120 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.905097 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s68bg\" (UniqueName: \"kubernetes.io/projected/e95ccacb-4317-4de3-a158-3219fb67bc07-kube-api-access-s68bg\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:23.905244 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.905145 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e95ccacb-4317-4de3-a158-3219fb67bc07-crio-socket\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:23.905244 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:23.905193 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e95ccacb-4317-4de3-a158-3219fb67bc07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:24.006260 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.006221 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e95ccacb-4317-4de3-a158-3219fb67bc07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:24.006475 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.006312 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e95ccacb-4317-4de3-a158-3219fb67bc07-data-volume\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:24.006475 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.006342 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n5sh\" (UniqueName: \"kubernetes.io/projected/b29b4ad7-74a3-4f33-9610-4a1a32c59a25-kube-api-access-9n5sh\") pod \"downloads-57bd96b888-8g7vs\" (UID: \"b29b4ad7-74a3-4f33-9610-4a1a32c59a25\") " pod="openshift-console/downloads-57bd96b888-8g7vs" May 21 20:41:24.006475 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.006433 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e95ccacb-4317-4de3-a158-3219fb67bc07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:24.006708 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.006508 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s68bg\" (UniqueName: \"kubernetes.io/projected/e95ccacb-4317-4de3-a158-3219fb67bc07-kube-api-access-s68bg\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:24.006708 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.006551 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e95ccacb-4317-4de3-a158-3219fb67bc07-crio-socket\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:24.006708 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.006641 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e95ccacb-4317-4de3-a158-3219fb67bc07-crio-socket\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:24.006858 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.006767 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e95ccacb-4317-4de3-a158-3219fb67bc07-data-volume\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:24.007069 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.007052 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e95ccacb-4317-4de3-a158-3219fb67bc07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:24.008950 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.008930 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e95ccacb-4317-4de3-a158-3219fb67bc07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:24.015764 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.015743 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s68bg\" (UniqueName: \"kubernetes.io/projected/e95ccacb-4317-4de3-a158-3219fb67bc07-kube-api-access-s68bg\") pod \"insights-runtime-extractor-xqzpt\" (UID: \"e95ccacb-4317-4de3-a158-3219fb67bc07\") " pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:24.107266 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.107178 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9n5sh\" (UniqueName: \"kubernetes.io/projected/b29b4ad7-74a3-4f33-9610-4a1a32c59a25-kube-api-access-9n5sh\") pod \"downloads-57bd96b888-8g7vs\" (UID: \"b29b4ad7-74a3-4f33-9610-4a1a32c59a25\") " pod="openshift-console/downloads-57bd96b888-8g7vs" May 21 20:41:24.117183 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.117101 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n5sh\" (UniqueName: \"kubernetes.io/projected/b29b4ad7-74a3-4f33-9610-4a1a32c59a25-kube-api-access-9n5sh\") pod \"downloads-57bd96b888-8g7vs\" (UID: \"b29b4ad7-74a3-4f33-9610-4a1a32c59a25\") " pod="openshift-console/downloads-57bd96b888-8g7vs" May 21 20:41:24.125371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.125341 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xqzpt" May 21 20:41:24.206533 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.206482 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-8g7vs" May 21 20:41:24.434606 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.434580 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-8g7vs"] May 21 20:41:24.436958 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:41:24.436919 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29b4ad7_74a3_4f33_9610_4a1a32c59a25.slice/crio-d102eeba4ffb20b2b048143f3a5bcef98dd29ef84788327a844faf797b711598 WatchSource:0}: Error finding container d102eeba4ffb20b2b048143f3a5bcef98dd29ef84788327a844faf797b711598: Status 404 returned error can't find the container with id d102eeba4ffb20b2b048143f3a5bcef98dd29ef84788327a844faf797b711598 May 21 20:41:24.448137 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:24.448079 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xqzpt"] May 21 20:41:24.452375 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:41:24.452349 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95ccacb_4317_4de3_a158_3219fb67bc07.slice/crio-a087ed12e933b15865cfea6259e907c0d8c950916c758cbcd64a0a2611bdcaba WatchSource:0}: Error finding container a087ed12e933b15865cfea6259e907c0d8c950916c758cbcd64a0a2611bdcaba: Status 404 returned error can't find the container with id a087ed12e933b15865cfea6259e907c0d8c950916c758cbcd64a0a2611bdcaba May 21 20:41:25.116326 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:25.116292 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mmgbz" May 21 20:41:25.151272 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:25.150564 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bvldf" event={"ID":"a5622334-2813-4e89-8705-ddb46c4132cd","Type":"ContainerStarted","Data":"32f3534be5b3e2111c9ff0487e5f6fb14c3563eebb0d3edc73f73053f4fccb60"} May 21 20:41:25.152427 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:25.152364 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-8g7vs" event={"ID":"b29b4ad7-74a3-4f33-9610-4a1a32c59a25","Type":"ContainerStarted","Data":"d102eeba4ffb20b2b048143f3a5bcef98dd29ef84788327a844faf797b711598"} May 21 20:41:25.154422 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:25.154378 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xqzpt" event={"ID":"e95ccacb-4317-4de3-a158-3219fb67bc07","Type":"ContainerStarted","Data":"143ef7c18bc6fd9c07df3cb3ff4dce1ae861b1a15ab5721404bd8110498b54d4"} May 21 20:41:25.154532 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:25.154430 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xqzpt" event={"ID":"e95ccacb-4317-4de3-a158-3219fb67bc07","Type":"ContainerStarted","Data":"9dc25702278ebfdeb6f6d0a4efe4a3f68d65514011801c87b1c15b5eb6ffff30"} May 21 20:41:25.154532 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:25.154447 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xqzpt" event={"ID":"e95ccacb-4317-4de3-a158-3219fb67bc07","Type":"ContainerStarted","Data":"a087ed12e933b15865cfea6259e907c0d8c950916c758cbcd64a0a2611bdcaba"} May 21 20:41:25.168774 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:25.168713 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bvldf" podStartSLOduration=139.656196696 podStartE2EDuration="2m21.168693767s" podCreationTimestamp="2026-05-21 20:39:04 +0000 UTC" firstStartedPulling="2026-05-21 20:41:22.814685482 +0000 UTC m=+173.706548065" lastFinishedPulling="2026-05-21 20:41:24.327182555 +0000 UTC m=+175.219045136" observedRunningTime="2026-05-21 20:41:25.167684036 +0000 UTC m=+176.059546635" watchObservedRunningTime="2026-05-21 20:41:25.168693767 +0000 UTC m=+176.060556366" May 21 20:41:27.164308 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:27.164261 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xqzpt" event={"ID":"e95ccacb-4317-4de3-a158-3219fb67bc07","Type":"ContainerStarted","Data":"836ef69a8e1abf58b201ec1511e6c0a8b204f017e094b08219dd8bc896800bce"} May 21 20:41:27.183739 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:27.183682 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xqzpt" podStartSLOduration=2.226670691 podStartE2EDuration="4.183665971s" podCreationTimestamp="2026-05-21 20:41:23 +0000 UTC" firstStartedPulling="2026-05-21 20:41:24.509981969 +0000 UTC m=+175.401844545" lastFinishedPulling="2026-05-21 20:41:26.466977227 +0000 UTC m=+177.358839825" observedRunningTime="2026-05-21 20:41:27.182112853 +0000 UTC m=+178.073975451" watchObservedRunningTime="2026-05-21 20:41:27.183665971 +0000 UTC m=+178.075528568" May 21 20:41:27.334392 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:27.334348 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:41:27.337080 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:27.337050 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64c42161-d041-4a84-addc-fa4b5c52e2f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bzg68\" (UID: \"64c42161-d041-4a84-addc-fa4b5c52e2f0\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:41:27.614979 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:27.614937 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" May 21 20:41:27.759295 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:27.759258 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68"] May 21 20:41:27.762721 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:41:27.762684 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c42161_d041_4a84_addc_fa4b5c52e2f0.slice/crio-2b3300a0cefaf253a1ab825f47ca615c1c8591bca11a4bd260f6bb4fd341c2bf WatchSource:0}: Error finding container 2b3300a0cefaf253a1ab825f47ca615c1c8591bca11a4bd260f6bb4fd341c2bf: Status 404 returned error can't find the container with id 2b3300a0cefaf253a1ab825f47ca615c1c8591bca11a4bd260f6bb4fd341c2bf May 21 20:41:28.169844 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:28.169809 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" event={"ID":"64c42161-d041-4a84-addc-fa4b5c52e2f0","Type":"ContainerStarted","Data":"2b3300a0cefaf253a1ab825f47ca615c1c8591bca11a4bd260f6bb4fd341c2bf"} May 21 20:41:29.958668 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:29.958629 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2"] May 21 20:41:29.961027 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:29.961003 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2" May 21 20:41:29.964630 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:29.964086 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 21 20:41:29.964630 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:29.964113 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kndpf\"" May 21 20:41:29.970374 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:29.969196 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2"] May 21 20:41:30.061934 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:30.061886 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8a3b77c9-533f-4e05-af79-2d1c9ae8e08b-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2\" (UID: \"8a3b77c9-533f-4e05-af79-2d1c9ae8e08b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2" May 21 20:41:30.163166 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:30.163125 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8a3b77c9-533f-4e05-af79-2d1c9ae8e08b-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2\" (UID: \"8a3b77c9-533f-4e05-af79-2d1c9ae8e08b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2" May 21 20:41:30.165983 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:30.165958 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8a3b77c9-533f-4e05-af79-2d1c9ae8e08b-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2\" (UID: \"8a3b77c9-533f-4e05-af79-2d1c9ae8e08b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2" May 21 20:41:30.177732 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:30.177675 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" event={"ID":"64c42161-d041-4a84-addc-fa4b5c52e2f0","Type":"ContainerStarted","Data":"0affe3b64783ac5892c55e8d061212052f7342dc4007ec7bde83f49d1774f39c"} May 21 20:41:30.195794 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:30.195741 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bzg68" podStartSLOduration=33.528521642 podStartE2EDuration="35.195724339s" podCreationTimestamp="2026-05-21 20:40:55 +0000 UTC" firstStartedPulling="2026-05-21 20:41:27.764894339 +0000 UTC m=+178.656756916" lastFinishedPulling="2026-05-21 20:41:29.432097037 +0000 UTC m=+180.323959613" observedRunningTime="2026-05-21 20:41:30.195037299 +0000 UTC m=+181.086899910" watchObservedRunningTime="2026-05-21 20:41:30.195724339 +0000 UTC m=+181.087586953" May 21 20:41:30.273575 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:30.273483 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2" May 21 20:41:30.413705 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:30.413670 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2"] May 21 20:41:30.418326 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:41:30.418296 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3b77c9_533f_4e05_af79_2d1c9ae8e08b.slice/crio-f82235493b670e92521761e4989a35e93367a9b7b3b4ab60b915ee4c57b8af03 WatchSource:0}: Error finding container f82235493b670e92521761e4989a35e93367a9b7b3b4ab60b915ee4c57b8af03: Status 404 returned error can't find the container with id f82235493b670e92521761e4989a35e93367a9b7b3b4ab60b915ee4c57b8af03 May 21 20:41:31.183829 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:31.183239 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2" event={"ID":"8a3b77c9-533f-4e05-af79-2d1c9ae8e08b","Type":"ContainerStarted","Data":"f82235493b670e92521761e4989a35e93367a9b7b3b4ab60b915ee4c57b8af03"} May 21 20:41:32.069280 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.069246 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b7887b884-dqhvf"] May 21 20:41:32.071581 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.071554 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.074508 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.074484 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 20:41:32.074637 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.074485 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 20:41:32.074637 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.074583 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 20:41:32.074747 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.074577 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q2hjx\"" May 21 20:41:32.075673 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.075654 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 20:41:32.076003 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.075982 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 20:41:32.085365 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.085336 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7887b884-dqhvf"] May 21 20:41:32.087841 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.087817 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 20:41:32.182918 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.182881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-oauth-config\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.183089 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.182928 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-trusted-ca-bundle\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.183089 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.182959 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-oauth-serving-cert\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.183089 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.183061 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-config\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.183260 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.183101 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-serving-cert\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.183260 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.183135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjndx\" (UniqueName: \"kubernetes.io/projected/1f5ed782-bc37-4bdc-93c9-290d7d52c955-kube-api-access-mjndx\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.183260 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.183191 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-service-ca\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.187271 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.187231 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2" event={"ID":"8a3b77c9-533f-4e05-af79-2d1c9ae8e08b","Type":"ContainerStarted","Data":"b732084b2c97842cd4cd7239c2426fc8c6f43a450cb4fcd47c8661d22e7ef29f"} May 21 20:41:32.187691 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.187529 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2" May 21 20:41:32.193478 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.193445 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2" May 21 20:41:32.204287 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.204236 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2" podStartSLOduration=2.32036021 podStartE2EDuration="3.204220953s" podCreationTimestamp="2026-05-21 20:41:29 +0000 UTC" firstStartedPulling="2026-05-21 20:41:30.420759403 +0000 UTC m=+181.312621978" lastFinishedPulling="2026-05-21 20:41:31.304620143 +0000 UTC m=+182.196482721" observedRunningTime="2026-05-21 20:41:32.20323128 +0000 UTC m=+183.095093878" watchObservedRunningTime="2026-05-21 20:41:32.204220953 +0000 UTC m=+183.096083550" May 21 20:41:32.284042 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.284005 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-service-ca\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.284042 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.284050 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-oauth-config\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.284282 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.284189 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-trusted-ca-bundle\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.284282 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.284223 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-oauth-serving-cert\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.284390 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.284308 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-config\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.284390 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.284350 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-serving-cert\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.284390 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.284385 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjndx\" (UniqueName: \"kubernetes.io/projected/1f5ed782-bc37-4bdc-93c9-290d7d52c955-kube-api-access-mjndx\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.284932 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.284880 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-service-ca\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.285274 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.285228 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-trusted-ca-bundle\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.285574 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.285555 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-oauth-serving-cert\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.285629 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.285583 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-config\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.287115 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.287088 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-oauth-config\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.287242 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.287217 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-serving-cert\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.293126 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.293082 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjndx\" (UniqueName: \"kubernetes.io/projected/1f5ed782-bc37-4bdc-93c9-290d7d52c955-kube-api-access-mjndx\") pod \"console-7b7887b884-dqhvf\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.386792 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.386698 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:32.531210 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:32.531173 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7887b884-dqhvf"] May 21 20:41:32.534462 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:41:32.534427 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f5ed782_bc37_4bdc_93c9_290d7d52c955.slice/crio-758998bab1ada059bd11afbcef01572f28fef8523139cb9cc4a72808b693f464 WatchSource:0}: Error finding container 758998bab1ada059bd11afbcef01572f28fef8523139cb9cc4a72808b693f464: Status 404 returned error can't find the container with id 758998bab1ada059bd11afbcef01572f28fef8523139cb9cc4a72808b693f464 May 21 20:41:33.191686 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:33.191642 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7887b884-dqhvf" event={"ID":"1f5ed782-bc37-4bdc-93c9-290d7d52c955","Type":"ContainerStarted","Data":"758998bab1ada059bd11afbcef01572f28fef8523139cb9cc4a72808b693f464"} May 21 20:41:33.905173 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:33.905071 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:41:39.357559 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.357497 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl"] May 21 20:41:39.361578 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.360555 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:39.365186 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.363822 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l92kq\"" May 21 20:41:39.365186 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.364095 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 21 20:41:39.365186 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.364853 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 21 20:41:39.365186 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.365001 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 20:41:39.372673 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.372444 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl"] May 21 20:41:39.382120 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.382090 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8znkh"] May 21 20:41:39.384757 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.384737 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.387926 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.387898 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 20:41:39.389119 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.388286 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 20:41:39.389355 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.388814 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p456j\"" May 21 20:41:39.390830 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.390754 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 20:41:39.451418 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.451014 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a333493f-5544-4ad1-b1ea-f8aaa49d0663-metrics-client-ca\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.451418 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.451063 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba038327-7953-4c00-8f80-e5d4428d8b56-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-mh9fl\" (UID: \"ba038327-7953-4c00-8f80-e5d4428d8b56\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:39.451418 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.451092 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba038327-7953-4c00-8f80-e5d4428d8b56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mh9fl\" (UID: \"ba038327-7953-4c00-8f80-e5d4428d8b56\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:39.451418 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.451117 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba038327-7953-4c00-8f80-e5d4428d8b56-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-mh9fl\" (UID: \"ba038327-7953-4c00-8f80-e5d4428d8b56\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:39.451418 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.451185 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ps74\" (UniqueName: \"kubernetes.io/projected/a333493f-5544-4ad1-b1ea-f8aaa49d0663-kube-api-access-2ps74\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.451418 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.451221 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xjcf\" (UniqueName: \"kubernetes.io/projected/ba038327-7953-4c00-8f80-e5d4428d8b56-kube-api-access-6xjcf\") pod \"openshift-state-metrics-9c959559f-mh9fl\" (UID: \"ba038327-7953-4c00-8f80-e5d4428d8b56\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:39.451418 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.451261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a333493f-5544-4ad1-b1ea-f8aaa49d0663-sys\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.451418 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.451351 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a333493f-5544-4ad1-b1ea-f8aaa49d0663-root\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.451418 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.451378 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-tls\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.451990 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.451443 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-textfile\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.451990 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.451474 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-wtmp\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.451990 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.451543 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-accelerators-collector-config\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.451990 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.451642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.554195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.552077 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ps74\" (UniqueName: \"kubernetes.io/projected/a333493f-5544-4ad1-b1ea-f8aaa49d0663-kube-api-access-2ps74\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.554195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.552135 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xjcf\" (UniqueName: \"kubernetes.io/projected/ba038327-7953-4c00-8f80-e5d4428d8b56-kube-api-access-6xjcf\") pod \"openshift-state-metrics-9c959559f-mh9fl\" (UID: \"ba038327-7953-4c00-8f80-e5d4428d8b56\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:39.554195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.552175 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a333493f-5544-4ad1-b1ea-f8aaa49d0663-sys\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.554195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.552224 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a333493f-5544-4ad1-b1ea-f8aaa49d0663-root\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.554195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.552250 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-tls\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.554195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.552279 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-textfile\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.554195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.552303 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-wtmp\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.554195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.552331 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-accelerators-collector-config\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.554195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.552364 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.554195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.552392 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a333493f-5544-4ad1-b1ea-f8aaa49d0663-metrics-client-ca\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.554195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.552438 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba038327-7953-4c00-8f80-e5d4428d8b56-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-mh9fl\" (UID: \"ba038327-7953-4c00-8f80-e5d4428d8b56\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:39.554195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.552467 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba038327-7953-4c00-8f80-e5d4428d8b56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mh9fl\" (UID: \"ba038327-7953-4c00-8f80-e5d4428d8b56\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:39.554195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.552495 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba038327-7953-4c00-8f80-e5d4428d8b56-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-mh9fl\" (UID: \"ba038327-7953-4c00-8f80-e5d4428d8b56\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:39.554195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.553254 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-textfile\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.554794 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.554355 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba038327-7953-4c00-8f80-e5d4428d8b56-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-mh9fl\" (UID: \"ba038327-7953-4c00-8f80-e5d4428d8b56\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:39.554794 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:39.554504 2573 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 21 20:41:39.554794 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:39.554568 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba038327-7953-4c00-8f80-e5d4428d8b56-openshift-state-metrics-tls podName:ba038327-7953-4c00-8f80-e5d4428d8b56 nodeName:}" failed. No retries permitted until 2026-05-21 20:41:40.054549502 +0000 UTC m=+190.946412092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ba038327-7953-4c00-8f80-e5d4428d8b56-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-mh9fl" (UID: "ba038327-7953-4c00-8f80-e5d4428d8b56") : secret "openshift-state-metrics-tls" not found May 21 20:41:39.555037 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.554935 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a333493f-5544-4ad1-b1ea-f8aaa49d0663-metrics-client-ca\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.555037 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.554984 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-wtmp\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.555037 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.554993 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a333493f-5544-4ad1-b1ea-f8aaa49d0663-sys\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.555326 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.555258 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a333493f-5544-4ad1-b1ea-f8aaa49d0663-root\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.555487 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.555449 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-accelerators-collector-config\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.558756 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.558713 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-tls\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.559835 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.559662 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a333493f-5544-4ad1-b1ea-f8aaa49d0663-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.559835 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.559794 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba038327-7953-4c00-8f80-e5d4428d8b56-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-mh9fl\" (UID: \"ba038327-7953-4c00-8f80-e5d4428d8b56\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:39.565888 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.565839 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xjcf\" (UniqueName: \"kubernetes.io/projected/ba038327-7953-4c00-8f80-e5d4428d8b56-kube-api-access-6xjcf\") pod \"openshift-state-metrics-9c959559f-mh9fl\" (UID: \"ba038327-7953-4c00-8f80-e5d4428d8b56\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:39.568147 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.568075 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ps74\" (UniqueName: \"kubernetes.io/projected/a333493f-5544-4ad1-b1ea-f8aaa49d0663-kube-api-access-2ps74\") pod \"node-exporter-8znkh\" (UID: \"a333493f-5544-4ad1-b1ea-f8aaa49d0663\") " pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:39.700307 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:39.699850 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8znkh" May 21 20:41:40.057586 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.057550 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba038327-7953-4c00-8f80-e5d4428d8b56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mh9fl\" (UID: \"ba038327-7953-4c00-8f80-e5d4428d8b56\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:40.060284 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.060254 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba038327-7953-4c00-8f80-e5d4428d8b56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mh9fl\" (UID: \"ba038327-7953-4c00-8f80-e5d4428d8b56\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:40.277270 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.277214 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" May 21 20:41:40.464999 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.464827 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 20:41:40.471319 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.471213 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.474152 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.474125 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 21 20:41:40.474305 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.474125 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 21 20:41:40.474489 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.474125 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 21 20:41:40.474821 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.474620 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8mhlq\"" May 21 20:41:40.474821 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.474675 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 21 20:41:40.474821 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.474620 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 21 20:41:40.475386 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.474901 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 21 20:41:40.475386 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.474956 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 21 20:41:40.475386 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.475065 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 21 20:41:40.475386 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.475101 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 21 20:41:40.479983 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.479955 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 20:41:40.562840 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.562795 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-config-volume\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.563009 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.562849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-web-config\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.563009 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.562884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99mq5\" (UniqueName: \"kubernetes.io/projected/00efb094-b9a2-4f1e-99e0-bc55f6153945-kube-api-access-99mq5\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.563009 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.562952 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.563152 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.563010 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.563152 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.563083 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00efb094-b9a2-4f1e-99e0-bc55f6153945-config-out\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.563152 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.563131 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00efb094-b9a2-4f1e-99e0-bc55f6153945-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.563275 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.563165 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.563275 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.563203 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.563275 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.563246 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.563433 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.563274 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00efb094-b9a2-4f1e-99e0-bc55f6153945-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.563433 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.563313 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00efb094-b9a2-4f1e-99e0-bc55f6153945-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.563433 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.563360 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00efb094-b9a2-4f1e-99e0-bc55f6153945-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.664542 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.664505 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00efb094-b9a2-4f1e-99e0-bc55f6153945-config-out\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.664542 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.664546 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00efb094-b9a2-4f1e-99e0-bc55f6153945-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.664767 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.664579 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.664767 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.664612 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.664767 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.664647 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.664767 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.664673 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00efb094-b9a2-4f1e-99e0-bc55f6153945-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.664767 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.664709 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00efb094-b9a2-4f1e-99e0-bc55f6153945-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.664767 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.664737 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00efb094-b9a2-4f1e-99e0-bc55f6153945-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.665021 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.664782 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-config-volume\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.665021 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.664810 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-web-config\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.665021 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.664839 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99mq5\" (UniqueName: \"kubernetes.io/projected/00efb094-b9a2-4f1e-99e0-bc55f6153945-kube-api-access-99mq5\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.665021 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.664875 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.665021 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.664931 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.665233 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:40.665062 2573 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found May 21 20:41:40.665233 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:40.665156 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-main-tls podName:00efb094-b9a2-4f1e-99e0-bc55f6153945 nodeName:}" failed. No retries permitted until 2026-05-21 20:41:41.165132568 +0000 UTC m=+192.056995159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "00efb094-b9a2-4f1e-99e0-bc55f6153945") : secret "alertmanager-main-tls" not found May 21 20:41:40.666730 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.665801 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00efb094-b9a2-4f1e-99e0-bc55f6153945-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.666730 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.666066 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00efb094-b9a2-4f1e-99e0-bc55f6153945-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.666730 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.666299 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00efb094-b9a2-4f1e-99e0-bc55f6153945-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.667941 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.667914 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.668557 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.668530 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00efb094-b9a2-4f1e-99e0-bc55f6153945-config-out\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.668656 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.668635 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00efb094-b9a2-4f1e-99e0-bc55f6153945-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.670490 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.670466 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.670952 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.670921 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-config-volume\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.671913 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.671887 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.673052 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.672976 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-web-config\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.673136 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.673118 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:40.675299 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:40.675271 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99mq5\" (UniqueName: \"kubernetes.io/projected/00efb094-b9a2-4f1e-99e0-bc55f6153945-kube-api-access-99mq5\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:41.170264 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:41.170218 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:41.173171 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:41.173141 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00efb094-b9a2-4f1e-99e0-bc55f6153945-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00efb094-b9a2-4f1e-99e0-bc55f6153945\") " pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:41.387158 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:41.386744 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 20:41:41.837921 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:41:41.837874 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda333493f_5544_4ad1_b1ea_f8aaa49d0663.slice/crio-428a4277d9091e0b357f4752f4a38b8ffcf8359a575308864916342492e3a592 WatchSource:0}: Error finding container 428a4277d9091e0b357f4752f4a38b8ffcf8359a575308864916342492e3a592: Status 404 returned error can't find the container with id 428a4277d9091e0b357f4752f4a38b8ffcf8359a575308864916342492e3a592 May 21 20:41:41.996946 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:41.996920 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 20:41:41.999133 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:41:41.999106 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00efb094_b9a2_4f1e_99e0_bc55f6153945.slice/crio-920c32001d29ff296e39346567381931700725ee1df53939d5ae33bf6fa3b342 WatchSource:0}: Error finding container 920c32001d29ff296e39346567381931700725ee1df53939d5ae33bf6fa3b342: Status 404 returned error can't find the container with id 920c32001d29ff296e39346567381931700725ee1df53939d5ae33bf6fa3b342 May 21 20:41:42.007565 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.007542 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl"] May 21 20:41:42.011243 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:41:42.011205 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba038327_7953_4c00_8f80_e5d4428d8b56.slice/crio-05a6c0185082b7198d47be717347d9704e8fc1379909477263c43098dc1bf641 WatchSource:0}: Error finding container 05a6c0185082b7198d47be717347d9704e8fc1379909477263c43098dc1bf641: Status 404 returned error can't find the container with id 05a6c0185082b7198d47be717347d9704e8fc1379909477263c43098dc1bf641 May 21 20:41:42.222074 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.222034 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-8g7vs" event={"ID":"b29b4ad7-74a3-4f33-9610-4a1a32c59a25","Type":"ContainerStarted","Data":"4daeced76cf50fa9d0ee764ea056d6dcd8479d237aeaa89a42755a2a845508af"} May 21 20:41:42.222356 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.222337 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-8g7vs" May 21 20:41:42.224129 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.224098 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" event={"ID":"ba038327-7953-4c00-8f80-e5d4428d8b56","Type":"ContainerStarted","Data":"5a2fda807ef59b9c3ff8a672cf7bed5488b393926ff7e76b32ef7f7a7049b17d"} May 21 20:41:42.224244 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.224135 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" event={"ID":"ba038327-7953-4c00-8f80-e5d4428d8b56","Type":"ContainerStarted","Data":"164694d4562d43ab1b0ff02027ee54057a9c6970866b28e5e82055a0e70d7b6c"} May 21 20:41:42.224244 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.224151 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" event={"ID":"ba038327-7953-4c00-8f80-e5d4428d8b56","Type":"ContainerStarted","Data":"05a6c0185082b7198d47be717347d9704e8fc1379909477263c43098dc1bf641"} May 21 20:41:42.225179 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.225155 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00efb094-b9a2-4f1e-99e0-bc55f6153945","Type":"ContainerStarted","Data":"920c32001d29ff296e39346567381931700725ee1df53939d5ae33bf6fa3b342"} May 21 20:41:42.226600 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.226578 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7887b884-dqhvf" event={"ID":"1f5ed782-bc37-4bdc-93c9-290d7d52c955","Type":"ContainerStarted","Data":"c352f2e35b1c9b50f8743df0f9fe00235d52149060e85bc631e46166f978d946"} May 21 20:41:42.227655 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.227627 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8znkh" event={"ID":"a333493f-5544-4ad1-b1ea-f8aaa49d0663","Type":"ContainerStarted","Data":"428a4277d9091e0b357f4752f4a38b8ffcf8359a575308864916342492e3a592"} May 21 20:41:42.237165 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.237126 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-8g7vs" May 21 20:41:42.249410 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.249347 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-8g7vs" podStartSLOduration=1.811702936 podStartE2EDuration="19.249326257s" podCreationTimestamp="2026-05-21 20:41:23 +0000 UTC" firstStartedPulling="2026-05-21 20:41:24.438870613 +0000 UTC m=+175.330733189" lastFinishedPulling="2026-05-21 20:41:41.876493921 +0000 UTC m=+192.768356510" observedRunningTime="2026-05-21 20:41:42.245975265 +0000 UTC m=+193.137837876" watchObservedRunningTime="2026-05-21 20:41:42.249326257 +0000 UTC m=+193.141188857" May 21 20:41:42.300542 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.299022 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7b7887b884-dqhvf" podStartSLOduration=0.9943863 podStartE2EDuration="10.299002964s" podCreationTimestamp="2026-05-21 20:41:32 +0000 UTC" firstStartedPulling="2026-05-21 20:41:32.537024239 +0000 UTC m=+183.428886821" lastFinishedPulling="2026-05-21 20:41:41.841640903 +0000 UTC m=+192.733503485" observedRunningTime="2026-05-21 20:41:42.298075732 +0000 UTC m=+193.189938324" watchObservedRunningTime="2026-05-21 20:41:42.299002964 +0000 UTC m=+193.190865563" May 21 20:41:42.388468 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.387383 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:42.388468 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.387511 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:42.408486 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.408459 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:42.568240 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.565447 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-579b9789f5-965lm"] May 21 20:41:42.569024 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.568997 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.572227 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.571965 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 21 20:41:42.572227 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.571966 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 21 20:41:42.572227 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.572179 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 21 20:41:42.572638 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.572275 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7k9prm4d1715n\"" May 21 20:41:42.572638 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.572380 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 21 20:41:42.572638 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.572443 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-k2pl7\"" May 21 20:41:42.572638 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.572550 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 21 20:41:42.580490 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.580233 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-579b9789f5-965lm"] May 21 20:41:42.691059 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.690594 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f65219a9-d06b-4672-a7d6-cd096aaaed72-metrics-client-ca\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.691059 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.690645 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz7zb\" (UniqueName: \"kubernetes.io/projected/f65219a9-d06b-4672-a7d6-cd096aaaed72-kube-api-access-nz7zb\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.691059 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.690679 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.691059 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.690757 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.691059 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.690792 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-tls\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.691059 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.690828 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.691059 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.690888 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.691059 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.690928 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-grpc-tls\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.793193 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.792308 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-grpc-tls\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.793193 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.792365 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f65219a9-d06b-4672-a7d6-cd096aaaed72-metrics-client-ca\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.793193 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.792422 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nz7zb\" (UniqueName: \"kubernetes.io/projected/f65219a9-d06b-4672-a7d6-cd096aaaed72-kube-api-access-nz7zb\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.793193 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.792459 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.793193 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.792543 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.793193 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.792576 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-tls\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.793193 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.792604 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.793193 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.792714 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.794185 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.794052 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f65219a9-d06b-4672-a7d6-cd096aaaed72-metrics-client-ca\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.804502 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.804448 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.808058 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.808006 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.809901 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.809187 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-grpc-tls\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.809901 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.809646 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.809901 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.809820 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.810583 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.810531 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f65219a9-d06b-4672-a7d6-cd096aaaed72-secret-thanos-querier-tls\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.812275 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.812248 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz7zb\" (UniqueName: \"kubernetes.io/projected/f65219a9-d06b-4672-a7d6-cd096aaaed72-kube-api-access-nz7zb\") pod \"thanos-querier-579b9789f5-965lm\" (UID: \"f65219a9-d06b-4672-a7d6-cd096aaaed72\") " pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:42.890390 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:42.890352 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:43.238261 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:43.238071 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:41:44.440444 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:44.440379 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-579b9789f5-965lm"] May 21 20:41:44.450539 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:41:44.450499 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf65219a9_d06b_4672_a7d6_cd096aaaed72.slice/crio-b7896942e3467690743362dd6e9ac4064ad7c67e8e62202aec72584ba156fa9f WatchSource:0}: Error finding container b7896942e3467690743362dd6e9ac4064ad7c67e8e62202aec72584ba156fa9f: Status 404 returned error can't find the container with id b7896942e3467690743362dd6e9ac4064ad7c67e8e62202aec72584ba156fa9f May 21 20:41:45.240105 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:45.240052 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" event={"ID":"f65219a9-d06b-4672-a7d6-cd096aaaed72","Type":"ContainerStarted","Data":"b7896942e3467690743362dd6e9ac4064ad7c67e8e62202aec72584ba156fa9f"} May 21 20:41:45.243258 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:45.243190 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" event={"ID":"ba038327-7953-4c00-8f80-e5d4428d8b56","Type":"ContainerStarted","Data":"e164f3c14b8371f0b6757b8c20607f26f3076ab758fcad1b87c0516ff4a3f1f2"} May 21 20:41:45.246240 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:45.246162 2573 generic.go:358] "Generic (PLEG): container finished" podID="00efb094-b9a2-4f1e-99e0-bc55f6153945" containerID="fed339bad4ee4668d976e4e1794b74e22eaccde1077e6d710e22b31499439778" exitCode=0 May 21 20:41:45.246383 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:45.246296 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00efb094-b9a2-4f1e-99e0-bc55f6153945","Type":"ContainerDied","Data":"fed339bad4ee4668d976e4e1794b74e22eaccde1077e6d710e22b31499439778"} May 21 20:41:45.255980 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:45.255942 2573 generic.go:358] "Generic (PLEG): container finished" podID="a333493f-5544-4ad1-b1ea-f8aaa49d0663" containerID="110b7d42cfafb523d2ca1be582ada20a6bc36f242ad0bf5e320ac3d842f11689" exitCode=0 May 21 20:41:45.256276 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:45.256202 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8znkh" event={"ID":"a333493f-5544-4ad1-b1ea-f8aaa49d0663","Type":"ContainerDied","Data":"110b7d42cfafb523d2ca1be582ada20a6bc36f242ad0bf5e320ac3d842f11689"} May 21 20:41:45.265122 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:45.265067 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mh9fl" podStartSLOduration=4.179992018 podStartE2EDuration="6.265049526s" podCreationTimestamp="2026-05-21 20:41:39 +0000 UTC" firstStartedPulling="2026-05-21 20:41:42.143708883 +0000 UTC m=+193.035571461" lastFinishedPulling="2026-05-21 20:41:44.22876639 +0000 UTC m=+195.120628969" observedRunningTime="2026-05-21 20:41:45.265003112 +0000 UTC m=+196.156865708" watchObservedRunningTime="2026-05-21 20:41:45.265049526 +0000 UTC m=+196.156912125" May 21 20:41:46.264553 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:46.264388 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8znkh" event={"ID":"a333493f-5544-4ad1-b1ea-f8aaa49d0663","Type":"ContainerStarted","Data":"c1e2cd3769da33d3659602e44c09ad0bd01a352a1f38d09d6d019995818d5587"} May 21 20:41:46.264553 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:46.264466 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8znkh" event={"ID":"a333493f-5544-4ad1-b1ea-f8aaa49d0663","Type":"ContainerStarted","Data":"d97b73faeafbf4d43328cd2162b4d4a59566101ff72dfa4a4a2e9f56e3c017ce"} May 21 20:41:46.286370 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:46.286110 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8znkh" podStartSLOduration=4.901708407 podStartE2EDuration="7.286087904s" podCreationTimestamp="2026-05-21 20:41:39 +0000 UTC" firstStartedPulling="2026-05-21 20:41:41.839737598 +0000 UTC m=+192.731600190" lastFinishedPulling="2026-05-21 20:41:44.224117098 +0000 UTC m=+195.115979687" observedRunningTime="2026-05-21 20:41:46.283501452 +0000 UTC m=+197.175364052" watchObservedRunningTime="2026-05-21 20:41:46.286087904 +0000 UTC m=+197.177950502" May 21 20:41:48.273269 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:48.273218 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00efb094-b9a2-4f1e-99e0-bc55f6153945","Type":"ContainerStarted","Data":"1cbf6df800510aa1db4f6431850904930eba0be704ba5e9f7cd14ecdc92016da"} May 21 20:41:48.273743 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:48.273292 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00efb094-b9a2-4f1e-99e0-bc55f6153945","Type":"ContainerStarted","Data":"bc06e07750b5500e90d42102e9a5bdac50279a66d482396315120b9c7c4381cc"} May 21 20:41:48.273743 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:48.273309 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00efb094-b9a2-4f1e-99e0-bc55f6153945","Type":"ContainerStarted","Data":"bdb5c7a346a604ac69c027c216c504983862c294ce9f056dbdf9f201805ed814"} May 21 20:41:48.273743 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:48.273321 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00efb094-b9a2-4f1e-99e0-bc55f6153945","Type":"ContainerStarted","Data":"cc80a9c6c91337cbb09a660688524138938051ae0331c1a4258a502cb2661ea6"} May 21 20:41:48.275596 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:48.275564 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" event={"ID":"f65219a9-d06b-4672-a7d6-cd096aaaed72","Type":"ContainerStarted","Data":"80b484665e379a13ebca44be8c62bbc151feb79f0134f8b81df433b177081c6e"} May 21 20:41:48.275714 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:48.275603 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" event={"ID":"f65219a9-d06b-4672-a7d6-cd096aaaed72","Type":"ContainerStarted","Data":"aaba4d26cef471dd97eb5d3ac74cad9c8c065c597d629ff59b3db43b01270365"} May 21 20:41:48.275714 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:48.275618 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" event={"ID":"f65219a9-d06b-4672-a7d6-cd096aaaed72","Type":"ContainerStarted","Data":"ea1f48a75977dc4dea9c694b8cb3553a8735fc9f5e669b6ea89995f10850e358"} May 21 20:41:48.925073 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:48.925021 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" podUID="9c4cdce4-9c75-428f-98a8-debfde2f010c" containerName="registry" containerID="cri-o://6b1525beebeaa9e6d76a1944c0470e628b93e37d85d620f1c048fa44d0287c75" gracePeriod=30 May 21 20:41:49.246796 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.246769 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:41:49.281526 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.281489 2573 generic.go:358] "Generic (PLEG): container finished" podID="9c4cdce4-9c75-428f-98a8-debfde2f010c" containerID="6b1525beebeaa9e6d76a1944c0470e628b93e37d85d620f1c048fa44d0287c75" exitCode=0 May 21 20:41:49.282005 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.281578 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" event={"ID":"9c4cdce4-9c75-428f-98a8-debfde2f010c","Type":"ContainerDied","Data":"6b1525beebeaa9e6d76a1944c0470e628b93e37d85d620f1c048fa44d0287c75"} May 21 20:41:49.282005 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.281610 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" event={"ID":"9c4cdce4-9c75-428f-98a8-debfde2f010c","Type":"ContainerDied","Data":"4e7b29ddc90b2b0554956f4690ae6d39ea72277c8326276f49ca73a5eca16c78"} May 21 20:41:49.282005 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.281632 2573 scope.go:117] "RemoveContainer" containerID="6b1525beebeaa9e6d76a1944c0470e628b93e37d85d620f1c048fa44d0287c75" May 21 20:41:49.282005 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.281709 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d5bdf8dd-c826d" May 21 20:41:49.285915 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.285885 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00efb094-b9a2-4f1e-99e0-bc55f6153945","Type":"ContainerStarted","Data":"f1815386606e0b6c623034b305be766e931d8069d9feae680b77d9de50d8f6f9"} May 21 20:41:49.321597 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.321561 2573 scope.go:117] "RemoveContainer" containerID="6b1525beebeaa9e6d76a1944c0470e628b93e37d85d620f1c048fa44d0287c75" May 21 20:41:49.322002 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:41:49.321973 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b1525beebeaa9e6d76a1944c0470e628b93e37d85d620f1c048fa44d0287c75\": container with ID starting with 6b1525beebeaa9e6d76a1944c0470e628b93e37d85d620f1c048fa44d0287c75 not found: ID does not exist" containerID="6b1525beebeaa9e6d76a1944c0470e628b93e37d85d620f1c048fa44d0287c75" May 21 20:41:49.322114 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.322015 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b1525beebeaa9e6d76a1944c0470e628b93e37d85d620f1c048fa44d0287c75"} err="failed to get container status \"6b1525beebeaa9e6d76a1944c0470e628b93e37d85d620f1c048fa44d0287c75\": rpc error: code = NotFound desc = could not find container \"6b1525beebeaa9e6d76a1944c0470e628b93e37d85d620f1c048fa44d0287c75\": container with ID starting with 6b1525beebeaa9e6d76a1944c0470e628b93e37d85d620f1c048fa44d0287c75 not found: ID does not exist" May 21 20:41:49.380321 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.380291 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls\") pod \"9c4cdce4-9c75-428f-98a8-debfde2f010c\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " May 21 20:41:49.380485 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.380362 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-bound-sa-token\") pod \"9c4cdce4-9c75-428f-98a8-debfde2f010c\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " May 21 20:41:49.380485 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.380416 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c4cdce4-9c75-428f-98a8-debfde2f010c-image-registry-private-configuration\") pod \"9c4cdce4-9c75-428f-98a8-debfde2f010c\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " May 21 20:41:49.380485 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.380443 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c4cdce4-9c75-428f-98a8-debfde2f010c-ca-trust-extracted\") pod \"9c4cdce4-9c75-428f-98a8-debfde2f010c\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " May 21 20:41:49.380485 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.380468 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh4z8\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-kube-api-access-mh4z8\") pod \"9c4cdce4-9c75-428f-98a8-debfde2f010c\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " May 21 20:41:49.380688 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.380500 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c4cdce4-9c75-428f-98a8-debfde2f010c-trusted-ca\") pod \"9c4cdce4-9c75-428f-98a8-debfde2f010c\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " May 21 20:41:49.380688 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.380526 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c4cdce4-9c75-428f-98a8-debfde2f010c-installation-pull-secrets\") pod \"9c4cdce4-9c75-428f-98a8-debfde2f010c\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " May 21 20:41:49.380688 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.380593 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-certificates\") pod \"9c4cdce4-9c75-428f-98a8-debfde2f010c\" (UID: \"9c4cdce4-9c75-428f-98a8-debfde2f010c\") " May 21 20:41:49.383465 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.383392 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c4cdce4-9c75-428f-98a8-debfde2f010c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9c4cdce4-9c75-428f-98a8-debfde2f010c" (UID: "9c4cdce4-9c75-428f-98a8-debfde2f010c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:41:49.383711 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.383679 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9c4cdce4-9c75-428f-98a8-debfde2f010c" (UID: "9c4cdce4-9c75-428f-98a8-debfde2f010c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:41:49.383885 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.383850 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-kube-api-access-mh4z8" (OuterVolumeSpecName: "kube-api-access-mh4z8") pod "9c4cdce4-9c75-428f-98a8-debfde2f010c" (UID: "9c4cdce4-9c75-428f-98a8-debfde2f010c"). InnerVolumeSpecName "kube-api-access-mh4z8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:41:49.384454 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.384391 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9c4cdce4-9c75-428f-98a8-debfde2f010c" (UID: "9c4cdce4-9c75-428f-98a8-debfde2f010c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:41:49.384776 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.384754 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c4cdce4-9c75-428f-98a8-debfde2f010c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9c4cdce4-9c75-428f-98a8-debfde2f010c" (UID: "9c4cdce4-9c75-428f-98a8-debfde2f010c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:41:49.385035 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.385012 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c4cdce4-9c75-428f-98a8-debfde2f010c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9c4cdce4-9c75-428f-98a8-debfde2f010c" (UID: "9c4cdce4-9c75-428f-98a8-debfde2f010c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:41:49.385144 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.385125 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9c4cdce4-9c75-428f-98a8-debfde2f010c" (UID: "9c4cdce4-9c75-428f-98a8-debfde2f010c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:41:49.390985 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.390954 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c4cdce4-9c75-428f-98a8-debfde2f010c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9c4cdce4-9c75-428f-98a8-debfde2f010c" (UID: "9c4cdce4-9c75-428f-98a8-debfde2f010c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:41:49.481515 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.481479 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-bound-sa-token\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:41:49.481515 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.481513 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c4cdce4-9c75-428f-98a8-debfde2f010c-image-registry-private-configuration\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:41:49.481515 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.481524 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c4cdce4-9c75-428f-98a8-debfde2f010c-ca-trust-extracted\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:41:49.481754 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.481533 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh4z8\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-kube-api-access-mh4z8\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:41:49.481754 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.481543 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c4cdce4-9c75-428f-98a8-debfde2f010c-trusted-ca\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:41:49.481754 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.481555 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c4cdce4-9c75-428f-98a8-debfde2f010c-installation-pull-secrets\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:41:49.481754 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.481568 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-certificates\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:41:49.481754 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.481576 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c4cdce4-9c75-428f-98a8-debfde2f010c-registry-tls\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:41:49.605760 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.605723 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64d5bdf8dd-c826d"] May 21 20:41:49.608904 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.608881 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64d5bdf8dd-c826d"] May 21 20:41:49.688431 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:49.688249 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c4cdce4-9c75-428f-98a8-debfde2f010c" path="/var/lib/kubelet/pods/9c4cdce4-9c75-428f-98a8-debfde2f010c/volumes" May 21 20:41:50.294141 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:50.294095 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00efb094-b9a2-4f1e-99e0-bc55f6153945","Type":"ContainerStarted","Data":"eb706a945c34629d89d613e253628f08e98f6fc4d9ca9c99dd6b13cac1e845b4"} May 21 20:41:50.297140 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:50.297102 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" event={"ID":"f65219a9-d06b-4672-a7d6-cd096aaaed72","Type":"ContainerStarted","Data":"3a93f365e70492358ceb644b28cf94d1f2e292ae4e845a5e7b8db85a485b153f"} May 21 20:41:50.297140 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:50.297144 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" event={"ID":"f65219a9-d06b-4672-a7d6-cd096aaaed72","Type":"ContainerStarted","Data":"993bec9d5b17d6299f05c6b6970a4c22d06a06534913e3d4d7e2a84de005924d"} May 21 20:41:50.297360 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:50.297156 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" event={"ID":"f65219a9-d06b-4672-a7d6-cd096aaaed72","Type":"ContainerStarted","Data":"1bd75e477eee428ebff3eda3b92e429bc1a55ea04288fd2d3cff9ca41f7d0f3a"} May 21 20:41:50.297360 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:50.297349 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:41:50.325101 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:50.325044 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.956553585 podStartE2EDuration="10.325029196s" podCreationTimestamp="2026-05-21 20:41:40 +0000 UTC" firstStartedPulling="2026-05-21 20:41:42.001054736 +0000 UTC m=+192.892917323" lastFinishedPulling="2026-05-21 20:41:49.369530347 +0000 UTC m=+200.261392934" observedRunningTime="2026-05-21 20:41:50.323518518 +0000 UTC m=+201.215381116" watchObservedRunningTime="2026-05-21 20:41:50.325029196 +0000 UTC m=+201.216891792" May 21 20:41:50.346361 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:50.346310 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" podStartSLOduration=3.431529613 podStartE2EDuration="8.346289584s" podCreationTimestamp="2026-05-21 20:41:42 +0000 UTC" firstStartedPulling="2026-05-21 20:41:44.453552838 +0000 UTC m=+195.345415414" lastFinishedPulling="2026-05-21 20:41:49.368312785 +0000 UTC m=+200.260175385" observedRunningTime="2026-05-21 20:41:50.346207273 +0000 UTC m=+201.238069872" watchObservedRunningTime="2026-05-21 20:41:50.346289584 +0000 UTC m=+201.238152186" May 21 20:41:56.306327 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:41:56.306297 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-579b9789f5-965lm" May 21 20:42:02.368172 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:02.368134 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b7887b884-dqhvf"] May 21 20:42:25.400447 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:25.400388 2573 generic.go:358] "Generic (PLEG): container finished" podID="30eadc96-7cda-4e4c-978f-173a0ef6ceaa" containerID="9ee393d87fe1f711c176975bba060723f3c71e6c63e46174632582bea409545c" exitCode=0 May 21 20:42:25.400850 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:25.400475 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" event={"ID":"30eadc96-7cda-4e4c-978f-173a0ef6ceaa","Type":"ContainerDied","Data":"9ee393d87fe1f711c176975bba060723f3c71e6c63e46174632582bea409545c"} May 21 20:42:25.400850 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:25.400820 2573 scope.go:117] "RemoveContainer" containerID="9ee393d87fe1f711c176975bba060723f3c71e6c63e46174632582bea409545c" May 21 20:42:26.066761 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:26.066733 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mmgbz_1760ef7c-0c3a-4255-b303-0bf5ccace164/dns/0.log" May 21 20:42:26.077258 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:26.077228 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mmgbz_1760ef7c-0c3a-4255-b303-0bf5ccace164/kube-rbac-proxy/0.log" May 21 20:42:26.404977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:26.404894 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-r9kfc" event={"ID":"30eadc96-7cda-4e4c-978f-173a0ef6ceaa","Type":"ContainerStarted","Data":"c548da86a6c721cb0a8448c4a6eceeaa72a58a95cb79d8f1f9746366fb06b88c"} May 21 20:42:26.634451 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:26.634422 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xb8nw_432776d9-7c1f-4742-bd20-da704e768581/dns-node-resolver/0.log" May 21 20:42:27.387251 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.387190 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7b7887b884-dqhvf" podUID="1f5ed782-bc37-4bdc-93c9-290d7d52c955" containerName="console" containerID="cri-o://c352f2e35b1c9b50f8743df0f9fe00235d52149060e85bc631e46166f978d946" gracePeriod=15 May 21 20:42:27.660208 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.660185 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b7887b884-dqhvf_1f5ed782-bc37-4bdc-93c9-290d7d52c955/console/0.log" May 21 20:42:27.660577 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.660246 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:42:27.820686 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.820645 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-config\") pod \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " May 21 20:42:27.820686 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.820694 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjndx\" (UniqueName: \"kubernetes.io/projected/1f5ed782-bc37-4bdc-93c9-290d7d52c955-kube-api-access-mjndx\") pod \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " May 21 20:42:27.820936 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.820713 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-oauth-config\") pod \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " May 21 20:42:27.820936 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.820810 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-trusted-ca-bundle\") pod \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " May 21 20:42:27.820936 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.820856 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-service-ca\") pod \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " May 21 20:42:27.820936 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.820928 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-serving-cert\") pod \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " May 21 20:42:27.821135 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.820984 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-oauth-serving-cert\") pod \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\" (UID: \"1f5ed782-bc37-4bdc-93c9-290d7d52c955\") " May 21 20:42:27.821190 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.821168 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-config" (OuterVolumeSpecName: "console-config") pod "1f5ed782-bc37-4bdc-93c9-290d7d52c955" (UID: "1f5ed782-bc37-4bdc-93c9-290d7d52c955"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:42:27.821240 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.821185 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f5ed782-bc37-4bdc-93c9-290d7d52c955" (UID: "1f5ed782-bc37-4bdc-93c9-290d7d52c955"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:42:27.821240 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.821204 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f5ed782-bc37-4bdc-93c9-290d7d52c955" (UID: "1f5ed782-bc37-4bdc-93c9-290d7d52c955"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:42:27.821484 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.821444 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-config\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:42:27.821580 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.821489 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-trusted-ca-bundle\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:42:27.821580 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.821499 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f5ed782-bc37-4bdc-93c9-290d7d52c955" (UID: "1f5ed782-bc37-4bdc-93c9-290d7d52c955"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:42:27.821580 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.821504 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-service-ca\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:42:27.823084 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.823064 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f5ed782-bc37-4bdc-93c9-290d7d52c955-kube-api-access-mjndx" (OuterVolumeSpecName: "kube-api-access-mjndx") pod "1f5ed782-bc37-4bdc-93c9-290d7d52c955" (UID: "1f5ed782-bc37-4bdc-93c9-290d7d52c955"). InnerVolumeSpecName "kube-api-access-mjndx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:42:27.823385 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.823367 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f5ed782-bc37-4bdc-93c9-290d7d52c955" (UID: "1f5ed782-bc37-4bdc-93c9-290d7d52c955"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:42:27.823453 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.823389 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f5ed782-bc37-4bdc-93c9-290d7d52c955" (UID: "1f5ed782-bc37-4bdc-93c9-290d7d52c955"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:42:27.922768 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.922676 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjndx\" (UniqueName: \"kubernetes.io/projected/1f5ed782-bc37-4bdc-93c9-290d7d52c955-kube-api-access-mjndx\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:42:27.922768 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.922712 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-oauth-config\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:42:27.922768 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.922721 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f5ed782-bc37-4bdc-93c9-290d7d52c955-console-serving-cert\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:42:27.922768 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:27.922732 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f5ed782-bc37-4bdc-93c9-290d7d52c955-oauth-serving-cert\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:42:28.414111 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:28.414081 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b7887b884-dqhvf_1f5ed782-bc37-4bdc-93c9-290d7d52c955/console/0.log" May 21 20:42:28.414298 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:28.414128 2573 generic.go:358] "Generic (PLEG): container finished" podID="1f5ed782-bc37-4bdc-93c9-290d7d52c955" containerID="c352f2e35b1c9b50f8743df0f9fe00235d52149060e85bc631e46166f978d946" exitCode=2 May 21 20:42:28.414298 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:28.414195 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7887b884-dqhvf" May 21 20:42:28.414298 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:28.414199 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7887b884-dqhvf" event={"ID":"1f5ed782-bc37-4bdc-93c9-290d7d52c955","Type":"ContainerDied","Data":"c352f2e35b1c9b50f8743df0f9fe00235d52149060e85bc631e46166f978d946"} May 21 20:42:28.414490 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:28.414301 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7887b884-dqhvf" event={"ID":"1f5ed782-bc37-4bdc-93c9-290d7d52c955","Type":"ContainerDied","Data":"758998bab1ada059bd11afbcef01572f28fef8523139cb9cc4a72808b693f464"} May 21 20:42:28.414490 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:28.414323 2573 scope.go:117] "RemoveContainer" containerID="c352f2e35b1c9b50f8743df0f9fe00235d52149060e85bc631e46166f978d946" May 21 20:42:28.423204 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:28.423184 2573 scope.go:117] "RemoveContainer" containerID="c352f2e35b1c9b50f8743df0f9fe00235d52149060e85bc631e46166f978d946" May 21 20:42:28.423523 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:42:28.423498 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c352f2e35b1c9b50f8743df0f9fe00235d52149060e85bc631e46166f978d946\": container with ID starting with c352f2e35b1c9b50f8743df0f9fe00235d52149060e85bc631e46166f978d946 not found: ID does not exist" containerID="c352f2e35b1c9b50f8743df0f9fe00235d52149060e85bc631e46166f978d946" May 21 20:42:28.423625 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:28.423530 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c352f2e35b1c9b50f8743df0f9fe00235d52149060e85bc631e46166f978d946"} err="failed to get container status \"c352f2e35b1c9b50f8743df0f9fe00235d52149060e85bc631e46166f978d946\": rpc error: code = NotFound desc = could not find container \"c352f2e35b1c9b50f8743df0f9fe00235d52149060e85bc631e46166f978d946\": container with ID starting with c352f2e35b1c9b50f8743df0f9fe00235d52149060e85bc631e46166f978d946 not found: ID does not exist" May 21 20:42:28.435448 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:28.435417 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b7887b884-dqhvf"] May 21 20:42:28.441548 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:28.441518 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b7887b884-dqhvf"] May 21 20:42:29.681654 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:29.681613 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f5ed782-bc37-4bdc-93c9-290d7d52c955" path="/var/lib/kubelet/pods/1f5ed782-bc37-4bdc-93c9-290d7d52c955/volumes" May 21 20:42:41.447624 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:41.447567 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:42:41.449905 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:41.449881 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0cabb11-fb0d-4a2a-b250-f4cc748429ba-metrics-certs\") pod \"network-metrics-daemon-8jlfz\" (UID: \"b0cabb11-fb0d-4a2a-b250-f4cc748429ba\") " pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:42:41.580645 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:41.580614 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cjf7l\"" May 21 20:42:41.588968 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:41.588944 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jlfz" May 21 20:42:41.721764 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:41.721718 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8jlfz"] May 21 20:42:41.724591 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:42:41.724558 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0cabb11_fb0d_4a2a_b250_f4cc748429ba.slice/crio-dcbda7f16edaaa5873c8a74114045973cdca5f71b6969a3f9b395b6846871c21 WatchSource:0}: Error finding container dcbda7f16edaaa5873c8a74114045973cdca5f71b6969a3f9b395b6846871c21: Status 404 returned error can't find the container with id dcbda7f16edaaa5873c8a74114045973cdca5f71b6969a3f9b395b6846871c21 May 21 20:42:42.458865 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:42.458822 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8jlfz" event={"ID":"b0cabb11-fb0d-4a2a-b250-f4cc748429ba","Type":"ContainerStarted","Data":"dcbda7f16edaaa5873c8a74114045973cdca5f71b6969a3f9b395b6846871c21"} May 21 20:42:43.463951 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:43.463906 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8jlfz" event={"ID":"b0cabb11-fb0d-4a2a-b250-f4cc748429ba","Type":"ContainerStarted","Data":"0fb95f97fd9a5ecddef9bcdc90475818b3b23a1a0b52d6f21d340ddb69956a81"} May 21 20:42:43.463951 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:43.463945 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8jlfz" event={"ID":"b0cabb11-fb0d-4a2a-b250-f4cc748429ba","Type":"ContainerStarted","Data":"d4f3d93b444434ab91ed742cf75350bd84ca832e4748d7c8ea2ee7dc1b7a1416"} May 21 20:42:56.543914 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.543793 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8jlfz" podStartSLOduration=266.648798731 podStartE2EDuration="4m27.543773385s" podCreationTimestamp="2026-05-21 20:38:29 +0000 UTC" firstStartedPulling="2026-05-21 20:42:41.726469649 +0000 UTC m=+252.618332225" lastFinishedPulling="2026-05-21 20:42:42.621444303 +0000 UTC m=+253.513306879" observedRunningTime="2026-05-21 20:42:43.480259355 +0000 UTC m=+254.372121952" watchObservedRunningTime="2026-05-21 20:42:56.543773385 +0000 UTC m=+267.435635984" May 21 20:42:56.545878 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.545823 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f469bdf9-tqggb"] May 21 20:42:56.546341 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.546305 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f5ed782-bc37-4bdc-93c9-290d7d52c955" containerName="console" May 21 20:42:56.546341 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.546331 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f5ed782-bc37-4bdc-93c9-290d7d52c955" containerName="console" May 21 20:42:56.546605 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.546352 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c4cdce4-9c75-428f-98a8-debfde2f010c" containerName="registry" May 21 20:42:56.546605 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.546361 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c4cdce4-9c75-428f-98a8-debfde2f010c" containerName="registry" May 21 20:42:56.546605 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.546479 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f5ed782-bc37-4bdc-93c9-290d7d52c955" containerName="console" May 21 20:42:56.546605 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.546493 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c4cdce4-9c75-428f-98a8-debfde2f010c" containerName="registry" May 21 20:42:56.548471 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.548451 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.551280 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.551259 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q2hjx\"" May 21 20:42:56.551533 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.551513 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 20:42:56.552586 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.552567 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 20:42:56.552586 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.552581 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 20:42:56.552988 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.552970 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 20:42:56.553095 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.552996 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 20:42:56.558947 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.558347 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 20:42:56.562769 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.562720 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f469bdf9-tqggb"] May 21 20:42:56.669018 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.668975 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-trusted-ca-bundle\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.669189 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.669034 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-serving-cert\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.669189 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.669079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-oauth-serving-cert\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.669189 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.669105 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b8cp\" (UniqueName: \"kubernetes.io/projected/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-kube-api-access-7b8cp\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.669337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.669183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-config\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.669337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.669221 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-service-ca\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.669337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.669239 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-oauth-config\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.770225 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.770184 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-serving-cert\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.770225 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.770230 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-oauth-serving-cert\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.770498 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.770281 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7b8cp\" (UniqueName: \"kubernetes.io/projected/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-kube-api-access-7b8cp\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.770498 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.770330 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-config\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.770498 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.770353 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-service-ca\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.770498 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.770380 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-oauth-config\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.770498 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.770484 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-trusted-ca-bundle\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.771029 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.770998 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-oauth-serving-cert\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.771306 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.771288 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-config\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.771484 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.771379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-trusted-ca-bundle\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.771484 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.771431 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-service-ca\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.772995 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.772976 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-serving-cert\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.773079 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.772999 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-oauth-config\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.778918 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.778895 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b8cp\" (UniqueName: \"kubernetes.io/projected/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-kube-api-access-7b8cp\") pod \"console-5f469bdf9-tqggb\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:56.867116 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:56.867024 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:42:57.004188 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:57.004164 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f469bdf9-tqggb"] May 21 20:42:57.006753 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:42:57.006715 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a021ec0_c9e2_40dc_8fa2_bbfed32066a5.slice/crio-cf1f9bb64232da6acada44740ca665651d1ffc1a06f1f461e5e81e801b43cd72 WatchSource:0}: Error finding container cf1f9bb64232da6acada44740ca665651d1ffc1a06f1f461e5e81e801b43cd72: Status 404 returned error can't find the container with id cf1f9bb64232da6acada44740ca665651d1ffc1a06f1f461e5e81e801b43cd72 May 21 20:42:57.505008 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:57.504974 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f469bdf9-tqggb" event={"ID":"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5","Type":"ContainerStarted","Data":"0f4df66e9ea821cc3121a311622cdd6dbd3ec0a516bdbf8718d578c925fcb028"} May 21 20:42:57.505008 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:57.505011 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f469bdf9-tqggb" event={"ID":"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5","Type":"ContainerStarted","Data":"cf1f9bb64232da6acada44740ca665651d1ffc1a06f1f461e5e81e801b43cd72"} May 21 20:42:57.524516 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:42:57.524470 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5f469bdf9-tqggb" podStartSLOduration=1.524455039 podStartE2EDuration="1.524455039s" podCreationTimestamp="2026-05-21 20:42:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:42:57.522251293 +0000 UTC m=+268.414113891" watchObservedRunningTime="2026-05-21 20:42:57.524455039 +0000 UTC m=+268.416317637" May 21 20:43:06.867771 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:43:06.867723 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:43:06.868256 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:43:06.867783 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:43:06.872665 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:43:06.872640 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:43:07.540846 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:43:07.540818 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:43:29.557469 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:43:29.557438 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 20:43:29.559191 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:43:29.559161 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 20:43:29.567009 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:43:29.566981 2573 kubelet.go:1628] "Image garbage collection succeeded" May 21 20:47:54.568446 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:54.568394 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-b7wvn"] May 21 20:47:54.571845 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:54.571823 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wvn" May 21 20:47:54.574531 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:54.574512 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 20:47:54.585350 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:54.585317 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b7wvn"] May 21 20:47:54.604963 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:54.604927 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7811e120-eaba-4ea0-8f75-35a8f51a24e6-dbus\") pod \"global-pull-secret-syncer-b7wvn\" (UID: \"7811e120-eaba-4ea0-8f75-35a8f51a24e6\") " pod="kube-system/global-pull-secret-syncer-b7wvn" May 21 20:47:54.604963 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:54.604964 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7811e120-eaba-4ea0-8f75-35a8f51a24e6-original-pull-secret\") pod \"global-pull-secret-syncer-b7wvn\" (UID: \"7811e120-eaba-4ea0-8f75-35a8f51a24e6\") " pod="kube-system/global-pull-secret-syncer-b7wvn" May 21 20:47:54.605189 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:54.604990 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7811e120-eaba-4ea0-8f75-35a8f51a24e6-kubelet-config\") pod \"global-pull-secret-syncer-b7wvn\" (UID: \"7811e120-eaba-4ea0-8f75-35a8f51a24e6\") " pod="kube-system/global-pull-secret-syncer-b7wvn" May 21 20:47:54.706040 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:54.705997 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7811e120-eaba-4ea0-8f75-35a8f51a24e6-dbus\") pod \"global-pull-secret-syncer-b7wvn\" (UID: \"7811e120-eaba-4ea0-8f75-35a8f51a24e6\") " pod="kube-system/global-pull-secret-syncer-b7wvn" May 21 20:47:54.706239 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:54.706043 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7811e120-eaba-4ea0-8f75-35a8f51a24e6-original-pull-secret\") pod \"global-pull-secret-syncer-b7wvn\" (UID: \"7811e120-eaba-4ea0-8f75-35a8f51a24e6\") " pod="kube-system/global-pull-secret-syncer-b7wvn" May 21 20:47:54.706239 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:54.706093 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7811e120-eaba-4ea0-8f75-35a8f51a24e6-kubelet-config\") pod \"global-pull-secret-syncer-b7wvn\" (UID: \"7811e120-eaba-4ea0-8f75-35a8f51a24e6\") " pod="kube-system/global-pull-secret-syncer-b7wvn" May 21 20:47:54.706239 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:54.706197 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7811e120-eaba-4ea0-8f75-35a8f51a24e6-dbus\") pod \"global-pull-secret-syncer-b7wvn\" (UID: \"7811e120-eaba-4ea0-8f75-35a8f51a24e6\") " pod="kube-system/global-pull-secret-syncer-b7wvn" May 21 20:47:54.706239 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:54.706225 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7811e120-eaba-4ea0-8f75-35a8f51a24e6-kubelet-config\") pod \"global-pull-secret-syncer-b7wvn\" (UID: \"7811e120-eaba-4ea0-8f75-35a8f51a24e6\") " pod="kube-system/global-pull-secret-syncer-b7wvn" May 21 20:47:54.708451 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:54.708415 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7811e120-eaba-4ea0-8f75-35a8f51a24e6-original-pull-secret\") pod \"global-pull-secret-syncer-b7wvn\" (UID: \"7811e120-eaba-4ea0-8f75-35a8f51a24e6\") " pod="kube-system/global-pull-secret-syncer-b7wvn" May 21 20:47:54.881333 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:54.881244 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wvn" May 21 20:47:55.009011 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:55.008939 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b7wvn"] May 21 20:47:55.011647 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:47:55.011616 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7811e120_eaba_4ea0_8f75_35a8f51a24e6.slice/crio-ad66654665c0f3a912e897d4a69001da52d9741ff7d94adf559ad0f83f5a55db WatchSource:0}: Error finding container ad66654665c0f3a912e897d4a69001da52d9741ff7d94adf559ad0f83f5a55db: Status 404 returned error can't find the container with id ad66654665c0f3a912e897d4a69001da52d9741ff7d94adf559ad0f83f5a55db May 21 20:47:55.013322 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:55.013304 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:47:55.374647 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:47:55.374604 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b7wvn" event={"ID":"7811e120-eaba-4ea0-8f75-35a8f51a24e6","Type":"ContainerStarted","Data":"ad66654665c0f3a912e897d4a69001da52d9741ff7d94adf559ad0f83f5a55db"} May 21 20:48:00.391606 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:00.391566 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b7wvn" event={"ID":"7811e120-eaba-4ea0-8f75-35a8f51a24e6","Type":"ContainerStarted","Data":"418efa27cb77046ed186d7d95cb5c4d39cd5a4e8f41037e5a53cd9b39d6d9776"} May 21 20:48:00.407073 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:00.407019 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b7wvn" podStartSLOduration=1.247552202 podStartE2EDuration="6.407004199s" podCreationTimestamp="2026-05-21 20:47:54 +0000 UTC" firstStartedPulling="2026-05-21 20:47:55.013497123 +0000 UTC m=+565.905359699" lastFinishedPulling="2026-05-21 20:48:00.172949117 +0000 UTC m=+571.064811696" observedRunningTime="2026-05-21 20:48:00.405714327 +0000 UTC m=+571.297576924" watchObservedRunningTime="2026-05-21 20:48:00.407004199 +0000 UTC m=+571.298866796" May 21 20:48:08.474325 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.474286 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s"] May 21 20:48:08.476690 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.476674 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" May 21 20:48:08.479470 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.479447 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 20:48:08.479594 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.479486 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 20:48:08.480517 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.480499 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qsgl2\"" May 21 20:48:08.485186 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.485160 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s"] May 21 20:48:08.634952 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.634905 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s\" (UID: \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" May 21 20:48:08.635123 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.634988 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfp5s\" (UniqueName: \"kubernetes.io/projected/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-kube-api-access-jfp5s\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s\" (UID: \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" May 21 20:48:08.635123 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.635013 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s\" (UID: \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" May 21 20:48:08.735885 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.735785 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s\" (UID: \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" May 21 20:48:08.735885 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.735872 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfp5s\" (UniqueName: \"kubernetes.io/projected/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-kube-api-access-jfp5s\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s\" (UID: \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" May 21 20:48:08.735885 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.735894 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s\" (UID: \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" May 21 20:48:08.736221 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.736205 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s\" (UID: \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" May 21 20:48:08.736258 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.736208 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s\" (UID: \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" May 21 20:48:08.744623 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.744591 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfp5s\" (UniqueName: \"kubernetes.io/projected/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-kube-api-access-jfp5s\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s\" (UID: \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" May 21 20:48:08.786495 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.786461 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" May 21 20:48:08.917728 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:08.917687 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s"] May 21 20:48:08.920662 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:48:08.920631 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5491bda9_23b1_48fb_98e7_f1a4b5e8c5a3.slice/crio-0368a1df2a34c6cf23cecc0338093feb162dccc387bf3c156f6a76bdaad43c9b WatchSource:0}: Error finding container 0368a1df2a34c6cf23cecc0338093feb162dccc387bf3c156f6a76bdaad43c9b: Status 404 returned error can't find the container with id 0368a1df2a34c6cf23cecc0338093feb162dccc387bf3c156f6a76bdaad43c9b May 21 20:48:09.418455 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:09.418422 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" event={"ID":"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3","Type":"ContainerStarted","Data":"0368a1df2a34c6cf23cecc0338093feb162dccc387bf3c156f6a76bdaad43c9b"} May 21 20:48:16.441875 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:16.441837 2573 generic.go:358] "Generic (PLEG): container finished" podID="5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3" containerID="07602f8488fd36fbd09d865e12e9cb89103ae9f7a6ab51bb2fe1ad2d3bbee758" exitCode=0 May 21 20:48:16.442277 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:16.441938 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" event={"ID":"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3","Type":"ContainerDied","Data":"07602f8488fd36fbd09d865e12e9cb89103ae9f7a6ab51bb2fe1ad2d3bbee758"} May 21 20:48:19.453520 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:19.453487 2573 generic.go:358] "Generic (PLEG): container finished" podID="5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3" containerID="6bbef150f024b199e3c8b75cd446137ae6ea8f604a6fac7788d2bd58a88362e2" exitCode=0 May 21 20:48:19.453938 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:19.453545 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" event={"ID":"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3","Type":"ContainerDied","Data":"6bbef150f024b199e3c8b75cd446137ae6ea8f604a6fac7788d2bd58a88362e2"} May 21 20:48:27.482970 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:27.482931 2573 generic.go:358] "Generic (PLEG): container finished" podID="5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3" containerID="70d4877678cc51524e8d4f027b358c159910911ab1ee2a150e8204bcdb1431b8" exitCode=0 May 21 20:48:27.483377 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:27.483023 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" event={"ID":"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3","Type":"ContainerDied","Data":"70d4877678cc51524e8d4f027b358c159910911ab1ee2a150e8204bcdb1431b8"} May 21 20:48:28.615886 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:28.615858 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" May 21 20:48:28.707658 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:28.707622 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-util\") pod \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\" (UID: \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\") " May 21 20:48:28.707658 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:28.707665 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfp5s\" (UniqueName: \"kubernetes.io/projected/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-kube-api-access-jfp5s\") pod \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\" (UID: \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\") " May 21 20:48:28.707881 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:28.707693 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-bundle\") pod \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\" (UID: \"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3\") " May 21 20:48:28.708376 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:28.708351 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-bundle" (OuterVolumeSpecName: "bundle") pod "5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3" (UID: "5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:48:28.710343 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:28.710315 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-kube-api-access-jfp5s" (OuterVolumeSpecName: "kube-api-access-jfp5s") pod "5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3" (UID: "5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3"). InnerVolumeSpecName "kube-api-access-jfp5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:48:28.712787 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:28.712757 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-util" (OuterVolumeSpecName: "util") pod "5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3" (UID: "5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:48:28.808929 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:28.808832 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-util\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:48:28.808929 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:28.808861 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfp5s\" (UniqueName: \"kubernetes.io/projected/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-kube-api-access-jfp5s\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:48:28.808929 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:28.808871 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3-bundle\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:48:29.490984 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:29.490954 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" May 21 20:48:29.491160 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:29.490952 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drpk4s" event={"ID":"5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3","Type":"ContainerDied","Data":"0368a1df2a34c6cf23cecc0338093feb162dccc387bf3c156f6a76bdaad43c9b"} May 21 20:48:29.491160 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:29.491061 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0368a1df2a34c6cf23cecc0338093feb162dccc387bf3c156f6a76bdaad43c9b" May 21 20:48:29.586391 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:29.586364 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 20:48:29.586576 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:29.586556 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 20:48:36.415158 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.415112 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdnxd"] May 21 20:48:36.416322 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.416285 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3" containerName="pull" May 21 20:48:36.416532 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.416516 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3" containerName="pull" May 21 20:48:36.416650 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.416639 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3" containerName="extract" May 21 20:48:36.416720 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.416712 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3" containerName="extract" May 21 20:48:36.416814 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.416805 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3" containerName="util" May 21 20:48:36.416875 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.416867 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3" containerName="util" May 21 20:48:36.417123 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.417110 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="5491bda9-23b1-48fb-98e7-f1a4b5e8c5a3" containerName="extract" May 21 20:48:36.422198 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.422176 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdnxd" May 21 20:48:36.425114 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.425085 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 21 20:48:36.425114 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.425111 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 21 20:48:36.425299 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.425124 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-82hfm\"" May 21 20:48:36.430759 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.430735 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdnxd"] May 21 20:48:36.473380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.473337 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nnk5\" (UniqueName: \"kubernetes.io/projected/bcf30436-fdbf-4915-adb7-3fda7c298bac-kube-api-access-7nnk5\") pod \"cert-manager-operator-controller-manager-54b9655956-zdnxd\" (UID: \"bcf30436-fdbf-4915-adb7-3fda7c298bac\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdnxd" May 21 20:48:36.473575 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.473463 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcf30436-fdbf-4915-adb7-3fda7c298bac-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zdnxd\" (UID: \"bcf30436-fdbf-4915-adb7-3fda7c298bac\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdnxd" May 21 20:48:36.574579 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.574541 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcf30436-fdbf-4915-adb7-3fda7c298bac-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zdnxd\" (UID: \"bcf30436-fdbf-4915-adb7-3fda7c298bac\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdnxd" May 21 20:48:36.574758 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.574603 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nnk5\" (UniqueName: \"kubernetes.io/projected/bcf30436-fdbf-4915-adb7-3fda7c298bac-kube-api-access-7nnk5\") pod \"cert-manager-operator-controller-manager-54b9655956-zdnxd\" (UID: \"bcf30436-fdbf-4915-adb7-3fda7c298bac\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdnxd" May 21 20:48:36.575011 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.574992 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcf30436-fdbf-4915-adb7-3fda7c298bac-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zdnxd\" (UID: \"bcf30436-fdbf-4915-adb7-3fda7c298bac\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdnxd" May 21 20:48:36.583113 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.583077 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nnk5\" (UniqueName: \"kubernetes.io/projected/bcf30436-fdbf-4915-adb7-3fda7c298bac-kube-api-access-7nnk5\") pod \"cert-manager-operator-controller-manager-54b9655956-zdnxd\" (UID: \"bcf30436-fdbf-4915-adb7-3fda7c298bac\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdnxd" May 21 20:48:36.732388 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.732358 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdnxd" May 21 20:48:36.871756 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:36.871726 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdnxd"] May 21 20:48:36.878008 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:48:36.877973 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf30436_fdbf_4915_adb7_3fda7c298bac.slice/crio-3eb523e3ac28d128857136ec8835a76450564953c5fa09a1ed1d45610abaf337 WatchSource:0}: Error finding container 3eb523e3ac28d128857136ec8835a76450564953c5fa09a1ed1d45610abaf337: Status 404 returned error can't find the container with id 3eb523e3ac28d128857136ec8835a76450564953c5fa09a1ed1d45610abaf337 May 21 20:48:37.517365 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:37.517323 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdnxd" event={"ID":"bcf30436-fdbf-4915-adb7-3fda7c298bac","Type":"ContainerStarted","Data":"3eb523e3ac28d128857136ec8835a76450564953c5fa09a1ed1d45610abaf337"} May 21 20:48:39.525990 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:39.525950 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdnxd" event={"ID":"bcf30436-fdbf-4915-adb7-3fda7c298bac","Type":"ContainerStarted","Data":"1d8253d073ee61620d6b746331819ce995949223fe1e42a389afe2f6192f5bac"} May 21 20:48:39.550553 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:39.550507 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdnxd" podStartSLOduration=1.725791964 podStartE2EDuration="3.550490822s" podCreationTimestamp="2026-05-21 20:48:36 +0000 UTC" firstStartedPulling="2026-05-21 20:48:36.880022849 +0000 UTC m=+607.771885426" lastFinishedPulling="2026-05-21 20:48:38.704721703 +0000 UTC m=+609.596584284" observedRunningTime="2026-05-21 20:48:39.548601245 +0000 UTC m=+610.440463876" watchObservedRunningTime="2026-05-21 20:48:39.550490822 +0000 UTC m=+610.442353420" May 21 20:48:40.541080 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.541048 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf"] May 21 20:48:40.543482 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.543465 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" May 21 20:48:40.546162 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.546142 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 20:48:40.546278 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.546180 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 20:48:40.547214 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.547192 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qsgl2\"" May 21 20:48:40.553921 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.553893 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf"] May 21 20:48:40.612479 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.612431 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf\" (UID: \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" May 21 20:48:40.612479 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.612479 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nshcz\" (UniqueName: \"kubernetes.io/projected/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-kube-api-access-nshcz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf\" (UID: \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" May 21 20:48:40.612699 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.612552 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf\" (UID: \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" May 21 20:48:40.713654 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.713612 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf\" (UID: \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" May 21 20:48:40.713827 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.713660 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nshcz\" (UniqueName: \"kubernetes.io/projected/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-kube-api-access-nshcz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf\" (UID: \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" May 21 20:48:40.713827 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.713713 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf\" (UID: \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" May 21 20:48:40.714136 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.714111 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf\" (UID: \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" May 21 20:48:40.714177 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.714121 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf\" (UID: \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" May 21 20:48:40.729100 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.729067 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nshcz\" (UniqueName: \"kubernetes.io/projected/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-kube-api-access-nshcz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf\" (UID: \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" May 21 20:48:40.861108 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.861017 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" May 21 20:48:40.996032 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:40.995944 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf"] May 21 20:48:40.998638 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:48:40.998609 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa3bab6_d94c_4fc5_becf_bb235e6458c6.slice/crio-54ef38b8142adf506403ecbf48dada05807f61df869ca08fd90d5af23210a3f5 WatchSource:0}: Error finding container 54ef38b8142adf506403ecbf48dada05807f61df869ca08fd90d5af23210a3f5: Status 404 returned error can't find the container with id 54ef38b8142adf506403ecbf48dada05807f61df869ca08fd90d5af23210a3f5 May 21 20:48:41.534676 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:41.534640 2573 generic.go:358] "Generic (PLEG): container finished" podID="8fa3bab6-d94c-4fc5-becf-bb235e6458c6" containerID="4a4abb3dde17f686d8219b1c31cb3cc23713d159962e61ed7b920ea82c0bd4c2" exitCode=0 May 21 20:48:41.534862 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:41.534704 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" event={"ID":"8fa3bab6-d94c-4fc5-becf-bb235e6458c6","Type":"ContainerDied","Data":"4a4abb3dde17f686d8219b1c31cb3cc23713d159962e61ed7b920ea82c0bd4c2"} May 21 20:48:41.534862 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:41.534726 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" event={"ID":"8fa3bab6-d94c-4fc5-becf-bb235e6458c6","Type":"ContainerStarted","Data":"54ef38b8142adf506403ecbf48dada05807f61df869ca08fd90d5af23210a3f5"} May 21 20:48:42.368795 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:42.368754 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-vt5fb"] May 21 20:48:42.371255 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:42.371233 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-vt5fb" May 21 20:48:42.373926 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:42.373905 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 20:48:42.373926 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:42.373912 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 20:48:42.375105 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:42.375090 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-g42x6\"" May 21 20:48:42.379889 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:42.379863 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-vt5fb"] May 21 20:48:42.430689 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:42.430637 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d592e67-151e-4617-bc70-6e4958e6d72c-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-vt5fb\" (UID: \"9d592e67-151e-4617-bc70-6e4958e6d72c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-vt5fb" May 21 20:48:42.430875 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:42.430713 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg98q\" (UniqueName: \"kubernetes.io/projected/9d592e67-151e-4617-bc70-6e4958e6d72c-kube-api-access-xg98q\") pod \"cert-manager-webhook-587ccfb98-vt5fb\" (UID: \"9d592e67-151e-4617-bc70-6e4958e6d72c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-vt5fb" May 21 20:48:42.531792 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:42.531741 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d592e67-151e-4617-bc70-6e4958e6d72c-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-vt5fb\" (UID: \"9d592e67-151e-4617-bc70-6e4958e6d72c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-vt5fb" May 21 20:48:42.531986 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:42.531814 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xg98q\" (UniqueName: \"kubernetes.io/projected/9d592e67-151e-4617-bc70-6e4958e6d72c-kube-api-access-xg98q\") pod \"cert-manager-webhook-587ccfb98-vt5fb\" (UID: \"9d592e67-151e-4617-bc70-6e4958e6d72c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-vt5fb" May 21 20:48:42.540216 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:42.540188 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d592e67-151e-4617-bc70-6e4958e6d72c-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-vt5fb\" (UID: \"9d592e67-151e-4617-bc70-6e4958e6d72c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-vt5fb" May 21 20:48:42.540353 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:42.540330 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg98q\" (UniqueName: \"kubernetes.io/projected/9d592e67-151e-4617-bc70-6e4958e6d72c-kube-api-access-xg98q\") pod \"cert-manager-webhook-587ccfb98-vt5fb\" (UID: \"9d592e67-151e-4617-bc70-6e4958e6d72c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-vt5fb" May 21 20:48:42.680826 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:42.680725 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-vt5fb" May 21 20:48:42.807480 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:42.807433 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-vt5fb"] May 21 20:48:42.810300 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:48:42.810268 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d592e67_151e_4617_bc70_6e4958e6d72c.slice/crio-8387811d45dc7d05be526168fd8b14b2fae72458976f0c5b7d429a481affc716 WatchSource:0}: Error finding container 8387811d45dc7d05be526168fd8b14b2fae72458976f0c5b7d429a481affc716: Status 404 returned error can't find the container with id 8387811d45dc7d05be526168fd8b14b2fae72458976f0c5b7d429a481affc716 May 21 20:48:43.047421 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:43.047364 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kk588"] May 21 20:48:43.050261 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:43.050234 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-kk588" May 21 20:48:43.052731 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:43.052708 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4vdff\"" May 21 20:48:43.060494 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:43.060458 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kk588"] May 21 20:48:43.138005 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:43.137954 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh2ss\" (UniqueName: \"kubernetes.io/projected/9afa0a94-4e46-44e6-95d3-34717466c83e-kube-api-access-qh2ss\") pod \"cert-manager-cainjector-68b757865b-kk588\" (UID: \"9afa0a94-4e46-44e6-95d3-34717466c83e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kk588" May 21 20:48:43.138195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:43.138128 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9afa0a94-4e46-44e6-95d3-34717466c83e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kk588\" (UID: \"9afa0a94-4e46-44e6-95d3-34717466c83e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kk588" May 21 20:48:43.239194 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:43.239163 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qh2ss\" (UniqueName: \"kubernetes.io/projected/9afa0a94-4e46-44e6-95d3-34717466c83e-kube-api-access-qh2ss\") pod \"cert-manager-cainjector-68b757865b-kk588\" (UID: \"9afa0a94-4e46-44e6-95d3-34717466c83e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kk588" May 21 20:48:43.239377 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:43.239289 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9afa0a94-4e46-44e6-95d3-34717466c83e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kk588\" (UID: \"9afa0a94-4e46-44e6-95d3-34717466c83e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kk588" May 21 20:48:43.247884 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:43.247831 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9afa0a94-4e46-44e6-95d3-34717466c83e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kk588\" (UID: \"9afa0a94-4e46-44e6-95d3-34717466c83e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kk588" May 21 20:48:43.248040 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:43.247911 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh2ss\" (UniqueName: \"kubernetes.io/projected/9afa0a94-4e46-44e6-95d3-34717466c83e-kube-api-access-qh2ss\") pod \"cert-manager-cainjector-68b757865b-kk588\" (UID: \"9afa0a94-4e46-44e6-95d3-34717466c83e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kk588" May 21 20:48:43.363064 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:43.362963 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-kk588" May 21 20:48:43.515621 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:43.515592 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kk588"] May 21 20:48:43.544558 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:43.544522 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-vt5fb" event={"ID":"9d592e67-151e-4617-bc70-6e4958e6d72c","Type":"ContainerStarted","Data":"8387811d45dc7d05be526168fd8b14b2fae72458976f0c5b7d429a481affc716"} May 21 20:48:44.327791 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:48:44.327750 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9afa0a94_4e46_44e6_95d3_34717466c83e.slice/crio-84aa47ffbe524ff34de63fedd9361bea1db7f977a61104e3e761328cb9a2523c WatchSource:0}: Error finding container 84aa47ffbe524ff34de63fedd9361bea1db7f977a61104e3e761328cb9a2523c: Status 404 returned error can't find the container with id 84aa47ffbe524ff34de63fedd9361bea1db7f977a61104e3e761328cb9a2523c May 21 20:48:44.549868 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:44.549826 2573 generic.go:358] "Generic (PLEG): container finished" podID="8fa3bab6-d94c-4fc5-becf-bb235e6458c6" containerID="d83ce6385233fa428662646cc4c12447d98bba0d0f28277910a332658e18fbd9" exitCode=0 May 21 20:48:44.550301 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:44.549923 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" event={"ID":"8fa3bab6-d94c-4fc5-becf-bb235e6458c6","Type":"ContainerDied","Data":"d83ce6385233fa428662646cc4c12447d98bba0d0f28277910a332658e18fbd9"} May 21 20:48:44.551117 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:44.551091 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-kk588" event={"ID":"9afa0a94-4e46-44e6-95d3-34717466c83e","Type":"ContainerStarted","Data":"84aa47ffbe524ff34de63fedd9361bea1db7f977a61104e3e761328cb9a2523c"} May 21 20:48:45.556839 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:45.556805 2573 generic.go:358] "Generic (PLEG): container finished" podID="8fa3bab6-d94c-4fc5-becf-bb235e6458c6" containerID="83501fe16e24c0378208d5f38bc670abcd945fdbccd87c8d9de72de15bd82988" exitCode=0 May 21 20:48:45.557188 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:45.556869 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" event={"ID":"8fa3bab6-d94c-4fc5-becf-bb235e6458c6","Type":"ContainerDied","Data":"83501fe16e24c0378208d5f38bc670abcd945fdbccd87c8d9de72de15bd82988"} May 21 20:48:45.558538 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:45.558509 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-kk588" event={"ID":"9afa0a94-4e46-44e6-95d3-34717466c83e","Type":"ContainerStarted","Data":"ebdb569a92c88e85b62eb07e222914ff5e93524e1c42c75a92de5c9ad28e4a7f"} May 21 20:48:45.559697 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:45.559668 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-vt5fb" event={"ID":"9d592e67-151e-4617-bc70-6e4958e6d72c","Type":"ContainerStarted","Data":"857a5bb2043335cbc53aa21bb25afa3e7379f1c774c853b34400d78720b13a78"} May 21 20:48:45.559825 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:45.559811 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-vt5fb" May 21 20:48:45.590298 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:45.590249 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-vt5fb" podStartSLOduration=0.971052767 podStartE2EDuration="3.590233777s" podCreationTimestamp="2026-05-21 20:48:42 +0000 UTC" firstStartedPulling="2026-05-21 20:48:42.812256467 +0000 UTC m=+613.704119051" lastFinishedPulling="2026-05-21 20:48:45.431437471 +0000 UTC m=+616.323300061" observedRunningTime="2026-05-21 20:48:45.589627966 +0000 UTC m=+616.481490556" watchObservedRunningTime="2026-05-21 20:48:45.590233777 +0000 UTC m=+616.482096375" May 21 20:48:45.604509 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:45.604444 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-kk588" podStartSLOduration=1.502757158 podStartE2EDuration="2.604423558s" podCreationTimestamp="2026-05-21 20:48:43 +0000 UTC" firstStartedPulling="2026-05-21 20:48:44.330524531 +0000 UTC m=+615.222387107" lastFinishedPulling="2026-05-21 20:48:45.432190927 +0000 UTC m=+616.324053507" observedRunningTime="2026-05-21 20:48:45.603323866 +0000 UTC m=+616.495186465" watchObservedRunningTime="2026-05-21 20:48:45.604423558 +0000 UTC m=+616.496286156" May 21 20:48:46.689900 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:46.689876 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" May 21 20:48:46.773848 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:46.773809 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nshcz\" (UniqueName: \"kubernetes.io/projected/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-kube-api-access-nshcz\") pod \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\" (UID: \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\") " May 21 20:48:46.774003 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:46.773862 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-bundle\") pod \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\" (UID: \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\") " May 21 20:48:46.774003 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:46.773895 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-util\") pod \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\" (UID: \"8fa3bab6-d94c-4fc5-becf-bb235e6458c6\") " May 21 20:48:46.774375 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:46.774339 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-bundle" (OuterVolumeSpecName: "bundle") pod "8fa3bab6-d94c-4fc5-becf-bb235e6458c6" (UID: "8fa3bab6-d94c-4fc5-becf-bb235e6458c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:48:46.775938 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:46.775913 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-kube-api-access-nshcz" (OuterVolumeSpecName: "kube-api-access-nshcz") pod "8fa3bab6-d94c-4fc5-becf-bb235e6458c6" (UID: "8fa3bab6-d94c-4fc5-becf-bb235e6458c6"). InnerVolumeSpecName "kube-api-access-nshcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:48:46.778010 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:46.777952 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-util" (OuterVolumeSpecName: "util") pod "8fa3bab6-d94c-4fc5-becf-bb235e6458c6" (UID: "8fa3bab6-d94c-4fc5-becf-bb235e6458c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:48:46.874936 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:46.874858 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nshcz\" (UniqueName: \"kubernetes.io/projected/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-kube-api-access-nshcz\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:48:46.874936 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:46.874885 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-bundle\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:48:46.874936 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:46.874894 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fa3bab6-d94c-4fc5-becf-bb235e6458c6-util\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:48:47.570834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:47.570796 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" event={"ID":"8fa3bab6-d94c-4fc5-becf-bb235e6458c6","Type":"ContainerDied","Data":"54ef38b8142adf506403ecbf48dada05807f61df869ca08fd90d5af23210a3f5"} May 21 20:48:47.570834 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:47.570831 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54ef38b8142adf506403ecbf48dada05807f61df869ca08fd90d5af23210a3f5" May 21 20:48:47.571084 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:47.570860 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzc8lf" May 21 20:48:51.565336 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:51.565256 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-vt5fb" May 21 20:48:53.740371 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.740335 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-5qjnd"] May 21 20:48:53.740742 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.740696 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa3bab6-d94c-4fc5-becf-bb235e6458c6" containerName="util" May 21 20:48:53.740742 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.740709 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa3bab6-d94c-4fc5-becf-bb235e6458c6" containerName="util" May 21 20:48:53.740742 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.740731 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa3bab6-d94c-4fc5-becf-bb235e6458c6" containerName="pull" May 21 20:48:53.740742 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.740737 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa3bab6-d94c-4fc5-becf-bb235e6458c6" containerName="pull" May 21 20:48:53.740742 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.740744 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa3bab6-d94c-4fc5-becf-bb235e6458c6" containerName="extract" May 21 20:48:53.740905 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.740751 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa3bab6-d94c-4fc5-becf-bb235e6458c6" containerName="extract" May 21 20:48:53.740905 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.740802 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="8fa3bab6-d94c-4fc5-becf-bb235e6458c6" containerName="extract" May 21 20:48:53.743669 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.743650 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-5qjnd" May 21 20:48:53.746356 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.746331 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 20:48:53.746492 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.746331 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 20:48:53.747480 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.747464 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-529sf\"" May 21 20:48:53.750980 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.750832 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-5qjnd"] May 21 20:48:53.835168 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.835126 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a10ebb1f-c780-4df9-a4cf-d109e3e9518a-tmp\") pod \"openshift-lws-operator-bfc7f696d-5qjnd\" (UID: \"a10ebb1f-c780-4df9-a4cf-d109e3e9518a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-5qjnd" May 21 20:48:53.835360 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.835183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp95m\" (UniqueName: \"kubernetes.io/projected/a10ebb1f-c780-4df9-a4cf-d109e3e9518a-kube-api-access-jp95m\") pod \"openshift-lws-operator-bfc7f696d-5qjnd\" (UID: \"a10ebb1f-c780-4df9-a4cf-d109e3e9518a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-5qjnd" May 21 20:48:53.936029 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.935990 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a10ebb1f-c780-4df9-a4cf-d109e3e9518a-tmp\") pod \"openshift-lws-operator-bfc7f696d-5qjnd\" (UID: \"a10ebb1f-c780-4df9-a4cf-d109e3e9518a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-5qjnd" May 21 20:48:53.936029 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.936044 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp95m\" (UniqueName: \"kubernetes.io/projected/a10ebb1f-c780-4df9-a4cf-d109e3e9518a-kube-api-access-jp95m\") pod \"openshift-lws-operator-bfc7f696d-5qjnd\" (UID: \"a10ebb1f-c780-4df9-a4cf-d109e3e9518a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-5qjnd" May 21 20:48:53.936469 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.936450 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a10ebb1f-c780-4df9-a4cf-d109e3e9518a-tmp\") pod \"openshift-lws-operator-bfc7f696d-5qjnd\" (UID: \"a10ebb1f-c780-4df9-a4cf-d109e3e9518a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-5qjnd" May 21 20:48:53.943902 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:53.943878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp95m\" (UniqueName: \"kubernetes.io/projected/a10ebb1f-c780-4df9-a4cf-d109e3e9518a-kube-api-access-jp95m\") pod \"openshift-lws-operator-bfc7f696d-5qjnd\" (UID: \"a10ebb1f-c780-4df9-a4cf-d109e3e9518a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-5qjnd" May 21 20:48:54.053312 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:54.053223 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-5qjnd" May 21 20:48:54.187943 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:54.187912 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-5qjnd"] May 21 20:48:54.191847 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:48:54.191811 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda10ebb1f_c780_4df9_a4cf_d109e3e9518a.slice/crio-aa23b8dae06b64b97bdd0cbce615f51413e207a41093031fbddd17de8a088908 WatchSource:0}: Error finding container aa23b8dae06b64b97bdd0cbce615f51413e207a41093031fbddd17de8a088908: Status 404 returned error can't find the container with id aa23b8dae06b64b97bdd0cbce615f51413e207a41093031fbddd17de8a088908 May 21 20:48:54.595703 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:54.595669 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-5qjnd" event={"ID":"a10ebb1f-c780-4df9-a4cf-d109e3e9518a","Type":"ContainerStarted","Data":"aa23b8dae06b64b97bdd0cbce615f51413e207a41093031fbddd17de8a088908"} May 21 20:48:56.604071 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:56.603980 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-5qjnd" event={"ID":"a10ebb1f-c780-4df9-a4cf-d109e3e9518a","Type":"ContainerStarted","Data":"249840b4de6b0d0aa541e422c86636e9ef0aa60ff1905348e337f2003744d766"} May 21 20:48:56.620010 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:56.619955 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-5qjnd" podStartSLOduration=1.558716596 podStartE2EDuration="3.619936304s" podCreationTimestamp="2026-05-21 20:48:53 +0000 UTC" firstStartedPulling="2026-05-21 20:48:54.193465386 +0000 UTC m=+625.085327967" lastFinishedPulling="2026-05-21 20:48:56.254685096 +0000 UTC m=+627.146547675" observedRunningTime="2026-05-21 20:48:56.619115847 +0000 UTC m=+627.510978445" watchObservedRunningTime="2026-05-21 20:48:56.619936304 +0000 UTC m=+627.511798904" May 21 20:48:59.316482 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.316447 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm"] May 21 20:48:59.372909 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.372874 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm"] May 21 20:48:59.373080 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.372999 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" May 21 20:48:59.375942 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.375917 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 20:48:59.377148 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.377128 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qsgl2\"" May 21 20:48:59.377148 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.377146 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 20:48:59.484845 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.484807 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpzw5\" (UniqueName: \"kubernetes.io/projected/b0b52247-e448-4189-bf80-99374fdace7b-kube-api-access-mpzw5\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm\" (UID: \"b0b52247-e448-4189-bf80-99374fdace7b\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" May 21 20:48:59.485047 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.484858 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b52247-e448-4189-bf80-99374fdace7b-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm\" (UID: \"b0b52247-e448-4189-bf80-99374fdace7b\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" May 21 20:48:59.485047 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.484951 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b52247-e448-4189-bf80-99374fdace7b-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm\" (UID: \"b0b52247-e448-4189-bf80-99374fdace7b\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" May 21 20:48:59.586310 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.586215 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b52247-e448-4189-bf80-99374fdace7b-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm\" (UID: \"b0b52247-e448-4189-bf80-99374fdace7b\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" May 21 20:48:59.586310 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.586266 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b52247-e448-4189-bf80-99374fdace7b-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm\" (UID: \"b0b52247-e448-4189-bf80-99374fdace7b\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" May 21 20:48:59.586549 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.586357 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpzw5\" (UniqueName: \"kubernetes.io/projected/b0b52247-e448-4189-bf80-99374fdace7b-kube-api-access-mpzw5\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm\" (UID: \"b0b52247-e448-4189-bf80-99374fdace7b\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" May 21 20:48:59.586782 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.586757 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b52247-e448-4189-bf80-99374fdace7b-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm\" (UID: \"b0b52247-e448-4189-bf80-99374fdace7b\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" May 21 20:48:59.586825 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.586758 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b52247-e448-4189-bf80-99374fdace7b-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm\" (UID: \"b0b52247-e448-4189-bf80-99374fdace7b\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" May 21 20:48:59.595200 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.595173 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpzw5\" (UniqueName: \"kubernetes.io/projected/b0b52247-e448-4189-bf80-99374fdace7b-kube-api-access-mpzw5\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm\" (UID: \"b0b52247-e448-4189-bf80-99374fdace7b\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" May 21 20:48:59.682323 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.682293 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" May 21 20:48:59.815879 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:48:59.815850 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm"] May 21 20:48:59.818185 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:48:59.818152 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b52247_e448_4189_bf80_99374fdace7b.slice/crio-725eb4083efa745a891cdb6df7dfdc2adb77c2b2ad04d4afaee95924a981bfda WatchSource:0}: Error finding container 725eb4083efa745a891cdb6df7dfdc2adb77c2b2ad04d4afaee95924a981bfda: Status 404 returned error can't find the container with id 725eb4083efa745a891cdb6df7dfdc2adb77c2b2ad04d4afaee95924a981bfda May 21 20:49:00.620260 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:00.620221 2573 generic.go:358] "Generic (PLEG): container finished" podID="b0b52247-e448-4189-bf80-99374fdace7b" containerID="897f33740f538905ebbddfde1aab2fc5f0ee5019ae8f02c8815cf3aeef196093" exitCode=0 May 21 20:49:00.620753 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:00.620305 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" event={"ID":"b0b52247-e448-4189-bf80-99374fdace7b","Type":"ContainerDied","Data":"897f33740f538905ebbddfde1aab2fc5f0ee5019ae8f02c8815cf3aeef196093"} May 21 20:49:00.620753 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:00.620337 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" event={"ID":"b0b52247-e448-4189-bf80-99374fdace7b","Type":"ContainerStarted","Data":"725eb4083efa745a891cdb6df7dfdc2adb77c2b2ad04d4afaee95924a981bfda"} May 21 20:49:02.627738 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:02.627704 2573 generic.go:358] "Generic (PLEG): container finished" podID="b0b52247-e448-4189-bf80-99374fdace7b" containerID="a7706b7410653f67d4fa00ed7932a452b7c26e462ad7f5804e85a81ba7b9716d" exitCode=0 May 21 20:49:02.628118 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:02.627758 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" event={"ID":"b0b52247-e448-4189-bf80-99374fdace7b","Type":"ContainerDied","Data":"a7706b7410653f67d4fa00ed7932a452b7c26e462ad7f5804e85a81ba7b9716d"} May 21 20:49:03.633432 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:03.633376 2573 generic.go:358] "Generic (PLEG): container finished" podID="b0b52247-e448-4189-bf80-99374fdace7b" containerID="c80a2a04b76e0a652e16f865624bcc9e11c688e94c80d272bdfa8f8e596b61e3" exitCode=0 May 21 20:49:03.633875 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:03.633454 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" event={"ID":"b0b52247-e448-4189-bf80-99374fdace7b","Type":"ContainerDied","Data":"c80a2a04b76e0a652e16f865624bcc9e11c688e94c80d272bdfa8f8e596b61e3"} May 21 20:49:04.764656 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:04.764626 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" May 21 20:49:04.934379 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:04.934269 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpzw5\" (UniqueName: \"kubernetes.io/projected/b0b52247-e448-4189-bf80-99374fdace7b-kube-api-access-mpzw5\") pod \"b0b52247-e448-4189-bf80-99374fdace7b\" (UID: \"b0b52247-e448-4189-bf80-99374fdace7b\") " May 21 20:49:04.934379 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:04.934364 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b52247-e448-4189-bf80-99374fdace7b-bundle\") pod \"b0b52247-e448-4189-bf80-99374fdace7b\" (UID: \"b0b52247-e448-4189-bf80-99374fdace7b\") " May 21 20:49:04.934638 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:04.934450 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b52247-e448-4189-bf80-99374fdace7b-util\") pod \"b0b52247-e448-4189-bf80-99374fdace7b\" (UID: \"b0b52247-e448-4189-bf80-99374fdace7b\") " May 21 20:49:04.935066 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:04.935035 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b52247-e448-4189-bf80-99374fdace7b-bundle" (OuterVolumeSpecName: "bundle") pod "b0b52247-e448-4189-bf80-99374fdace7b" (UID: "b0b52247-e448-4189-bf80-99374fdace7b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:49:04.936456 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:04.936433 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b52247-e448-4189-bf80-99374fdace7b-kube-api-access-mpzw5" (OuterVolumeSpecName: "kube-api-access-mpzw5") pod "b0b52247-e448-4189-bf80-99374fdace7b" (UID: "b0b52247-e448-4189-bf80-99374fdace7b"). InnerVolumeSpecName "kube-api-access-mpzw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:49:04.939702 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:04.939680 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b52247-e448-4189-bf80-99374fdace7b-util" (OuterVolumeSpecName: "util") pod "b0b52247-e448-4189-bf80-99374fdace7b" (UID: "b0b52247-e448-4189-bf80-99374fdace7b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:49:05.035750 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:05.035704 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpzw5\" (UniqueName: \"kubernetes.io/projected/b0b52247-e448-4189-bf80-99374fdace7b-kube-api-access-mpzw5\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:49:05.035750 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:05.035741 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b52247-e448-4189-bf80-99374fdace7b-bundle\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:49:05.035750 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:05.035752 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b52247-e448-4189-bf80-99374fdace7b-util\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:49:05.644170 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:05.644131 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" event={"ID":"b0b52247-e448-4189-bf80-99374fdace7b","Type":"ContainerDied","Data":"725eb4083efa745a891cdb6df7dfdc2adb77c2b2ad04d4afaee95924a981bfda"} May 21 20:49:05.644170 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:05.644157 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5cvrfm" May 21 20:49:05.644170 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:05.644173 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="725eb4083efa745a891cdb6df7dfdc2adb77c2b2ad04d4afaee95924a981bfda" May 21 20:49:15.937502 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:15.937465 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5"] May 21 20:49:15.937917 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:15.937801 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b52247-e448-4189-bf80-99374fdace7b" containerName="util" May 21 20:49:15.937917 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:15.937813 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b52247-e448-4189-bf80-99374fdace7b" containerName="util" May 21 20:49:15.937917 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:15.937826 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b52247-e448-4189-bf80-99374fdace7b" containerName="extract" May 21 20:49:15.937917 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:15.937832 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b52247-e448-4189-bf80-99374fdace7b" containerName="extract" May 21 20:49:15.937917 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:15.937844 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b52247-e448-4189-bf80-99374fdace7b" containerName="pull" May 21 20:49:15.937917 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:15.937851 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b52247-e448-4189-bf80-99374fdace7b" containerName="pull" May 21 20:49:15.937917 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:15.937912 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0b52247-e448-4189-bf80-99374fdace7b" containerName="extract" May 21 20:49:15.939943 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:15.939926 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" May 21 20:49:15.942815 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:15.942785 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 20:49:15.942935 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:15.942832 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 20:49:15.943924 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:15.943906 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qsgl2\"" May 21 20:49:15.948458 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:15.948432 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5"] May 21 20:49:16.132716 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.132664 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1637860b-3df7-4224-ba51-fdb57375cf57-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5\" (UID: \"1637860b-3df7-4224-ba51-fdb57375cf57\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" May 21 20:49:16.132716 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.132725 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2lqc\" (UniqueName: \"kubernetes.io/projected/1637860b-3df7-4224-ba51-fdb57375cf57-kube-api-access-n2lqc\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5\" (UID: \"1637860b-3df7-4224-ba51-fdb57375cf57\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" May 21 20:49:16.132941 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.132808 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1637860b-3df7-4224-ba51-fdb57375cf57-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5\" (UID: \"1637860b-3df7-4224-ba51-fdb57375cf57\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" May 21 20:49:16.234123 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.234066 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1637860b-3df7-4224-ba51-fdb57375cf57-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5\" (UID: \"1637860b-3df7-4224-ba51-fdb57375cf57\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" May 21 20:49:16.234335 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.234226 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1637860b-3df7-4224-ba51-fdb57375cf57-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5\" (UID: \"1637860b-3df7-4224-ba51-fdb57375cf57\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" May 21 20:49:16.234335 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.234286 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2lqc\" (UniqueName: \"kubernetes.io/projected/1637860b-3df7-4224-ba51-fdb57375cf57-kube-api-access-n2lqc\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5\" (UID: \"1637860b-3df7-4224-ba51-fdb57375cf57\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" May 21 20:49:16.234503 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.234483 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1637860b-3df7-4224-ba51-fdb57375cf57-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5\" (UID: \"1637860b-3df7-4224-ba51-fdb57375cf57\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" May 21 20:49:16.234622 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.234602 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1637860b-3df7-4224-ba51-fdb57375cf57-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5\" (UID: \"1637860b-3df7-4224-ba51-fdb57375cf57\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" May 21 20:49:16.242589 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.242561 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2lqc\" (UniqueName: \"kubernetes.io/projected/1637860b-3df7-4224-ba51-fdb57375cf57-kube-api-access-n2lqc\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5\" (UID: \"1637860b-3df7-4224-ba51-fdb57375cf57\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" May 21 20:49:16.250378 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.250351 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" May 21 20:49:16.386547 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.386518 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5"] May 21 20:49:16.388470 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:49:16.388440 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1637860b_3df7_4224_ba51_fdb57375cf57.slice/crio-6782acf9744ad4bf1e563b0bb19b7a4cda235c22b1fbbc33673ee8cbb0952d4a WatchSource:0}: Error finding container 6782acf9744ad4bf1e563b0bb19b7a4cda235c22b1fbbc33673ee8cbb0952d4a: Status 404 returned error can't find the container with id 6782acf9744ad4bf1e563b0bb19b7a4cda235c22b1fbbc33673ee8cbb0952d4a May 21 20:49:16.684128 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.684038 2573 generic.go:358] "Generic (PLEG): container finished" podID="1637860b-3df7-4224-ba51-fdb57375cf57" containerID="cfe6770960f24293a8469ee88233ec21ae679804e402b34f5bc7a59e136b8f8d" exitCode=0 May 21 20:49:16.684268 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.684119 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" event={"ID":"1637860b-3df7-4224-ba51-fdb57375cf57","Type":"ContainerDied","Data":"cfe6770960f24293a8469ee88233ec21ae679804e402b34f5bc7a59e136b8f8d"} May 21 20:49:16.684268 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.684152 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" event={"ID":"1637860b-3df7-4224-ba51-fdb57375cf57","Type":"ContainerStarted","Data":"6782acf9744ad4bf1e563b0bb19b7a4cda235c22b1fbbc33673ee8cbb0952d4a"} May 21 20:49:16.882329 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.882296 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc"] May 21 20:49:16.884686 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.884661 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" May 21 20:49:16.887464 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.887439 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 20:49:16.887590 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.887465 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 20:49:16.887590 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.887510 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 20:49:16.887773 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.887758 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 20:49:16.887809 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.887777 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8hv5g\"" May 21 20:49:16.913035 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.913002 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc"] May 21 20:49:16.940148 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.940046 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8s2p\" (UniqueName: \"kubernetes.io/projected/3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d-kube-api-access-s8s2p\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bvhnc\" (UID: \"3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" May 21 20:49:16.940148 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.940101 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bvhnc\" (UID: \"3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" May 21 20:49:16.940583 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:16.940199 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bvhnc\" (UID: \"3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" May 21 20:49:17.041060 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:17.041023 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bvhnc\" (UID: \"3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" May 21 20:49:17.041242 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:17.041090 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8s2p\" (UniqueName: \"kubernetes.io/projected/3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d-kube-api-access-s8s2p\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bvhnc\" (UID: \"3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" May 21 20:49:17.041242 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:17.041123 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bvhnc\" (UID: \"3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" May 21 20:49:17.043637 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:17.043608 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bvhnc\" (UID: \"3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" May 21 20:49:17.043753 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:17.043684 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bvhnc\" (UID: \"3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" May 21 20:49:17.049355 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:17.049328 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8s2p\" (UniqueName: \"kubernetes.io/projected/3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d-kube-api-access-s8s2p\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bvhnc\" (UID: \"3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" May 21 20:49:17.195205 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:17.195174 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" May 21 20:49:17.340671 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:17.340646 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc"] May 21 20:49:17.376809 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:49:17.376771 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebaf61f_0aa7_4b4b_a391_ebef2aa0c63d.slice/crio-91a10ae6fed9095f321e44c7047d7c0a97cbbb62ada251914bd8989b0c57f2f2 WatchSource:0}: Error finding container 91a10ae6fed9095f321e44c7047d7c0a97cbbb62ada251914bd8989b0c57f2f2: Status 404 returned error can't find the container with id 91a10ae6fed9095f321e44c7047d7c0a97cbbb62ada251914bd8989b0c57f2f2 May 21 20:49:17.689072 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:17.689038 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" event={"ID":"3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d","Type":"ContainerStarted","Data":"91a10ae6fed9095f321e44c7047d7c0a97cbbb62ada251914bd8989b0c57f2f2"} May 21 20:49:17.690585 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:17.690555 2573 generic.go:358] "Generic (PLEG): container finished" podID="1637860b-3df7-4224-ba51-fdb57375cf57" containerID="5278cc3504f4b7353de38f60f081017a0812efaa47041d3b806dd675e967cd0d" exitCode=0 May 21 20:49:17.690733 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:17.690606 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" event={"ID":"1637860b-3df7-4224-ba51-fdb57375cf57","Type":"ContainerDied","Data":"5278cc3504f4b7353de38f60f081017a0812efaa47041d3b806dd675e967cd0d"} May 21 20:49:18.698025 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:18.697987 2573 generic.go:358] "Generic (PLEG): container finished" podID="1637860b-3df7-4224-ba51-fdb57375cf57" containerID="6f90b5e2271231181e70262b9638d2b3b8447838c80de87580b55e0ce97133c5" exitCode=0 May 21 20:49:18.698476 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:18.698074 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" event={"ID":"1637860b-3df7-4224-ba51-fdb57375cf57","Type":"ContainerDied","Data":"6f90b5e2271231181e70262b9638d2b3b8447838c80de87580b55e0ce97133c5"} May 21 20:49:19.841381 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.841272 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8"] May 21 20:49:19.847511 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.847479 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:19.850767 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.850728 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 20:49:19.850924 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.850839 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pj8tj\"" May 21 20:49:19.850924 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.850738 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 20:49:19.851032 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.851020 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 20:49:19.857262 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.857203 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8"] May 21 20:49:19.867915 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.867877 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2b1ffc9-67cb-4f34-83bc-c5278624ab82-manager-config\") pod \"lws-controller-manager-5465c6b7f8-zdxr8\" (UID: \"c2b1ffc9-67cb-4f34-83bc-c5278624ab82\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:19.868094 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.867989 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2b1ffc9-67cb-4f34-83bc-c5278624ab82-cert\") pod \"lws-controller-manager-5465c6b7f8-zdxr8\" (UID: \"c2b1ffc9-67cb-4f34-83bc-c5278624ab82\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:19.868094 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.868029 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2b1ffc9-67cb-4f34-83bc-c5278624ab82-metrics-cert\") pod \"lws-controller-manager-5465c6b7f8-zdxr8\" (UID: \"c2b1ffc9-67cb-4f34-83bc-c5278624ab82\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:19.868094 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.868061 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f79x4\" (UniqueName: \"kubernetes.io/projected/c2b1ffc9-67cb-4f34-83bc-c5278624ab82-kube-api-access-f79x4\") pod \"lws-controller-manager-5465c6b7f8-zdxr8\" (UID: \"c2b1ffc9-67cb-4f34-83bc-c5278624ab82\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:19.907701 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.907676 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" May 21 20:49:19.968780 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.968748 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2lqc\" (UniqueName: \"kubernetes.io/projected/1637860b-3df7-4224-ba51-fdb57375cf57-kube-api-access-n2lqc\") pod \"1637860b-3df7-4224-ba51-fdb57375cf57\" (UID: \"1637860b-3df7-4224-ba51-fdb57375cf57\") " May 21 20:49:19.968926 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.968791 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1637860b-3df7-4224-ba51-fdb57375cf57-bundle\") pod \"1637860b-3df7-4224-ba51-fdb57375cf57\" (UID: \"1637860b-3df7-4224-ba51-fdb57375cf57\") " May 21 20:49:19.968926 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.968837 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1637860b-3df7-4224-ba51-fdb57375cf57-util\") pod \"1637860b-3df7-4224-ba51-fdb57375cf57\" (UID: \"1637860b-3df7-4224-ba51-fdb57375cf57\") " May 21 20:49:19.969076 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.969059 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2b1ffc9-67cb-4f34-83bc-c5278624ab82-manager-config\") pod \"lws-controller-manager-5465c6b7f8-zdxr8\" (UID: \"c2b1ffc9-67cb-4f34-83bc-c5278624ab82\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:19.969151 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.969136 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2b1ffc9-67cb-4f34-83bc-c5278624ab82-cert\") pod \"lws-controller-manager-5465c6b7f8-zdxr8\" (UID: \"c2b1ffc9-67cb-4f34-83bc-c5278624ab82\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:19.969210 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.969174 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2b1ffc9-67cb-4f34-83bc-c5278624ab82-metrics-cert\") pod \"lws-controller-manager-5465c6b7f8-zdxr8\" (UID: \"c2b1ffc9-67cb-4f34-83bc-c5278624ab82\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:19.969338 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.969311 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f79x4\" (UniqueName: \"kubernetes.io/projected/c2b1ffc9-67cb-4f34-83bc-c5278624ab82-kube-api-access-f79x4\") pod \"lws-controller-manager-5465c6b7f8-zdxr8\" (UID: \"c2b1ffc9-67cb-4f34-83bc-c5278624ab82\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:19.969860 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.969828 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2b1ffc9-67cb-4f34-83bc-c5278624ab82-manager-config\") pod \"lws-controller-manager-5465c6b7f8-zdxr8\" (UID: \"c2b1ffc9-67cb-4f34-83bc-c5278624ab82\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:19.969958 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.969915 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1637860b-3df7-4224-ba51-fdb57375cf57-bundle" (OuterVolumeSpecName: "bundle") pod "1637860b-3df7-4224-ba51-fdb57375cf57" (UID: "1637860b-3df7-4224-ba51-fdb57375cf57"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:49:19.971033 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.971005 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1637860b-3df7-4224-ba51-fdb57375cf57-kube-api-access-n2lqc" (OuterVolumeSpecName: "kube-api-access-n2lqc") pod "1637860b-3df7-4224-ba51-fdb57375cf57" (UID: "1637860b-3df7-4224-ba51-fdb57375cf57"). InnerVolumeSpecName "kube-api-access-n2lqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:49:19.972258 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.972234 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2b1ffc9-67cb-4f34-83bc-c5278624ab82-cert\") pod \"lws-controller-manager-5465c6b7f8-zdxr8\" (UID: \"c2b1ffc9-67cb-4f34-83bc-c5278624ab82\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:19.972335 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.972237 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2b1ffc9-67cb-4f34-83bc-c5278624ab82-metrics-cert\") pod \"lws-controller-manager-5465c6b7f8-zdxr8\" (UID: \"c2b1ffc9-67cb-4f34-83bc-c5278624ab82\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:19.974825 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.974797 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1637860b-3df7-4224-ba51-fdb57375cf57-util" (OuterVolumeSpecName: "util") pod "1637860b-3df7-4224-ba51-fdb57375cf57" (UID: "1637860b-3df7-4224-ba51-fdb57375cf57"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:49:19.985797 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:19.985771 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f79x4\" (UniqueName: \"kubernetes.io/projected/c2b1ffc9-67cb-4f34-83bc-c5278624ab82-kube-api-access-f79x4\") pod \"lws-controller-manager-5465c6b7f8-zdxr8\" (UID: \"c2b1ffc9-67cb-4f34-83bc-c5278624ab82\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:20.070622 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:20.070584 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2lqc\" (UniqueName: \"kubernetes.io/projected/1637860b-3df7-4224-ba51-fdb57375cf57-kube-api-access-n2lqc\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:49:20.070622 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:20.070616 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1637860b-3df7-4224-ba51-fdb57375cf57-bundle\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:49:20.070622 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:20.070625 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1637860b-3df7-4224-ba51-fdb57375cf57-util\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:49:20.161646 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:20.161604 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:20.298860 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:20.298835 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8"] May 21 20:49:20.300778 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:49:20.300749 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b1ffc9_67cb_4f34_83bc_c5278624ab82.slice/crio-bbb78b8a2a567f27ec1846aff5e389ba8a6d61b7683d96d41d1f1ac1da5601e8 WatchSource:0}: Error finding container bbb78b8a2a567f27ec1846aff5e389ba8a6d61b7683d96d41d1f1ac1da5601e8: Status 404 returned error can't find the container with id bbb78b8a2a567f27ec1846aff5e389ba8a6d61b7683d96d41d1f1ac1da5601e8 May 21 20:49:20.708787 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:20.708756 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" May 21 20:49:20.708961 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:20.708759 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c92vxp5" event={"ID":"1637860b-3df7-4224-ba51-fdb57375cf57","Type":"ContainerDied","Data":"6782acf9744ad4bf1e563b0bb19b7a4cda235c22b1fbbc33673ee8cbb0952d4a"} May 21 20:49:20.708961 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:20.708865 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6782acf9744ad4bf1e563b0bb19b7a4cda235c22b1fbbc33673ee8cbb0952d4a" May 21 20:49:20.709858 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:20.709831 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" event={"ID":"c2b1ffc9-67cb-4f34-83bc-c5278624ab82","Type":"ContainerStarted","Data":"bbb78b8a2a567f27ec1846aff5e389ba8a6d61b7683d96d41d1f1ac1da5601e8"} May 21 20:49:20.711295 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:20.711274 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" event={"ID":"3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d","Type":"ContainerStarted","Data":"ef3805533d58775ed8e29138b98ea608e5f28601054f9b86690a37e7fc81a7b1"} May 21 20:49:20.711436 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:20.711425 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" May 21 20:49:20.736827 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:20.736758 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" podStartSLOduration=2.194622609 podStartE2EDuration="4.736732213s" podCreationTimestamp="2026-05-21 20:49:16 +0000 UTC" firstStartedPulling="2026-05-21 20:49:17.379383424 +0000 UTC m=+648.271245999" lastFinishedPulling="2026-05-21 20:49:19.921493019 +0000 UTC m=+650.813355603" observedRunningTime="2026-05-21 20:49:20.733782754 +0000 UTC m=+651.625645352" watchObservedRunningTime="2026-05-21 20:49:20.736732213 +0000 UTC m=+651.628594811" May 21 20:49:22.720908 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:22.720873 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" event={"ID":"c2b1ffc9-67cb-4f34-83bc-c5278624ab82","Type":"ContainerStarted","Data":"99af3d18bfea9cfed2f55ae890e816d5b8ce967ac1b12d0f0baa166c59ed16f5"} May 21 20:49:22.721348 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:22.721031 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:22.746202 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:22.746141 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" podStartSLOduration=2.172967214 podStartE2EDuration="3.746124079s" podCreationTimestamp="2026-05-21 20:49:19 +0000 UTC" firstStartedPulling="2026-05-21 20:49:20.302582445 +0000 UTC m=+651.194445021" lastFinishedPulling="2026-05-21 20:49:21.875739307 +0000 UTC m=+652.767601886" observedRunningTime="2026-05-21 20:49:22.745870957 +0000 UTC m=+653.637733555" watchObservedRunningTime="2026-05-21 20:49:22.746124079 +0000 UTC m=+653.637986677" May 21 20:49:31.717341 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:31.717313 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bvhnc" May 21 20:49:33.727329 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:33.727300 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-zdxr8" May 21 20:49:46.463906 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.463869 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g"] May 21 20:49:46.464310 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.464242 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1637860b-3df7-4224-ba51-fdb57375cf57" containerName="pull" May 21 20:49:46.464310 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.464256 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1637860b-3df7-4224-ba51-fdb57375cf57" containerName="pull" May 21 20:49:46.464310 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.464278 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1637860b-3df7-4224-ba51-fdb57375cf57" containerName="util" May 21 20:49:46.464310 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.464283 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1637860b-3df7-4224-ba51-fdb57375cf57" containerName="util" May 21 20:49:46.464310 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.464291 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1637860b-3df7-4224-ba51-fdb57375cf57" containerName="extract" May 21 20:49:46.464310 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.464296 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1637860b-3df7-4224-ba51-fdb57375cf57" containerName="extract" May 21 20:49:46.464541 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.464354 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="1637860b-3df7-4224-ba51-fdb57375cf57" containerName="extract" May 21 20:49:46.469017 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.468997 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" May 21 20:49:46.471738 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.471709 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qsgl2\"" May 21 20:49:46.472208 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.472189 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 20:49:46.472847 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.472828 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 20:49:46.480501 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.480473 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g"] May 21 20:49:46.606972 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.606935 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a507414-e983-4fe9-b594-e1c582e91317-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g\" (UID: \"6a507414-e983-4fe9-b594-e1c582e91317\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" May 21 20:49:46.607361 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.607064 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a507414-e983-4fe9-b594-e1c582e91317-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g\" (UID: \"6a507414-e983-4fe9-b594-e1c582e91317\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" May 21 20:49:46.607361 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.607179 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p9gc\" (UniqueName: \"kubernetes.io/projected/6a507414-e983-4fe9-b594-e1c582e91317-kube-api-access-8p9gc\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g\" (UID: \"6a507414-e983-4fe9-b594-e1c582e91317\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" May 21 20:49:46.708516 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.708476 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8p9gc\" (UniqueName: \"kubernetes.io/projected/6a507414-e983-4fe9-b594-e1c582e91317-kube-api-access-8p9gc\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g\" (UID: \"6a507414-e983-4fe9-b594-e1c582e91317\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" May 21 20:49:46.708724 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.708575 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a507414-e983-4fe9-b594-e1c582e91317-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g\" (UID: \"6a507414-e983-4fe9-b594-e1c582e91317\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" May 21 20:49:46.708724 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.708632 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a507414-e983-4fe9-b594-e1c582e91317-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g\" (UID: \"6a507414-e983-4fe9-b594-e1c582e91317\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" May 21 20:49:46.709027 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.709005 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a507414-e983-4fe9-b594-e1c582e91317-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g\" (UID: \"6a507414-e983-4fe9-b594-e1c582e91317\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" May 21 20:49:46.709083 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.709073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a507414-e983-4fe9-b594-e1c582e91317-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g\" (UID: \"6a507414-e983-4fe9-b594-e1c582e91317\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" May 21 20:49:46.716941 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.716867 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p9gc\" (UniqueName: \"kubernetes.io/projected/6a507414-e983-4fe9-b594-e1c582e91317-kube-api-access-8p9gc\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g\" (UID: \"6a507414-e983-4fe9-b594-e1c582e91317\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" May 21 20:49:46.786630 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.786589 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" May 21 20:49:46.926277 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:46.926050 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g"] May 21 20:49:46.931746 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:49:46.931702 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a507414_e983_4fe9_b594_e1c582e91317.slice/crio-4f9ee0c8f42ba729de7debc90881fc95cd5eab94198ff172b6f71c9952f5b188 WatchSource:0}: Error finding container 4f9ee0c8f42ba729de7debc90881fc95cd5eab94198ff172b6f71c9952f5b188: Status 404 returned error can't find the container with id 4f9ee0c8f42ba729de7debc90881fc95cd5eab94198ff172b6f71c9952f5b188 May 21 20:49:47.811539 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:47.811504 2573 generic.go:358] "Generic (PLEG): container finished" podID="6a507414-e983-4fe9-b594-e1c582e91317" containerID="74444f899180698071e77a7b891a6b5da6feaeb1370a296f9c78a9b8566470fc" exitCode=0 May 21 20:49:47.811919 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:47.811586 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" event={"ID":"6a507414-e983-4fe9-b594-e1c582e91317","Type":"ContainerDied","Data":"74444f899180698071e77a7b891a6b5da6feaeb1370a296f9c78a9b8566470fc"} May 21 20:49:47.811919 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:47.811623 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" event={"ID":"6a507414-e983-4fe9-b594-e1c582e91317","Type":"ContainerStarted","Data":"4f9ee0c8f42ba729de7debc90881fc95cd5eab94198ff172b6f71c9952f5b188"} May 21 20:49:50.823589 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:50.823505 2573 generic.go:358] "Generic (PLEG): container finished" podID="6a507414-e983-4fe9-b594-e1c582e91317" containerID="ed8283543dc0588e6d6ba0d2e68cec7ba7d529da8da416e6c6866c1600364a67" exitCode=0 May 21 20:49:50.823977 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:50.823587 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" event={"ID":"6a507414-e983-4fe9-b594-e1c582e91317","Type":"ContainerDied","Data":"ed8283543dc0588e6d6ba0d2e68cec7ba7d529da8da416e6c6866c1600364a67"} May 21 20:49:51.828740 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:51.828703 2573 generic.go:358] "Generic (PLEG): container finished" podID="6a507414-e983-4fe9-b594-e1c582e91317" containerID="d603f7861b36709df3fcd245d0caaeec71658aed260629e0062b6641aac21e3c" exitCode=0 May 21 20:49:51.829184 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:51.828792 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" event={"ID":"6a507414-e983-4fe9-b594-e1c582e91317","Type":"ContainerDied","Data":"d603f7861b36709df3fcd245d0caaeec71658aed260629e0062b6641aac21e3c"} May 21 20:49:52.961043 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:52.961018 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" May 21 20:49:53.073577 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:53.073542 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8p9gc\" (UniqueName: \"kubernetes.io/projected/6a507414-e983-4fe9-b594-e1c582e91317-kube-api-access-8p9gc\") pod \"6a507414-e983-4fe9-b594-e1c582e91317\" (UID: \"6a507414-e983-4fe9-b594-e1c582e91317\") " May 21 20:49:53.073770 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:53.073594 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a507414-e983-4fe9-b594-e1c582e91317-bundle\") pod \"6a507414-e983-4fe9-b594-e1c582e91317\" (UID: \"6a507414-e983-4fe9-b594-e1c582e91317\") " May 21 20:49:53.073770 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:53.073688 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a507414-e983-4fe9-b594-e1c582e91317-util\") pod \"6a507414-e983-4fe9-b594-e1c582e91317\" (UID: \"6a507414-e983-4fe9-b594-e1c582e91317\") " May 21 20:49:53.074626 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:53.074589 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a507414-e983-4fe9-b594-e1c582e91317-bundle" (OuterVolumeSpecName: "bundle") pod "6a507414-e983-4fe9-b594-e1c582e91317" (UID: "6a507414-e983-4fe9-b594-e1c582e91317"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:49:53.075763 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:53.075738 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a507414-e983-4fe9-b594-e1c582e91317-kube-api-access-8p9gc" (OuterVolumeSpecName: "kube-api-access-8p9gc") pod "6a507414-e983-4fe9-b594-e1c582e91317" (UID: "6a507414-e983-4fe9-b594-e1c582e91317"). InnerVolumeSpecName "kube-api-access-8p9gc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:49:53.078277 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:53.078255 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a507414-e983-4fe9-b594-e1c582e91317-util" (OuterVolumeSpecName: "util") pod "6a507414-e983-4fe9-b594-e1c582e91317" (UID: "6a507414-e983-4fe9-b594-e1c582e91317"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:49:53.174435 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:53.174318 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a507414-e983-4fe9-b594-e1c582e91317-util\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:49:53.174435 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:53.174350 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p9gc\" (UniqueName: \"kubernetes.io/projected/6a507414-e983-4fe9-b594-e1c582e91317-kube-api-access-8p9gc\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:49:53.174435 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:53.174365 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a507414-e983-4fe9-b594-e1c582e91317-bundle\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:49:53.838294 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:53.838262 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" May 21 20:49:53.838482 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:53.838270 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357gn4g" event={"ID":"6a507414-e983-4fe9-b594-e1c582e91317","Type":"ContainerDied","Data":"4f9ee0c8f42ba729de7debc90881fc95cd5eab94198ff172b6f71c9952f5b188"} May 21 20:49:53.838482 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:49:53.838381 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f9ee0c8f42ba729de7debc90881fc95cd5eab94198ff172b6f71c9952f5b188" May 21 20:50:00.684742 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.684707 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp"] May 21 20:50:00.685126 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.685043 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a507414-e983-4fe9-b594-e1c582e91317" containerName="pull" May 21 20:50:00.685126 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.685053 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a507414-e983-4fe9-b594-e1c582e91317" containerName="pull" May 21 20:50:00.685126 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.685065 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a507414-e983-4fe9-b594-e1c582e91317" containerName="extract" May 21 20:50:00.685126 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.685070 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a507414-e983-4fe9-b594-e1c582e91317" containerName="extract" May 21 20:50:00.685126 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.685085 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a507414-e983-4fe9-b594-e1c582e91317" containerName="util" May 21 20:50:00.685126 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.685091 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a507414-e983-4fe9-b594-e1c582e91317" containerName="util" May 21 20:50:00.685319 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.685146 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a507414-e983-4fe9-b594-e1c582e91317" containerName="extract" May 21 20:50:00.690581 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.690559 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" May 21 20:50:00.697508 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.697487 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qsgl2\"" May 21 20:50:00.697623 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.697524 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 20:50:00.698316 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.698299 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 20:50:00.715304 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.715271 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp"] May 21 20:50:00.733317 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.733288 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gntsp\" (UniqueName: \"kubernetes.io/projected/e5075338-d2bc-4c48-bc4e-ce7648c21594-kube-api-access-gntsp\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp\" (UID: \"e5075338-d2bc-4c48-bc4e-ce7648c21594\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" May 21 20:50:00.733515 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.733354 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5075338-d2bc-4c48-bc4e-ce7648c21594-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp\" (UID: \"e5075338-d2bc-4c48-bc4e-ce7648c21594\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" May 21 20:50:00.733515 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.733497 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5075338-d2bc-4c48-bc4e-ce7648c21594-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp\" (UID: \"e5075338-d2bc-4c48-bc4e-ce7648c21594\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" May 21 20:50:00.834488 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.834446 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gntsp\" (UniqueName: \"kubernetes.io/projected/e5075338-d2bc-4c48-bc4e-ce7648c21594-kube-api-access-gntsp\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp\" (UID: \"e5075338-d2bc-4c48-bc4e-ce7648c21594\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" May 21 20:50:00.834663 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.834545 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5075338-d2bc-4c48-bc4e-ce7648c21594-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp\" (UID: \"e5075338-d2bc-4c48-bc4e-ce7648c21594\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" May 21 20:50:00.834744 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.834718 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5075338-d2bc-4c48-bc4e-ce7648c21594-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp\" (UID: \"e5075338-d2bc-4c48-bc4e-ce7648c21594\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" May 21 20:50:00.835006 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.834980 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5075338-d2bc-4c48-bc4e-ce7648c21594-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp\" (UID: \"e5075338-d2bc-4c48-bc4e-ce7648c21594\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" May 21 20:50:00.835112 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.835023 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5075338-d2bc-4c48-bc4e-ce7648c21594-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp\" (UID: \"e5075338-d2bc-4c48-bc4e-ce7648c21594\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" May 21 20:50:00.848020 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.847987 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gntsp\" (UniqueName: \"kubernetes.io/projected/e5075338-d2bc-4c48-bc4e-ce7648c21594-kube-api-access-gntsp\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp\" (UID: \"e5075338-d2bc-4c48-bc4e-ce7648c21594\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" May 21 20:50:00.999456 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:00.999421 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" May 21 20:50:01.144578 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:01.144551 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp"] May 21 20:50:01.146990 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:50:01.146961 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5075338_d2bc_4c48_bc4e_ce7648c21594.slice/crio-6d2483cffb642338d855f0899bf992b47c565b08788d2e3bab6587015a264b48 WatchSource:0}: Error finding container 6d2483cffb642338d855f0899bf992b47c565b08788d2e3bab6587015a264b48: Status 404 returned error can't find the container with id 6d2483cffb642338d855f0899bf992b47c565b08788d2e3bab6587015a264b48 May 21 20:50:01.870859 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:01.870824 2573 generic.go:358] "Generic (PLEG): container finished" podID="e5075338-d2bc-4c48-bc4e-ce7648c21594" containerID="3e535aef4b3ec35d0bcee15368cdcc8719dcd6c73f7e1a6dac32172559cdc2b6" exitCode=0 May 21 20:50:01.871242 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:01.870908 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" event={"ID":"e5075338-d2bc-4c48-bc4e-ce7648c21594","Type":"ContainerDied","Data":"3e535aef4b3ec35d0bcee15368cdcc8719dcd6c73f7e1a6dac32172559cdc2b6"} May 21 20:50:01.871242 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:01.870941 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" event={"ID":"e5075338-d2bc-4c48-bc4e-ce7648c21594","Type":"ContainerStarted","Data":"6d2483cffb642338d855f0899bf992b47c565b08788d2e3bab6587015a264b48"} May 21 20:50:03.879870 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:03.879830 2573 generic.go:358] "Generic (PLEG): container finished" podID="e5075338-d2bc-4c48-bc4e-ce7648c21594" containerID="650de1772fccdc15554ec9616dfcaefd1b96d7f7350fe96c93fc1881a36949b6" exitCode=0 May 21 20:50:03.880385 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:03.879921 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" event={"ID":"e5075338-d2bc-4c48-bc4e-ce7648c21594","Type":"ContainerDied","Data":"650de1772fccdc15554ec9616dfcaefd1b96d7f7350fe96c93fc1881a36949b6"} May 21 20:50:04.885996 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:04.885961 2573 generic.go:358] "Generic (PLEG): container finished" podID="e5075338-d2bc-4c48-bc4e-ce7648c21594" containerID="1dc0772518b2f47c552ad1a0dbf8c8e77f1fc67f99982c4791fe4fc7d3d04281" exitCode=0 May 21 20:50:04.886415 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:04.886059 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" event={"ID":"e5075338-d2bc-4c48-bc4e-ce7648c21594","Type":"ContainerDied","Data":"1dc0772518b2f47c552ad1a0dbf8c8e77f1fc67f99982c4791fe4fc7d3d04281"} May 21 20:50:06.022474 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:06.022175 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" May 21 20:50:06.075482 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:06.075447 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gntsp\" (UniqueName: \"kubernetes.io/projected/e5075338-d2bc-4c48-bc4e-ce7648c21594-kube-api-access-gntsp\") pod \"e5075338-d2bc-4c48-bc4e-ce7648c21594\" (UID: \"e5075338-d2bc-4c48-bc4e-ce7648c21594\") " May 21 20:50:06.075647 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:06.075548 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5075338-d2bc-4c48-bc4e-ce7648c21594-bundle\") pod \"e5075338-d2bc-4c48-bc4e-ce7648c21594\" (UID: \"e5075338-d2bc-4c48-bc4e-ce7648c21594\") " May 21 20:50:06.075647 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:06.075585 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5075338-d2bc-4c48-bc4e-ce7648c21594-util\") pod \"e5075338-d2bc-4c48-bc4e-ce7648c21594\" (UID: \"e5075338-d2bc-4c48-bc4e-ce7648c21594\") " May 21 20:50:06.076431 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:06.076385 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5075338-d2bc-4c48-bc4e-ce7648c21594-bundle" (OuterVolumeSpecName: "bundle") pod "e5075338-d2bc-4c48-bc4e-ce7648c21594" (UID: "e5075338-d2bc-4c48-bc4e-ce7648c21594"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:50:06.077637 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:06.077601 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5075338-d2bc-4c48-bc4e-ce7648c21594-kube-api-access-gntsp" (OuterVolumeSpecName: "kube-api-access-gntsp") pod "e5075338-d2bc-4c48-bc4e-ce7648c21594" (UID: "e5075338-d2bc-4c48-bc4e-ce7648c21594"). InnerVolumeSpecName "kube-api-access-gntsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:50:06.081110 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:06.081080 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5075338-d2bc-4c48-bc4e-ce7648c21594-util" (OuterVolumeSpecName: "util") pod "e5075338-d2bc-4c48-bc4e-ce7648c21594" (UID: "e5075338-d2bc-4c48-bc4e-ce7648c21594"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:50:06.177294 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:06.177189 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5075338-d2bc-4c48-bc4e-ce7648c21594-bundle\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:06.177294 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:06.177232 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5075338-d2bc-4c48-bc4e-ce7648c21594-util\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:06.177294 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:06.177247 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gntsp\" (UniqueName: \"kubernetes.io/projected/e5075338-d2bc-4c48-bc4e-ce7648c21594-kube-api-access-gntsp\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:06.894950 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:06.894922 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" May 21 20:50:06.895118 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:06.894921 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4swcp" event={"ID":"e5075338-d2bc-4c48-bc4e-ce7648c21594","Type":"ContainerDied","Data":"6d2483cffb642338d855f0899bf992b47c565b08788d2e3bab6587015a264b48"} May 21 20:50:06.895118 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:06.895029 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d2483cffb642338d855f0899bf992b47c565b08788d2e3bab6587015a264b48" May 21 20:50:28.261248 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.261141 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9"] May 21 20:50:28.261740 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.261552 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5075338-d2bc-4c48-bc4e-ce7648c21594" containerName="util" May 21 20:50:28.261740 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.261567 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5075338-d2bc-4c48-bc4e-ce7648c21594" containerName="util" May 21 20:50:28.261740 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.261584 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5075338-d2bc-4c48-bc4e-ce7648c21594" containerName="pull" May 21 20:50:28.261740 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.261589 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5075338-d2bc-4c48-bc4e-ce7648c21594" containerName="pull" May 21 20:50:28.261740 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.261600 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5075338-d2bc-4c48-bc4e-ce7648c21594" containerName="extract" May 21 20:50:28.261740 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.261606 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5075338-d2bc-4c48-bc4e-ce7648c21594" containerName="extract" May 21 20:50:28.261740 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.261658 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5075338-d2bc-4c48-bc4e-ce7648c21594" containerName="extract" May 21 20:50:28.264839 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.264815 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.267662 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.267637 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 20:50:28.267807 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.267639 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 20:50:28.267807 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.267662 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gv8bw\"" May 21 20:50:28.267930 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.267837 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 20:50:28.275857 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.275828 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9"] May 21 20:50:28.383464 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.383430 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.383464 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.383471 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.383719 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.383487 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.383719 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.383575 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xxr5\" (UniqueName: \"kubernetes.io/projected/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-kube-api-access-5xxr5\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.383719 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.383636 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.383719 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.383682 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.383916 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.383728 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.383916 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.383791 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.383916 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.383823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.485021 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.484980 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.485021 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.485024 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.485285 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.485041 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.485285 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.485073 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xxr5\" (UniqueName: \"kubernetes.io/projected/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-kube-api-access-5xxr5\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.485285 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.485111 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.485285 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.485139 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.485285 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.485179 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.485285 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.485244 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.485610 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.485435 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.485610 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.485556 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.485707 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.485633 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.485772 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.485746 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.485892 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.485811 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.485960 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.485932 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.487349 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.487327 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.487831 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.487808 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.494805 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.494781 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.494903 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.494843 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xxr5\" (UniqueName: \"kubernetes.io/projected/38d6f163-ec38-4ed5-9fd4-8ab1fc02e555-kube-api-access-5xxr5\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9\" (UID: \"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.577330 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.577234 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:28.712086 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.712056 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9"] May 21 20:50:28.713300 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:50:28.713269 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d6f163_ec38_4ed5_9fd4_8ab1fc02e555.slice/crio-96a8ff2ead8a476f19b4e55d847fd8f1088147cf5ba95308ec4b9833c954a4fd WatchSource:0}: Error finding container 96a8ff2ead8a476f19b4e55d847fd8f1088147cf5ba95308ec4b9833c954a4fd: Status 404 returned error can't find the container with id 96a8ff2ead8a476f19b4e55d847fd8f1088147cf5ba95308ec4b9833c954a4fd May 21 20:50:28.978005 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:28.977961 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" event={"ID":"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555","Type":"ContainerStarted","Data":"96a8ff2ead8a476f19b4e55d847fd8f1088147cf5ba95308ec4b9833c954a4fd"} May 21 20:50:31.966766 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:31.966728 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 21 20:50:31.967043 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:31.966803 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 21 20:50:31.967043 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:31.966832 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 21 20:50:32.995462 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:32.995426 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" event={"ID":"38d6f163-ec38-4ed5-9fd4-8ab1fc02e555","Type":"ContainerStarted","Data":"b597641d6a3a2a690188aca165f986fd7ca31f080d2532a3e88dd632de7a0bf6"} May 21 20:50:33.016871 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:33.016820 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" podStartSLOduration=1.76563995 podStartE2EDuration="5.016803934s" podCreationTimestamp="2026-05-21 20:50:28 +0000 UTC" firstStartedPulling="2026-05-21 20:50:28.715316172 +0000 UTC m=+719.607178748" lastFinishedPulling="2026-05-21 20:50:31.966480138 +0000 UTC m=+722.858342732" observedRunningTime="2026-05-21 20:50:33.013947439 +0000 UTC m=+723.905810037" watchObservedRunningTime="2026-05-21 20:50:33.016803934 +0000 UTC m=+723.908666536" May 21 20:50:33.577816 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:33.577781 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:33.582604 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:33.582578 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:33.999414 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:33.999371 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:34.000513 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:34.000490 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9" May 21 20:50:35.473632 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:35.473593 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgnxx"] May 21 20:50:35.477280 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:35.477259 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vgnxx" May 21 20:50:35.480058 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:35.480018 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 20:50:35.481618 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:35.481599 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 20:50:35.481744 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:35.481604 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4g97p\"" May 21 20:50:35.485076 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:35.484827 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgnxx"] May 21 20:50:35.649868 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:35.649810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqwh8\" (UniqueName: \"kubernetes.io/projected/4c7ad4f7-3066-4a52-9ddd-930aada73edd-kube-api-access-sqwh8\") pod \"kuadrant-operator-catalog-vgnxx\" (UID: \"4c7ad4f7-3066-4a52-9ddd-930aada73edd\") " pod="kuadrant-system/kuadrant-operator-catalog-vgnxx" May 21 20:50:35.750686 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:35.750596 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqwh8\" (UniqueName: \"kubernetes.io/projected/4c7ad4f7-3066-4a52-9ddd-930aada73edd-kube-api-access-sqwh8\") pod \"kuadrant-operator-catalog-vgnxx\" (UID: \"4c7ad4f7-3066-4a52-9ddd-930aada73edd\") " pod="kuadrant-system/kuadrant-operator-catalog-vgnxx" May 21 20:50:35.761619 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:35.761582 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqwh8\" (UniqueName: \"kubernetes.io/projected/4c7ad4f7-3066-4a52-9ddd-930aada73edd-kube-api-access-sqwh8\") pod \"kuadrant-operator-catalog-vgnxx\" (UID: \"4c7ad4f7-3066-4a52-9ddd-930aada73edd\") " pod="kuadrant-system/kuadrant-operator-catalog-vgnxx" May 21 20:50:35.787634 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:35.787597 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vgnxx" May 21 20:50:35.831795 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:35.831759 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgnxx"] May 21 20:50:35.941940 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:35.941911 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgnxx"] May 21 20:50:35.944647 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:50:35.944618 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7ad4f7_3066_4a52_9ddd_930aada73edd.slice/crio-bce15cb96f74cf01b11c374379e58e47104e707aa6da22c35deb68c7ed4a1a14 WatchSource:0}: Error finding container bce15cb96f74cf01b11c374379e58e47104e707aa6da22c35deb68c7ed4a1a14: Status 404 returned error can't find the container with id bce15cb96f74cf01b11c374379e58e47104e707aa6da22c35deb68c7ed4a1a14 May 21 20:50:36.007748 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:36.007656 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vgnxx" event={"ID":"4c7ad4f7-3066-4a52-9ddd-930aada73edd","Type":"ContainerStarted","Data":"bce15cb96f74cf01b11c374379e58e47104e707aa6da22c35deb68c7ed4a1a14"} May 21 20:50:36.038380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:36.038344 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqwkw"] May 21 20:50:36.043012 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:36.042995 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xqwkw" May 21 20:50:36.048858 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:36.048830 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqwkw"] May 21 20:50:36.157984 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:36.157941 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg2g8\" (UniqueName: \"kubernetes.io/projected/2874801d-4c22-4f4c-8049-d0a74abfdacb-kube-api-access-mg2g8\") pod \"kuadrant-operator-catalog-xqwkw\" (UID: \"2874801d-4c22-4f4c-8049-d0a74abfdacb\") " pod="kuadrant-system/kuadrant-operator-catalog-xqwkw" May 21 20:50:36.259463 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:36.259372 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mg2g8\" (UniqueName: \"kubernetes.io/projected/2874801d-4c22-4f4c-8049-d0a74abfdacb-kube-api-access-mg2g8\") pod \"kuadrant-operator-catalog-xqwkw\" (UID: \"2874801d-4c22-4f4c-8049-d0a74abfdacb\") " pod="kuadrant-system/kuadrant-operator-catalog-xqwkw" May 21 20:50:36.267242 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:36.267214 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg2g8\" (UniqueName: \"kubernetes.io/projected/2874801d-4c22-4f4c-8049-d0a74abfdacb-kube-api-access-mg2g8\") pod \"kuadrant-operator-catalog-xqwkw\" (UID: \"2874801d-4c22-4f4c-8049-d0a74abfdacb\") " pod="kuadrant-system/kuadrant-operator-catalog-xqwkw" May 21 20:50:36.353996 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:36.353954 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xqwkw" May 21 20:50:36.485210 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:36.485183 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqwkw"] May 21 20:50:36.487132 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:50:36.487090 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2874801d_4c22_4f4c_8049_d0a74abfdacb.slice/crio-b48ff59bc5dfcaef5473927e1cebeebbcf34d7bc4dc71a85b17de74383490640 WatchSource:0}: Error finding container b48ff59bc5dfcaef5473927e1cebeebbcf34d7bc4dc71a85b17de74383490640: Status 404 returned error can't find the container with id b48ff59bc5dfcaef5473927e1cebeebbcf34d7bc4dc71a85b17de74383490640 May 21 20:50:37.014423 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:37.014349 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xqwkw" event={"ID":"2874801d-4c22-4f4c-8049-d0a74abfdacb","Type":"ContainerStarted","Data":"b48ff59bc5dfcaef5473927e1cebeebbcf34d7bc4dc71a85b17de74383490640"} May 21 20:50:39.023955 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:39.023913 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vgnxx" event={"ID":"4c7ad4f7-3066-4a52-9ddd-930aada73edd","Type":"ContainerStarted","Data":"0b86b24f654e6940437592f1d4d14b4d5a2aeab01cae3ca9429d1c76de3d5cd1"} May 21 20:50:39.024415 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:39.023951 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-vgnxx" podUID="4c7ad4f7-3066-4a52-9ddd-930aada73edd" containerName="registry-server" containerID="cri-o://0b86b24f654e6940437592f1d4d14b4d5a2aeab01cae3ca9429d1c76de3d5cd1" gracePeriod=2 May 21 20:50:39.025345 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:39.025319 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xqwkw" event={"ID":"2874801d-4c22-4f4c-8049-d0a74abfdacb","Type":"ContainerStarted","Data":"41acb66108f324d7a54cf784376511328511c3333112e74f2a0abc01bc5f5da9"} May 21 20:50:39.039385 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:39.039336 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vgnxx" podStartSLOduration=1.795056812 podStartE2EDuration="4.039318792s" podCreationTimestamp="2026-05-21 20:50:35 +0000 UTC" firstStartedPulling="2026-05-21 20:50:35.946057935 +0000 UTC m=+726.837920511" lastFinishedPulling="2026-05-21 20:50:38.190319912 +0000 UTC m=+729.082182491" observedRunningTime="2026-05-21 20:50:39.037511125 +0000 UTC m=+729.929373733" watchObservedRunningTime="2026-05-21 20:50:39.039318792 +0000 UTC m=+729.931181390" May 21 20:50:39.053604 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:39.053554 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xqwkw" podStartSLOduration=1.348680691 podStartE2EDuration="3.053538971s" podCreationTimestamp="2026-05-21 20:50:36 +0000 UTC" firstStartedPulling="2026-05-21 20:50:36.48868907 +0000 UTC m=+727.380551645" lastFinishedPulling="2026-05-21 20:50:38.193547343 +0000 UTC m=+729.085409925" observedRunningTime="2026-05-21 20:50:39.051509296 +0000 UTC m=+729.943371893" watchObservedRunningTime="2026-05-21 20:50:39.053538971 +0000 UTC m=+729.945401569" May 21 20:50:39.261027 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:39.261003 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vgnxx" May 21 20:50:39.386156 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:39.386074 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqwh8\" (UniqueName: \"kubernetes.io/projected/4c7ad4f7-3066-4a52-9ddd-930aada73edd-kube-api-access-sqwh8\") pod \"4c7ad4f7-3066-4a52-9ddd-930aada73edd\" (UID: \"4c7ad4f7-3066-4a52-9ddd-930aada73edd\") " May 21 20:50:39.388358 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:39.388324 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c7ad4f7-3066-4a52-9ddd-930aada73edd-kube-api-access-sqwh8" (OuterVolumeSpecName: "kube-api-access-sqwh8") pod "4c7ad4f7-3066-4a52-9ddd-930aada73edd" (UID: "4c7ad4f7-3066-4a52-9ddd-930aada73edd"). InnerVolumeSpecName "kube-api-access-sqwh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:50:39.487591 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:39.487483 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqwh8\" (UniqueName: \"kubernetes.io/projected/4c7ad4f7-3066-4a52-9ddd-930aada73edd-kube-api-access-sqwh8\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:40.030131 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:40.030089 2573 generic.go:358] "Generic (PLEG): container finished" podID="4c7ad4f7-3066-4a52-9ddd-930aada73edd" containerID="0b86b24f654e6940437592f1d4d14b4d5a2aeab01cae3ca9429d1c76de3d5cd1" exitCode=0 May 21 20:50:40.030595 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:40.030166 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vgnxx" May 21 20:50:40.030595 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:40.030182 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vgnxx" event={"ID":"4c7ad4f7-3066-4a52-9ddd-930aada73edd","Type":"ContainerDied","Data":"0b86b24f654e6940437592f1d4d14b4d5a2aeab01cae3ca9429d1c76de3d5cd1"} May 21 20:50:40.030595 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:40.030223 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vgnxx" event={"ID":"4c7ad4f7-3066-4a52-9ddd-930aada73edd","Type":"ContainerDied","Data":"bce15cb96f74cf01b11c374379e58e47104e707aa6da22c35deb68c7ed4a1a14"} May 21 20:50:40.030595 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:40.030242 2573 scope.go:117] "RemoveContainer" containerID="0b86b24f654e6940437592f1d4d14b4d5a2aeab01cae3ca9429d1c76de3d5cd1" May 21 20:50:40.039103 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:40.039085 2573 scope.go:117] "RemoveContainer" containerID="0b86b24f654e6940437592f1d4d14b4d5a2aeab01cae3ca9429d1c76de3d5cd1" May 21 20:50:40.039385 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:50:40.039366 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b86b24f654e6940437592f1d4d14b4d5a2aeab01cae3ca9429d1c76de3d5cd1\": container with ID starting with 0b86b24f654e6940437592f1d4d14b4d5a2aeab01cae3ca9429d1c76de3d5cd1 not found: ID does not exist" containerID="0b86b24f654e6940437592f1d4d14b4d5a2aeab01cae3ca9429d1c76de3d5cd1" May 21 20:50:40.039459 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:40.039393 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b86b24f654e6940437592f1d4d14b4d5a2aeab01cae3ca9429d1c76de3d5cd1"} err="failed to get container status \"0b86b24f654e6940437592f1d4d14b4d5a2aeab01cae3ca9429d1c76de3d5cd1\": rpc error: code = NotFound desc = could not find container \"0b86b24f654e6940437592f1d4d14b4d5a2aeab01cae3ca9429d1c76de3d5cd1\": container with ID starting with 0b86b24f654e6940437592f1d4d14b4d5a2aeab01cae3ca9429d1c76de3d5cd1 not found: ID does not exist" May 21 20:50:40.046302 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:40.046269 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgnxx"] May 21 20:50:40.049861 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:40.049840 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgnxx"] May 21 20:50:41.682236 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:41.682204 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c7ad4f7-3066-4a52-9ddd-930aada73edd" path="/var/lib/kubelet/pods/4c7ad4f7-3066-4a52-9ddd-930aada73edd/volumes" May 21 20:50:46.354212 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:46.354173 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xqwkw" May 21 20:50:46.354695 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:46.354430 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xqwkw" May 21 20:50:46.375942 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:46.375916 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xqwkw" May 21 20:50:47.078120 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:47.078090 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xqwkw" May 21 20:50:51.072774 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.072745 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k"] May 21 20:50:51.073178 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.073081 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c7ad4f7-3066-4a52-9ddd-930aada73edd" containerName="registry-server" May 21 20:50:51.073178 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.073092 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c7ad4f7-3066-4a52-9ddd-930aada73edd" containerName="registry-server" May 21 20:50:51.073178 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.073152 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c7ad4f7-3066-4a52-9ddd-930aada73edd" containerName="registry-server" May 21 20:50:51.077453 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.077433 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" May 21 20:50:51.081453 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.081427 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2zgxl\"" May 21 20:50:51.082544 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.082518 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d095a2d6-b915-4237-9650-32429af2c848-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k\" (UID: \"d095a2d6-b915-4237-9650-32429af2c848\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" May 21 20:50:51.082672 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.082555 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdz7z\" (UniqueName: \"kubernetes.io/projected/d095a2d6-b915-4237-9650-32429af2c848-kube-api-access-cdz7z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k\" (UID: \"d095a2d6-b915-4237-9650-32429af2c848\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" May 21 20:50:51.082762 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.082739 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d095a2d6-b915-4237-9650-32429af2c848-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k\" (UID: \"d095a2d6-b915-4237-9650-32429af2c848\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" May 21 20:50:51.083095 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.083075 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k"] May 21 20:50:51.183362 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.183328 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d095a2d6-b915-4237-9650-32429af2c848-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k\" (UID: \"d095a2d6-b915-4237-9650-32429af2c848\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" May 21 20:50:51.183555 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.183418 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d095a2d6-b915-4237-9650-32429af2c848-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k\" (UID: \"d095a2d6-b915-4237-9650-32429af2c848\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" May 21 20:50:51.183555 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.183438 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cdz7z\" (UniqueName: \"kubernetes.io/projected/d095a2d6-b915-4237-9650-32429af2c848-kube-api-access-cdz7z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k\" (UID: \"d095a2d6-b915-4237-9650-32429af2c848\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" May 21 20:50:51.183745 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.183727 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d095a2d6-b915-4237-9650-32429af2c848-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k\" (UID: \"d095a2d6-b915-4237-9650-32429af2c848\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" May 21 20:50:51.183782 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.183767 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d095a2d6-b915-4237-9650-32429af2c848-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k\" (UID: \"d095a2d6-b915-4237-9650-32429af2c848\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" May 21 20:50:51.191554 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.191532 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdz7z\" (UniqueName: \"kubernetes.io/projected/d095a2d6-b915-4237-9650-32429af2c848-kube-api-access-cdz7z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k\" (UID: \"d095a2d6-b915-4237-9650-32429af2c848\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" May 21 20:50:51.387461 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.387343 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" May 21 20:50:51.472462 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.472426 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2"] May 21 20:50:51.477943 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.477912 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" May 21 20:50:51.485087 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.484991 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2\" (UID: \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" May 21 20:50:51.485375 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.485351 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2\" (UID: \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" May 21 20:50:51.485484 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.485104 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2"] May 21 20:50:51.485576 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.485529 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svwwf\" (UniqueName: \"kubernetes.io/projected/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-kube-api-access-svwwf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2\" (UID: \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" May 21 20:50:51.517075 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.517052 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k"] May 21 20:50:51.519199 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:50:51.519170 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd095a2d6_b915_4237_9650_32429af2c848.slice/crio-514944d71719954afd7c25f82877e5ba12b7b5d85ba8efe9ed6776f1fe0fc000 WatchSource:0}: Error finding container 514944d71719954afd7c25f82877e5ba12b7b5d85ba8efe9ed6776f1fe0fc000: Status 404 returned error can't find the container with id 514944d71719954afd7c25f82877e5ba12b7b5d85ba8efe9ed6776f1fe0fc000 May 21 20:50:51.586196 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.586166 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-svwwf\" (UniqueName: \"kubernetes.io/projected/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-kube-api-access-svwwf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2\" (UID: \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" May 21 20:50:51.586303 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.586240 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2\" (UID: \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" May 21 20:50:51.586303 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.586263 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2\" (UID: \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" May 21 20:50:51.586697 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.586677 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2\" (UID: \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" May 21 20:50:51.586697 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.586690 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2\" (UID: \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" May 21 20:50:51.593576 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.593550 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svwwf\" (UniqueName: \"kubernetes.io/projected/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-kube-api-access-svwwf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2\" (UID: \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" May 21 20:50:51.790132 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.790091 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" May 21 20:50:51.868949 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.868916 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd"] May 21 20:50:51.874173 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.874145 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" May 21 20:50:51.880622 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.880593 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd"] May 21 20:50:51.888859 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.888825 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c50380a1-2c56-45ee-949c-5438dec83bc8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd\" (UID: \"c50380a1-2c56-45ee-949c-5438dec83bc8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" May 21 20:50:51.888990 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.888951 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c50380a1-2c56-45ee-949c-5438dec83bc8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd\" (UID: \"c50380a1-2c56-45ee-949c-5438dec83bc8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" May 21 20:50:51.889060 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.889031 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rbn4\" (UniqueName: \"kubernetes.io/projected/c50380a1-2c56-45ee-949c-5438dec83bc8-kube-api-access-5rbn4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd\" (UID: \"c50380a1-2c56-45ee-949c-5438dec83bc8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" May 21 20:50:51.925857 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.925830 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2"] May 21 20:50:51.927165 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:50:51.927134 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6661ac5_208a_4616_9ff5_a80b6e2c06b0.slice/crio-a4d2849ab1e9a4449a474ee6b10b5d147691239c4d77a60148b1336d277d6056 WatchSource:0}: Error finding container a4d2849ab1e9a4449a474ee6b10b5d147691239c4d77a60148b1336d277d6056: Status 404 returned error can't find the container with id a4d2849ab1e9a4449a474ee6b10b5d147691239c4d77a60148b1336d277d6056 May 21 20:50:51.989667 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.989637 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c50380a1-2c56-45ee-949c-5438dec83bc8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd\" (UID: \"c50380a1-2c56-45ee-949c-5438dec83bc8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" May 21 20:50:51.989797 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.989723 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbn4\" (UniqueName: \"kubernetes.io/projected/c50380a1-2c56-45ee-949c-5438dec83bc8-kube-api-access-5rbn4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd\" (UID: \"c50380a1-2c56-45ee-949c-5438dec83bc8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" May 21 20:50:51.989797 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.989770 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c50380a1-2c56-45ee-949c-5438dec83bc8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd\" (UID: \"c50380a1-2c56-45ee-949c-5438dec83bc8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" May 21 20:50:51.990151 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.990130 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c50380a1-2c56-45ee-949c-5438dec83bc8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd\" (UID: \"c50380a1-2c56-45ee-949c-5438dec83bc8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" May 21 20:50:51.990277 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.990130 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c50380a1-2c56-45ee-949c-5438dec83bc8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd\" (UID: \"c50380a1-2c56-45ee-949c-5438dec83bc8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" May 21 20:50:51.999349 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:51.999322 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rbn4\" (UniqueName: \"kubernetes.io/projected/c50380a1-2c56-45ee-949c-5438dec83bc8-kube-api-access-5rbn4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd\" (UID: \"c50380a1-2c56-45ee-949c-5438dec83bc8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" May 21 20:50:52.078767 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.078657 2573 generic.go:358] "Generic (PLEG): container finished" podID="b6661ac5-208a-4616-9ff5-a80b6e2c06b0" containerID="1d3d11733ce3c27a3e95fdeaa6dd5538e47a3c095042cf31ec5da7941393d957" exitCode=0 May 21 20:50:52.078767 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.078738 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" event={"ID":"b6661ac5-208a-4616-9ff5-a80b6e2c06b0","Type":"ContainerDied","Data":"1d3d11733ce3c27a3e95fdeaa6dd5538e47a3c095042cf31ec5da7941393d957"} May 21 20:50:52.079267 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.078781 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" event={"ID":"b6661ac5-208a-4616-9ff5-a80b6e2c06b0","Type":"ContainerStarted","Data":"a4d2849ab1e9a4449a474ee6b10b5d147691239c4d77a60148b1336d277d6056"} May 21 20:50:52.080337 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.080313 2573 generic.go:358] "Generic (PLEG): container finished" podID="d095a2d6-b915-4237-9650-32429af2c848" containerID="93e816c6961a6872c652414d3bf9323b89fd1f34a109c0639331fc77bfab99f7" exitCode=0 May 21 20:50:52.080466 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.080384 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" event={"ID":"d095a2d6-b915-4237-9650-32429af2c848","Type":"ContainerDied","Data":"93e816c6961a6872c652414d3bf9323b89fd1f34a109c0639331fc77bfab99f7"} May 21 20:50:52.080466 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.080430 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" event={"ID":"d095a2d6-b915-4237-9650-32429af2c848","Type":"ContainerStarted","Data":"514944d71719954afd7c25f82877e5ba12b7b5d85ba8efe9ed6776f1fe0fc000"} May 21 20:50:52.186071 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.186034 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" May 21 20:50:52.274725 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.274691 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7"] May 21 20:50:52.280132 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.280107 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" May 21 20:50:52.286787 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.286720 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7"] May 21 20:50:52.291384 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.291354 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7\" (UID: \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" May 21 20:50:52.291512 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.291481 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7\" (UID: \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" May 21 20:50:52.291583 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.291515 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km2t7\" (UniqueName: \"kubernetes.io/projected/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-kube-api-access-km2t7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7\" (UID: \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" May 21 20:50:52.322171 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.322136 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd"] May 21 20:50:52.323508 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:50:52.323475 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc50380a1_2c56_45ee_949c_5438dec83bc8.slice/crio-22ed089afdcfff27f23c00c38fb168eda0139fa4d703ecca53a4a4b0d09dc20e WatchSource:0}: Error finding container 22ed089afdcfff27f23c00c38fb168eda0139fa4d703ecca53a4a4b0d09dc20e: Status 404 returned error can't find the container with id 22ed089afdcfff27f23c00c38fb168eda0139fa4d703ecca53a4a4b0d09dc20e May 21 20:50:52.392415 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.392379 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7\" (UID: \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" May 21 20:50:52.392570 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.392453 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7\" (UID: \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" May 21 20:50:52.392570 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.392474 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-km2t7\" (UniqueName: \"kubernetes.io/projected/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-kube-api-access-km2t7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7\" (UID: \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" May 21 20:50:52.392690 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.392672 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7\" (UID: \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" May 21 20:50:52.392808 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.392787 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7\" (UID: \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" May 21 20:50:52.401139 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.401117 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-km2t7\" (UniqueName: \"kubernetes.io/projected/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-kube-api-access-km2t7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7\" (UID: \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" May 21 20:50:52.592801 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.592722 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" May 21 20:50:52.889323 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:52.889280 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7"] May 21 20:50:52.915554 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:50:52.915522 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c48ba9_6da3_4b3f_bd34_91b1e9d2f488.slice/crio-483ca662afd6f6b6217109f9c04c018587b38d8a2620a289fa708a0750c4eb17 WatchSource:0}: Error finding container 483ca662afd6f6b6217109f9c04c018587b38d8a2620a289fa708a0750c4eb17: Status 404 returned error can't find the container with id 483ca662afd6f6b6217109f9c04c018587b38d8a2620a289fa708a0750c4eb17 May 21 20:50:53.085295 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:53.085220 2573 generic.go:358] "Generic (PLEG): container finished" podID="a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488" containerID="be00c80237e4663f34cd59376a3d1fcd9cd08dbd9cd337db4baba098165b9f15" exitCode=0 May 21 20:50:53.085740 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:53.085319 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" event={"ID":"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488","Type":"ContainerDied","Data":"be00c80237e4663f34cd59376a3d1fcd9cd08dbd9cd337db4baba098165b9f15"} May 21 20:50:53.085740 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:53.085358 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" event={"ID":"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488","Type":"ContainerStarted","Data":"483ca662afd6f6b6217109f9c04c018587b38d8a2620a289fa708a0750c4eb17"} May 21 20:50:53.086884 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:53.086865 2573 generic.go:358] "Generic (PLEG): container finished" podID="c50380a1-2c56-45ee-949c-5438dec83bc8" containerID="2f3cf7af0abe4739a3c73b9112dab6e09b7edbccdb6d549b0a8352815bc523ea" exitCode=0 May 21 20:50:53.086976 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:53.086935 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" event={"ID":"c50380a1-2c56-45ee-949c-5438dec83bc8","Type":"ContainerDied","Data":"2f3cf7af0abe4739a3c73b9112dab6e09b7edbccdb6d549b0a8352815bc523ea"} May 21 20:50:53.086976 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:53.086968 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" event={"ID":"c50380a1-2c56-45ee-949c-5438dec83bc8","Type":"ContainerStarted","Data":"22ed089afdcfff27f23c00c38fb168eda0139fa4d703ecca53a4a4b0d09dc20e"} May 21 20:50:53.088601 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:53.088577 2573 generic.go:358] "Generic (PLEG): container finished" podID="b6661ac5-208a-4616-9ff5-a80b6e2c06b0" containerID="543e8e4231f9b96f7be73050060d681cb1e50dca22481de848b558e43c8c4345" exitCode=0 May 21 20:50:53.088710 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:53.088646 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" event={"ID":"b6661ac5-208a-4616-9ff5-a80b6e2c06b0","Type":"ContainerDied","Data":"543e8e4231f9b96f7be73050060d681cb1e50dca22481de848b558e43c8c4345"} May 21 20:50:53.090530 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:53.090513 2573 generic.go:358] "Generic (PLEG): container finished" podID="d095a2d6-b915-4237-9650-32429af2c848" containerID="5202f273d19badaaa05457d2712ba27e5821840e6ddd4f8a3a29e9999dc7e627" exitCode=0 May 21 20:50:53.090602 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:53.090587 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" event={"ID":"d095a2d6-b915-4237-9650-32429af2c848","Type":"ContainerDied","Data":"5202f273d19badaaa05457d2712ba27e5821840e6ddd4f8a3a29e9999dc7e627"} May 21 20:50:54.095989 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:54.095909 2573 generic.go:358] "Generic (PLEG): container finished" podID="a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488" containerID="d8e971e10b3bdee04d86a219bf519591c731d59d4161cf209ef36714fb7d8196" exitCode=0 May 21 20:50:54.096392 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:54.096052 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" event={"ID":"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488","Type":"ContainerDied","Data":"d8e971e10b3bdee04d86a219bf519591c731d59d4161cf209ef36714fb7d8196"} May 21 20:50:54.097791 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:54.097767 2573 generic.go:358] "Generic (PLEG): container finished" podID="c50380a1-2c56-45ee-949c-5438dec83bc8" containerID="6153f01e8637c38fac6d6ad00eee1ec7991b69e903b837f4ecc6d31bac37ca55" exitCode=0 May 21 20:50:54.097874 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:54.097845 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" event={"ID":"c50380a1-2c56-45ee-949c-5438dec83bc8","Type":"ContainerDied","Data":"6153f01e8637c38fac6d6ad00eee1ec7991b69e903b837f4ecc6d31bac37ca55"} May 21 20:50:54.105995 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:54.105966 2573 generic.go:358] "Generic (PLEG): container finished" podID="b6661ac5-208a-4616-9ff5-a80b6e2c06b0" containerID="ded72212066a3e4b5082680dbf9a604494882ad8c4bff5cbdc801ec765a2a1bd" exitCode=0 May 21 20:50:54.106117 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:54.106032 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" event={"ID":"b6661ac5-208a-4616-9ff5-a80b6e2c06b0","Type":"ContainerDied","Data":"ded72212066a3e4b5082680dbf9a604494882ad8c4bff5cbdc801ec765a2a1bd"} May 21 20:50:54.108529 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:54.108493 2573 generic.go:358] "Generic (PLEG): container finished" podID="d095a2d6-b915-4237-9650-32429af2c848" containerID="aa8acf232b57b1b5b62e63b4f86bf6440d80b92c5522753e9862cb255ab51953" exitCode=0 May 21 20:50:54.108606 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:54.108540 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" event={"ID":"d095a2d6-b915-4237-9650-32429af2c848","Type":"ContainerDied","Data":"aa8acf232b57b1b5b62e63b4f86bf6440d80b92c5522753e9862cb255ab51953"} May 21 20:50:55.118605 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.118572 2573 generic.go:358] "Generic (PLEG): container finished" podID="c50380a1-2c56-45ee-949c-5438dec83bc8" containerID="87154e0d8c6de866532b186dd333d01e9b33e5dcb45b3c503532c5cea11dc01f" exitCode=0 May 21 20:50:55.118967 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.118652 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" event={"ID":"c50380a1-2c56-45ee-949c-5438dec83bc8","Type":"ContainerDied","Data":"87154e0d8c6de866532b186dd333d01e9b33e5dcb45b3c503532c5cea11dc01f"} May 21 20:50:55.120319 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.120297 2573 generic.go:358] "Generic (PLEG): container finished" podID="a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488" containerID="4e7d01e99bfec4ee1af725e502cb459249ea91626b2404a1c0f72180db77b967" exitCode=0 May 21 20:50:55.120443 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.120375 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" event={"ID":"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488","Type":"ContainerDied","Data":"4e7d01e99bfec4ee1af725e502cb459249ea91626b2404a1c0f72180db77b967"} May 21 20:50:55.277964 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.277941 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" May 21 20:50:55.281177 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.281148 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" May 21 20:50:55.318176 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.318145 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-bundle\") pod \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\" (UID: \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\") " May 21 20:50:55.318176 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.318181 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d095a2d6-b915-4237-9650-32429af2c848-util\") pod \"d095a2d6-b915-4237-9650-32429af2c848\" (UID: \"d095a2d6-b915-4237-9650-32429af2c848\") " May 21 20:50:55.318429 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.318245 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdz7z\" (UniqueName: \"kubernetes.io/projected/d095a2d6-b915-4237-9650-32429af2c848-kube-api-access-cdz7z\") pod \"d095a2d6-b915-4237-9650-32429af2c848\" (UID: \"d095a2d6-b915-4237-9650-32429af2c848\") " May 21 20:50:55.318429 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.318264 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svwwf\" (UniqueName: \"kubernetes.io/projected/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-kube-api-access-svwwf\") pod \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\" (UID: \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\") " May 21 20:50:55.318429 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.318296 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d095a2d6-b915-4237-9650-32429af2c848-bundle\") pod \"d095a2d6-b915-4237-9650-32429af2c848\" (UID: \"d095a2d6-b915-4237-9650-32429af2c848\") " May 21 20:50:55.318429 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.318343 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-util\") pod \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\" (UID: \"b6661ac5-208a-4616-9ff5-a80b6e2c06b0\") " May 21 20:50:55.319178 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.319042 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-bundle" (OuterVolumeSpecName: "bundle") pod "b6661ac5-208a-4616-9ff5-a80b6e2c06b0" (UID: "b6661ac5-208a-4616-9ff5-a80b6e2c06b0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:50:55.319178 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.319136 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d095a2d6-b915-4237-9650-32429af2c848-bundle" (OuterVolumeSpecName: "bundle") pod "d095a2d6-b915-4237-9650-32429af2c848" (UID: "d095a2d6-b915-4237-9650-32429af2c848"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:50:55.320844 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.320816 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d095a2d6-b915-4237-9650-32429af2c848-kube-api-access-cdz7z" (OuterVolumeSpecName: "kube-api-access-cdz7z") pod "d095a2d6-b915-4237-9650-32429af2c848" (UID: "d095a2d6-b915-4237-9650-32429af2c848"). InnerVolumeSpecName "kube-api-access-cdz7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:50:55.321017 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.320995 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-kube-api-access-svwwf" (OuterVolumeSpecName: "kube-api-access-svwwf") pod "b6661ac5-208a-4616-9ff5-a80b6e2c06b0" (UID: "b6661ac5-208a-4616-9ff5-a80b6e2c06b0"). InnerVolumeSpecName "kube-api-access-svwwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:50:55.324270 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.324247 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-util" (OuterVolumeSpecName: "util") pod "b6661ac5-208a-4616-9ff5-a80b6e2c06b0" (UID: "b6661ac5-208a-4616-9ff5-a80b6e2c06b0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:50:55.324722 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.324702 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d095a2d6-b915-4237-9650-32429af2c848-util" (OuterVolumeSpecName: "util") pod "d095a2d6-b915-4237-9650-32429af2c848" (UID: "d095a2d6-b915-4237-9650-32429af2c848"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:50:55.419742 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.419649 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdz7z\" (UniqueName: \"kubernetes.io/projected/d095a2d6-b915-4237-9650-32429af2c848-kube-api-access-cdz7z\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:55.419742 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.419683 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svwwf\" (UniqueName: \"kubernetes.io/projected/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-kube-api-access-svwwf\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:55.419742 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.419693 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d095a2d6-b915-4237-9650-32429af2c848-bundle\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:55.419742 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.419703 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-util\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:55.419742 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.419712 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6661ac5-208a-4616-9ff5-a80b6e2c06b0-bundle\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:55.419742 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:55.419719 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d095a2d6-b915-4237-9650-32429af2c848-util\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:56.126696 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.126661 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" event={"ID":"b6661ac5-208a-4616-9ff5-a80b6e2c06b0","Type":"ContainerDied","Data":"a4d2849ab1e9a4449a474ee6b10b5d147691239c4d77a60148b1336d277d6056"} May 21 20:50:56.126696 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.126685 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2" May 21 20:50:56.126696 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.126696 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4d2849ab1e9a4449a474ee6b10b5d147691239c4d77a60148b1336d277d6056" May 21 20:50:56.128446 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.128393 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" event={"ID":"d095a2d6-b915-4237-9650-32429af2c848","Type":"ContainerDied","Data":"514944d71719954afd7c25f82877e5ba12b7b5d85ba8efe9ed6776f1fe0fc000"} May 21 20:50:56.128564 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.128467 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="514944d71719954afd7c25f82877e5ba12b7b5d85ba8efe9ed6776f1fe0fc000" May 21 20:50:56.128564 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.128390 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k" May 21 20:50:56.261477 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.261453 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" May 21 20:50:56.296777 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.296750 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" May 21 20:50:56.327366 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.327335 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km2t7\" (UniqueName: \"kubernetes.io/projected/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-kube-api-access-km2t7\") pod \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\" (UID: \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\") " May 21 20:50:56.327560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.327409 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-bundle\") pod \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\" (UID: \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\") " May 21 20:50:56.327560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.327443 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rbn4\" (UniqueName: \"kubernetes.io/projected/c50380a1-2c56-45ee-949c-5438dec83bc8-kube-api-access-5rbn4\") pod \"c50380a1-2c56-45ee-949c-5438dec83bc8\" (UID: \"c50380a1-2c56-45ee-949c-5438dec83bc8\") " May 21 20:50:56.327560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.327473 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c50380a1-2c56-45ee-949c-5438dec83bc8-util\") pod \"c50380a1-2c56-45ee-949c-5438dec83bc8\" (UID: \"c50380a1-2c56-45ee-949c-5438dec83bc8\") " May 21 20:50:56.327560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.327500 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-util\") pod \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\" (UID: \"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488\") " May 21 20:50:56.327560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.327530 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c50380a1-2c56-45ee-949c-5438dec83bc8-bundle\") pod \"c50380a1-2c56-45ee-949c-5438dec83bc8\" (UID: \"c50380a1-2c56-45ee-949c-5438dec83bc8\") " May 21 20:50:56.328107 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.327971 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-bundle" (OuterVolumeSpecName: "bundle") pod "a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488" (UID: "a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:50:56.328416 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.328374 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c50380a1-2c56-45ee-949c-5438dec83bc8-bundle" (OuterVolumeSpecName: "bundle") pod "c50380a1-2c56-45ee-949c-5438dec83bc8" (UID: "c50380a1-2c56-45ee-949c-5438dec83bc8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:50:56.330591 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.329930 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-kube-api-access-km2t7" (OuterVolumeSpecName: "kube-api-access-km2t7") pod "a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488" (UID: "a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488"). InnerVolumeSpecName "kube-api-access-km2t7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:50:56.330591 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.330322 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c50380a1-2c56-45ee-949c-5438dec83bc8-kube-api-access-5rbn4" (OuterVolumeSpecName: "kube-api-access-5rbn4") pod "c50380a1-2c56-45ee-949c-5438dec83bc8" (UID: "c50380a1-2c56-45ee-949c-5438dec83bc8"). InnerVolumeSpecName "kube-api-access-5rbn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:50:56.334390 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.334367 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c50380a1-2c56-45ee-949c-5438dec83bc8-util" (OuterVolumeSpecName: "util") pod "c50380a1-2c56-45ee-949c-5438dec83bc8" (UID: "c50380a1-2c56-45ee-949c-5438dec83bc8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:50:56.336335 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.336311 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-util" (OuterVolumeSpecName: "util") pod "a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488" (UID: "a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:50:56.428441 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.428333 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c50380a1-2c56-45ee-949c-5438dec83bc8-bundle\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:56.428441 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.428370 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km2t7\" (UniqueName: \"kubernetes.io/projected/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-kube-api-access-km2t7\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:56.428441 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.428380 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-bundle\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:56.428441 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.428388 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rbn4\" (UniqueName: \"kubernetes.io/projected/c50380a1-2c56-45ee-949c-5438dec83bc8-kube-api-access-5rbn4\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:56.428441 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.428421 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c50380a1-2c56-45ee-949c-5438dec83bc8-util\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:56.428441 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:56.428434 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488-util\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:50:57.134344 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:57.134312 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" May 21 20:50:57.134344 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:57.134316 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7" event={"ID":"a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488","Type":"ContainerDied","Data":"483ca662afd6f6b6217109f9c04c018587b38d8a2620a289fa708a0750c4eb17"} May 21 20:50:57.134344 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:57.134351 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="483ca662afd6f6b6217109f9c04c018587b38d8a2620a289fa708a0750c4eb17" May 21 20:50:57.135982 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:57.135954 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" event={"ID":"c50380a1-2c56-45ee-949c-5438dec83bc8","Type":"ContainerDied","Data":"22ed089afdcfff27f23c00c38fb168eda0139fa4d703ecca53a4a4b0d09dc20e"} May 21 20:50:57.135982 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:57.135981 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22ed089afdcfff27f23c00c38fb168eda0139fa4d703ecca53a4a4b0d09dc20e" May 21 20:50:57.135982 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:50:57.135983 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd" May 21 20:51:14.979088 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979055 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k"] May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979439 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488" containerName="pull" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979452 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488" containerName="pull" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979461 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d095a2d6-b915-4237-9650-32429af2c848" containerName="util" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979466 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d095a2d6-b915-4237-9650-32429af2c848" containerName="util" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979474 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c50380a1-2c56-45ee-949c-5438dec83bc8" containerName="pull" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979480 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c50380a1-2c56-45ee-949c-5438dec83bc8" containerName="pull" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979497 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488" containerName="util" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979502 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488" containerName="util" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979508 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488" containerName="extract" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979513 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488" containerName="extract" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979522 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6661ac5-208a-4616-9ff5-a80b6e2c06b0" containerName="pull" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979528 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6661ac5-208a-4616-9ff5-a80b6e2c06b0" containerName="pull" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979535 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c50380a1-2c56-45ee-949c-5438dec83bc8" containerName="util" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979541 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c50380a1-2c56-45ee-949c-5438dec83bc8" containerName="util" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979547 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6661ac5-208a-4616-9ff5-a80b6e2c06b0" containerName="extract" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979551 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6661ac5-208a-4616-9ff5-a80b6e2c06b0" containerName="extract" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979560 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d095a2d6-b915-4237-9650-32429af2c848" containerName="extract" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979565 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d095a2d6-b915-4237-9650-32429af2c848" containerName="extract" May 21 20:51:14.979560 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979572 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c50380a1-2c56-45ee-949c-5438dec83bc8" containerName="extract" May 21 20:51:14.980172 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979576 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c50380a1-2c56-45ee-949c-5438dec83bc8" containerName="extract" May 21 20:51:14.980172 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979582 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d095a2d6-b915-4237-9650-32429af2c848" containerName="pull" May 21 20:51:14.980172 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979587 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d095a2d6-b915-4237-9650-32429af2c848" containerName="pull" May 21 20:51:14.980172 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979593 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6661ac5-208a-4616-9ff5-a80b6e2c06b0" containerName="util" May 21 20:51:14.980172 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979597 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6661ac5-208a-4616-9ff5-a80b6e2c06b0" containerName="util" May 21 20:51:14.980172 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979651 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488" containerName="extract" May 21 20:51:14.980172 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979658 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="c50380a1-2c56-45ee-949c-5438dec83bc8" containerName="extract" May 21 20:51:14.980172 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979665 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="d095a2d6-b915-4237-9650-32429af2c848" containerName="extract" May 21 20:51:14.980172 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.979672 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="b6661ac5-208a-4616-9ff5-a80b6e2c06b0" containerName="extract" May 21 20:51:14.987321 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.987303 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" May 21 20:51:14.990154 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.990132 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-j22bm\"" May 21 20:51:14.998007 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:14.997984 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k"] May 21 20:51:15.096638 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:15.096592 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8b4q\" (UniqueName: \"kubernetes.io/projected/47259533-2a09-48b6-9193-a3112e05404f-kube-api-access-h8b4q\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7qj9k\" (UID: \"47259533-2a09-48b6-9193-a3112e05404f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" May 21 20:51:15.096638 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:15.096640 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47259533-2a09-48b6-9193-a3112e05404f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7qj9k\" (UID: \"47259533-2a09-48b6-9193-a3112e05404f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" May 21 20:51:15.197161 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:15.197114 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8b4q\" (UniqueName: \"kubernetes.io/projected/47259533-2a09-48b6-9193-a3112e05404f-kube-api-access-h8b4q\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7qj9k\" (UID: \"47259533-2a09-48b6-9193-a3112e05404f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" May 21 20:51:15.197161 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:15.197166 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47259533-2a09-48b6-9193-a3112e05404f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7qj9k\" (UID: \"47259533-2a09-48b6-9193-a3112e05404f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" May 21 20:51:15.197619 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:15.197597 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47259533-2a09-48b6-9193-a3112e05404f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7qj9k\" (UID: \"47259533-2a09-48b6-9193-a3112e05404f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" May 21 20:51:15.210323 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:15.210297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8b4q\" (UniqueName: \"kubernetes.io/projected/47259533-2a09-48b6-9193-a3112e05404f-kube-api-access-h8b4q\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7qj9k\" (UID: \"47259533-2a09-48b6-9193-a3112e05404f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" May 21 20:51:15.298174 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:15.298076 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" May 21 20:51:15.455007 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:15.454974 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k"] May 21 20:51:15.456004 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:51:15.455976 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47259533_2a09_48b6_9193_a3112e05404f.slice/crio-b569c866f781b65abd75653edbddf0ff8ed06e84ce85c0008b89ddce26b4b49c WatchSource:0}: Error finding container b569c866f781b65abd75653edbddf0ff8ed06e84ce85c0008b89ddce26b4b49c: Status 404 returned error can't find the container with id b569c866f781b65abd75653edbddf0ff8ed06e84ce85c0008b89ddce26b4b49c May 21 20:51:16.211561 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:16.211516 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" event={"ID":"47259533-2a09-48b6-9193-a3112e05404f","Type":"ContainerStarted","Data":"b569c866f781b65abd75653edbddf0ff8ed06e84ce85c0008b89ddce26b4b49c"} May 21 20:51:21.236970 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:21.236929 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" event={"ID":"47259533-2a09-48b6-9193-a3112e05404f","Type":"ContainerStarted","Data":"9a0fac1ab9a869d05b65c64555d6a5167465f8a69b59912a1973a732b7f2bd87"} May 21 20:51:21.237360 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:21.237093 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" May 21 20:51:21.257678 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:21.257630 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" podStartSLOduration=2.472608254 podStartE2EDuration="7.257615291s" podCreationTimestamp="2026-05-21 20:51:14 +0000 UTC" firstStartedPulling="2026-05-21 20:51:15.458421952 +0000 UTC m=+766.350284529" lastFinishedPulling="2026-05-21 20:51:20.24342899 +0000 UTC m=+771.135291566" observedRunningTime="2026-05-21 20:51:21.255204584 +0000 UTC m=+772.147067193" watchObservedRunningTime="2026-05-21 20:51:21.257615291 +0000 UTC m=+772.149477889" May 21 20:51:25.498783 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:25.498747 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbb7x"] May 21 20:51:25.502212 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:25.502187 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbb7x" May 21 20:51:25.504809 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:25.504780 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 20:51:25.504924 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:25.504825 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-58c7q\"" May 21 20:51:25.517877 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:25.517847 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbb7x"] May 21 20:51:25.590756 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:25.590717 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gb2m\" (UniqueName: \"kubernetes.io/projected/5ceaf5f0-9d70-4dff-8240-8e7dfc0d8a0a-kube-api-access-8gb2m\") pod \"dns-operator-controller-manager-648d5c98bc-nbb7x\" (UID: \"5ceaf5f0-9d70-4dff-8240-8e7dfc0d8a0a\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbb7x" May 21 20:51:25.691271 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:25.691234 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gb2m\" (UniqueName: \"kubernetes.io/projected/5ceaf5f0-9d70-4dff-8240-8e7dfc0d8a0a-kube-api-access-8gb2m\") pod \"dns-operator-controller-manager-648d5c98bc-nbb7x\" (UID: \"5ceaf5f0-9d70-4dff-8240-8e7dfc0d8a0a\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbb7x" May 21 20:51:25.699607 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:25.699574 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gb2m\" (UniqueName: \"kubernetes.io/projected/5ceaf5f0-9d70-4dff-8240-8e7dfc0d8a0a-kube-api-access-8gb2m\") pod \"dns-operator-controller-manager-648d5c98bc-nbb7x\" (UID: \"5ceaf5f0-9d70-4dff-8240-8e7dfc0d8a0a\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbb7x" May 21 20:51:25.812044 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:25.811959 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbb7x" May 21 20:51:25.950886 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:25.950858 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbb7x"] May 21 20:51:25.952462 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:51:25.952428 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ceaf5f0_9d70_4dff_8240_8e7dfc0d8a0a.slice/crio-5300c2b8afb4485fbcf244547f0e56211466f86797cb633ebf51cb95fc9be848 WatchSource:0}: Error finding container 5300c2b8afb4485fbcf244547f0e56211466f86797cb633ebf51cb95fc9be848: Status 404 returned error can't find the container with id 5300c2b8afb4485fbcf244547f0e56211466f86797cb633ebf51cb95fc9be848 May 21 20:51:26.259769 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:26.259730 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbb7x" event={"ID":"5ceaf5f0-9d70-4dff-8240-8e7dfc0d8a0a","Type":"ContainerStarted","Data":"5300c2b8afb4485fbcf244547f0e56211466f86797cb633ebf51cb95fc9be848"} May 21 20:51:28.270736 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:28.270700 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbb7x" event={"ID":"5ceaf5f0-9d70-4dff-8240-8e7dfc0d8a0a","Type":"ContainerStarted","Data":"f1593fd744884491fc273c938e911ce397097880721d4dde53b7e205ee1720aa"} May 21 20:51:28.271110 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:28.270752 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbb7x" May 21 20:51:28.292868 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:28.292816 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbb7x" podStartSLOduration=1.123062278 podStartE2EDuration="3.292800345s" podCreationTimestamp="2026-05-21 20:51:25 +0000 UTC" firstStartedPulling="2026-05-21 20:51:25.954373473 +0000 UTC m=+776.846236049" lastFinishedPulling="2026-05-21 20:51:28.12411154 +0000 UTC m=+779.015974116" observedRunningTime="2026-05-21 20:51:28.29086961 +0000 UTC m=+779.182732221" watchObservedRunningTime="2026-05-21 20:51:28.292800345 +0000 UTC m=+779.184662942" May 21 20:51:32.243132 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:32.243104 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" May 21 20:51:33.938697 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.938656 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k"] May 21 20:51:33.939220 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.939095 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" podUID="47259533-2a09-48b6-9193-a3112e05404f" containerName="manager" containerID="cri-o://9a0fac1ab9a869d05b65c64555d6a5167465f8a69b59912a1973a732b7f2bd87" gracePeriod=2 May 21 20:51:33.941181 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.941152 2573 status_manager.go:895] "Failed to get status for pod" podUID="47259533-2a09-48b6-9193-a3112e05404f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qj9k\" is forbidden: User \"system:node:ip-10-0-133-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-110.ec2.internal' and this object" May 21 20:51:33.941670 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.941648 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k"] May 21 20:51:33.968598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.965868 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8"] May 21 20:51:33.968598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.966735 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47259533-2a09-48b6-9193-a3112e05404f" containerName="manager" May 21 20:51:33.968598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.966757 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="47259533-2a09-48b6-9193-a3112e05404f" containerName="manager" May 21 20:51:33.968598 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.966921 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="47259533-2a09-48b6-9193-a3112e05404f" containerName="manager" May 21 20:51:33.972743 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.972493 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" May 21 20:51:33.975242 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.975207 2573 status_manager.go:895] "Failed to get status for pod" podUID="47259533-2a09-48b6-9193-a3112e05404f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qj9k\" is forbidden: User \"system:node:ip-10-0-133-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-110.ec2.internal' and this object" May 21 20:51:33.975713 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.975690 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpdtt"] May 21 20:51:33.978156 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.978136 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpdtt" May 21 20:51:33.982920 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.982897 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kdmtx\"" May 21 20:51:33.984754 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.984729 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8"] May 21 20:51:33.992266 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:33.992242 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpdtt"] May 21 20:51:34.005366 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.005333 2573 status_manager.go:895] "Failed to get status for pod" podUID="47259533-2a09-48b6-9193-a3112e05404f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qj9k\" is forbidden: User \"system:node:ip-10-0-133-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-110.ec2.internal' and this object" May 21 20:51:34.074116 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.074081 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr94z\" (UniqueName: \"kubernetes.io/projected/472b3b5b-0fbc-4a62-a96e-6105698ed3b2-kube-api-access-tr94z\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-x8zg8\" (UID: \"472b3b5b-0fbc-4a62-a96e-6105698ed3b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" May 21 20:51:34.074313 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.074139 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6wrz\" (UniqueName: \"kubernetes.io/projected/f3a3bf21-218e-4bf1-baba-4d512d1ea1a7-kube-api-access-n6wrz\") pod \"limitador-operator-controller-manager-85c4996f8c-zpdtt\" (UID: \"f3a3bf21-218e-4bf1-baba-4d512d1ea1a7\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpdtt" May 21 20:51:34.074313 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.074188 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/472b3b5b-0fbc-4a62-a96e-6105698ed3b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-x8zg8\" (UID: \"472b3b5b-0fbc-4a62-a96e-6105698ed3b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" May 21 20:51:34.175341 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.175302 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6wrz\" (UniqueName: \"kubernetes.io/projected/f3a3bf21-218e-4bf1-baba-4d512d1ea1a7-kube-api-access-n6wrz\") pod \"limitador-operator-controller-manager-85c4996f8c-zpdtt\" (UID: \"f3a3bf21-218e-4bf1-baba-4d512d1ea1a7\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpdtt" May 21 20:51:34.175538 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.175368 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/472b3b5b-0fbc-4a62-a96e-6105698ed3b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-x8zg8\" (UID: \"472b3b5b-0fbc-4a62-a96e-6105698ed3b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" May 21 20:51:34.175538 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.175460 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tr94z\" (UniqueName: \"kubernetes.io/projected/472b3b5b-0fbc-4a62-a96e-6105698ed3b2-kube-api-access-tr94z\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-x8zg8\" (UID: \"472b3b5b-0fbc-4a62-a96e-6105698ed3b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" May 21 20:51:34.175847 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.175822 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/472b3b5b-0fbc-4a62-a96e-6105698ed3b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-x8zg8\" (UID: \"472b3b5b-0fbc-4a62-a96e-6105698ed3b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" May 21 20:51:34.183588 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.183559 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr94z\" (UniqueName: \"kubernetes.io/projected/472b3b5b-0fbc-4a62-a96e-6105698ed3b2-kube-api-access-tr94z\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-x8zg8\" (UID: \"472b3b5b-0fbc-4a62-a96e-6105698ed3b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" May 21 20:51:34.183688 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.183597 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6wrz\" (UniqueName: \"kubernetes.io/projected/f3a3bf21-218e-4bf1-baba-4d512d1ea1a7-kube-api-access-n6wrz\") pod \"limitador-operator-controller-manager-85c4996f8c-zpdtt\" (UID: \"f3a3bf21-218e-4bf1-baba-4d512d1ea1a7\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpdtt" May 21 20:51:34.201061 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.200993 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" May 21 20:51:34.203549 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.203519 2573 status_manager.go:895] "Failed to get status for pod" podUID="47259533-2a09-48b6-9193-a3112e05404f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qj9k\" is forbidden: User \"system:node:ip-10-0-133-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-110.ec2.internal' and this object" May 21 20:51:34.295535 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.295502 2573 generic.go:358] "Generic (PLEG): container finished" podID="47259533-2a09-48b6-9193-a3112e05404f" containerID="9a0fac1ab9a869d05b65c64555d6a5167465f8a69b59912a1973a732b7f2bd87" exitCode=0 May 21 20:51:34.295746 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.295564 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" May 21 20:51:34.295746 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.295619 2573 scope.go:117] "RemoveContainer" containerID="9a0fac1ab9a869d05b65c64555d6a5167465f8a69b59912a1973a732b7f2bd87" May 21 20:51:34.298159 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.298131 2573 status_manager.go:895] "Failed to get status for pod" podUID="47259533-2a09-48b6-9193-a3112e05404f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qj9k\" is forbidden: User \"system:node:ip-10-0-133-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-110.ec2.internal' and this object" May 21 20:51:34.304650 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.304632 2573 scope.go:117] "RemoveContainer" containerID="9a0fac1ab9a869d05b65c64555d6a5167465f8a69b59912a1973a732b7f2bd87" May 21 20:51:34.304911 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:51:34.304892 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a0fac1ab9a869d05b65c64555d6a5167465f8a69b59912a1973a732b7f2bd87\": container with ID starting with 9a0fac1ab9a869d05b65c64555d6a5167465f8a69b59912a1973a732b7f2bd87 not found: ID does not exist" containerID="9a0fac1ab9a869d05b65c64555d6a5167465f8a69b59912a1973a732b7f2bd87" May 21 20:51:34.304955 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.304937 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a0fac1ab9a869d05b65c64555d6a5167465f8a69b59912a1973a732b7f2bd87"} err="failed to get container status \"9a0fac1ab9a869d05b65c64555d6a5167465f8a69b59912a1973a732b7f2bd87\": rpc error: code = NotFound desc = could not find container \"9a0fac1ab9a869d05b65c64555d6a5167465f8a69b59912a1973a732b7f2bd87\": container with ID starting with 9a0fac1ab9a869d05b65c64555d6a5167465f8a69b59912a1973a732b7f2bd87 not found: ID does not exist" May 21 20:51:34.317152 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.317128 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" May 21 20:51:34.322900 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.322879 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpdtt" May 21 20:51:34.378476 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.378444 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47259533-2a09-48b6-9193-a3112e05404f-extensions-socket-volume\") pod \"47259533-2a09-48b6-9193-a3112e05404f\" (UID: \"47259533-2a09-48b6-9193-a3112e05404f\") " May 21 20:51:34.378637 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.378621 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8b4q\" (UniqueName: \"kubernetes.io/projected/47259533-2a09-48b6-9193-a3112e05404f-kube-api-access-h8b4q\") pod \"47259533-2a09-48b6-9193-a3112e05404f\" (UID: \"47259533-2a09-48b6-9193-a3112e05404f\") " May 21 20:51:34.379677 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.379645 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47259533-2a09-48b6-9193-a3112e05404f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "47259533-2a09-48b6-9193-a3112e05404f" (UID: "47259533-2a09-48b6-9193-a3112e05404f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:51:34.381838 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.381807 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47259533-2a09-48b6-9193-a3112e05404f-kube-api-access-h8b4q" (OuterVolumeSpecName: "kube-api-access-h8b4q") pod "47259533-2a09-48b6-9193-a3112e05404f" (UID: "47259533-2a09-48b6-9193-a3112e05404f"). InnerVolumeSpecName "kube-api-access-h8b4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:51:34.465677 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.465650 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8"] May 21 20:51:34.466985 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:51:34.466957 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472b3b5b_0fbc_4a62_a96e_6105698ed3b2.slice/crio-1691e006c140abb196031e9ea7e25c31df0c8c7be2f613b33e97a710050d62c7 WatchSource:0}: Error finding container 1691e006c140abb196031e9ea7e25c31df0c8c7be2f613b33e97a710050d62c7: Status 404 returned error can't find the container with id 1691e006c140abb196031e9ea7e25c31df0c8c7be2f613b33e97a710050d62c7 May 21 20:51:34.476848 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.476826 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpdtt"] May 21 20:51:34.479793 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.479773 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8b4q\" (UniqueName: \"kubernetes.io/projected/47259533-2a09-48b6-9193-a3112e05404f-kube-api-access-h8b4q\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:51:34.479889 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.479797 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47259533-2a09-48b6-9193-a3112e05404f-extensions-socket-volume\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:51:34.481825 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:51:34.481802 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a3bf21_218e_4bf1_baba_4d512d1ea1a7.slice/crio-e4813f6a68a43509b495724f96c21e85da7b11eab3ed0a7b11b7f858001c43cb WatchSource:0}: Error finding container e4813f6a68a43509b495724f96c21e85da7b11eab3ed0a7b11b7f858001c43cb: Status 404 returned error can't find the container with id e4813f6a68a43509b495724f96c21e85da7b11eab3ed0a7b11b7f858001c43cb May 21 20:51:34.607167 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:34.607134 2573 status_manager.go:895] "Failed to get status for pod" podUID="47259533-2a09-48b6-9193-a3112e05404f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qj9k\" is forbidden: User \"system:node:ip-10-0-133-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-110.ec2.internal' and this object" May 21 20:51:35.301066 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:35.300961 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" event={"ID":"472b3b5b-0fbc-4a62-a96e-6105698ed3b2","Type":"ContainerStarted","Data":"55bf0adfbe80a220a64a843555af6e1a005d5144780d667fea9bb4d249c37772"} May 21 20:51:35.301066 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:35.301007 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" event={"ID":"472b3b5b-0fbc-4a62-a96e-6105698ed3b2","Type":"ContainerStarted","Data":"1691e006c140abb196031e9ea7e25c31df0c8c7be2f613b33e97a710050d62c7"} May 21 20:51:35.301066 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:35.301024 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" May 21 20:51:35.302986 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:35.302926 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpdtt" event={"ID":"f3a3bf21-218e-4bf1-baba-4d512d1ea1a7","Type":"ContainerStarted","Data":"e4813f6a68a43509b495724f96c21e85da7b11eab3ed0a7b11b7f858001c43cb"} May 21 20:51:35.303093 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:35.303072 2573 status_manager.go:895] "Failed to get status for pod" podUID="47259533-2a09-48b6-9193-a3112e05404f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qj9k" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qj9k\" is forbidden: User \"system:node:ip-10-0-133-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-110.ec2.internal' and this object" May 21 20:51:35.325776 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:35.325722 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" podStartSLOduration=2.32570614 podStartE2EDuration="2.32570614s" podCreationTimestamp="2026-05-21 20:51:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:51:35.321592412 +0000 UTC m=+786.213455010" watchObservedRunningTime="2026-05-21 20:51:35.32570614 +0000 UTC m=+786.217568739" May 21 20:51:35.682227 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:35.682153 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47259533-2a09-48b6-9193-a3112e05404f" path="/var/lib/kubelet/pods/47259533-2a09-48b6-9193-a3112e05404f/volumes" May 21 20:51:36.311347 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:36.311312 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpdtt" event={"ID":"f3a3bf21-218e-4bf1-baba-4d512d1ea1a7","Type":"ContainerStarted","Data":"6adad7ad7b500a73bf0d492df4507637c4fb5e768c8823d78fc218072536f6b6"} May 21 20:51:36.311806 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:36.311556 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpdtt" May 21 20:51:36.332059 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:36.332007 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpdtt" podStartSLOduration=2.116670807 podStartE2EDuration="3.331991704s" podCreationTimestamp="2026-05-21 20:51:33 +0000 UTC" firstStartedPulling="2026-05-21 20:51:34.483519174 +0000 UTC m=+785.375381751" lastFinishedPulling="2026-05-21 20:51:35.698840072 +0000 UTC m=+786.590702648" observedRunningTime="2026-05-21 20:51:36.329906504 +0000 UTC m=+787.221769102" watchObservedRunningTime="2026-05-21 20:51:36.331991704 +0000 UTC m=+787.223854301" May 21 20:51:39.277290 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:39.277251 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbb7x" May 21 20:51:46.314292 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:46.314261 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" May 21 20:51:47.317901 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:47.317867 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpdtt" May 21 20:51:51.210016 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:51.209914 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8"] May 21 20:51:51.210478 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:51.210221 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" podUID="472b3b5b-0fbc-4a62-a96e-6105698ed3b2" containerName="manager" containerID="cri-o://55bf0adfbe80a220a64a843555af6e1a005d5144780d667fea9bb4d249c37772" gracePeriod=10 May 21 20:51:51.779639 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:51.779615 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" May 21 20:51:51.820791 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:51.820753 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/472b3b5b-0fbc-4a62-a96e-6105698ed3b2-extensions-socket-volume\") pod \"472b3b5b-0fbc-4a62-a96e-6105698ed3b2\" (UID: \"472b3b5b-0fbc-4a62-a96e-6105698ed3b2\") " May 21 20:51:51.820979 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:51.820833 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr94z\" (UniqueName: \"kubernetes.io/projected/472b3b5b-0fbc-4a62-a96e-6105698ed3b2-kube-api-access-tr94z\") pod \"472b3b5b-0fbc-4a62-a96e-6105698ed3b2\" (UID: \"472b3b5b-0fbc-4a62-a96e-6105698ed3b2\") " May 21 20:51:51.821128 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:51.821100 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/472b3b5b-0fbc-4a62-a96e-6105698ed3b2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "472b3b5b-0fbc-4a62-a96e-6105698ed3b2" (UID: "472b3b5b-0fbc-4a62-a96e-6105698ed3b2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:51:51.822890 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:51.822855 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/472b3b5b-0fbc-4a62-a96e-6105698ed3b2-kube-api-access-tr94z" (OuterVolumeSpecName: "kube-api-access-tr94z") pod "472b3b5b-0fbc-4a62-a96e-6105698ed3b2" (UID: "472b3b5b-0fbc-4a62-a96e-6105698ed3b2"). InnerVolumeSpecName "kube-api-access-tr94z". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:51:51.921445 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:51.921388 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr94z\" (UniqueName: \"kubernetes.io/projected/472b3b5b-0fbc-4a62-a96e-6105698ed3b2-kube-api-access-tr94z\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:51:51.921445 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:51.921439 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/472b3b5b-0fbc-4a62-a96e-6105698ed3b2-extensions-socket-volume\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:51:52.376242 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:52.376203 2573 generic.go:358] "Generic (PLEG): container finished" podID="472b3b5b-0fbc-4a62-a96e-6105698ed3b2" containerID="55bf0adfbe80a220a64a843555af6e1a005d5144780d667fea9bb4d249c37772" exitCode=0 May 21 20:51:52.376656 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:52.376272 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" May 21 20:51:52.376656 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:52.376292 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" event={"ID":"472b3b5b-0fbc-4a62-a96e-6105698ed3b2","Type":"ContainerDied","Data":"55bf0adfbe80a220a64a843555af6e1a005d5144780d667fea9bb4d249c37772"} May 21 20:51:52.376656 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:52.376340 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8" event={"ID":"472b3b5b-0fbc-4a62-a96e-6105698ed3b2","Type":"ContainerDied","Data":"1691e006c140abb196031e9ea7e25c31df0c8c7be2f613b33e97a710050d62c7"} May 21 20:51:52.376656 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:52.376368 2573 scope.go:117] "RemoveContainer" containerID="55bf0adfbe80a220a64a843555af6e1a005d5144780d667fea9bb4d249c37772" May 21 20:51:52.385993 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:52.385974 2573 scope.go:117] "RemoveContainer" containerID="55bf0adfbe80a220a64a843555af6e1a005d5144780d667fea9bb4d249c37772" May 21 20:51:52.386268 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:51:52.386251 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55bf0adfbe80a220a64a843555af6e1a005d5144780d667fea9bb4d249c37772\": container with ID starting with 55bf0adfbe80a220a64a843555af6e1a005d5144780d667fea9bb4d249c37772 not found: ID does not exist" containerID="55bf0adfbe80a220a64a843555af6e1a005d5144780d667fea9bb4d249c37772" May 21 20:51:52.386351 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:52.386277 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55bf0adfbe80a220a64a843555af6e1a005d5144780d667fea9bb4d249c37772"} err="failed to get container status \"55bf0adfbe80a220a64a843555af6e1a005d5144780d667fea9bb4d249c37772\": rpc error: code = NotFound desc = could not find container \"55bf0adfbe80a220a64a843555af6e1a005d5144780d667fea9bb4d249c37772\": container with ID starting with 55bf0adfbe80a220a64a843555af6e1a005d5144780d667fea9bb4d249c37772 not found: ID does not exist" May 21 20:51:52.401203 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:52.401172 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8"] May 21 20:51:52.404606 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:52.404583 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x8zg8"] May 21 20:51:53.682220 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:51:53.682185 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="472b3b5b-0fbc-4a62-a96e-6105698ed3b2" path="/var/lib/kubelet/pods/472b3b5b-0fbc-4a62-a96e-6105698ed3b2/volumes" May 21 20:52:07.439101 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.439060 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5"] May 21 20:52:07.439543 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.439487 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="472b3b5b-0fbc-4a62-a96e-6105698ed3b2" containerName="manager" May 21 20:52:07.439543 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.439501 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="472b3b5b-0fbc-4a62-a96e-6105698ed3b2" containerName="manager" May 21 20:52:07.439659 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.439592 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="472b3b5b-0fbc-4a62-a96e-6105698ed3b2" containerName="manager" May 21 20:52:07.443270 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.443249 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.445989 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.445959 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fvs5q\"" May 21 20:52:07.456162 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.456139 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5"] May 21 20:52:07.564293 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.564249 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.564482 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.564300 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.564482 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.564375 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.564482 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.564444 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.564482 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.564472 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea7e2add-003c-4daa-9fa5-60dfebaef951-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.564654 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.564491 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea7e2add-003c-4daa-9fa5-60dfebaef951-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.564654 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.564513 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc78v\" (UniqueName: \"kubernetes.io/projected/ea7e2add-003c-4daa-9fa5-60dfebaef951-kube-api-access-hc78v\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.564654 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.564580 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea7e2add-003c-4daa-9fa5-60dfebaef951-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.564654 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.564616 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.665774 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.665735 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.665774 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.665774 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea7e2add-003c-4daa-9fa5-60dfebaef951-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.666044 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.665793 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea7e2add-003c-4daa-9fa5-60dfebaef951-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.666044 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.665814 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hc78v\" (UniqueName: \"kubernetes.io/projected/ea7e2add-003c-4daa-9fa5-60dfebaef951-kube-api-access-hc78v\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.666044 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.665843 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea7e2add-003c-4daa-9fa5-60dfebaef951-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.666044 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.665879 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.666044 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.665959 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.666044 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.665983 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.666044 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.666042 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.666383 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.666211 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.666484 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.666466 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.666543 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.666501 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.666601 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.666572 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.666653 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.666616 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea7e2add-003c-4daa-9fa5-60dfebaef951-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.668749 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.668725 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea7e2add-003c-4daa-9fa5-60dfebaef951-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.669048 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.669026 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea7e2add-003c-4daa-9fa5-60dfebaef951-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.674789 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.674765 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea7e2add-003c-4daa-9fa5-60dfebaef951-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.674900 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.674834 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc78v\" (UniqueName: \"kubernetes.io/projected/ea7e2add-003c-4daa-9fa5-60dfebaef951-kube-api-access-hc78v\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5xpd5\" (UID: \"ea7e2add-003c-4daa-9fa5-60dfebaef951\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.755750 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.755720 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:07.893475 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.893447 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5"] May 21 20:52:07.895243 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:52:07.895208 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea7e2add_003c_4daa_9fa5_60dfebaef951.slice/crio-4a189577b63e4d06948257e8e75d4548ad15226d292171b09f45a014d28d5600 WatchSource:0}: Error finding container 4a189577b63e4d06948257e8e75d4548ad15226d292171b09f45a014d28d5600: Status 404 returned error can't find the container with id 4a189577b63e4d06948257e8e75d4548ad15226d292171b09f45a014d28d5600 May 21 20:52:07.897513 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.897481 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 21 20:52:07.897620 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.897565 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 21 20:52:07.897620 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:07.897606 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 21 20:52:08.449331 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:08.449295 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" event={"ID":"ea7e2add-003c-4daa-9fa5-60dfebaef951","Type":"ContainerStarted","Data":"ed01fd9ff00e0efa5ae52c7e22779ed0486dc095af0430e7bef76c6a890a223c"} May 21 20:52:08.449331 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:08.449333 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" event={"ID":"ea7e2add-003c-4daa-9fa5-60dfebaef951","Type":"ContainerStarted","Data":"4a189577b63e4d06948257e8e75d4548ad15226d292171b09f45a014d28d5600"} May 21 20:52:08.470935 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:08.470877 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" podStartSLOduration=1.470862001 podStartE2EDuration="1.470862001s" podCreationTimestamp="2026-05-21 20:52:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:52:08.469322402 +0000 UTC m=+819.361185001" watchObservedRunningTime="2026-05-21 20:52:08.470862001 +0000 UTC m=+819.362724599" May 21 20:52:08.756076 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:08.756035 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:08.761152 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:08.761125 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:09.459731 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:09.459690 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:09.460900 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:09.460879 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5xpd5" May 21 20:52:11.689118 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:11.689038 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-pb4wj"] May 21 20:52:11.693506 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:11.693485 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" May 21 20:52:11.695995 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:11.695976 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 20:52:11.696082 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:11.696044 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2zgxl\"" May 21 20:52:11.703635 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:11.703612 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-pb4wj"] May 21 20:52:11.786739 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:11.786696 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-pb4wj"] May 21 20:52:11.802938 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:11.802908 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05eb9a37-10ff-4318-b3ec-e6191c19a376-config-file\") pod \"limitador-limitador-7d549b5b-pb4wj\" (UID: \"05eb9a37-10ff-4318-b3ec-e6191c19a376\") " pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" May 21 20:52:11.803132 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:11.802989 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs56k\" (UniqueName: \"kubernetes.io/projected/05eb9a37-10ff-4318-b3ec-e6191c19a376-kube-api-access-zs56k\") pod \"limitador-limitador-7d549b5b-pb4wj\" (UID: \"05eb9a37-10ff-4318-b3ec-e6191c19a376\") " pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" May 21 20:52:11.903533 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:11.903496 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zs56k\" (UniqueName: \"kubernetes.io/projected/05eb9a37-10ff-4318-b3ec-e6191c19a376-kube-api-access-zs56k\") pod \"limitador-limitador-7d549b5b-pb4wj\" (UID: \"05eb9a37-10ff-4318-b3ec-e6191c19a376\") " pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" May 21 20:52:11.903716 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:11.903588 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05eb9a37-10ff-4318-b3ec-e6191c19a376-config-file\") pod \"limitador-limitador-7d549b5b-pb4wj\" (UID: \"05eb9a37-10ff-4318-b3ec-e6191c19a376\") " pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" May 21 20:52:11.904187 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:11.904170 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05eb9a37-10ff-4318-b3ec-e6191c19a376-config-file\") pod \"limitador-limitador-7d549b5b-pb4wj\" (UID: \"05eb9a37-10ff-4318-b3ec-e6191c19a376\") " pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" May 21 20:52:11.911129 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:11.911108 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs56k\" (UniqueName: \"kubernetes.io/projected/05eb9a37-10ff-4318-b3ec-e6191c19a376-kube-api-access-zs56k\") pod \"limitador-limitador-7d549b5b-pb4wj\" (UID: \"05eb9a37-10ff-4318-b3ec-e6191c19a376\") " pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" May 21 20:52:12.003867 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:12.003827 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" May 21 20:52:12.149623 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:12.149593 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-pb4wj"] May 21 20:52:12.152424 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:52:12.152375 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05eb9a37_10ff_4318_b3ec_e6191c19a376.slice/crio-7b5baadd8ac65743d47431fea73fc8883ba8221d96c5a895cb760913ec6bf2bf WatchSource:0}: Error finding container 7b5baadd8ac65743d47431fea73fc8883ba8221d96c5a895cb760913ec6bf2bf: Status 404 returned error can't find the container with id 7b5baadd8ac65743d47431fea73fc8883ba8221d96c5a895cb760913ec6bf2bf May 21 20:52:12.473453 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:12.473389 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" event={"ID":"05eb9a37-10ff-4318-b3ec-e6191c19a376","Type":"ContainerStarted","Data":"7b5baadd8ac65743d47431fea73fc8883ba8221d96c5a895cb760913ec6bf2bf"} May 21 20:52:15.488160 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:15.488123 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" event={"ID":"05eb9a37-10ff-4318-b3ec-e6191c19a376","Type":"ContainerStarted","Data":"32d3f6b355fd0164deaf462a752fde64917d850beedd03feb9f50d45c49707f3"} May 21 20:52:15.488549 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:15.488200 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" May 21 20:52:15.505265 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:15.505206 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" podStartSLOduration=1.6665885089999999 podStartE2EDuration="4.505191836s" podCreationTimestamp="2026-05-21 20:52:11 +0000 UTC" firstStartedPulling="2026-05-21 20:52:12.154262979 +0000 UTC m=+823.046125554" lastFinishedPulling="2026-05-21 20:52:14.992866302 +0000 UTC m=+825.884728881" observedRunningTime="2026-05-21 20:52:15.503035595 +0000 UTC m=+826.394898216" watchObservedRunningTime="2026-05-21 20:52:15.505191836 +0000 UTC m=+826.397054491" May 21 20:52:19.008754 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.008720 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-595b5448d4-wfstz"] May 21 20:52:19.012756 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.012723 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.026020 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.025996 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595b5448d4-wfstz"] May 21 20:52:19.170066 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.170031 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-console-serving-cert\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.170066 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.170073 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-console-config\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.170301 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.170115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-oauth-serving-cert\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.170301 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.170194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-trusted-ca-bundle\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.170301 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.170253 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-service-ca\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.170301 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.170288 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtfld\" (UniqueName: \"kubernetes.io/projected/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-kube-api-access-gtfld\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.170479 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.170310 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-console-oauth-config\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.271025 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.270919 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-console-serving-cert\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.271025 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.270971 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-console-config\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.271025 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.271005 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-oauth-serving-cert\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.271025 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.271029 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-trusted-ca-bundle\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.271373 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.271071 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-service-ca\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.271373 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.271116 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtfld\" (UniqueName: \"kubernetes.io/projected/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-kube-api-access-gtfld\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.271373 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.271143 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-console-oauth-config\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.271942 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.271913 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-console-config\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.272037 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.271939 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-oauth-serving-cert\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.272037 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.271925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-service-ca\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.272104 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.272059 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-trusted-ca-bundle\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.274050 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.274025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-console-oauth-config\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.274150 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.274104 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-console-serving-cert\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.279020 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.278998 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtfld\" (UniqueName: \"kubernetes.io/projected/c631ccf4-b486-4af1-b09b-f6b9ad2e9b10-kube-api-access-gtfld\") pod \"console-595b5448d4-wfstz\" (UID: \"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10\") " pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.321619 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.321587 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:19.455370 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.455342 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595b5448d4-wfstz"] May 21 20:52:19.456550 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:52:19.456526 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc631ccf4_b486_4af1_b09b_f6b9ad2e9b10.slice/crio-3a2d2842894dc39112926118368f61ffc59794bb90096ee9c3cf24f1eab927d2 WatchSource:0}: Error finding container 3a2d2842894dc39112926118368f61ffc59794bb90096ee9c3cf24f1eab927d2: Status 404 returned error can't find the container with id 3a2d2842894dc39112926118368f61ffc59794bb90096ee9c3cf24f1eab927d2 May 21 20:52:19.509346 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:19.509007 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595b5448d4-wfstz" event={"ID":"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10","Type":"ContainerStarted","Data":"3a2d2842894dc39112926118368f61ffc59794bb90096ee9c3cf24f1eab927d2"} May 21 20:52:20.514764 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:20.514726 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595b5448d4-wfstz" event={"ID":"c631ccf4-b486-4af1-b09b-f6b9ad2e9b10","Type":"ContainerStarted","Data":"e2bd7ce3340fd1cea7336274a46cee8c3e870fd26be93953d074ce971b096790"} May 21 20:52:20.533533 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:20.533483 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-595b5448d4-wfstz" podStartSLOduration=2.533467608 podStartE2EDuration="2.533467608s" podCreationTimestamp="2026-05-21 20:52:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:52:20.53154881 +0000 UTC m=+831.423411408" watchObservedRunningTime="2026-05-21 20:52:20.533467608 +0000 UTC m=+831.425330205" May 21 20:52:26.295908 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:26.295871 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-pb4wj"] May 21 20:52:26.296309 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:26.296129 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" podUID="05eb9a37-10ff-4318-b3ec-e6191c19a376" containerName="limitador" containerID="cri-o://32d3f6b355fd0164deaf462a752fde64917d850beedd03feb9f50d45c49707f3" gracePeriod=30 May 21 20:52:26.296849 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:26.296787 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" May 21 20:52:26.850779 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:26.850752 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" May 21 20:52:26.949251 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:26.949164 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs56k\" (UniqueName: \"kubernetes.io/projected/05eb9a37-10ff-4318-b3ec-e6191c19a376-kube-api-access-zs56k\") pod \"05eb9a37-10ff-4318-b3ec-e6191c19a376\" (UID: \"05eb9a37-10ff-4318-b3ec-e6191c19a376\") " May 21 20:52:26.949430 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:26.949285 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05eb9a37-10ff-4318-b3ec-e6191c19a376-config-file\") pod \"05eb9a37-10ff-4318-b3ec-e6191c19a376\" (UID: \"05eb9a37-10ff-4318-b3ec-e6191c19a376\") " May 21 20:52:26.949693 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:26.949669 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05eb9a37-10ff-4318-b3ec-e6191c19a376-config-file" (OuterVolumeSpecName: "config-file") pod "05eb9a37-10ff-4318-b3ec-e6191c19a376" (UID: "05eb9a37-10ff-4318-b3ec-e6191c19a376"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:52:26.951445 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:26.951421 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05eb9a37-10ff-4318-b3ec-e6191c19a376-kube-api-access-zs56k" (OuterVolumeSpecName: "kube-api-access-zs56k") pod "05eb9a37-10ff-4318-b3ec-e6191c19a376" (UID: "05eb9a37-10ff-4318-b3ec-e6191c19a376"). InnerVolumeSpecName "kube-api-access-zs56k". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:52:27.050083 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.050045 2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05eb9a37-10ff-4318-b3ec-e6191c19a376-config-file\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:52:27.050083 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.050077 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs56k\" (UniqueName: \"kubernetes.io/projected/05eb9a37-10ff-4318-b3ec-e6191c19a376-kube-api-access-zs56k\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:52:27.542799 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.542763 2573 generic.go:358] "Generic (PLEG): container finished" podID="05eb9a37-10ff-4318-b3ec-e6191c19a376" containerID="32d3f6b355fd0164deaf462a752fde64917d850beedd03feb9f50d45c49707f3" exitCode=0 May 21 20:52:27.543206 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.542827 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" May 21 20:52:27.543206 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.542834 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" event={"ID":"05eb9a37-10ff-4318-b3ec-e6191c19a376","Type":"ContainerDied","Data":"32d3f6b355fd0164deaf462a752fde64917d850beedd03feb9f50d45c49707f3"} May 21 20:52:27.543206 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.542873 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-pb4wj" event={"ID":"05eb9a37-10ff-4318-b3ec-e6191c19a376","Type":"ContainerDied","Data":"7b5baadd8ac65743d47431fea73fc8883ba8221d96c5a895cb760913ec6bf2bf"} May 21 20:52:27.543206 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.542887 2573 scope.go:117] "RemoveContainer" containerID="32d3f6b355fd0164deaf462a752fde64917d850beedd03feb9f50d45c49707f3" May 21 20:52:27.552185 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.552166 2573 scope.go:117] "RemoveContainer" containerID="32d3f6b355fd0164deaf462a752fde64917d850beedd03feb9f50d45c49707f3" May 21 20:52:27.552467 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:52:27.552426 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32d3f6b355fd0164deaf462a752fde64917d850beedd03feb9f50d45c49707f3\": container with ID starting with 32d3f6b355fd0164deaf462a752fde64917d850beedd03feb9f50d45c49707f3 not found: ID does not exist" containerID="32d3f6b355fd0164deaf462a752fde64917d850beedd03feb9f50d45c49707f3" May 21 20:52:27.552536 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.552480 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32d3f6b355fd0164deaf462a752fde64917d850beedd03feb9f50d45c49707f3"} err="failed to get container status \"32d3f6b355fd0164deaf462a752fde64917d850beedd03feb9f50d45c49707f3\": rpc error: code = NotFound desc = could not find container \"32d3f6b355fd0164deaf462a752fde64917d850beedd03feb9f50d45c49707f3\": container with ID starting with 32d3f6b355fd0164deaf462a752fde64917d850beedd03feb9f50d45c49707f3 not found: ID does not exist" May 21 20:52:27.565425 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.565379 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-pb4wj"] May 21 20:52:27.567779 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.567761 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-pb4wj"] May 21 20:52:27.682088 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.682053 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05eb9a37-10ff-4318-b3ec-e6191c19a376" path="/var/lib/kubelet/pods/05eb9a37-10ff-4318-b3ec-e6191c19a376/volumes" May 21 20:52:27.759501 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.759469 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-t24kj"] May 21 20:52:27.760087 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.760068 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05eb9a37-10ff-4318-b3ec-e6191c19a376" containerName="limitador" May 21 20:52:27.760140 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.760092 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="05eb9a37-10ff-4318-b3ec-e6191c19a376" containerName="limitador" May 21 20:52:27.760198 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.760186 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="05eb9a37-10ff-4318-b3ec-e6191c19a376" containerName="limitador" May 21 20:52:27.765155 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.765133 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-t24kj" May 21 20:52:27.768517 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.768472 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bs4xp\"" May 21 20:52:27.768728 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.768700 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 21 20:52:27.773353 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.773331 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-t24kj"] May 21 20:52:27.959058 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.959033 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ad25bf34-e648-4f9c-a319-789bfea61611-data\") pod \"postgres-68c4fbbd6f-t24kj\" (UID: \"ad25bf34-e648-4f9c-a319-789bfea61611\") " pod="opendatahub/postgres-68c4fbbd6f-t24kj" May 21 20:52:27.959218 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:27.959078 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvtw2\" (UniqueName: \"kubernetes.io/projected/ad25bf34-e648-4f9c-a319-789bfea61611-kube-api-access-jvtw2\") pod \"postgres-68c4fbbd6f-t24kj\" (UID: \"ad25bf34-e648-4f9c-a319-789bfea61611\") " pod="opendatahub/postgres-68c4fbbd6f-t24kj" May 21 20:52:28.059822 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:28.059781 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvtw2\" (UniqueName: \"kubernetes.io/projected/ad25bf34-e648-4f9c-a319-789bfea61611-kube-api-access-jvtw2\") pod \"postgres-68c4fbbd6f-t24kj\" (UID: \"ad25bf34-e648-4f9c-a319-789bfea61611\") " pod="opendatahub/postgres-68c4fbbd6f-t24kj" May 21 20:52:28.060009 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:28.059930 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ad25bf34-e648-4f9c-a319-789bfea61611-data\") pod \"postgres-68c4fbbd6f-t24kj\" (UID: \"ad25bf34-e648-4f9c-a319-789bfea61611\") " pod="opendatahub/postgres-68c4fbbd6f-t24kj" May 21 20:52:28.060311 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:28.060291 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ad25bf34-e648-4f9c-a319-789bfea61611-data\") pod \"postgres-68c4fbbd6f-t24kj\" (UID: \"ad25bf34-e648-4f9c-a319-789bfea61611\") " pod="opendatahub/postgres-68c4fbbd6f-t24kj" May 21 20:52:28.067839 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:28.067815 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvtw2\" (UniqueName: \"kubernetes.io/projected/ad25bf34-e648-4f9c-a319-789bfea61611-kube-api-access-jvtw2\") pod \"postgres-68c4fbbd6f-t24kj\" (UID: \"ad25bf34-e648-4f9c-a319-789bfea61611\") " pod="opendatahub/postgres-68c4fbbd6f-t24kj" May 21 20:52:28.078818 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:28.078789 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-t24kj" May 21 20:52:28.212069 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:28.212044 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-t24kj"] May 21 20:52:28.214144 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:52:28.214109 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad25bf34_e648_4f9c_a319_789bfea61611.slice/crio-45ce24682ff6c64ff9c08f205258dc13f0d409482be0d74d8b9c376058d67581 WatchSource:0}: Error finding container 45ce24682ff6c64ff9c08f205258dc13f0d409482be0d74d8b9c376058d67581: Status 404 returned error can't find the container with id 45ce24682ff6c64ff9c08f205258dc13f0d409482be0d74d8b9c376058d67581 May 21 20:52:28.548826 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:28.548740 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-t24kj" event={"ID":"ad25bf34-e648-4f9c-a319-789bfea61611","Type":"ContainerStarted","Data":"45ce24682ff6c64ff9c08f205258dc13f0d409482be0d74d8b9c376058d67581"} May 21 20:52:29.322026 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:29.321985 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:29.322204 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:29.322040 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:29.327272 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:29.327241 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:29.561945 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:29.561703 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-595b5448d4-wfstz" May 21 20:52:29.608432 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:29.608331 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f469bdf9-tqggb"] May 21 20:52:33.601806 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:33.601780 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 21 20:52:34.586483 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:34.586442 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-t24kj" event={"ID":"ad25bf34-e648-4f9c-a319-789bfea61611","Type":"ContainerStarted","Data":"16bce1d6ad136afcdaa376f7149d51ef6b543755d63175516f51b6f5b6ee928e"} May 21 20:52:34.586699 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:34.586579 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-t24kj" May 21 20:52:34.601749 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:34.601701 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-t24kj" podStartSLOduration=2.218343518 podStartE2EDuration="7.601685236s" podCreationTimestamp="2026-05-21 20:52:27 +0000 UTC" firstStartedPulling="2026-05-21 20:52:28.215494572 +0000 UTC m=+839.107357148" lastFinishedPulling="2026-05-21 20:52:33.598836279 +0000 UTC m=+844.490698866" observedRunningTime="2026-05-21 20:52:34.601234189 +0000 UTC m=+845.493096787" watchObservedRunningTime="2026-05-21 20:52:34.601685236 +0000 UTC m=+845.493547836" May 21 20:52:40.620941 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:40.620905 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-t24kj" May 21 20:52:45.961852 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:45.961814 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7df575f8c9-595lz"] May 21 20:52:46.169850 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.169813 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-595lz"] May 21 20:52:46.170026 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.169891 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-679d84ff8b-57q79"] May 21 20:52:46.170026 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.169976 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-595lz" May 21 20:52:46.172485 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.172450 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 20:52:46.172590 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.172459 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-m7pfq\"" May 21 20:52:46.205790 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.205751 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-679d84ff8b-57q79"] May 21 20:52:46.210416 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.206308 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679d84ff8b-57q79" May 21 20:52:46.229374 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.229340 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk2jk\" (UniqueName: \"kubernetes.io/projected/189a7e63-af3c-4d67-b710-e1daeff3dfad-kube-api-access-dk2jk\") pod \"maas-controller-679d84ff8b-57q79\" (UID: \"189a7e63-af3c-4d67-b710-e1daeff3dfad\") " pod="opendatahub/maas-controller-679d84ff8b-57q79" May 21 20:52:46.229565 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.229542 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdsf8\" (UniqueName: \"kubernetes.io/projected/2ba5b951-34e6-405a-b109-870b5ca72585-kube-api-access-cdsf8\") pod \"maas-controller-7df575f8c9-595lz\" (UID: \"2ba5b951-34e6-405a-b109-870b5ca72585\") " pod="opendatahub/maas-controller-7df575f8c9-595lz" May 21 20:52:46.229790 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.229771 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-595lz"] May 21 20:52:46.230000 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:52:46.229984 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cdsf8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="opendatahub/maas-controller-7df575f8c9-595lz" podUID="2ba5b951-34e6-405a-b109-870b5ca72585" May 21 20:52:46.256660 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.256628 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-567c5cd67d-7947v"] May 21 20:52:46.279930 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.279898 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-567c5cd67d-7947v"] May 21 20:52:46.280075 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.280050 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-567c5cd67d-7947v" May 21 20:52:46.330298 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.330263 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cdsf8\" (UniqueName: \"kubernetes.io/projected/2ba5b951-34e6-405a-b109-870b5ca72585-kube-api-access-cdsf8\") pod \"maas-controller-7df575f8c9-595lz\" (UID: \"2ba5b951-34e6-405a-b109-870b5ca72585\") " pod="opendatahub/maas-controller-7df575f8c9-595lz" May 21 20:52:46.330488 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.330316 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dk2jk\" (UniqueName: \"kubernetes.io/projected/189a7e63-af3c-4d67-b710-e1daeff3dfad-kube-api-access-dk2jk\") pod \"maas-controller-679d84ff8b-57q79\" (UID: \"189a7e63-af3c-4d67-b710-e1daeff3dfad\") " pod="opendatahub/maas-controller-679d84ff8b-57q79" May 21 20:52:46.330488 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.330418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdmls\" (UniqueName: \"kubernetes.io/projected/a60832d9-e9f4-4279-be3a-2f5a18ae073f-kube-api-access-bdmls\") pod \"maas-controller-567c5cd67d-7947v\" (UID: \"a60832d9-e9f4-4279-be3a-2f5a18ae073f\") " pod="opendatahub/maas-controller-567c5cd67d-7947v" May 21 20:52:46.338281 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.338253 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdsf8\" (UniqueName: \"kubernetes.io/projected/2ba5b951-34e6-405a-b109-870b5ca72585-kube-api-access-cdsf8\") pod \"maas-controller-7df575f8c9-595lz\" (UID: \"2ba5b951-34e6-405a-b109-870b5ca72585\") " pod="opendatahub/maas-controller-7df575f8c9-595lz" May 21 20:52:46.339106 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.339083 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk2jk\" (UniqueName: \"kubernetes.io/projected/189a7e63-af3c-4d67-b710-e1daeff3dfad-kube-api-access-dk2jk\") pod \"maas-controller-679d84ff8b-57q79\" (UID: \"189a7e63-af3c-4d67-b710-e1daeff3dfad\") " pod="opendatahub/maas-controller-679d84ff8b-57q79" May 21 20:52:46.431807 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.431768 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bdmls\" (UniqueName: \"kubernetes.io/projected/a60832d9-e9f4-4279-be3a-2f5a18ae073f-kube-api-access-bdmls\") pod \"maas-controller-567c5cd67d-7947v\" (UID: \"a60832d9-e9f4-4279-be3a-2f5a18ae073f\") " pod="opendatahub/maas-controller-567c5cd67d-7947v" May 21 20:52:46.440012 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.439979 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdmls\" (UniqueName: \"kubernetes.io/projected/a60832d9-e9f4-4279-be3a-2f5a18ae073f-kube-api-access-bdmls\") pod \"maas-controller-567c5cd67d-7947v\" (UID: \"a60832d9-e9f4-4279-be3a-2f5a18ae073f\") " pod="opendatahub/maas-controller-567c5cd67d-7947v" May 21 20:52:46.521816 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.521725 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679d84ff8b-57q79" May 21 20:52:46.590342 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.590310 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-567c5cd67d-7947v" May 21 20:52:46.635059 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.635027 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-595lz" May 21 20:52:46.641490 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.641460 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-595lz" May 21 20:52:46.660866 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.660832 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-679d84ff8b-57q79"] May 21 20:52:46.662745 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:52:46.662711 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod189a7e63_af3c_4d67_b710_e1daeff3dfad.slice/crio-99123e773d7e675fba12a1ba9898d7ee9698302a3c8f851ea23a5964a7067f4e WatchSource:0}: Error finding container 99123e773d7e675fba12a1ba9898d7ee9698302a3c8f851ea23a5964a7067f4e: Status 404 returned error can't find the container with id 99123e773d7e675fba12a1ba9898d7ee9698302a3c8f851ea23a5964a7067f4e May 21 20:52:46.733653 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.733627 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-567c5cd67d-7947v"] May 21 20:52:46.734015 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.733996 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdsf8\" (UniqueName: \"kubernetes.io/projected/2ba5b951-34e6-405a-b109-870b5ca72585-kube-api-access-cdsf8\") pod \"2ba5b951-34e6-405a-b109-870b5ca72585\" (UID: \"2ba5b951-34e6-405a-b109-870b5ca72585\") " May 21 20:52:46.735690 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:52:46.735661 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60832d9_e9f4_4279_be3a_2f5a18ae073f.slice/crio-fde9361eb67e5ca11658108a7a648d9b847bed91a1df04806d6bfac880920dc1 WatchSource:0}: Error finding container fde9361eb67e5ca11658108a7a648d9b847bed91a1df04806d6bfac880920dc1: Status 404 returned error can't find the container with id fde9361eb67e5ca11658108a7a648d9b847bed91a1df04806d6bfac880920dc1 May 21 20:52:46.736150 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.736134 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ba5b951-34e6-405a-b109-870b5ca72585-kube-api-access-cdsf8" (OuterVolumeSpecName: "kube-api-access-cdsf8") pod "2ba5b951-34e6-405a-b109-870b5ca72585" (UID: "2ba5b951-34e6-405a-b109-870b5ca72585"). InnerVolumeSpecName "kube-api-access-cdsf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:52:46.835377 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:46.835294 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdsf8\" (UniqueName: \"kubernetes.io/projected/2ba5b951-34e6-405a-b109-870b5ca72585-kube-api-access-cdsf8\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:52:47.644158 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:47.644052 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679d84ff8b-57q79" event={"ID":"189a7e63-af3c-4d67-b710-e1daeff3dfad","Type":"ContainerStarted","Data":"99123e773d7e675fba12a1ba9898d7ee9698302a3c8f851ea23a5964a7067f4e"} May 21 20:52:47.647169 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:47.647139 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-595lz" May 21 20:52:47.647738 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:47.647595 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-567c5cd67d-7947v" event={"ID":"a60832d9-e9f4-4279-be3a-2f5a18ae073f","Type":"ContainerStarted","Data":"fde9361eb67e5ca11658108a7a648d9b847bed91a1df04806d6bfac880920dc1"} May 21 20:52:47.690631 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:47.688688 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-595lz"] May 21 20:52:47.690631 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:47.690434 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-595lz"] May 21 20:52:49.656517 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:49.656430 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679d84ff8b-57q79" event={"ID":"189a7e63-af3c-4d67-b710-e1daeff3dfad","Type":"ContainerStarted","Data":"3e80d7e888cf5d9bbccaff9fc641694118a041f5d83d5a0fb375f9516cc96b9c"} May 21 20:52:49.656517 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:49.656483 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-679d84ff8b-57q79" May 21 20:52:49.658034 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:49.658007 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-567c5cd67d-7947v" event={"ID":"a60832d9-e9f4-4279-be3a-2f5a18ae073f","Type":"ContainerStarted","Data":"92aa17c0da4233f301f52b677a34c5fe6f5ee986e5dbc42d21d9aa2084326b0e"} May 21 20:52:49.658179 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:49.658056 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-567c5cd67d-7947v" May 21 20:52:49.689434 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:49.689374 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ba5b951-34e6-405a-b109-870b5ca72585" path="/var/lib/kubelet/pods/2ba5b951-34e6-405a-b109-870b5ca72585/volumes" May 21 20:52:49.690381 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:49.690337 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-679d84ff8b-57q79" podStartSLOduration=0.987010994 podStartE2EDuration="3.690325391s" podCreationTimestamp="2026-05-21 20:52:46 +0000 UTC" firstStartedPulling="2026-05-21 20:52:46.664245759 +0000 UTC m=+857.556108351" lastFinishedPulling="2026-05-21 20:52:49.367560169 +0000 UTC m=+860.259422748" observedRunningTime="2026-05-21 20:52:49.686653006 +0000 UTC m=+860.578515600" watchObservedRunningTime="2026-05-21 20:52:49.690325391 +0000 UTC m=+860.582187988" May 21 20:52:49.724385 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:49.724327 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-567c5cd67d-7947v" podStartSLOduration=1.083740672 podStartE2EDuration="3.72431285s" podCreationTimestamp="2026-05-21 20:52:46 +0000 UTC" firstStartedPulling="2026-05-21 20:52:46.737620885 +0000 UTC m=+857.629483461" lastFinishedPulling="2026-05-21 20:52:49.378193064 +0000 UTC m=+860.270055639" observedRunningTime="2026-05-21 20:52:49.721663075 +0000 UTC m=+860.613525694" watchObservedRunningTime="2026-05-21 20:52:49.72431285 +0000 UTC m=+860.616175447" May 21 20:52:54.658488 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:54.658424 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5f469bdf9-tqggb" podUID="9a021ec0-c9e2-40dc-8fa2-bbfed32066a5" containerName="console" containerID="cri-o://0f4df66e9ea821cc3121a311622cdd6dbd3ec0a516bdbf8718d578c925fcb028" gracePeriod=15 May 21 20:52:54.908963 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:54.908896 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f469bdf9-tqggb_9a021ec0-c9e2-40dc-8fa2-bbfed32066a5/console/0.log" May 21 20:52:54.908963 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:54.908959 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:52:55.010941 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.010899 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-serving-cert\") pod \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " May 21 20:52:55.011099 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.010976 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b8cp\" (UniqueName: \"kubernetes.io/projected/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-kube-api-access-7b8cp\") pod \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " May 21 20:52:55.011099 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.011032 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-oauth-serving-cert\") pod \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " May 21 20:52:55.011099 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.011048 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-service-ca\") pod \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " May 21 20:52:55.011099 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.011085 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-trusted-ca-bundle\") pod \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " May 21 20:52:55.011296 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.011127 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-config\") pod \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " May 21 20:52:55.011296 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.011151 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-oauth-config\") pod \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\" (UID: \"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5\") " May 21 20:52:55.011530 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.011498 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a021ec0-c9e2-40dc-8fa2-bbfed32066a5" (UID: "9a021ec0-c9e2-40dc-8fa2-bbfed32066a5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:52:55.011654 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.011524 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a021ec0-c9e2-40dc-8fa2-bbfed32066a5" (UID: "9a021ec0-c9e2-40dc-8fa2-bbfed32066a5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:52:55.011654 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.011549 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9a021ec0-c9e2-40dc-8fa2-bbfed32066a5" (UID: "9a021ec0-c9e2-40dc-8fa2-bbfed32066a5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:52:55.011654 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.011631 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-config" (OuterVolumeSpecName: "console-config") pod "9a021ec0-c9e2-40dc-8fa2-bbfed32066a5" (UID: "9a021ec0-c9e2-40dc-8fa2-bbfed32066a5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:52:55.013535 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.013499 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a021ec0-c9e2-40dc-8fa2-bbfed32066a5" (UID: "9a021ec0-c9e2-40dc-8fa2-bbfed32066a5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:52:55.013766 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.013744 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a021ec0-c9e2-40dc-8fa2-bbfed32066a5" (UID: "9a021ec0-c9e2-40dc-8fa2-bbfed32066a5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:52:55.013849 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.013786 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-kube-api-access-7b8cp" (OuterVolumeSpecName: "kube-api-access-7b8cp") pod "9a021ec0-c9e2-40dc-8fa2-bbfed32066a5" (UID: "9a021ec0-c9e2-40dc-8fa2-bbfed32066a5"). InnerVolumeSpecName "kube-api-access-7b8cp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:52:55.112511 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.112466 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b8cp\" (UniqueName: \"kubernetes.io/projected/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-kube-api-access-7b8cp\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:52:55.112511 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.112505 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-oauth-serving-cert\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:52:55.112511 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.112519 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-service-ca\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:52:55.112761 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.112534 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-trusted-ca-bundle\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:52:55.112761 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.112550 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-config\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:52:55.112761 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.112562 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-oauth-config\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:52:55.112761 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.112573 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5-console-serving-cert\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:52:55.688861 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.688824 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f469bdf9-tqggb_9a021ec0-c9e2-40dc-8fa2-bbfed32066a5/console/0.log" May 21 20:52:55.689244 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.688886 2573 generic.go:358] "Generic (PLEG): container finished" podID="9a021ec0-c9e2-40dc-8fa2-bbfed32066a5" containerID="0f4df66e9ea821cc3121a311622cdd6dbd3ec0a516bdbf8718d578c925fcb028" exitCode=2 May 21 20:52:55.689244 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.688974 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f469bdf9-tqggb" event={"ID":"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5","Type":"ContainerDied","Data":"0f4df66e9ea821cc3121a311622cdd6dbd3ec0a516bdbf8718d578c925fcb028"} May 21 20:52:55.689244 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.688990 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f469bdf9-tqggb" May 21 20:52:55.689244 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.689017 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f469bdf9-tqggb" event={"ID":"9a021ec0-c9e2-40dc-8fa2-bbfed32066a5","Type":"ContainerDied","Data":"cf1f9bb64232da6acada44740ca665651d1ffc1a06f1f461e5e81e801b43cd72"} May 21 20:52:55.689244 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.689034 2573 scope.go:117] "RemoveContainer" containerID="0f4df66e9ea821cc3121a311622cdd6dbd3ec0a516bdbf8718d578c925fcb028" May 21 20:52:55.700471 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.700450 2573 scope.go:117] "RemoveContainer" containerID="0f4df66e9ea821cc3121a311622cdd6dbd3ec0a516bdbf8718d578c925fcb028" May 21 20:52:55.700800 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:52:55.700777 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f4df66e9ea821cc3121a311622cdd6dbd3ec0a516bdbf8718d578c925fcb028\": container with ID starting with 0f4df66e9ea821cc3121a311622cdd6dbd3ec0a516bdbf8718d578c925fcb028 not found: ID does not exist" containerID="0f4df66e9ea821cc3121a311622cdd6dbd3ec0a516bdbf8718d578c925fcb028" May 21 20:52:55.700884 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.700813 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f4df66e9ea821cc3121a311622cdd6dbd3ec0a516bdbf8718d578c925fcb028"} err="failed to get container status \"0f4df66e9ea821cc3121a311622cdd6dbd3ec0a516bdbf8718d578c925fcb028\": rpc error: code = NotFound desc = could not find container \"0f4df66e9ea821cc3121a311622cdd6dbd3ec0a516bdbf8718d578c925fcb028\": container with ID starting with 0f4df66e9ea821cc3121a311622cdd6dbd3ec0a516bdbf8718d578c925fcb028 not found: ID does not exist" May 21 20:52:55.714221 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.714187 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f469bdf9-tqggb"] May 21 20:52:55.717572 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:55.717540 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f469bdf9-tqggb"] May 21 20:52:57.683304 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:52:57.683269 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a021ec0-c9e2-40dc-8fa2-bbfed32066a5" path="/var/lib/kubelet/pods/9a021ec0-c9e2-40dc-8fa2-bbfed32066a5/volumes" May 21 20:53:00.667368 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:00.667338 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-679d84ff8b-57q79" May 21 20:53:00.667837 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:00.667389 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-567c5cd67d-7947v" May 21 20:53:00.722311 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:00.722271 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-679d84ff8b-57q79"] May 21 20:53:00.722545 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:00.722502 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-679d84ff8b-57q79" podUID="189a7e63-af3c-4d67-b710-e1daeff3dfad" containerName="manager" containerID="cri-o://3e80d7e888cf5d9bbccaff9fc641694118a041f5d83d5a0fb375f9516cc96b9c" gracePeriod=30 May 21 20:53:00.902992 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:00.902950 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5958649c76-8p265"] May 21 20:53:00.903536 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:00.903513 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a021ec0-c9e2-40dc-8fa2-bbfed32066a5" containerName="console" May 21 20:53:00.903536 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:00.903538 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a021ec0-c9e2-40dc-8fa2-bbfed32066a5" containerName="console" May 21 20:53:00.903702 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:00.903620 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a021ec0-c9e2-40dc-8fa2-bbfed32066a5" containerName="console" May 21 20:53:00.905652 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:00.905630 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5958649c76-8p265" May 21 20:53:00.912453 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:00.912424 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5958649c76-8p265"] May 21 20:53:00.974200 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:00.974169 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7nlk\" (UniqueName: \"kubernetes.io/projected/118e2d5e-3106-4502-8fae-f70aad686be9-kube-api-access-j7nlk\") pod \"maas-controller-5958649c76-8p265\" (UID: \"118e2d5e-3106-4502-8fae-f70aad686be9\") " pod="opendatahub/maas-controller-5958649c76-8p265" May 21 20:53:00.975068 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:00.975030 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679d84ff8b-57q79" May 21 20:53:01.074909 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.074868 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dk2jk\" (UniqueName: \"kubernetes.io/projected/189a7e63-af3c-4d67-b710-e1daeff3dfad-kube-api-access-dk2jk\") pod \"189a7e63-af3c-4d67-b710-e1daeff3dfad\" (UID: \"189a7e63-af3c-4d67-b710-e1daeff3dfad\") " May 21 20:53:01.075105 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.075071 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7nlk\" (UniqueName: \"kubernetes.io/projected/118e2d5e-3106-4502-8fae-f70aad686be9-kube-api-access-j7nlk\") pod \"maas-controller-5958649c76-8p265\" (UID: \"118e2d5e-3106-4502-8fae-f70aad686be9\") " pod="opendatahub/maas-controller-5958649c76-8p265" May 21 20:53:01.077205 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.077171 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/189a7e63-af3c-4d67-b710-e1daeff3dfad-kube-api-access-dk2jk" (OuterVolumeSpecName: "kube-api-access-dk2jk") pod "189a7e63-af3c-4d67-b710-e1daeff3dfad" (UID: "189a7e63-af3c-4d67-b710-e1daeff3dfad"). InnerVolumeSpecName "kube-api-access-dk2jk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:53:01.084034 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.084008 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7nlk\" (UniqueName: \"kubernetes.io/projected/118e2d5e-3106-4502-8fae-f70aad686be9-kube-api-access-j7nlk\") pod \"maas-controller-5958649c76-8p265\" (UID: \"118e2d5e-3106-4502-8fae-f70aad686be9\") " pod="opendatahub/maas-controller-5958649c76-8p265" May 21 20:53:01.175667 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.175627 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dk2jk\" (UniqueName: \"kubernetes.io/projected/189a7e63-af3c-4d67-b710-e1daeff3dfad-kube-api-access-dk2jk\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:53:01.219725 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.219685 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5958649c76-8p265" May 21 20:53:01.355282 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.355253 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5958649c76-8p265"] May 21 20:53:01.356727 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:53:01.356687 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118e2d5e_3106_4502_8fae_f70aad686be9.slice/crio-89198651a13aa6dd26dd356cc84a36e696e26168ab87befb22b2a4f7e9b50ada WatchSource:0}: Error finding container 89198651a13aa6dd26dd356cc84a36e696e26168ab87befb22b2a4f7e9b50ada: Status 404 returned error can't find the container with id 89198651a13aa6dd26dd356cc84a36e696e26168ab87befb22b2a4f7e9b50ada May 21 20:53:01.358250 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.358230 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:53:01.716950 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.716901 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5958649c76-8p265" event={"ID":"118e2d5e-3106-4502-8fae-f70aad686be9","Type":"ContainerStarted","Data":"89198651a13aa6dd26dd356cc84a36e696e26168ab87befb22b2a4f7e9b50ada"} May 21 20:53:01.718256 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.718229 2573 generic.go:358] "Generic (PLEG): container finished" podID="189a7e63-af3c-4d67-b710-e1daeff3dfad" containerID="3e80d7e888cf5d9bbccaff9fc641694118a041f5d83d5a0fb375f9516cc96b9c" exitCode=0 May 21 20:53:01.718375 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.718286 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679d84ff8b-57q79" May 21 20:53:01.718375 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.718314 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679d84ff8b-57q79" event={"ID":"189a7e63-af3c-4d67-b710-e1daeff3dfad","Type":"ContainerDied","Data":"3e80d7e888cf5d9bbccaff9fc641694118a041f5d83d5a0fb375f9516cc96b9c"} May 21 20:53:01.718375 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.718350 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679d84ff8b-57q79" event={"ID":"189a7e63-af3c-4d67-b710-e1daeff3dfad","Type":"ContainerDied","Data":"99123e773d7e675fba12a1ba9898d7ee9698302a3c8f851ea23a5964a7067f4e"} May 21 20:53:01.718375 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.718366 2573 scope.go:117] "RemoveContainer" containerID="3e80d7e888cf5d9bbccaff9fc641694118a041f5d83d5a0fb375f9516cc96b9c" May 21 20:53:01.727468 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:53:01.727442 2573 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118e2d5e_3106_4502_8fae_f70aad686be9.slice/crio-d5963dcf4413b1d2dda63d09c5900984fb7ecc736c14469f3a293a193b9914e8.scope\": RecentStats: unable to find data in memory cache]" May 21 20:53:01.728181 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.728026 2573 scope.go:117] "RemoveContainer" containerID="3e80d7e888cf5d9bbccaff9fc641694118a041f5d83d5a0fb375f9516cc96b9c" May 21 20:53:01.728314 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:53:01.728294 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e80d7e888cf5d9bbccaff9fc641694118a041f5d83d5a0fb375f9516cc96b9c\": container with ID starting with 3e80d7e888cf5d9bbccaff9fc641694118a041f5d83d5a0fb375f9516cc96b9c not found: ID does not exist" containerID="3e80d7e888cf5d9bbccaff9fc641694118a041f5d83d5a0fb375f9516cc96b9c" May 21 20:53:01.728391 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.728322 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e80d7e888cf5d9bbccaff9fc641694118a041f5d83d5a0fb375f9516cc96b9c"} err="failed to get container status \"3e80d7e888cf5d9bbccaff9fc641694118a041f5d83d5a0fb375f9516cc96b9c\": rpc error: code = NotFound desc = could not find container \"3e80d7e888cf5d9bbccaff9fc641694118a041f5d83d5a0fb375f9516cc96b9c\": container with ID starting with 3e80d7e888cf5d9bbccaff9fc641694118a041f5d83d5a0fb375f9516cc96b9c not found: ID does not exist" May 21 20:53:01.736346 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.736318 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-679d84ff8b-57q79"] May 21 20:53:01.740381 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:01.740355 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-679d84ff8b-57q79"] May 21 20:53:02.724581 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:02.724544 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5958649c76-8p265" event={"ID":"118e2d5e-3106-4502-8fae-f70aad686be9","Type":"ContainerStarted","Data":"d5963dcf4413b1d2dda63d09c5900984fb7ecc736c14469f3a293a193b9914e8"} May 21 20:53:02.724969 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:02.724666 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5958649c76-8p265" May 21 20:53:02.741740 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:02.741684 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5958649c76-8p265" podStartSLOduration=2.416308558 podStartE2EDuration="2.741667893s" podCreationTimestamp="2026-05-21 20:53:00 +0000 UTC" firstStartedPulling="2026-05-21 20:53:01.358431024 +0000 UTC m=+872.250293600" lastFinishedPulling="2026-05-21 20:53:01.68379036 +0000 UTC m=+872.575652935" observedRunningTime="2026-05-21 20:53:02.740061268 +0000 UTC m=+873.631923866" watchObservedRunningTime="2026-05-21 20:53:02.741667893 +0000 UTC m=+873.633530491" May 21 20:53:03.683026 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:03.682995 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="189a7e63-af3c-4d67-b710-e1daeff3dfad" path="/var/lib/kubelet/pods/189a7e63-af3c-4d67-b710-e1daeff3dfad/volumes" May 21 20:53:13.734662 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:13.734633 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5958649c76-8p265" May 21 20:53:13.773718 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:13.773682 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-567c5cd67d-7947v"] May 21 20:53:13.773941 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:13.773919 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-567c5cd67d-7947v" podUID="a60832d9-e9f4-4279-be3a-2f5a18ae073f" containerName="manager" containerID="cri-o://92aa17c0da4233f301f52b677a34c5fe6f5ee986e5dbc42d21d9aa2084326b0e" gracePeriod=30 May 21 20:53:14.020855 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:14.020826 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-567c5cd67d-7947v" May 21 20:53:14.200659 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:14.200619 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdmls\" (UniqueName: \"kubernetes.io/projected/a60832d9-e9f4-4279-be3a-2f5a18ae073f-kube-api-access-bdmls\") pod \"a60832d9-e9f4-4279-be3a-2f5a18ae073f\" (UID: \"a60832d9-e9f4-4279-be3a-2f5a18ae073f\") " May 21 20:53:14.202698 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:14.202673 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a60832d9-e9f4-4279-be3a-2f5a18ae073f-kube-api-access-bdmls" (OuterVolumeSpecName: "kube-api-access-bdmls") pod "a60832d9-e9f4-4279-be3a-2f5a18ae073f" (UID: "a60832d9-e9f4-4279-be3a-2f5a18ae073f"). InnerVolumeSpecName "kube-api-access-bdmls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:53:14.301929 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:14.301824 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdmls\" (UniqueName: \"kubernetes.io/projected/a60832d9-e9f4-4279-be3a-2f5a18ae073f-kube-api-access-bdmls\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:53:14.774380 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:14.774344 2573 generic.go:358] "Generic (PLEG): container finished" podID="a60832d9-e9f4-4279-be3a-2f5a18ae073f" containerID="92aa17c0da4233f301f52b677a34c5fe6f5ee986e5dbc42d21d9aa2084326b0e" exitCode=0 May 21 20:53:14.774839 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:14.774422 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-567c5cd67d-7947v" May 21 20:53:14.774839 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:14.774428 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-567c5cd67d-7947v" event={"ID":"a60832d9-e9f4-4279-be3a-2f5a18ae073f","Type":"ContainerDied","Data":"92aa17c0da4233f301f52b677a34c5fe6f5ee986e5dbc42d21d9aa2084326b0e"} May 21 20:53:14.774839 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:14.774469 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-567c5cd67d-7947v" event={"ID":"a60832d9-e9f4-4279-be3a-2f5a18ae073f","Type":"ContainerDied","Data":"fde9361eb67e5ca11658108a7a648d9b847bed91a1df04806d6bfac880920dc1"} May 21 20:53:14.774839 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:14.774490 2573 scope.go:117] "RemoveContainer" containerID="92aa17c0da4233f301f52b677a34c5fe6f5ee986e5dbc42d21d9aa2084326b0e" May 21 20:53:14.783576 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:14.783558 2573 scope.go:117] "RemoveContainer" containerID="92aa17c0da4233f301f52b677a34c5fe6f5ee986e5dbc42d21d9aa2084326b0e" May 21 20:53:14.783834 ip-10-0-133-110 kubenswrapper[2573]: E0521 20:53:14.783815 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92aa17c0da4233f301f52b677a34c5fe6f5ee986e5dbc42d21d9aa2084326b0e\": container with ID starting with 92aa17c0da4233f301f52b677a34c5fe6f5ee986e5dbc42d21d9aa2084326b0e not found: ID does not exist" containerID="92aa17c0da4233f301f52b677a34c5fe6f5ee986e5dbc42d21d9aa2084326b0e" May 21 20:53:14.783875 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:14.783842 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92aa17c0da4233f301f52b677a34c5fe6f5ee986e5dbc42d21d9aa2084326b0e"} err="failed to get container status \"92aa17c0da4233f301f52b677a34c5fe6f5ee986e5dbc42d21d9aa2084326b0e\": rpc error: code = NotFound desc = could not find container \"92aa17c0da4233f301f52b677a34c5fe6f5ee986e5dbc42d21d9aa2084326b0e\": container with ID starting with 92aa17c0da4233f301f52b677a34c5fe6f5ee986e5dbc42d21d9aa2084326b0e not found: ID does not exist" May 21 20:53:14.796095 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:14.796070 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-567c5cd67d-7947v"] May 21 20:53:14.798534 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:14.798510 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-567c5cd67d-7947v"] May 21 20:53:15.682370 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:15.682331 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a60832d9-e9f4-4279-be3a-2f5a18ae073f" path="/var/lib/kubelet/pods/a60832d9-e9f4-4279-be3a-2f5a18ae073f/volumes" May 21 20:53:29.627782 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:29.627702 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 20:53:29.628917 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:29.628892 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 20:53:36.658996 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.658961 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7bf4848f9b-rl4j4"] May 21 20:53:36.659377 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.659357 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="189a7e63-af3c-4d67-b710-e1daeff3dfad" containerName="manager" May 21 20:53:36.659377 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.659369 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="189a7e63-af3c-4d67-b710-e1daeff3dfad" containerName="manager" May 21 20:53:36.659496 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.659415 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60832d9-e9f4-4279-be3a-2f5a18ae073f" containerName="manager" May 21 20:53:36.659496 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.659421 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60832d9-e9f4-4279-be3a-2f5a18ae073f" containerName="manager" May 21 20:53:36.659496 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.659486 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="189a7e63-af3c-4d67-b710-e1daeff3dfad" containerName="manager" May 21 20:53:36.659496 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.659494 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="a60832d9-e9f4-4279-be3a-2f5a18ae073f" containerName="manager" May 21 20:53:36.664314 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.664297 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7bf4848f9b-rl4j4" May 21 20:53:36.666802 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.666777 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 20:53:36.666920 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.666838 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-q858m\"" May 21 20:53:36.672850 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.672777 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7bf4848f9b-rl4j4"] May 21 20:53:36.700235 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.700204 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/353ee7b9-e070-41c2-89f2-1e44809972fc-maas-api-tls\") pod \"maas-api-7bf4848f9b-rl4j4\" (UID: \"353ee7b9-e070-41c2-89f2-1e44809972fc\") " pod="opendatahub/maas-api-7bf4848f9b-rl4j4" May 21 20:53:36.700424 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.700248 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttv4q\" (UniqueName: \"kubernetes.io/projected/353ee7b9-e070-41c2-89f2-1e44809972fc-kube-api-access-ttv4q\") pod \"maas-api-7bf4848f9b-rl4j4\" (UID: \"353ee7b9-e070-41c2-89f2-1e44809972fc\") " pod="opendatahub/maas-api-7bf4848f9b-rl4j4" May 21 20:53:36.801524 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.801492 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/353ee7b9-e070-41c2-89f2-1e44809972fc-maas-api-tls\") pod \"maas-api-7bf4848f9b-rl4j4\" (UID: \"353ee7b9-e070-41c2-89f2-1e44809972fc\") " pod="opendatahub/maas-api-7bf4848f9b-rl4j4" May 21 20:53:36.801691 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.801561 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttv4q\" (UniqueName: \"kubernetes.io/projected/353ee7b9-e070-41c2-89f2-1e44809972fc-kube-api-access-ttv4q\") pod \"maas-api-7bf4848f9b-rl4j4\" (UID: \"353ee7b9-e070-41c2-89f2-1e44809972fc\") " pod="opendatahub/maas-api-7bf4848f9b-rl4j4" May 21 20:53:36.804015 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.803990 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/353ee7b9-e070-41c2-89f2-1e44809972fc-maas-api-tls\") pod \"maas-api-7bf4848f9b-rl4j4\" (UID: \"353ee7b9-e070-41c2-89f2-1e44809972fc\") " pod="opendatahub/maas-api-7bf4848f9b-rl4j4" May 21 20:53:36.810631 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.810607 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttv4q\" (UniqueName: \"kubernetes.io/projected/353ee7b9-e070-41c2-89f2-1e44809972fc-kube-api-access-ttv4q\") pod \"maas-api-7bf4848f9b-rl4j4\" (UID: \"353ee7b9-e070-41c2-89f2-1e44809972fc\") " pod="opendatahub/maas-api-7bf4848f9b-rl4j4" May 21 20:53:36.976917 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:36.976880 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7bf4848f9b-rl4j4" May 21 20:53:37.119868 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:37.119836 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-n4ns7"] May 21 20:53:37.124297 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:37.124275 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-n4ns7" May 21 20:53:37.126781 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:37.126761 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 20:53:37.126890 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:37.126775 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-smxcs\"" May 21 20:53:37.134801 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:37.134777 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-n4ns7"] May 21 20:53:37.135823 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:53:37.135782 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod353ee7b9_e070_41c2_89f2_1e44809972fc.slice/crio-e7e7dddfeb169a518603fbf78826f41e908e513d77cc7a1c3b979af0007332df WatchSource:0}: Error finding container e7e7dddfeb169a518603fbf78826f41e908e513d77cc7a1c3b979af0007332df: Status 404 returned error can't find the container with id e7e7dddfeb169a518603fbf78826f41e908e513d77cc7a1c3b979af0007332df May 21 20:53:37.138086 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:37.138009 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7bf4848f9b-rl4j4"] May 21 20:53:37.206803 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:37.206767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbrvj\" (UniqueName: \"kubernetes.io/projected/e7b03cae-5d06-47fc-b088-72afec8b66f6-kube-api-access-zbrvj\") pod \"payload-processing-58b6c8fdc7-n4ns7\" (UID: \"e7b03cae-5d06-47fc-b088-72afec8b66f6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-n4ns7" May 21 20:53:37.307743 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:37.307646 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbrvj\" (UniqueName: \"kubernetes.io/projected/e7b03cae-5d06-47fc-b088-72afec8b66f6-kube-api-access-zbrvj\") pod \"payload-processing-58b6c8fdc7-n4ns7\" (UID: \"e7b03cae-5d06-47fc-b088-72afec8b66f6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-n4ns7" May 21 20:53:37.318207 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:37.318180 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbrvj\" (UniqueName: \"kubernetes.io/projected/e7b03cae-5d06-47fc-b088-72afec8b66f6-kube-api-access-zbrvj\") pod \"payload-processing-58b6c8fdc7-n4ns7\" (UID: \"e7b03cae-5d06-47fc-b088-72afec8b66f6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-n4ns7" May 21 20:53:37.436901 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:37.436866 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-n4ns7" May 21 20:53:37.573190 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:37.573166 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-n4ns7"] May 21 20:53:37.575021 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:53:37.574994 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b03cae_5d06_47fc_b088_72afec8b66f6.slice/crio-1ffc3e44ad0581d4cc0f1f0f5ce924b7eaa43c764b869ec7801f8e0ca22c6686 WatchSource:0}: Error finding container 1ffc3e44ad0581d4cc0f1f0f5ce924b7eaa43c764b869ec7801f8e0ca22c6686: Status 404 returned error can't find the container with id 1ffc3e44ad0581d4cc0f1f0f5ce924b7eaa43c764b869ec7801f8e0ca22c6686 May 21 20:53:37.869156 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:37.869061 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-n4ns7" event={"ID":"e7b03cae-5d06-47fc-b088-72afec8b66f6","Type":"ContainerStarted","Data":"1ffc3e44ad0581d4cc0f1f0f5ce924b7eaa43c764b869ec7801f8e0ca22c6686"} May 21 20:53:37.870187 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:37.870162 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7bf4848f9b-rl4j4" event={"ID":"353ee7b9-e070-41c2-89f2-1e44809972fc","Type":"ContainerStarted","Data":"e7e7dddfeb169a518603fbf78826f41e908e513d77cc7a1c3b979af0007332df"} May 21 20:53:39.881983 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:39.881928 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7bf4848f9b-rl4j4" event={"ID":"353ee7b9-e070-41c2-89f2-1e44809972fc","Type":"ContainerStarted","Data":"8322c6f5d334f317d73ad7b614112c7c003188e9d9d814c378d32076eb2528af"} May 21 20:53:39.882454 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:39.882144 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7bf4848f9b-rl4j4" May 21 20:53:39.899270 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:39.899207 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-7bf4848f9b-rl4j4" podStartSLOduration=1.8687391249999998 podStartE2EDuration="3.899187291s" podCreationTimestamp="2026-05-21 20:53:36 +0000 UTC" firstStartedPulling="2026-05-21 20:53:37.137679752 +0000 UTC m=+908.029542327" lastFinishedPulling="2026-05-21 20:53:39.168127903 +0000 UTC m=+910.059990493" observedRunningTime="2026-05-21 20:53:39.897303394 +0000 UTC m=+910.789165992" watchObservedRunningTime="2026-05-21 20:53:39.899187291 +0000 UTC m=+910.791049894" May 21 20:53:40.887817 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:40.887712 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-n4ns7" event={"ID":"e7b03cae-5d06-47fc-b088-72afec8b66f6","Type":"ContainerStarted","Data":"edd2d49b96963b89a4d1ed3cf9eb0989a938d30a2c27ca672336596a9ff5b808"} May 21 20:53:40.888195 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:40.888058 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-n4ns7" May 21 20:53:40.904100 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:40.904051 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-n4ns7" podStartSLOduration=0.916460713 podStartE2EDuration="3.904037028s" podCreationTimestamp="2026-05-21 20:53:37 +0000 UTC" firstStartedPulling="2026-05-21 20:53:37.57680848 +0000 UTC m=+908.468671057" lastFinishedPulling="2026-05-21 20:53:40.56438478 +0000 UTC m=+911.456247372" observedRunningTime="2026-05-21 20:53:40.902390229 +0000 UTC m=+911.794252827" watchObservedRunningTime="2026-05-21 20:53:40.904037028 +0000 UTC m=+911.795899625" May 21 20:53:45.893576 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:45.893543 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7bf4848f9b-rl4j4" May 21 20:53:51.893601 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:53:51.893569 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-n4ns7" May 21 20:54:06.320959 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.320916 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch"] May 21 20:54:06.325975 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.325949 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.328650 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.328624 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 20:54:06.328850 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.328801 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7vwml\"" May 21 20:54:06.329649 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.329617 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 21 20:54:06.329649 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.329641 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 20:54:06.330928 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.330905 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch"] May 21 20:54:06.483617 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.483582 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/913f56ea-8804-4c67-b55c-bd12e9fc759c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.483840 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.483639 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/913f56ea-8804-4c67-b55c-bd12e9fc759c-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.483840 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.483721 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jphcf\" (UniqueName: \"kubernetes.io/projected/913f56ea-8804-4c67-b55c-bd12e9fc759c-kube-api-access-jphcf\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.483840 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.483756 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/913f56ea-8804-4c67-b55c-bd12e9fc759c-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.483840 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.483785 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/913f56ea-8804-4c67-b55c-bd12e9fc759c-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.483840 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.483829 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/913f56ea-8804-4c67-b55c-bd12e9fc759c-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.584881 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.584785 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/913f56ea-8804-4c67-b55c-bd12e9fc759c-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.584881 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.584840 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/913f56ea-8804-4c67-b55c-bd12e9fc759c-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.585132 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.584889 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/913f56ea-8804-4c67-b55c-bd12e9fc759c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.585132 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.584917 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/913f56ea-8804-4c67-b55c-bd12e9fc759c-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.585132 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.585054 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jphcf\" (UniqueName: \"kubernetes.io/projected/913f56ea-8804-4c67-b55c-bd12e9fc759c-kube-api-access-jphcf\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.585132 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.585091 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/913f56ea-8804-4c67-b55c-bd12e9fc759c-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.585357 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.585210 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/913f56ea-8804-4c67-b55c-bd12e9fc759c-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.585357 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.585265 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/913f56ea-8804-4c67-b55c-bd12e9fc759c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.585481 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.585393 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/913f56ea-8804-4c67-b55c-bd12e9fc759c-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.587202 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.587183 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/913f56ea-8804-4c67-b55c-bd12e9fc759c-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.587421 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.587386 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/913f56ea-8804-4c67-b55c-bd12e9fc759c-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.592601 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.592578 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jphcf\" (UniqueName: \"kubernetes.io/projected/913f56ea-8804-4c67-b55c-bd12e9fc759c-kube-api-access-jphcf\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch\" (UID: \"913f56ea-8804-4c67-b55c-bd12e9fc759c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.639530 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.639485 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:06.784467 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.780561 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch"] May 21 20:54:07.000009 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:06.999951 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" event={"ID":"913f56ea-8804-4c67-b55c-bd12e9fc759c","Type":"ContainerStarted","Data":"e987285d2aeb78892548f6db11c9e89ccf8168d8ee10d90fb80ad03e1457ee81"} May 21 20:54:12.024142 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:12.024105 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" event={"ID":"913f56ea-8804-4c67-b55c-bd12e9fc759c","Type":"ContainerStarted","Data":"f0ca234fdb869d180509c410ce992e2fcbd9e3d2755bdfea861ed69d87ff5b70"} May 21 20:54:18.051457 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:18.051394 2573 generic.go:358] "Generic (PLEG): container finished" podID="913f56ea-8804-4c67-b55c-bd12e9fc759c" containerID="f0ca234fdb869d180509c410ce992e2fcbd9e3d2755bdfea861ed69d87ff5b70" exitCode=0 May 21 20:54:18.051457 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:18.051442 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" event={"ID":"913f56ea-8804-4c67-b55c-bd12e9fc759c","Type":"ContainerDied","Data":"f0ca234fdb869d180509c410ce992e2fcbd9e3d2755bdfea861ed69d87ff5b70"} May 21 20:54:20.062472 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:20.062426 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" event={"ID":"913f56ea-8804-4c67-b55c-bd12e9fc759c","Type":"ContainerStarted","Data":"71edeb77c1f41ec2b3f30653caef142b860b4fd0ca405ce312d3f94b05fcdaac"} May 21 20:54:20.062859 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:20.062655 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:54:20.080603 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:20.080550 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" podStartSLOduration=1.757941942 podStartE2EDuration="14.08053445s" podCreationTimestamp="2026-05-21 20:54:06 +0000 UTC" firstStartedPulling="2026-05-21 20:54:06.788295433 +0000 UTC m=+937.680158037" lastFinishedPulling="2026-05-21 20:54:19.11088797 +0000 UTC m=+950.002750545" observedRunningTime="2026-05-21 20:54:20.079130048 +0000 UTC m=+950.970992671" watchObservedRunningTime="2026-05-21 20:54:20.08053445 +0000 UTC m=+950.972397085" May 21 20:54:31.079895 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:54:31.079856 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch" May 21 20:56:27.492737 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:27.492654 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5958649c76-8p265"] May 21 20:56:27.493189 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:27.492881 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5958649c76-8p265" podUID="118e2d5e-3106-4502-8fae-f70aad686be9" containerName="manager" containerID="cri-o://d5963dcf4413b1d2dda63d09c5900984fb7ecc736c14469f3a293a193b9914e8" gracePeriod=30 May 21 20:56:27.609958 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:27.609925 2573 generic.go:358] "Generic (PLEG): container finished" podID="118e2d5e-3106-4502-8fae-f70aad686be9" containerID="d5963dcf4413b1d2dda63d09c5900984fb7ecc736c14469f3a293a193b9914e8" exitCode=0 May 21 20:56:27.610117 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:27.609999 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5958649c76-8p265" event={"ID":"118e2d5e-3106-4502-8fae-f70aad686be9","Type":"ContainerDied","Data":"d5963dcf4413b1d2dda63d09c5900984fb7ecc736c14469f3a293a193b9914e8"} May 21 20:56:27.747165 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:27.747099 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5958649c76-8p265" May 21 20:56:27.840619 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:27.840580 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7nlk\" (UniqueName: \"kubernetes.io/projected/118e2d5e-3106-4502-8fae-f70aad686be9-kube-api-access-j7nlk\") pod \"118e2d5e-3106-4502-8fae-f70aad686be9\" (UID: \"118e2d5e-3106-4502-8fae-f70aad686be9\") " May 21 20:56:27.842748 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:27.842714 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/118e2d5e-3106-4502-8fae-f70aad686be9-kube-api-access-j7nlk" (OuterVolumeSpecName: "kube-api-access-j7nlk") pod "118e2d5e-3106-4502-8fae-f70aad686be9" (UID: "118e2d5e-3106-4502-8fae-f70aad686be9"). InnerVolumeSpecName "kube-api-access-j7nlk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:56:27.942077 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:27.942040 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7nlk\" (UniqueName: \"kubernetes.io/projected/118e2d5e-3106-4502-8fae-f70aad686be9-kube-api-access-j7nlk\") on node \"ip-10-0-133-110.ec2.internal\" DevicePath \"\"" May 21 20:56:28.615450 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:28.615422 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5958649c76-8p265" May 21 20:56:28.615911 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:28.615417 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5958649c76-8p265" event={"ID":"118e2d5e-3106-4502-8fae-f70aad686be9","Type":"ContainerDied","Data":"89198651a13aa6dd26dd356cc84a36e696e26168ab87befb22b2a4f7e9b50ada"} May 21 20:56:28.615911 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:28.615542 2573 scope.go:117] "RemoveContainer" containerID="d5963dcf4413b1d2dda63d09c5900984fb7ecc736c14469f3a293a193b9914e8" May 21 20:56:28.640536 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:28.640495 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5958649c76-8p265"] May 21 20:56:28.643174 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:28.643148 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5958649c76-8p265"] May 21 20:56:29.360420 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:29.359532 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5958649c76-vvrjr"] May 21 20:56:29.360630 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:29.360477 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="118e2d5e-3106-4502-8fae-f70aad686be9" containerName="manager" May 21 20:56:29.360630 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:29.360498 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="118e2d5e-3106-4502-8fae-f70aad686be9" containerName="manager" May 21 20:56:29.360739 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:29.360717 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="118e2d5e-3106-4502-8fae-f70aad686be9" containerName="manager" May 21 20:56:29.366226 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:29.366199 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5958649c76-vvrjr" May 21 20:56:29.367575 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:29.367547 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5958649c76-vvrjr"] May 21 20:56:29.368741 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:29.368723 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-m7pfq\"" May 21 20:56:29.455309 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:29.455268 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkzjd\" (UniqueName: \"kubernetes.io/projected/453f51fe-811d-4d2c-8c66-95c59a903af1-kube-api-access-vkzjd\") pod \"maas-controller-5958649c76-vvrjr\" (UID: \"453f51fe-811d-4d2c-8c66-95c59a903af1\") " pod="opendatahub/maas-controller-5958649c76-vvrjr" May 21 20:56:29.556086 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:29.556051 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vkzjd\" (UniqueName: \"kubernetes.io/projected/453f51fe-811d-4d2c-8c66-95c59a903af1-kube-api-access-vkzjd\") pod \"maas-controller-5958649c76-vvrjr\" (UID: \"453f51fe-811d-4d2c-8c66-95c59a903af1\") " pod="opendatahub/maas-controller-5958649c76-vvrjr" May 21 20:56:29.564473 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:29.564444 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkzjd\" (UniqueName: \"kubernetes.io/projected/453f51fe-811d-4d2c-8c66-95c59a903af1-kube-api-access-vkzjd\") pod \"maas-controller-5958649c76-vvrjr\" (UID: \"453f51fe-811d-4d2c-8c66-95c59a903af1\") " pod="opendatahub/maas-controller-5958649c76-vvrjr" May 21 20:56:29.678692 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:29.678609 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-m7pfq\"" May 21 20:56:29.682868 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:29.682842 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="118e2d5e-3106-4502-8fae-f70aad686be9" path="/var/lib/kubelet/pods/118e2d5e-3106-4502-8fae-f70aad686be9/volumes" May 21 20:56:29.686385 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:29.686368 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5958649c76-vvrjr" May 21 20:56:29.828811 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:29.828780 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5958649c76-vvrjr"] May 21 20:56:29.830684 ip-10-0-133-110 kubenswrapper[2573]: W0521 20:56:29.830653 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453f51fe_811d_4d2c_8c66_95c59a903af1.slice/crio-677ce1ff09b074787b7c4517002edf16e53bd54ac8c718337cd6bb1669694260 WatchSource:0}: Error finding container 677ce1ff09b074787b7c4517002edf16e53bd54ac8c718337cd6bb1669694260: Status 404 returned error can't find the container with id 677ce1ff09b074787b7c4517002edf16e53bd54ac8c718337cd6bb1669694260 May 21 20:56:30.626538 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:30.626430 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5958649c76-vvrjr" event={"ID":"453f51fe-811d-4d2c-8c66-95c59a903af1","Type":"ContainerStarted","Data":"95738b37f37cf1f9866c6f3775a261eee33fea2b05099632dd67b82e453dc4d7"} May 21 20:56:30.626538 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:30.626471 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5958649c76-vvrjr" event={"ID":"453f51fe-811d-4d2c-8c66-95c59a903af1","Type":"ContainerStarted","Data":"677ce1ff09b074787b7c4517002edf16e53bd54ac8c718337cd6bb1669694260"} May 21 20:56:30.626538 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:30.626517 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5958649c76-vvrjr" May 21 20:56:30.644841 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:30.644783 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5958649c76-vvrjr" podStartSLOduration=1.237209661 podStartE2EDuration="1.644764281s" podCreationTimestamp="2026-05-21 20:56:29 +0000 UTC" firstStartedPulling="2026-05-21 20:56:29.832005373 +0000 UTC m=+1080.723867949" lastFinishedPulling="2026-05-21 20:56:30.23955999 +0000 UTC m=+1081.131422569" observedRunningTime="2026-05-21 20:56:30.641506061 +0000 UTC m=+1081.533368659" watchObservedRunningTime="2026-05-21 20:56:30.644764281 +0000 UTC m=+1081.536626880" May 21 20:56:41.635316 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:56:41.635286 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5958649c76-vvrjr" May 21 20:58:29.662548 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:58:29.662516 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 20:58:29.665792 ip-10-0-133-110 kubenswrapper[2573]: I0521 20:58:29.665765 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 21:03:29.702577 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:03:29.702545 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 21:03:29.707793 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:03:29.707766 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 21:08:29.740812 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:08:29.740781 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 21:08:29.745948 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:08:29.745924 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 21:13:29.778739 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:13:29.778708 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 21:13:29.784578 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:13:29.784548 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 21:17:33.695802 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:33.695758 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7bf4848f9b-rl4j4_353ee7b9-e070-41c2-89f2-1e44809972fc/maas-api/0.log" May 21 21:17:34.023283 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:34.023238 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5958649c76-vvrjr_453f51fe-811d-4d2c-8c66-95c59a903af1/manager/0.log" May 21 21:17:34.369106 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:34.369027 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cc84b65c-bvhnc_3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d/manager/0.log" May 21 21:17:34.581807 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:34.581770 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-t24kj_ad25bf34-e648-4f9c-a319-789bfea61611/postgres/0.log" May 21 21:17:35.321844 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:35.321813 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k_d095a2d6-b915-4237-9650-32429af2c848/util/0.log" May 21 21:17:35.328230 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:35.328202 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k_d095a2d6-b915-4237-9650-32429af2c848/pull/0.log" May 21 21:17:35.334098 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:35.334073 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k_d095a2d6-b915-4237-9650-32429af2c848/extract/0.log" May 21 21:17:35.441660 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:35.441633 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7_a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488/util/0.log" May 21 21:17:35.447650 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:35.447626 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7_a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488/pull/0.log" May 21 21:17:35.453412 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:35.453375 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7_a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488/extract/0.log" May 21 21:17:35.557760 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:35.557732 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2_b6661ac5-208a-4616-9ff5-a80b6e2c06b0/util/0.log" May 21 21:17:35.563853 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:35.563828 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2_b6661ac5-208a-4616-9ff5-a80b6e2c06b0/pull/0.log" May 21 21:17:35.569645 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:35.569623 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2_b6661ac5-208a-4616-9ff5-a80b6e2c06b0/extract/0.log" May 21 21:17:35.676172 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:35.676094 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd_c50380a1-2c56-45ee-949c-5438dec83bc8/util/0.log" May 21 21:17:35.686655 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:35.686625 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd_c50380a1-2c56-45ee-949c-5438dec83bc8/pull/0.log" May 21 21:17:35.692951 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:35.692917 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd_c50380a1-2c56-45ee-949c-5438dec83bc8/extract/0.log" May 21 21:17:36.034673 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:36.034637 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-nbb7x_5ceaf5f0-9d70-4dff-8240-8e7dfc0d8a0a/manager/0.log" May 21 21:17:36.247011 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:36.246976 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xqwkw_2874801d-4c22-4f4c-8049-d0a74abfdacb/registry-server/0.log" May 21 21:17:36.582452 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:36.582385 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-zpdtt_f3a3bf21-218e-4bf1-baba-4d512d1ea1a7/manager/0.log" May 21 21:17:36.918193 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:36.918103 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9_38d6f163-ec38-4ed5-9fd4-8ab1fc02e555/istio-proxy/0.log" May 21 21:17:37.369960 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:37.369929 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-5xpd5_ea7e2add-003c-4daa-9fa5-60dfebaef951/istio-proxy/0.log" May 21 21:17:37.478899 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:37.478863 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-n4ns7_e7b03cae-5d06-47fc-b088-72afec8b66f6/payload-processing/0.log" May 21 21:17:38.033511 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:38.033484 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch_913f56ea-8804-4c67-b55c-bd12e9fc759c/storage-initializer/0.log" May 21 21:17:38.040431 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:38.040385 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-fn7ch_913f56ea-8804-4c67-b55c-bd12e9fc759c/main/0.log" May 21 21:17:42.266421 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.266361 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-866q5/must-gather-7vsfl"] May 21 21:17:42.270122 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.270106 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-866q5/must-gather-7vsfl" May 21 21:17:42.273274 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.273248 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-866q5\"/\"kube-root-ca.crt\"" May 21 21:17:42.273489 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.273275 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-866q5\"/\"openshift-service-ca.crt\"" May 21 21:17:42.274511 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.274491 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-866q5\"/\"default-dockercfg-phbdl\"" May 21 21:17:42.285943 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.285916 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-866q5/must-gather-7vsfl"] May 21 21:17:42.394734 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.394674 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cce4275e-10c8-46bf-ba42-d15990dac091-must-gather-output\") pod \"must-gather-7vsfl\" (UID: \"cce4275e-10c8-46bf-ba42-d15990dac091\") " pod="openshift-must-gather-866q5/must-gather-7vsfl" May 21 21:17:42.394924 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.394816 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pn7z\" (UniqueName: \"kubernetes.io/projected/cce4275e-10c8-46bf-ba42-d15990dac091-kube-api-access-8pn7z\") pod \"must-gather-7vsfl\" (UID: \"cce4275e-10c8-46bf-ba42-d15990dac091\") " pod="openshift-must-gather-866q5/must-gather-7vsfl" May 21 21:17:42.495489 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.495450 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cce4275e-10c8-46bf-ba42-d15990dac091-must-gather-output\") pod \"must-gather-7vsfl\" (UID: \"cce4275e-10c8-46bf-ba42-d15990dac091\") " pod="openshift-must-gather-866q5/must-gather-7vsfl" May 21 21:17:42.495665 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.495528 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8pn7z\" (UniqueName: \"kubernetes.io/projected/cce4275e-10c8-46bf-ba42-d15990dac091-kube-api-access-8pn7z\") pod \"must-gather-7vsfl\" (UID: \"cce4275e-10c8-46bf-ba42-d15990dac091\") " pod="openshift-must-gather-866q5/must-gather-7vsfl" May 21 21:17:42.495805 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.495784 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cce4275e-10c8-46bf-ba42-d15990dac091-must-gather-output\") pod \"must-gather-7vsfl\" (UID: \"cce4275e-10c8-46bf-ba42-d15990dac091\") " pod="openshift-must-gather-866q5/must-gather-7vsfl" May 21 21:17:42.503678 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.503655 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pn7z\" (UniqueName: \"kubernetes.io/projected/cce4275e-10c8-46bf-ba42-d15990dac091-kube-api-access-8pn7z\") pod \"must-gather-7vsfl\" (UID: \"cce4275e-10c8-46bf-ba42-d15990dac091\") " pod="openshift-must-gather-866q5/must-gather-7vsfl" May 21 21:17:42.580158 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.580069 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-866q5/must-gather-7vsfl" May 21 21:17:42.713900 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.713867 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-866q5/must-gather-7vsfl"] May 21 21:17:42.715254 ip-10-0-133-110 kubenswrapper[2573]: W0521 21:17:42.715226 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcce4275e_10c8_46bf_ba42_d15990dac091.slice/crio-6d5b9cd70a1a465024c75d5aa1cc3b511d167607dd71804d82cba3e4f98b7dd7 WatchSource:0}: Error finding container 6d5b9cd70a1a465024c75d5aa1cc3b511d167607dd71804d82cba3e4f98b7dd7: Status 404 returned error can't find the container with id 6d5b9cd70a1a465024c75d5aa1cc3b511d167607dd71804d82cba3e4f98b7dd7 May 21 21:17:42.717046 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.717027 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 21:17:42.983193 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:42.983152 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-866q5/must-gather-7vsfl" event={"ID":"cce4275e-10c8-46bf-ba42-d15990dac091","Type":"ContainerStarted","Data":"6d5b9cd70a1a465024c75d5aa1cc3b511d167607dd71804d82cba3e4f98b7dd7"} May 21 21:17:43.993220 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:43.992269 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-866q5/must-gather-7vsfl" event={"ID":"cce4275e-10c8-46bf-ba42-d15990dac091","Type":"ContainerStarted","Data":"b23a954fdd7b714bcd9661b23f68a07c06b321074b5751b736d369fb0d2a334f"} May 21 21:17:43.993220 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:43.992321 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-866q5/must-gather-7vsfl" event={"ID":"cce4275e-10c8-46bf-ba42-d15990dac091","Type":"ContainerStarted","Data":"3ee7f27d2992ccdfcb403d613aaddbd063a83b5d9f55acbc090234a20a3d8688"} May 21 21:17:44.012572 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:44.012518 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-866q5/must-gather-7vsfl" podStartSLOduration=1.15478027 podStartE2EDuration="2.012500735s" podCreationTimestamp="2026-05-21 21:17:42 +0000 UTC" firstStartedPulling="2026-05-21 21:17:42.717158493 +0000 UTC m=+2353.609021069" lastFinishedPulling="2026-05-21 21:17:43.574878958 +0000 UTC m=+2354.466741534" observedRunningTime="2026-05-21 21:17:44.011321076 +0000 UTC m=+2354.903183675" watchObservedRunningTime="2026-05-21 21:17:44.012500735 +0000 UTC m=+2354.904363332" May 21 21:17:45.200784 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:45.200751 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b7wvn_7811e120-eaba-4ea0-8f75-35a8f51a24e6/global-pull-secret-syncer/0.log" May 21 21:17:45.418940 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:45.418881 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rbpj6_7e251c5e-f46c-46ad-be14-c2db03260a1c/konnectivity-agent/0.log" May 21 21:17:45.480809 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:45.480779 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-110.ec2.internal_1ded2943643923fe492defbee7ce9d57/haproxy/0.log" May 21 21:17:48.962935 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:48.962904 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k_d095a2d6-b915-4237-9650-32429af2c848/extract/0.log" May 21 21:17:48.991935 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:48.991904 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k_d095a2d6-b915-4237-9650-32429af2c848/util/0.log" May 21 21:17:49.014357 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:49.014265 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599vr5k_d095a2d6-b915-4237-9650-32429af2c848/pull/0.log" May 21 21:17:49.042938 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:49.042907 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7_a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488/extract/0.log" May 21 21:17:49.067261 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:49.067234 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7_a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488/util/0.log" May 21 21:17:49.092455 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:49.092429 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfbd7_a2c48ba9-6da3-4b3f-bd34-91b1e9d2f488/pull/0.log" May 21 21:17:49.121011 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:49.120978 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2_b6661ac5-208a-4616-9ff5-a80b6e2c06b0/extract/0.log" May 21 21:17:49.143044 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:49.143017 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2_b6661ac5-208a-4616-9ff5-a80b6e2c06b0/util/0.log" May 21 21:17:49.167332 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:49.167288 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739pmq2_b6661ac5-208a-4616-9ff5-a80b6e2c06b0/pull/0.log" May 21 21:17:49.197720 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:49.197685 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd_c50380a1-2c56-45ee-949c-5438dec83bc8/extract/0.log" May 21 21:17:49.220441 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:49.220340 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd_c50380a1-2c56-45ee-949c-5438dec83bc8/util/0.log" May 21 21:17:49.250574 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:49.250536 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19nzjd_c50380a1-2c56-45ee-949c-5438dec83bc8/pull/0.log" May 21 21:17:49.673132 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:49.673029 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-nbb7x_5ceaf5f0-9d70-4dff-8240-8e7dfc0d8a0a/manager/0.log" May 21 21:17:49.752499 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:49.752309 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xqwkw_2874801d-4c22-4f4c-8049-d0a74abfdacb/registry-server/0.log" May 21 21:17:49.941074 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:49.940952 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-zpdtt_f3a3bf21-218e-4bf1-baba-4d512d1ea1a7/manager/0.log" May 21 21:17:51.273752 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:51.273711 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00efb094-b9a2-4f1e-99e0-bc55f6153945/alertmanager/0.log" May 21 21:17:51.295996 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:51.295954 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00efb094-b9a2-4f1e-99e0-bc55f6153945/config-reloader/0.log" May 21 21:17:51.318011 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:51.317968 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00efb094-b9a2-4f1e-99e0-bc55f6153945/kube-rbac-proxy-web/0.log" May 21 21:17:51.339826 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:51.339780 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00efb094-b9a2-4f1e-99e0-bc55f6153945/kube-rbac-proxy/0.log" May 21 21:17:51.359947 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:51.359919 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00efb094-b9a2-4f1e-99e0-bc55f6153945/kube-rbac-proxy-metric/0.log" May 21 21:17:51.379368 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:51.379338 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00efb094-b9a2-4f1e-99e0-bc55f6153945/prom-label-proxy/0.log" May 21 21:17:51.400755 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:51.400725 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00efb094-b9a2-4f1e-99e0-bc55f6153945/init-config-reloader/0.log" May 21 21:17:51.439210 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:51.439175 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-bzg68_64c42161-d041-4a84-addc-fa4b5c52e2f0/cluster-monitoring-operator/0.log" May 21 21:17:51.605497 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:51.605463 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8znkh_a333493f-5544-4ad1-b1ea-f8aaa49d0663/node-exporter/0.log" May 21 21:17:51.635178 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:51.635150 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8znkh_a333493f-5544-4ad1-b1ea-f8aaa49d0663/kube-rbac-proxy/0.log" May 21 21:17:51.657216 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:51.657188 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8znkh_a333493f-5544-4ad1-b1ea-f8aaa49d0663/init-textfile/0.log" May 21 21:17:51.853239 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:51.853117 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-mh9fl_ba038327-7953-4c00-8f80-e5d4428d8b56/kube-rbac-proxy-main/0.log" May 21 21:17:51.875234 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:51.875183 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-mh9fl_ba038327-7953-4c00-8f80-e5d4428d8b56/kube-rbac-proxy-self/0.log" May 21 21:17:51.899991 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:51.899961 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-mh9fl_ba038327-7953-4c00-8f80-e5d4428d8b56/openshift-state-metrics/0.log" May 21 21:17:52.132799 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:52.132691 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-n4vm2_8a3b77c9-533f-4e05-af79-2d1c9ae8e08b/prometheus-operator-admission-webhook/0.log" May 21 21:17:52.235876 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:52.235848 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579b9789f5-965lm_f65219a9-d06b-4672-a7d6-cd096aaaed72/thanos-query/0.log" May 21 21:17:52.256238 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:52.256207 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579b9789f5-965lm_f65219a9-d06b-4672-a7d6-cd096aaaed72/kube-rbac-proxy-web/0.log" May 21 21:17:52.275764 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:52.275735 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579b9789f5-965lm_f65219a9-d06b-4672-a7d6-cd096aaaed72/kube-rbac-proxy/0.log" May 21 21:17:52.295108 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:52.295075 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579b9789f5-965lm_f65219a9-d06b-4672-a7d6-cd096aaaed72/prom-label-proxy/0.log" May 21 21:17:52.319529 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:52.319495 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579b9789f5-965lm_f65219a9-d06b-4672-a7d6-cd096aaaed72/kube-rbac-proxy-rules/0.log" May 21 21:17:52.340124 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:52.340091 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579b9789f5-965lm_f65219a9-d06b-4672-a7d6-cd096aaaed72/kube-rbac-proxy-metrics/0.log" May 21 21:17:53.988352 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:53.988321 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/1.log" May 21 21:17:53.996225 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:53.996198 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vxk5c_e10707ec-cbb2-40ec-a5d6-be05b057b517/console-operator/2.log" May 21 21:17:54.058155 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.058113 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p"] May 21 21:17:54.064573 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.064542 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.069499 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.069469 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p"] May 21 21:17:54.137020 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.136961 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b3b4c9c-54a3-46a4-8724-0a29b4435158-lib-modules\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.137304 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.137284 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b3b4c9c-54a3-46a4-8724-0a29b4435158-sys\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.138011 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.137532 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrmc4\" (UniqueName: \"kubernetes.io/projected/0b3b4c9c-54a3-46a4-8724-0a29b4435158-kube-api-access-qrmc4\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.138011 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.137594 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b3b4c9c-54a3-46a4-8724-0a29b4435158-podres\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.138011 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.137630 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b3b4c9c-54a3-46a4-8724-0a29b4435158-proc\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.238873 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.238770 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b3b4c9c-54a3-46a4-8724-0a29b4435158-sys\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.238873 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.238870 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrmc4\" (UniqueName: \"kubernetes.io/projected/0b3b4c9c-54a3-46a4-8724-0a29b4435158-kube-api-access-qrmc4\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.239109 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.238913 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b3b4c9c-54a3-46a4-8724-0a29b4435158-podres\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.239109 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.238944 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b3b4c9c-54a3-46a4-8724-0a29b4435158-proc\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.239109 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.239024 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b3b4c9c-54a3-46a4-8724-0a29b4435158-lib-modules\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.239260 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.239197 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b3b4c9c-54a3-46a4-8724-0a29b4435158-lib-modules\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.239314 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.239255 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b3b4c9c-54a3-46a4-8724-0a29b4435158-sys\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.239742 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.239713 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b3b4c9c-54a3-46a4-8724-0a29b4435158-podres\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.239852 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.239784 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b3b4c9c-54a3-46a4-8724-0a29b4435158-proc\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.247217 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.247179 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrmc4\" (UniqueName: \"kubernetes.io/projected/0b3b4c9c-54a3-46a4-8724-0a29b4435158-kube-api-access-qrmc4\") pod \"perf-node-gather-daemonset-mrz6p\" (UID: \"0b3b4c9c-54a3-46a4-8724-0a29b4435158\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.382443 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.381929 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:54.476716 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.476688 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-595b5448d4-wfstz_c631ccf4-b486-4af1-b09b-f6b9ad2e9b10/console/0.log" May 21 21:17:54.514940 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.514915 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-8g7vs_b29b4ad7-74a3-4f33-9610-4a1a32c59a25/download-server/0.log" May 21 21:17:54.548980 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:54.548778 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p"] May 21 21:17:55.016829 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:55.016794 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-4mxqf_5a9a50e3-fc4b-42a3-bbb6-a67dbe7c7bb6/volume-data-source-validator/0.log" May 21 21:17:55.060294 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:55.060253 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" event={"ID":"0b3b4c9c-54a3-46a4-8724-0a29b4435158","Type":"ContainerStarted","Data":"fe69ba0900490e5afbd6e7e1fc466485083f346ebf268213dce564c0ef86812c"} May 21 21:17:55.060485 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:55.060302 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" event={"ID":"0b3b4c9c-54a3-46a4-8724-0a29b4435158","Type":"ContainerStarted","Data":"c609d19c2a996ecf2e5960b80215896c23289c04c3fdd832759d8f276758189d"} May 21 21:17:55.060547 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:55.060495 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:17:55.079480 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:55.079413 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" podStartSLOduration=1.079374506 podStartE2EDuration="1.079374506s" podCreationTimestamp="2026-05-21 21:17:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:17:55.075390915 +0000 UTC m=+2365.967253513" watchObservedRunningTime="2026-05-21 21:17:55.079374506 +0000 UTC m=+2365.971237105" May 21 21:17:55.878532 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:55.878504 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mmgbz_1760ef7c-0c3a-4255-b303-0bf5ccace164/dns/0.log" May 21 21:17:55.914585 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:55.914557 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mmgbz_1760ef7c-0c3a-4255-b303-0bf5ccace164/kube-rbac-proxy/0.log" May 21 21:17:56.126467 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:56.126441 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xb8nw_432776d9-7c1f-4742-bd20-da704e768581/dns-node-resolver/0.log" May 21 21:17:56.667374 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:56.667340 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vf548_1daa7f15-874e-4696-802f-f7505865a63b/node-ca/0.log" May 21 21:17:57.536461 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:57.536431 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bvfvb9_38d6f163-ec38-4ed5-9fd4-8ab1fc02e555/istio-proxy/0.log" May 21 21:17:57.802593 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:57.802459 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-5xpd5_ea7e2add-003c-4daa-9fa5-60dfebaef951/istio-proxy/0.log" May 21 21:17:57.865949 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:57.865915 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-n4ns7_e7b03cae-5d06-47fc-b088-72afec8b66f6/payload-processing/0.log" May 21 21:17:58.368919 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:58.368881 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bvldf_a5622334-2813-4e89-8705-ddb46c4132cd/serve-healthcheck-canary/0.log" May 21 21:17:58.847180 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:58.847148 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-r9kfc_30eadc96-7cda-4e4c-978f-173a0ef6ceaa/insights-operator/0.log" May 21 21:17:58.847683 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:58.847226 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-r9kfc_30eadc96-7cda-4e4c-978f-173a0ef6ceaa/insights-operator/1.log" May 21 21:17:58.994305 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:58.994274 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xqzpt_e95ccacb-4317-4de3-a158-3219fb67bc07/kube-rbac-proxy/0.log" May 21 21:17:59.034548 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:59.034520 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xqzpt_e95ccacb-4317-4de3-a158-3219fb67bc07/exporter/0.log" May 21 21:17:59.054207 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:17:59.054178 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xqzpt_e95ccacb-4317-4de3-a158-3219fb67bc07/extractor/0.log" May 21 21:18:00.944919 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:00.944886 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7bf4848f9b-rl4j4_353ee7b9-e070-41c2-89f2-1e44809972fc/maas-api/0.log" May 21 21:18:01.059559 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:01.059525 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5958649c76-vvrjr_453f51fe-811d-4d2c-8c66-95c59a903af1/manager/0.log" May 21 21:18:01.075442 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:01.075392 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-mrz6p" May 21 21:18:01.173943 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:01.173909 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cc84b65c-bvhnc_3ebaf61f-0aa7-4b4b-a391-ebef2aa0c63d/manager/0.log" May 21 21:18:01.220377 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:01.220352 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-t24kj_ad25bf34-e648-4f9c-a319-789bfea61611/postgres/0.log" May 21 21:18:02.339798 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:02.339767 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5465c6b7f8-zdxr8_c2b1ffc9-67cb-4f34-83bc-c5278624ab82/manager/0.log" May 21 21:18:02.364700 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:02.364668 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-5qjnd_a10ebb1f-c780-4df9-a4cf-d109e3e9518a/openshift-lws-operator/0.log" May 21 21:18:08.474073 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:08.474038 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqj25_ffe481af-318e-4d07-8f20-b9444f36f745/kube-multus-additional-cni-plugins/0.log" May 21 21:18:08.502583 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:08.502552 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqj25_ffe481af-318e-4d07-8f20-b9444f36f745/egress-router-binary-copy/0.log" May 21 21:18:08.529054 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:08.529025 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqj25_ffe481af-318e-4d07-8f20-b9444f36f745/cni-plugins/0.log" May 21 21:18:08.556348 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:08.556322 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqj25_ffe481af-318e-4d07-8f20-b9444f36f745/bond-cni-plugin/0.log" May 21 21:18:08.583276 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:08.583239 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqj25_ffe481af-318e-4d07-8f20-b9444f36f745/routeoverride-cni/0.log" May 21 21:18:08.608213 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:08.608181 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqj25_ffe481af-318e-4d07-8f20-b9444f36f745/whereabouts-cni-bincopy/0.log" May 21 21:18:08.636700 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:08.636674 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqj25_ffe481af-318e-4d07-8f20-b9444f36f745/whereabouts-cni/0.log" May 21 21:18:08.678084 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:08.678044 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tvvlr_33e24c13-2fea-4546-8f05-a510637a3947/kube-multus/0.log" May 21 21:18:08.804926 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:08.804845 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8jlfz_b0cabb11-fb0d-4a2a-b250-f4cc748429ba/network-metrics-daemon/0.log" May 21 21:18:08.827937 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:08.827908 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8jlfz_b0cabb11-fb0d-4a2a-b250-f4cc748429ba/kube-rbac-proxy/0.log" May 21 21:18:09.784106 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:09.784072 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zmnk_c149b399-f275-4534-9b50-410a8df81fad/ovn-controller/0.log" May 21 21:18:09.812184 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:09.812149 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zmnk_c149b399-f275-4534-9b50-410a8df81fad/ovn-acl-logging/0.log" May 21 21:18:09.833120 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:09.833092 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zmnk_c149b399-f275-4534-9b50-410a8df81fad/kube-rbac-proxy-node/0.log" May 21 21:18:09.854669 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:09.854644 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zmnk_c149b399-f275-4534-9b50-410a8df81fad/kube-rbac-proxy-ovn-metrics/0.log" May 21 21:18:09.878268 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:09.878243 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zmnk_c149b399-f275-4534-9b50-410a8df81fad/northd/0.log" May 21 21:18:09.901902 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:09.901873 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zmnk_c149b399-f275-4534-9b50-410a8df81fad/nbdb/0.log" May 21 21:18:09.923963 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:09.923935 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zmnk_c149b399-f275-4534-9b50-410a8df81fad/sbdb/0.log" May 21 21:18:10.036449 ip-10-0-133-110 kubenswrapper[2573]: I0521 21:18:10.036357 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zmnk_c149b399-f275-4534-9b50-410a8df81fad/ovnkube-controller/0.log"