May 29 16:56:41.871960 ip-10-0-137-133 systemd[1]: Starting Kubernetes Kubelet... May 29 16:56:42.232361 ip-10-0-137-133 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 16:56:42.232361 ip-10-0-137-133 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 29 16:56:42.232361 ip-10-0-137-133 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 16:56:42.232361 ip-10-0-137-133 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 29 16:56:42.232361 ip-10-0-137-133 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 16:56:42.233801 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.233679 2561 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 29 16:56:42.236419 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236404 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 16:56:42.236419 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236420 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236424 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236427 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236430 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236433 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236436 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236439 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236442 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236445 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236447 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236450 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236452 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236460 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236462 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236465 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236468 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236470 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236473 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236476 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 16:56:42.236484 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236478 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236481 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236483 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236486 2561 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236488 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236493 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236497 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236499 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236502 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236506 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236508 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236511 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236514 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236517 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236519 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236523 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236525 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236528 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236530 2561 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236532 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 16:56:42.236950 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236535 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236538 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236540 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236543 2561 feature_gate.go:328] unrecognized feature gate: Example2 May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236545 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236548 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236550 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236553 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236556 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236558 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236561 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236563 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236565 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236574 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236578 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236581 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236584 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236587 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236592 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 16:56:42.237443 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236595 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236597 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236600 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236603 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236606 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236609 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236611 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236614 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236617 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236621 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236623 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236626 2561 feature_gate.go:328] unrecognized feature gate: Example May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236628 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236631 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236633 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236636 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236638 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236641 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236643 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236646 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 16:56:42.237924 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236648 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236651 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236653 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236656 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236658 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236661 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.236663 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237043 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237049 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237052 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237054 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237057 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237060 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237062 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237065 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237068 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237071 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237073 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237076 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237079 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 16:56:42.238401 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237082 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237084 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237087 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237089 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237092 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237095 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237097 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237100 2561 feature_gate.go:328] unrecognized feature gate: Example2 May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237102 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237105 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237108 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237110 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237113 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237115 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237117 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237120 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237123 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237125 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237128 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237132 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 16:56:42.238901 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237135 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237139 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237143 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237146 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237150 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237152 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237155 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237157 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237160 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237162 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237165 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237168 2561 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237170 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237173 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237175 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237178 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237181 2561 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237183 2561 feature_gate.go:328] unrecognized feature gate: Example May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237186 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 16:56:42.239386 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237188 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237190 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237193 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237195 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237198 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237200 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237203 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237206 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237208 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237211 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237213 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237216 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237219 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237222 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237225 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237227 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237230 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237233 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237236 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237238 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 16:56:42.239883 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237241 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237243 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237246 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237248 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237251 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237253 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237256 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237259 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237261 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237263 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237266 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237268 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237271 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237274 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237343 2561 flags.go:64] FLAG: --address="0.0.0.0" May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237350 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237358 2561 flags.go:64] FLAG: --anonymous-auth="true" May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237376 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237383 2561 flags.go:64] FLAG: --authentication-token-webhook="false" May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237387 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 29 16:56:42.240382 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237391 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237395 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237398 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237401 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237405 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237408 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237411 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237414 2561 flags.go:64] FLAG: --cgroup-root="" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237417 2561 flags.go:64] FLAG: --cgroups-per-qos="true" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237420 2561 flags.go:64] FLAG: --client-ca-file="" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237422 2561 flags.go:64] FLAG: --cloud-config="" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237425 2561 flags.go:64] FLAG: --cloud-provider="external" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237428 2561 flags.go:64] FLAG: --cluster-dns="[]" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237432 2561 flags.go:64] FLAG: --cluster-domain="" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237434 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237437 2561 flags.go:64] FLAG: --config-dir="" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237440 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237444 2561 flags.go:64] FLAG: --container-log-max-files="5" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237448 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237451 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237455 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237458 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237460 2561 flags.go:64] FLAG: --contention-profiling="false" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237463 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" May 29 16:56:42.240889 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237466 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237469 2561 flags.go:64] FLAG: --cpu-manager-policy="none" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237472 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237476 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237479 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237482 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237485 2561 flags.go:64] FLAG: --enable-load-reader="false" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237489 2561 flags.go:64] FLAG: --enable-server="true" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237491 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237496 2561 flags.go:64] FLAG: --event-burst="100" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237499 2561 flags.go:64] FLAG: --event-qps="50" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237502 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237505 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237507 2561 flags.go:64] FLAG: --eviction-hard="" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237511 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237514 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237517 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237520 2561 flags.go:64] FLAG: --eviction-soft="" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237523 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237526 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237528 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237531 2561 flags.go:64] FLAG: --experimental-mounter-path="" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237534 2561 flags.go:64] FLAG: --fail-cgroupv1="false" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237537 2561 flags.go:64] FLAG: --fail-swap-on="true" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237540 2561 flags.go:64] FLAG: --feature-gates="" May 29 16:56:42.241489 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237544 2561 flags.go:64] FLAG: --file-check-frequency="20s" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237547 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237550 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237553 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237556 2561 flags.go:64] FLAG: --healthz-port="10248" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237559 2561 flags.go:64] FLAG: --help="false" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237563 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-137-133.ec2.internal" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237566 2561 flags.go:64] FLAG: --housekeeping-interval="10s" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237569 2561 flags.go:64] FLAG: --http-check-frequency="20s" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237572 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237576 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237579 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237582 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237585 2561 flags.go:64] FLAG: --image-service-endpoint="" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237588 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237591 2561 flags.go:64] FLAG: --kube-api-burst="100" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237594 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237597 2561 flags.go:64] FLAG: --kube-api-qps="50" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237600 2561 flags.go:64] FLAG: --kube-reserved="" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237603 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237605 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237608 2561 flags.go:64] FLAG: --kubelet-cgroups="" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237611 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237614 2561 flags.go:64] FLAG: --lock-file="" May 29 16:56:42.242108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237617 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237619 2561 flags.go:64] FLAG: --log-flush-frequency="5s" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237622 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237627 2561 flags.go:64] FLAG: --log-json-split-stream="false" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237630 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237632 2561 flags.go:64] FLAG: --log-text-split-stream="false" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237635 2561 flags.go:64] FLAG: --logging-format="text" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237638 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237641 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237644 2561 flags.go:64] FLAG: --manifest-url="" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237647 2561 flags.go:64] FLAG: --manifest-url-header="" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237651 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237654 2561 flags.go:64] FLAG: --max-open-files="1000000" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237659 2561 flags.go:64] FLAG: --max-pods="110" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237662 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237665 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237668 2561 flags.go:64] FLAG: --memory-manager-policy="None" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237671 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237674 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237677 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237681 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237701 2561 flags.go:64] FLAG: --node-status-max-images="50" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237704 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237707 2561 flags.go:64] FLAG: --oom-score-adj="-999" May 29 16:56:42.242756 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237710 2561 flags.go:64] FLAG: --pod-cidr="" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237713 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237718 2561 flags.go:64] FLAG: --pod-manifest-path="" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237721 2561 flags.go:64] FLAG: --pod-max-pids="-1" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237724 2561 flags.go:64] FLAG: --pods-per-core="0" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237727 2561 flags.go:64] FLAG: --port="10250" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237730 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237733 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00b49437560992a86" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237736 2561 flags.go:64] FLAG: --qos-reserved="" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237739 2561 flags.go:64] FLAG: --read-only-port="10255" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237742 2561 flags.go:64] FLAG: --register-node="true" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237745 2561 flags.go:64] FLAG: --register-schedulable="true" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237748 2561 flags.go:64] FLAG: --register-with-taints="" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237751 2561 flags.go:64] FLAG: --registry-burst="10" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237754 2561 flags.go:64] FLAG: --registry-qps="5" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237756 2561 flags.go:64] FLAG: --reserved-cpus="" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237759 2561 flags.go:64] FLAG: --reserved-memory="" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237763 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237765 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237769 2561 flags.go:64] FLAG: --rotate-certificates="false" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237772 2561 flags.go:64] FLAG: --rotate-server-certificates="false" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237775 2561 flags.go:64] FLAG: --runonce="false" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237778 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237781 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237784 2561 flags.go:64] FLAG: --seccomp-default="false" May 29 16:56:42.243597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237786 2561 flags.go:64] FLAG: --serialize-image-pulls="true" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237789 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237792 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237795 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237798 2561 flags.go:64] FLAG: --storage-driver-password="root" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237801 2561 flags.go:64] FLAG: --storage-driver-secure="false" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237804 2561 flags.go:64] FLAG: --storage-driver-table="stats" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237807 2561 flags.go:64] FLAG: --storage-driver-user="root" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237809 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237812 2561 flags.go:64] FLAG: --sync-frequency="1m0s" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237816 2561 flags.go:64] FLAG: --system-cgroups="" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237819 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237825 2561 flags.go:64] FLAG: --system-reserved-cgroup="" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237828 2561 flags.go:64] FLAG: --tls-cert-file="" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237831 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237834 2561 flags.go:64] FLAG: --tls-min-version="" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237837 2561 flags.go:64] FLAG: --tls-private-key-file="" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237840 2561 flags.go:64] FLAG: --topology-manager-policy="none" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237842 2561 flags.go:64] FLAG: --topology-manager-policy-options="" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237846 2561 flags.go:64] FLAG: --topology-manager-scope="container" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237848 2561 flags.go:64] FLAG: --v="2" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237852 2561 flags.go:64] FLAG: --version="false" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237857 2561 flags.go:64] FLAG: --vmodule="" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237861 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.237864 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 29 16:56:42.244674 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237961 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237966 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237969 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237973 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237976 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237979 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237982 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237985 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237987 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237990 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237992 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237995 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.237997 2561 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238000 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238003 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238005 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238008 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238010 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238013 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238015 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 16:56:42.245807 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238018 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238020 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238023 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238026 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238028 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238031 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238033 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238035 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238038 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238041 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238043 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238046 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238049 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238052 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238054 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238057 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238060 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238063 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238065 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238068 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 16:56:42.246558 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238070 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238073 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238075 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238078 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238080 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238083 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238085 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238088 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238090 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238093 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238095 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238099 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238102 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238105 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238108 2561 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238110 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238115 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238118 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238120 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238123 2561 feature_gate.go:328] unrecognized feature gate: Example May 29 16:56:42.247192 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238125 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238127 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238133 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238136 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238138 2561 feature_gate.go:328] unrecognized feature gate: Example2 May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238141 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238143 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238146 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238148 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238151 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238155 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238157 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238160 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238162 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238166 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238170 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238173 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238175 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238178 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238181 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 16:56:42.247794 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238183 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238186 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238188 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238191 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238194 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.238196 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.238202 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.245052 2561 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.245076 2561 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245146 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245153 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245159 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245163 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245168 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245172 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 16:56:42.248619 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245176 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245181 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245186 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245191 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245196 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245200 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245204 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245209 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245214 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245218 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245222 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245226 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245231 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245235 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245239 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245243 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245248 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245252 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245256 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245260 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 16:56:42.249209 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245264 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245269 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245273 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245277 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245281 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245294 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245299 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245303 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245308 2561 feature_gate.go:328] unrecognized feature gate: Example May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245312 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245316 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245320 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245327 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245334 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245338 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245343 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245348 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245354 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245360 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 16:56:42.249750 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245365 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245369 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245373 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245377 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245381 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245385 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245389 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245394 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245398 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245402 2561 feature_gate.go:328] unrecognized feature gate: Example2 May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245406 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245410 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245414 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245418 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245423 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245428 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245432 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245436 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245441 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245453 2561 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 16:56:42.250296 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245457 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245462 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245466 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245470 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245474 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245479 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245482 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245487 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245490 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245495 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245499 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245503 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245508 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245511 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245516 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245520 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245524 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245528 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245540 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245545 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 16:56:42.250835 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245549 2561 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.245557 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245774 2561 feature_gate.go:328] unrecognized feature gate: Example2 May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245783 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245789 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245793 2561 feature_gate.go:328] unrecognized feature gate: Example May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245798 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245802 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245806 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245810 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245815 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245819 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245831 2561 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245836 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245840 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245844 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 16:56:42.251412 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245848 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245853 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245857 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245861 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245865 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245870 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245874 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245877 2561 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245883 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245890 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245895 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245899 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245903 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245907 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245910 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245914 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245918 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245922 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245926 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 16:56:42.251919 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245930 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245934 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245939 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245943 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245946 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245950 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245954 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245959 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245963 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245967 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245979 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245983 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245988 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245992 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.245996 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246000 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246004 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246008 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246012 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246016 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 16:56:42.252435 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246020 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246024 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246028 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246032 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246036 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246040 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246044 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246048 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246052 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246056 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246060 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246064 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246068 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246072 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246076 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246081 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246084 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246091 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246097 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 16:56:42.253066 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246102 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246107 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246112 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246116 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246129 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246134 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246138 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246142 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246146 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246150 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246154 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246158 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246162 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:42.246166 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.246173 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 16:56:42.253530 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.247007 2561 server.go:962] "Client rotation is on, will bootstrap in background" May 29 16:56:42.253966 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.251831 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 29 16:56:42.253966 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.252674 2561 server.go:1019] "Starting client certificate rotation" May 29 16:56:42.253966 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.252790 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 16:56:42.253966 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.253274 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 16:56:42.272851 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.272834 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 16:56:42.276963 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.276940 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 16:56:42.287546 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.287529 2561 log.go:25] "Validated CRI v1 runtime API" May 29 16:56:42.292343 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.292329 2561 log.go:25] "Validated CRI v1 image API" May 29 16:56:42.293497 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.293473 2561 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 29 16:56:42.296681 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.296662 2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a5297e36-779d-4d72-8e3c-9eafc41a0a20:/dev/nvme0n1p3 c1ece2f9-d581-41d3-8117-d7138d663bdb:/dev/nvme0n1p4] May 29 16:56:42.296775 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.296680 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 29 16:56:42.300989 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.300880 2561 manager.go:217] Machine: {Timestamp:2026-05-29 16:56:42.300369593 +0000 UTC m=+0.330838592 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100775 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec239aba2663c0b9ca0ebac4c0b9540d SystemUUID:ec239aba-2663-c0b9-ca0e-bac4c0b9540d BootID:e8d235cd-ad93-4439-908d-331add51ccb2 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:26:f6:d3:24:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:26:f6:d3:24:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:f3:cb:17:1b:2a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 29 16:56:42.301606 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.301595 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 29 16:56:42.301730 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.301717 2561 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 29 16:56:42.303317 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.303296 2561 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 29 16:56:42.303443 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.303320 2561 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 29 16:56:42.303487 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.303453 2561 topology_manager.go:138] "Creating topology manager with none policy" May 29 16:56:42.303487 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.303461 2561 container_manager_linux.go:306] "Creating device plugin manager" May 29 16:56:42.303487 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.303468 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 16:56:42.304154 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.304144 2561 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 16:56:42.305135 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.305121 2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 16:56:42.305500 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.305488 2561 state_mem.go:36] "Initialized new in-memory state store" May 29 16:56:42.305617 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.305607 2561 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 29 16:56:42.308733 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.308720 2561 kubelet.go:491] "Attempting to sync node with API server" May 29 16:56:42.308793 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.308744 2561 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 29 16:56:42.308793 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.308760 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 29 16:56:42.308793 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.308769 2561 kubelet.go:397] "Adding apiserver pod source" May 29 16:56:42.308793 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.308778 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 29 16:56:42.309792 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.309775 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 16:56:42.309852 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.309805 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 16:56:42.312813 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.312794 2561 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" May 29 16:56:42.314621 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.314607 2561 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 29 16:56:42.316810 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.316797 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 29 16:56:42.316896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.316816 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 29 16:56:42.316896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.316826 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 29 16:56:42.316896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.316834 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 29 16:56:42.316896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.316843 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 29 16:56:42.316896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.316849 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 29 16:56:42.316896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.316855 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 29 16:56:42.316896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.316860 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 29 16:56:42.316896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.316866 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 29 16:56:42.316896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.316872 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 29 16:56:42.316896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.316880 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 29 16:56:42.316896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.316885 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 29 16:56:42.317563 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.317552 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 29 16:56:42.317563 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.317562 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 29 16:56:42.321317 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.321299 2561 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 29 16:56:42.321415 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.321387 2561 server.go:1295] "Started kubelet" May 29 16:56:42.321466 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.321429 2561 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 29 16:56:42.321531 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.321488 2561 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 29 16:56:42.321578 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.321541 2561 server_v1.go:47] "podresources" method="list" useActivePods=true May 29 16:56:42.321860 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.321821 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 29 16:56:42.321979 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.321954 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 29 16:56:42.321979 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.321952 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 29 16:56:42.322142 ip-10-0-137-133 systemd[1]: Started Kubernetes Kubelet. May 29 16:56:42.322612 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.322460 2561 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 29 16:56:42.324131 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.324117 2561 server.go:317] "Adding debug handlers to kubelet server" May 29 16:56:42.327537 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.327516 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 29 16:56:42.327632 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.326714 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-133.ec2.internal.18b417b12557d138 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-133.ec2.internal,UID:ip-10-0-137-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-133.ec2.internal,},FirstTimestamp:2026-05-29 16:56:42.321350968 +0000 UTC m=+0.351819969,LastTimestamp:2026-05-29 16:56:42.321350968 +0000 UTC m=+0.351819969,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-133.ec2.internal,}" May 29 16:56:42.328001 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.327987 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 29 16:56:42.328066 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.328053 2561 volume_manager.go:295] "The desired_state_of_world populator starts" May 29 16:56:42.328066 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.328065 2561 volume_manager.go:297] "Starting Kubelet Volume Manager" May 29 16:56:42.328169 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.328155 2561 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 29 16:56:42.328220 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.328201 2561 reconstruct.go:97] "Volume reconstruction finished" May 29 16:56:42.328220 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.328209 2561 reconciler.go:26] "Reconciler: start to sync state" May 29 16:56:42.328933 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.328888 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-133.ec2.internal\" not found" May 29 16:56:42.330715 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.330677 2561 factory.go:55] Registering systemd factory May 29 16:56:42.330715 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.330717 2561 factory.go:223] Registration of the systemd container factory successfully May 29 16:56:42.331776 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.331754 2561 factory.go:153] Registering CRI-O factory May 29 16:56:42.331776 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.331774 2561 factory.go:223] Registration of the crio container factory successfully May 29 16:56:42.331882 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.331840 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 29 16:56:42.331882 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.331860 2561 factory.go:103] Registering Raw factory May 29 16:56:42.331882 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.331879 2561 manager.go:1196] Started watching for new ooms in manager May 29 16:56:42.332008 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.331941 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 29 16:56:42.332008 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.331954 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 29 16:56:42.332281 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.332267 2561 manager.go:319] Starting recovery of all containers May 29 16:56:42.334140 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.334097 2561 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 29 16:56:42.342526 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.342510 2561 manager.go:324] Recovery completed May 29 16:56:42.344246 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.344177 2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory May 29 16:56:42.345739 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.345720 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sl56v" May 29 16:56:42.348020 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.348008 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 16:56:42.351718 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.351701 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasSufficientMemory" May 29 16:56:42.351805 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.351734 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasNoDiskPressure" May 29 16:56:42.351805 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.351745 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasSufficientPID" May 29 16:56:42.352013 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.351990 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sl56v" May 29 16:56:42.352249 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.352230 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" May 29 16:56:42.352249 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.352248 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 29 16:56:42.352344 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.352270 2561 state_mem.go:36] "Initialized new in-memory state store" May 29 16:56:42.353156 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.353100 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-133.ec2.internal.18b417b1272726db default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-133.ec2.internal,UID:ip-10-0-137-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-133.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-133.ec2.internal,},FirstTimestamp:2026-05-29 16:56:42.351716059 +0000 UTC m=+0.382185058,LastTimestamp:2026-05-29 16:56:42.351716059 +0000 UTC m=+0.382185058,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-133.ec2.internal,}" May 29 16:56:42.354939 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.354927 2561 policy_none.go:49] "None policy: Start" May 29 16:56:42.354996 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.354943 2561 memory_manager.go:186] "Starting memorymanager" policy="None" May 29 16:56:42.354996 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.354953 2561 state_mem.go:35] "Initializing new in-memory state store" May 29 16:56:42.397283 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.397270 2561 manager.go:341] "Starting Device Plugin manager" May 29 16:56:42.397371 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.397300 2561 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 29 16:56:42.397371 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.397313 2561 server.go:85] "Starting device plugin registration server" May 29 16:56:42.397538 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.397527 2561 eviction_manager.go:189] "Eviction manager: starting control loop" May 29 16:56:42.397577 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.397542 2561 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 29 16:56:42.397631 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.397615 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 29 16:56:42.397896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.397724 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 29 16:56:42.397896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.397738 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 29 16:56:42.398170 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.398154 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 29 16:56:42.398237 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.398185 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-133.ec2.internal\" not found" May 29 16:56:42.418258 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.418237 2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 29 16:56:42.419421 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.419395 2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 29 16:56:42.419421 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.419421 2561 status_manager.go:230] "Starting to sync pod status with apiserver" May 29 16:56:42.419535 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.419436 2561 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 29 16:56:42.419535 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.419442 2561 kubelet.go:2451] "Starting kubelet main sync loop" May 29 16:56:42.419535 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.419505 2561 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 29 16:56:42.422632 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.422613 2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 16:56:42.497854 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.497791 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 16:56:42.498565 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.498549 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasSufficientMemory" May 29 16:56:42.498619 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.498578 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasNoDiskPressure" May 29 16:56:42.498619 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.498588 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasSufficientPID" May 29 16:56:42.498619 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.498614 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-133.ec2.internal" May 29 16:56:42.505511 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.505497 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-133.ec2.internal" May 29 16:56:42.505565 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.505516 2561 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-133.ec2.internal\": node \"ip-10-0-137-133.ec2.internal\" not found" May 29 16:56:42.520098 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.520075 2561 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-133.ec2.internal"] May 29 16:56:42.520169 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.520136 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 16:56:42.520861 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.520847 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasSufficientMemory" May 29 16:56:42.520923 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.520875 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasNoDiskPressure" May 29 16:56:42.520923 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.520889 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasSufficientPID" May 29 16:56:42.521935 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.521924 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 16:56:42.522108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.522092 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal" May 29 16:56:42.522173 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.522130 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 16:56:42.522532 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.522514 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasSufficientMemory" May 29 16:56:42.522592 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.522544 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasNoDiskPressure" May 29 16:56:42.522592 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.522554 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasSufficientPID" May 29 16:56:42.522592 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.522565 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasSufficientMemory" May 29 16:56:42.522592 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.522584 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasNoDiskPressure" May 29 16:56:42.522592 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.522593 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasSufficientPID" May 29 16:56:42.523625 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.523613 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-133.ec2.internal" May 29 16:56:42.523660 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.523635 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 16:56:42.524271 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.524253 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasSufficientMemory" May 29 16:56:42.524366 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.524284 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasNoDiskPressure" May 29 16:56:42.524366 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.524298 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeHasSufficientPID" May 29 16:56:42.542283 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.542265 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-133.ec2.internal\" not found" May 29 16:56:42.555313 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.555296 2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-133.ec2.internal\" not found" node="ip-10-0-137-133.ec2.internal" May 29 16:56:42.559649 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.559635 2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-133.ec2.internal\" not found" node="ip-10-0-137-133.ec2.internal" May 29 16:56:42.629693 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.629664 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6ad3b2bb57678d3163019d56ce90007-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal\" (UID: \"b6ad3b2bb57678d3163019d56ce90007\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal" May 29 16:56:42.629772 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.629702 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08ed79040e29d0c7963204127ead4896-config\") pod \"kube-apiserver-proxy-ip-10-0-137-133.ec2.internal\" (UID: \"08ed79040e29d0c7963204127ead4896\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-133.ec2.internal" May 29 16:56:42.629772 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.629728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b6ad3b2bb57678d3163019d56ce90007-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal\" (UID: \"b6ad3b2bb57678d3163019d56ce90007\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal" May 29 16:56:42.642754 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.642737 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-133.ec2.internal\" not found" May 29 16:56:42.730114 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.730089 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b6ad3b2bb57678d3163019d56ce90007-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal\" (UID: \"b6ad3b2bb57678d3163019d56ce90007\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal" May 29 16:56:42.730217 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.730117 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6ad3b2bb57678d3163019d56ce90007-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal\" (UID: \"b6ad3b2bb57678d3163019d56ce90007\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal" May 29 16:56:42.730217 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.730134 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08ed79040e29d0c7963204127ead4896-config\") pod \"kube-apiserver-proxy-ip-10-0-137-133.ec2.internal\" (UID: \"08ed79040e29d0c7963204127ead4896\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-133.ec2.internal" May 29 16:56:42.730217 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.730183 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6ad3b2bb57678d3163019d56ce90007-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal\" (UID: \"b6ad3b2bb57678d3163019d56ce90007\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal" May 29 16:56:42.730217 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.730211 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08ed79040e29d0c7963204127ead4896-config\") pod \"kube-apiserver-proxy-ip-10-0-137-133.ec2.internal\" (UID: \"08ed79040e29d0c7963204127ead4896\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-133.ec2.internal" May 29 16:56:42.730352 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.730187 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b6ad3b2bb57678d3163019d56ce90007-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal\" (UID: \"b6ad3b2bb57678d3163019d56ce90007\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal" May 29 16:56:42.743182 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.743162 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-133.ec2.internal\" not found" May 29 16:56:42.843919 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.843890 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-133.ec2.internal\" not found" May 29 16:56:42.858059 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.858039 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal" May 29 16:56:42.863614 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:42.863599 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-133.ec2.internal" May 29 16:56:42.944386 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:42.944360 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-133.ec2.internal\" not found" May 29 16:56:43.044816 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:43.044782 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-133.ec2.internal\" not found" May 29 16:56:43.145296 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:43.145242 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-133.ec2.internal\" not found" May 29 16:56:43.245741 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:43.245717 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-133.ec2.internal\" not found" May 29 16:56:43.252944 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.252802 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 29 16:56:43.253083 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.253059 2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 16:56:43.328018 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.327995 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 29 16:56:43.343750 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.343728 2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 16:56:43.345805 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:43.345786 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-133.ec2.internal\" not found" May 29 16:56:43.353534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.353512 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 16:51:42 +0000 UTC" deadline="2028-01-30 06:05:11.445041941 +0000 UTC" May 29 16:56:43.353587 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.353535 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14653h8m28.091510149s" May 29 16:56:43.363042 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.363026 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5qddc" May 29 16:56:43.371791 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.371777 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5qddc" May 29 16:56:43.446181 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:43.446156 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-133.ec2.internal\" not found" May 29 16:56:43.503975 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:43.503931 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08ed79040e29d0c7963204127ead4896.slice/crio-b82e58f93d1c6ab9cd2ea5f133e2dfb09100838456cf46699bcbb554a165d4a7 WatchSource:0}: Error finding container b82e58f93d1c6ab9cd2ea5f133e2dfb09100838456cf46699bcbb554a165d4a7: Status 404 returned error can't find the container with id b82e58f93d1c6ab9cd2ea5f133e2dfb09100838456cf46699bcbb554a165d4a7 May 29 16:56:43.504218 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:43.504198 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ad3b2bb57678d3163019d56ce90007.slice/crio-5c0fa7e8b4564a3bd30073dfb86c245180743beb792cf392ad467c7d2c265fbd WatchSource:0}: Error finding container 5c0fa7e8b4564a3bd30073dfb86c245180743beb792cf392ad467c7d2c265fbd: Status 404 returned error can't find the container with id 5c0fa7e8b4564a3bd30073dfb86c245180743beb792cf392ad467c7d2c265fbd May 29 16:56:43.507149 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.507136 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 16:56:43.546469 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:43.546438 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-133.ec2.internal\" not found" May 29 16:56:43.596600 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.596581 2561 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 29 16:56:43.628753 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.628731 2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal" May 29 16:56:43.643801 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.643781 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 16:56:43.645195 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.645181 2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-133.ec2.internal" May 29 16:56:43.651948 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.651934 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 16:56:43.683729 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.683641 2561 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 16:56:43.894568 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:43.894542 2561 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 29 16:56:44.309774 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.309747 2561 apiserver.go:52] "Watching apiserver" May 29 16:56:44.318101 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.318074 2561 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 29 16:56:44.318423 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.318397 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-zgd4j","openshift-ovn-kubernetes/ovnkube-node-bf6q2","kube-system/kube-apiserver-proxy-ip-10-0-137-133.ec2.internal","openshift-image-registry/node-ca-bh98g","openshift-multus/multus-gqk9b","openshift-multus/network-metrics-daemon-tz999","kube-system/konnectivity-agent-7mfzc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc","openshift-cluster-node-tuning-operator/tuned-stdtw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal","openshift-multus/multus-additional-cni-plugins-ppgpq","openshift-network-diagnostics/network-check-target-ggsd5"] May 29 16:56:44.319832 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.319809 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zgd4j" May 29 16:56:44.321175 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.321038 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.323290 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.323267 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bh98g" May 29 16:56:44.324037 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.324017 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6q7wv\"" May 29 16:56:44.324189 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.324166 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 29 16:56:44.324306 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.324200 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 29 16:56:44.324900 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.324411 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 29 16:56:44.324900 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.324558 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gqk9b" May 29 16:56:44.324900 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.324616 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 29 16:56:44.324900 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.324797 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 29 16:56:44.324900 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.324847 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 29 16:56:44.325273 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.324930 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2kt7n\"" May 29 16:56:44.325273 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.324975 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 29 16:56:44.325273 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.325066 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 29 16:56:44.325273 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.325088 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 29 16:56:44.325874 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.325758 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 29 16:56:44.326560 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.326060 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vszf7\"" May 29 16:56:44.326560 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.326296 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 29 16:56:44.326560 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.326406 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7mfzc" May 29 16:56:44.326560 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.326461 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 29 16:56:44.327797 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.327777 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 29 16:56:44.327797 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.327790 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 29 16:56:44.328069 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.328047 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 29 16:56:44.328069 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.328066 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xfdzr\"" May 29 16:56:44.328275 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.328238 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.328340 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.328303 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 29 16:56:44.329358 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.329283 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 29 16:56:44.329956 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.329333 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 29 16:56:44.329956 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.329470 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dd9jr\"" May 29 16:56:44.329956 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.329714 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:44.329956 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:44.329781 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:56:44.331609 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.331582 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 29 16:56:44.331733 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.331722 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.331886 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.331839 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 29 16:56:44.332068 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.332052 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 29 16:56:44.332208 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.332191 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jftcr\"" May 29 16:56:44.333293 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.333263 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.333452 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.333234 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:56:44.333633 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:44.333572 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:56:44.334733 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.334660 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5cdvw\"" May 29 16:56:44.335141 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.334965 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 29 16:56:44.335141 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.335007 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 29 16:56:44.335854 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.335835 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 29 16:56:44.336068 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.336044 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vwtrk\"" May 29 16:56:44.336146 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.336093 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 29 16:56:44.339739 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.339553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-cni-netd\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.339739 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.339645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5wsj\" (UniqueName: \"kubernetes.io/projected/8b1bfbae-6538-4989-b8a1-446dd10dd72d-kube-api-access-r5wsj\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.339739 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.339675 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c776ba0f-d190-46f1-85e2-874f75d80904-serviceca\") pod \"node-ca-bh98g\" (UID: \"c776ba0f-d190-46f1-85e2-874f75d80904\") " pod="openshift-image-registry/node-ca-bh98g" May 29 16:56:44.339739 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.339723 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-sysctl-conf\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.339984 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.339747 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n797m\" (UniqueName: \"kubernetes.io/projected/c776ba0f-d190-46f1-85e2-874f75d80904-kube-api-access-n797m\") pod \"node-ca-bh98g\" (UID: \"c776ba0f-d190-46f1-85e2-874f75d80904\") " pod="openshift-image-registry/node-ca-bh98g" May 29 16:56:44.339984 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.339784 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.339984 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.339808 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-sysconfig\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.339984 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.339873 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ac04bdb5-2246-4a23-bb8e-23ec69d5ace3-iptables-alerter-script\") pod \"iptables-alerter-zgd4j\" (UID: \"ac04bdb5-2246-4a23-bb8e-23ec69d5ace3\") " pod="openshift-network-operator/iptables-alerter-zgd4j" May 29 16:56:44.339984 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.339900 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-var-lib-kubelet\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.339984 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.339936 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-registration-dir\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.339984 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.339963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-var-lib-cni-bin\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.340317 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340013 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b1bfbae-6538-4989-b8a1-446dd10dd72d-ovnkube-script-lib\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.340317 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340046 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-run-netns\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.340317 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-var-lib-openvswitch\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.340317 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-etc-openvswitch\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.340317 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340165 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23102591-f481-46c7-9a4a-ae10e3ab7f24-konnectivity-ca\") pod \"konnectivity-agent-7mfzc\" (UID: \"23102591-f481-46c7-9a4a-ae10e3ab7f24\") " pod="kube-system/konnectivity-agent-7mfzc" May 29 16:56:44.340317 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340183 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-slash\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.340317 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340212 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-cni-bin\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.340317 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b1bfbae-6538-4989-b8a1-446dd10dd72d-ovn-node-metrics-cert\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.340317 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340271 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-sysctl-d\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.340317 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340308 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-etc-selinux\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340338 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-run\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340373 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-var-lib-cni-multus\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340412 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbjcp\" (UniqueName: \"kubernetes.io/projected/57bc6055-1278-49c4-820e-7f501bc6552c-kube-api-access-tbjcp\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340440 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-run-systemd\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-run-ovn-kubernetes\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340488 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac04bdb5-2246-4a23-bb8e-23ec69d5ace3-host-slash\") pod \"iptables-alerter-zgd4j\" (UID: \"ac04bdb5-2246-4a23-bb8e-23ec69d5ace3\") " pod="openshift-network-operator/iptables-alerter-zgd4j" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57bc6055-1278-49c4-820e-7f501bc6552c-cni-binary-copy\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340577 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-run-netns\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-hostroot\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340631 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-run-multus-certs\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340654 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c776ba0f-d190-46f1-85e2-874f75d80904-host\") pod \"node-ca-bh98g\" (UID: \"c776ba0f-d190-46f1-85e2-874f75d80904\") " pod="openshift-image-registry/node-ca-bh98g" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340676 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-run-openvswitch\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340713 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-run-ovn\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-node-log\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340761 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-device-dir\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340783 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/980502e5-812a-42f8-a10b-3ce76f22d753-tmp\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.340803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340804 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf96w\" (UniqueName: \"kubernetes.io/projected/980502e5-812a-42f8-a10b-3ce76f22d753-kube-api-access-hf96w\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340850 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-system-cni-dir\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-kubelet\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340894 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gsss\" (UniqueName: \"kubernetes.io/projected/55e53008-1e22-4b0c-a90a-b8d94328e20e-kube-api-access-5gsss\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340939 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-sys\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.340974 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-run-k8s-cni-cncf-io\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-systemd-units\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341053 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpgwm\" (UniqueName: \"kubernetes.io/projected/ac04bdb5-2246-4a23-bb8e-23ec69d5ace3-kube-api-access-kpgwm\") pod \"iptables-alerter-zgd4j\" (UID: \"ac04bdb5-2246-4a23-bb8e-23ec69d5ace3\") " pod="openshift-network-operator/iptables-alerter-zgd4j" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341079 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-etc-kubernetes\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341102 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23102591-f481-46c7-9a4a-ae10e3ab7f24-agent-certs\") pod \"konnectivity-agent-7mfzc\" (UID: \"23102591-f481-46c7-9a4a-ae10e3ab7f24\") " pod="kube-system/konnectivity-agent-7mfzc" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341126 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-lib-modules\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-multus-cni-dir\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341205 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-cnibin\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnx2l\" (UniqueName: \"kubernetes.io/projected/47cbc84a-e410-451b-86f1-222dfcd8d0ad-kube-api-access-wnx2l\") pod \"network-metrics-daemon-tz999\" (UID: \"47cbc84a-e410-451b-86f1-222dfcd8d0ad\") " pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341252 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-modprobe-d\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341275 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-os-release\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-multus-socket-dir-parent\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.341562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341320 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/57bc6055-1278-49c4-820e-7f501bc6552c-multus-daemon-config\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.342418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b1bfbae-6538-4989-b8a1-446dd10dd72d-ovnkube-config\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.342418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341354 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-socket-dir\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.342418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341368 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-kubernetes\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.342418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341381 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-var-lib-kubelet\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.342418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/980502e5-812a-42f8-a10b-3ce76f22d753-etc-tuned\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.342418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341407 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-sys-fs\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.342418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341445 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-host\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.342418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341461 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs\") pod \"network-metrics-daemon-tz999\" (UID: \"47cbc84a-e410-451b-86f1-222dfcd8d0ad\") " pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:44.342418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-log-socket\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.342418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b1bfbae-6538-4989-b8a1-446dd10dd72d-env-overrides\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.342418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341533 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-multus-conf-dir\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.342418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341563 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.342418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.341591 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-systemd\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.374336 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.373425 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 16:51:43 +0000 UTC" deadline="2027-10-26 15:38:45.504716177 +0000 UTC" May 29 16:56:44.374336 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.373446 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12358h42m1.131272968s" May 29 16:56:44.424729 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.424670 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal" event={"ID":"b6ad3b2bb57678d3163019d56ce90007","Type":"ContainerStarted","Data":"5c0fa7e8b4564a3bd30073dfb86c245180743beb792cf392ad467c7d2c265fbd"} May 29 16:56:44.426001 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.425975 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-133.ec2.internal" event={"ID":"08ed79040e29d0c7963204127ead4896","Type":"ContainerStarted","Data":"b82e58f93d1c6ab9cd2ea5f133e2dfb09100838456cf46699bcbb554a165d4a7"} May 29 16:56:44.429916 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.429897 2561 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442538 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-slash\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442580 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-cni-bin\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442607 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-slash\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442608 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b1bfbae-6538-4989-b8a1-446dd10dd72d-ovn-node-metrics-cert\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442650 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-sysctl-d\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442678 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27c5d260-d0e2-438c-8488-bfd82910b177-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442703 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-cni-bin\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442718 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-etc-selinux\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442757 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-run\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442764 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-etc-selinux\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442796 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-var-lib-cni-multus\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442812 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-run\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442848 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-var-lib-cni-multus\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442849 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-sysctl-d\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442845 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tbjcp\" (UniqueName: \"kubernetes.io/projected/57bc6055-1278-49c4-820e-7f501bc6552c-kube-api-access-tbjcp\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442896 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwt64\" (UniqueName: \"kubernetes.io/projected/27c5d260-d0e2-438c-8488-bfd82910b177-kube-api-access-bwt64\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.443319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442924 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-run-systemd\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.442960 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-run-systemd\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443005 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-run-ovn-kubernetes\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443059 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac04bdb5-2246-4a23-bb8e-23ec69d5ace3-host-slash\") pod \"iptables-alerter-zgd4j\" (UID: \"ac04bdb5-2246-4a23-bb8e-23ec69d5ace3\") " pod="openshift-network-operator/iptables-alerter-zgd4j" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443072 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443087 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57bc6055-1278-49c4-820e-7f501bc6552c-cni-binary-copy\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443093 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac04bdb5-2246-4a23-bb8e-23ec69d5ace3-host-slash\") pod \"iptables-alerter-zgd4j\" (UID: \"ac04bdb5-2246-4a23-bb8e-23ec69d5ace3\") " pod="openshift-network-operator/iptables-alerter-zgd4j" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443113 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-run-netns\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443061 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-run-ovn-kubernetes\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443159 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-run-netns\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443191 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-hostroot\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443224 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-run-multus-certs\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443248 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c776ba0f-d190-46f1-85e2-874f75d80904-host\") pod \"node-ca-bh98g\" (UID: \"c776ba0f-d190-46f1-85e2-874f75d80904\") " pod="openshift-image-registry/node-ca-bh98g" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443275 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-hostroot\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443286 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-run-multus-certs\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443274 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-run-openvswitch\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443309 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-run-openvswitch\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443314 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c776ba0f-d190-46f1-85e2-874f75d80904-host\") pod \"node-ca-bh98g\" (UID: \"c776ba0f-d190-46f1-85e2-874f75d80904\") " pod="openshift-image-registry/node-ca-bh98g" May 29 16:56:44.444222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443329 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-run-ovn\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443355 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-node-log\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443378 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-device-dir\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443401 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-run-ovn\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443414 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-node-log\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443427 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-device-dir\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443447 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/980502e5-812a-42f8-a10b-3ce76f22d753-tmp\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443473 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hf96w\" (UniqueName: \"kubernetes.io/projected/980502e5-812a-42f8-a10b-3ce76f22d753-kube-api-access-hf96w\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443499 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-system-cni-dir\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443522 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-kubelet\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443549 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5gsss\" (UniqueName: \"kubernetes.io/projected/55e53008-1e22-4b0c-a90a-b8d94328e20e-kube-api-access-5gsss\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443571 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-sys\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443593 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-run-k8s-cni-cncf-io\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443615 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-systemd-units\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443638 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpgwm\" (UniqueName: \"kubernetes.io/projected/ac04bdb5-2246-4a23-bb8e-23ec69d5ace3-kube-api-access-kpgwm\") pod \"iptables-alerter-zgd4j\" (UID: \"ac04bdb5-2246-4a23-bb8e-23ec69d5ace3\") " pod="openshift-network-operator/iptables-alerter-zgd4j" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443640 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57bc6055-1278-49c4-820e-7f501bc6552c-cni-binary-copy\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443663 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-etc-kubernetes\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443705 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23102591-f481-46c7-9a4a-ae10e3ab7f24-agent-certs\") pod \"konnectivity-agent-7mfzc\" (UID: \"23102591-f481-46c7-9a4a-ae10e3ab7f24\") " pod="kube-system/konnectivity-agent-7mfzc" May 29 16:56:44.445088 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443737 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-lib-modules\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443760 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-multus-cni-dir\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443764 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-run-k8s-cni-cncf-io\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443781 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-system-cni-dir\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443783 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-cnibin\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443804 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-systemd-units\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443828 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnx2l\" (UniqueName: \"kubernetes.io/projected/47cbc84a-e410-451b-86f1-222dfcd8d0ad-kube-api-access-wnx2l\") pod \"network-metrics-daemon-tz999\" (UID: \"47cbc84a-e410-451b-86f1-222dfcd8d0ad\") " pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443856 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-modprobe-d\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443898 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-os-release\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-multus-cni-dir\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443937 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-multus-socket-dir-parent\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443944 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-lib-modules\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443963 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/57bc6055-1278-49c4-820e-7f501bc6552c-multus-daemon-config\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443830 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-cnibin\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.443990 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b1bfbae-6538-4989-b8a1-446dd10dd72d-ovnkube-config\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444009 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-os-release\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444014 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-socket-dir\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444033 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-sys\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.445932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444057 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-etc-kubernetes\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444062 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-kubernetes\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444097 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-var-lib-kubelet\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444112 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-multus-socket-dir-parent\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444121 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/980502e5-812a-42f8-a10b-3ce76f22d753-etc-tuned\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444148 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27c5d260-d0e2-438c-8488-bfd82910b177-system-cni-dir\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444143 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-socket-dir\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444154 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-modprobe-d\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444204 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-var-lib-kubelet\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444215 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-sys-fs\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444178 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-sys-fs\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444384 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-host\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444412 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs\") pod \"network-metrics-daemon-tz999\" (UID: \"47cbc84a-e410-451b-86f1-222dfcd8d0ad\") " pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444442 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27c5d260-d0e2-438c-8488-bfd82910b177-os-release\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27c5d260-d0e2-438c-8488-bfd82910b177-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444500 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-log-socket\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444525 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b1bfbae-6538-4989-b8a1-446dd10dd72d-env-overrides\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.446768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444551 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-multus-conf-dir\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444579 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vj2b\" (UniqueName: \"kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b\") pod \"network-check-target-ggsd5\" (UID: \"e1e737e3-e8c5-422a-a103-c227400103f9\") " pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444606 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444632 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-systemd\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444681 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-cni-netd\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444724 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5wsj\" (UniqueName: \"kubernetes.io/projected/8b1bfbae-6538-4989-b8a1-446dd10dd72d-kube-api-access-r5wsj\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444735 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b1bfbae-6538-4989-b8a1-446dd10dd72d-ovnkube-config\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444750 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/57bc6055-1278-49c4-820e-7f501bc6552c-multus-daemon-config\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444750 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c776ba0f-d190-46f1-85e2-874f75d80904-serviceca\") pod \"node-ca-bh98g\" (UID: \"c776ba0f-d190-46f1-85e2-874f75d80904\") " pod="openshift-image-registry/node-ca-bh98g" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444808 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-sysctl-conf\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444829 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-kubernetes\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444862 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-cni-netd\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444898 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-multus-conf-dir\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444929 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27c5d260-d0e2-438c-8488-bfd82910b177-cnibin\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444955 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27c5d260-d0e2-438c-8488-bfd82910b177-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.444981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27c5d260-d0e2-438c-8488-bfd82910b177-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445008 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n797m\" (UniqueName: \"kubernetes.io/projected/c776ba0f-d190-46f1-85e2-874f75d80904-kube-api-access-n797m\") pod \"node-ca-bh98g\" (UID: \"c776ba0f-d190-46f1-85e2-874f75d80904\") " pod="openshift-image-registry/node-ca-bh98g" May 29 16:56:44.447534 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445029 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445052 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-sysconfig\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445073 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ac04bdb5-2246-4a23-bb8e-23ec69d5ace3-iptables-alerter-script\") pod \"iptables-alerter-zgd4j\" (UID: \"ac04bdb5-2246-4a23-bb8e-23ec69d5ace3\") " pod="openshift-network-operator/iptables-alerter-zgd4j" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:44.445083 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445096 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-var-lib-kubelet\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:44.445194 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs podName:47cbc84a-e410-451b-86f1-222dfcd8d0ad nodeName:}" failed. No retries permitted until 2026-05-29 16:56:44.945152665 +0000 UTC m=+2.975621650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs") pod "network-metrics-daemon-tz999" (UID: "47cbc84a-e410-451b-86f1-222dfcd8d0ad") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445202 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b1bfbae-6538-4989-b8a1-446dd10dd72d-env-overrides\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445266 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-log-socket\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445309 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-kubelet\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445316 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-var-lib-kubelet\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445364 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445384 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-registration-dir\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445411 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-systemd\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445415 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-sysctl-conf\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445455 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-var-lib-cni-bin\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445417 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57bc6055-1278-49c4-820e-7f501bc6552c-host-var-lib-cni-bin\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445453 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.448346 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445495 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b1bfbae-6538-4989-b8a1-446dd10dd72d-ovnkube-script-lib\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445517 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-etc-sysconfig\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445522 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-run-netns\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445574 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55e53008-1e22-4b0c-a90a-b8d94328e20e-registration-dir\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445601 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ac04bdb5-2246-4a23-bb8e-23ec69d5ace3-iptables-alerter-script\") pod \"iptables-alerter-zgd4j\" (UID: \"ac04bdb5-2246-4a23-bb8e-23ec69d5ace3\") " pod="openshift-network-operator/iptables-alerter-zgd4j" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445606 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-var-lib-openvswitch\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445635 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-var-lib-openvswitch\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445673 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-etc-openvswitch\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445715 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23102591-f481-46c7-9a4a-ae10e3ab7f24-konnectivity-ca\") pod \"konnectivity-agent-7mfzc\" (UID: \"23102591-f481-46c7-9a4a-ae10e3ab7f24\") " pod="kube-system/konnectivity-agent-7mfzc" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445746 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-host-run-netns\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445776 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/980502e5-812a-42f8-a10b-3ce76f22d753-host\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445821 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c776ba0f-d190-46f1-85e2-874f75d80904-serviceca\") pod \"node-ca-bh98g\" (UID: \"c776ba0f-d190-46f1-85e2-874f75d80904\") " pod="openshift-image-registry/node-ca-bh98g" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.445828 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b1bfbae-6538-4989-b8a1-446dd10dd72d-etc-openvswitch\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.446053 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b1bfbae-6538-4989-b8a1-446dd10dd72d-ovnkube-script-lib\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.446268 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23102591-f481-46c7-9a4a-ae10e3ab7f24-konnectivity-ca\") pod \"konnectivity-agent-7mfzc\" (UID: \"23102591-f481-46c7-9a4a-ae10e3ab7f24\") " pod="kube-system/konnectivity-agent-7mfzc" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.446913 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/980502e5-812a-42f8-a10b-3ce76f22d753-etc-tuned\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.447106 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23102591-f481-46c7-9a4a-ae10e3ab7f24-agent-certs\") pod \"konnectivity-agent-7mfzc\" (UID: \"23102591-f481-46c7-9a4a-ae10e3ab7f24\") " pod="kube-system/konnectivity-agent-7mfzc" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.447654 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b1bfbae-6538-4989-b8a1-446dd10dd72d-ovn-node-metrics-cert\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.449147 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.448925 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/980502e5-812a-42f8-a10b-3ce76f22d753-tmp\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.451788 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.451766 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbjcp\" (UniqueName: \"kubernetes.io/projected/57bc6055-1278-49c4-820e-7f501bc6552c-kube-api-access-tbjcp\") pod \"multus-gqk9b\" (UID: \"57bc6055-1278-49c4-820e-7f501bc6552c\") " pod="openshift-multus/multus-gqk9b" May 29 16:56:44.451968 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.451907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf96w\" (UniqueName: \"kubernetes.io/projected/980502e5-812a-42f8-a10b-3ce76f22d753-kube-api-access-hf96w\") pod \"tuned-stdtw\" (UID: \"980502e5-812a-42f8-a10b-3ce76f22d753\") " pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.452910 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.452870 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gsss\" (UniqueName: \"kubernetes.io/projected/55e53008-1e22-4b0c-a90a-b8d94328e20e-kube-api-access-5gsss\") pod \"aws-ebs-csi-driver-node-9z8rc\" (UID: \"55e53008-1e22-4b0c-a90a-b8d94328e20e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.454475 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.454430 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n797m\" (UniqueName: \"kubernetes.io/projected/c776ba0f-d190-46f1-85e2-874f75d80904-kube-api-access-n797m\") pod \"node-ca-bh98g\" (UID: \"c776ba0f-d190-46f1-85e2-874f75d80904\") " pod="openshift-image-registry/node-ca-bh98g" May 29 16:56:44.454827 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.454800 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5wsj\" (UniqueName: \"kubernetes.io/projected/8b1bfbae-6538-4989-b8a1-446dd10dd72d-kube-api-access-r5wsj\") pod \"ovnkube-node-bf6q2\" (UID: \"8b1bfbae-6538-4989-b8a1-446dd10dd72d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.454898 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.454884 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnx2l\" (UniqueName: \"kubernetes.io/projected/47cbc84a-e410-451b-86f1-222dfcd8d0ad-kube-api-access-wnx2l\") pod \"network-metrics-daemon-tz999\" (UID: \"47cbc84a-e410-451b-86f1-222dfcd8d0ad\") " pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:44.455318 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.455296 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpgwm\" (UniqueName: \"kubernetes.io/projected/ac04bdb5-2246-4a23-bb8e-23ec69d5ace3-kube-api-access-kpgwm\") pod \"iptables-alerter-zgd4j\" (UID: \"ac04bdb5-2246-4a23-bb8e-23ec69d5ace3\") " pod="openshift-network-operator/iptables-alerter-zgd4j" May 29 16:56:44.547076 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.547047 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj2b\" (UniqueName: \"kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b\") pod \"network-check-target-ggsd5\" (UID: \"e1e737e3-e8c5-422a-a103-c227400103f9\") " pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:56:44.547250 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.547084 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27c5d260-d0e2-438c-8488-bfd82910b177-cnibin\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.547250 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.547108 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27c5d260-d0e2-438c-8488-bfd82910b177-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.547250 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.547183 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27c5d260-d0e2-438c-8488-bfd82910b177-cnibin\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.547250 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.547215 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27c5d260-d0e2-438c-8488-bfd82910b177-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.547454 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.547258 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27c5d260-d0e2-438c-8488-bfd82910b177-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.547454 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.547271 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27c5d260-d0e2-438c-8488-bfd82910b177-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.547454 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.547302 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bwt64\" (UniqueName: \"kubernetes.io/projected/27c5d260-d0e2-438c-8488-bfd82910b177-kube-api-access-bwt64\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.547454 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.547355 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27c5d260-d0e2-438c-8488-bfd82910b177-system-cni-dir\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.547454 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.547398 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27c5d260-d0e2-438c-8488-bfd82910b177-os-release\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.547454 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.547423 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27c5d260-d0e2-438c-8488-bfd82910b177-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.547454 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.547433 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27c5d260-d0e2-438c-8488-bfd82910b177-system-cni-dir\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.547731 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.547511 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27c5d260-d0e2-438c-8488-bfd82910b177-os-release\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.548278 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.548252 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27c5d260-d0e2-438c-8488-bfd82910b177-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.548380 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.548358 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27c5d260-d0e2-438c-8488-bfd82910b177-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.548504 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.548444 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27c5d260-d0e2-438c-8488-bfd82910b177-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.553969 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:44.553949 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 16:56:44.553969 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:44.553971 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 16:56:44.554146 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:44.553982 2561 projected.go:194] Error preparing data for projected volume kube-api-access-2vj2b for pod openshift-network-diagnostics/network-check-target-ggsd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 16:56:44.554146 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:44.554054 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b podName:e1e737e3-e8c5-422a-a103-c227400103f9 nodeName:}" failed. No retries permitted until 2026-05-29 16:56:45.054037423 +0000 UTC m=+3.084506408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2vj2b" (UniqueName: "kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b") pod "network-check-target-ggsd5" (UID: "e1e737e3-e8c5-422a-a103-c227400103f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 16:56:44.557039 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.556990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwt64\" (UniqueName: \"kubernetes.io/projected/27c5d260-d0e2-438c-8488-bfd82910b177-kube-api-access-bwt64\") pod \"multus-additional-cni-plugins-ppgpq\" (UID: \"27c5d260-d0e2-438c-8488-bfd82910b177\") " pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.617611 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.617549 2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 16:56:44.637327 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.637303 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zgd4j" May 29 16:56:44.646008 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.645987 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:56:44.654641 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.654617 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bh98g" May 29 16:56:44.661200 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.661184 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gqk9b" May 29 16:56:44.669597 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.669579 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7mfzc" May 29 16:56:44.677107 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.677090 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" May 29 16:56:44.684613 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.684593 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppgpq" May 29 16:56:44.691151 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.691133 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-stdtw" May 29 16:56:44.949026 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:44.948944 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs\") pod \"network-metrics-daemon-tz999\" (UID: \"47cbc84a-e410-451b-86f1-222dfcd8d0ad\") " pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:44.949180 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:44.949098 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 16:56:44.949180 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:44.949172 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs podName:47cbc84a-e410-451b-86f1-222dfcd8d0ad nodeName:}" failed. No retries permitted until 2026-05-29 16:56:45.949152702 +0000 UTC m=+3.979621703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs") pod "network-metrics-daemon-tz999" (UID: "47cbc84a-e410-451b-86f1-222dfcd8d0ad") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 16:56:45.150270 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.150240 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj2b\" (UniqueName: \"kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b\") pod \"network-check-target-ggsd5\" (UID: \"e1e737e3-e8c5-422a-a103-c227400103f9\") " pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:56:45.150438 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:45.150355 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 16:56:45.150438 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:45.150368 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 16:56:45.150438 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:45.150377 2561 projected.go:194] Error preparing data for projected volume kube-api-access-2vj2b for pod openshift-network-diagnostics/network-check-target-ggsd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 16:56:45.150438 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:45.150433 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b podName:e1e737e3-e8c5-422a-a103-c227400103f9 nodeName:}" failed. No retries permitted until 2026-05-29 16:56:46.150419065 +0000 UTC m=+4.180888051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vj2b" (UniqueName: "kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b") pod "network-check-target-ggsd5" (UID: "e1e737e3-e8c5-422a-a103-c227400103f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 16:56:45.296299 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:45.296268 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc776ba0f_d190_46f1_85e2_874f75d80904.slice/crio-c53dee0fb2468769c1bf2c80eca2b84743270e21c8e0b4e2c7f5c7ab306f7bf7 WatchSource:0}: Error finding container c53dee0fb2468769c1bf2c80eca2b84743270e21c8e0b4e2c7f5c7ab306f7bf7: Status 404 returned error can't find the container with id c53dee0fb2468769c1bf2c80eca2b84743270e21c8e0b4e2c7f5c7ab306f7bf7 May 29 16:56:45.302616 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:45.302582 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57bc6055_1278_49c4_820e_7f501bc6552c.slice/crio-e5fd2bf2411999127bd5e3d94f949501b63137886dbac55228e5e6ac2cf9530d WatchSource:0}: Error finding container e5fd2bf2411999127bd5e3d94f949501b63137886dbac55228e5e6ac2cf9530d: Status 404 returned error can't find the container with id e5fd2bf2411999127bd5e3d94f949501b63137886dbac55228e5e6ac2cf9530d May 29 16:56:45.303646 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:45.303627 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod980502e5_812a_42f8_a10b_3ce76f22d753.slice/crio-c346d4ebdd953457ea36760ab02423338d22fac8d87cd338500f7626943a7631 WatchSource:0}: Error finding container c346d4ebdd953457ea36760ab02423338d22fac8d87cd338500f7626943a7631: Status 404 returned error can't find the container with id c346d4ebdd953457ea36760ab02423338d22fac8d87cd338500f7626943a7631 May 29 16:56:45.304525 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:45.304449 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1bfbae_6538_4989_b8a1_446dd10dd72d.slice/crio-6dcbd0005ebd4295b1664145c3d47729b7bb1237d022e175ec14044204fd3325 WatchSource:0}: Error finding container 6dcbd0005ebd4295b1664145c3d47729b7bb1237d022e175ec14044204fd3325: Status 404 returned error can't find the container with id 6dcbd0005ebd4295b1664145c3d47729b7bb1237d022e175ec14044204fd3325 May 29 16:56:45.305606 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:45.305256 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac04bdb5_2246_4a23_bb8e_23ec69d5ace3.slice/crio-c3ece830b62e005b1f950b4e0daa629db0b56dd5d7b2ecfe5c61ac4d992c0329 WatchSource:0}: Error finding container c3ece830b62e005b1f950b4e0daa629db0b56dd5d7b2ecfe5c61ac4d992c0329: Status 404 returned error can't find the container with id c3ece830b62e005b1f950b4e0daa629db0b56dd5d7b2ecfe5c61ac4d992c0329 May 29 16:56:45.306175 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:45.306149 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e53008_1e22_4b0c_a90a_b8d94328e20e.slice/crio-8db3037781ddbc78d4742b39529c94868cf5a802f2b57f1cae8fcec77a59d06e WatchSource:0}: Error finding container 8db3037781ddbc78d4742b39529c94868cf5a802f2b57f1cae8fcec77a59d06e: Status 404 returned error can't find the container with id 8db3037781ddbc78d4742b39529c94868cf5a802f2b57f1cae8fcec77a59d06e May 29 16:56:45.307874 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:45.307849 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c5d260_d0e2_438c_8488_bfd82910b177.slice/crio-d3253f38e187c89301c53ef60913eb64db49444a17cf2c9ad2b96b2437392308 WatchSource:0}: Error finding container d3253f38e187c89301c53ef60913eb64db49444a17cf2c9ad2b96b2437392308: Status 404 returned error can't find the container with id d3253f38e187c89301c53ef60913eb64db49444a17cf2c9ad2b96b2437392308 May 29 16:56:45.311248 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:56:45.309740 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23102591_f481_46c7_9a4a_ae10e3ab7f24.slice/crio-ae8bae78c81e62c19df066021427f3be09e2687aac682e74b63ebf41899d2536 WatchSource:0}: Error finding container ae8bae78c81e62c19df066021427f3be09e2687aac682e74b63ebf41899d2536: Status 404 returned error can't find the container with id ae8bae78c81e62c19df066021427f3be09e2687aac682e74b63ebf41899d2536 May 29 16:56:45.374179 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.374152 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 16:51:43 +0000 UTC" deadline="2028-02-29 00:37:27.054739396 +0000 UTC" May 29 16:56:45.374179 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.374179 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15367h40m41.680563187s" May 29 16:56:45.419950 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.419913 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:45.420046 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:45.420025 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:56:45.428370 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.428343 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-133.ec2.internal" event={"ID":"08ed79040e29d0c7963204127ead4896","Type":"ContainerStarted","Data":"6650b40f78623e2ee833ba226f793919660e4990b0afc72dfc38d912bbc30505"} May 29 16:56:45.429388 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.429364 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgpq" event={"ID":"27c5d260-d0e2-438c-8488-bfd82910b177","Type":"ContainerStarted","Data":"d3253f38e187c89301c53ef60913eb64db49444a17cf2c9ad2b96b2437392308"} May 29 16:56:45.430383 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.430363 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zgd4j" event={"ID":"ac04bdb5-2246-4a23-bb8e-23ec69d5ace3","Type":"ContainerStarted","Data":"c3ece830b62e005b1f950b4e0daa629db0b56dd5d7b2ecfe5c61ac4d992c0329"} May 29 16:56:45.431259 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.431238 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7mfzc" event={"ID":"23102591-f481-46c7-9a4a-ae10e3ab7f24","Type":"ContainerStarted","Data":"ae8bae78c81e62c19df066021427f3be09e2687aac682e74b63ebf41899d2536"} May 29 16:56:45.432347 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.432327 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" event={"ID":"55e53008-1e22-4b0c-a90a-b8d94328e20e","Type":"ContainerStarted","Data":"8db3037781ddbc78d4742b39529c94868cf5a802f2b57f1cae8fcec77a59d06e"} May 29 16:56:45.433329 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.433302 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" event={"ID":"8b1bfbae-6538-4989-b8a1-446dd10dd72d","Type":"ContainerStarted","Data":"6dcbd0005ebd4295b1664145c3d47729b7bb1237d022e175ec14044204fd3325"} May 29 16:56:45.436107 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.436088 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-stdtw" event={"ID":"980502e5-812a-42f8-a10b-3ce76f22d753","Type":"ContainerStarted","Data":"c346d4ebdd953457ea36760ab02423338d22fac8d87cd338500f7626943a7631"} May 29 16:56:45.437124 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.437106 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gqk9b" event={"ID":"57bc6055-1278-49c4-820e-7f501bc6552c","Type":"ContainerStarted","Data":"e5fd2bf2411999127bd5e3d94f949501b63137886dbac55228e5e6ac2cf9530d"} May 29 16:56:45.437982 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.437964 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bh98g" event={"ID":"c776ba0f-d190-46f1-85e2-874f75d80904","Type":"ContainerStarted","Data":"c53dee0fb2468769c1bf2c80eca2b84743270e21c8e0b4e2c7f5c7ab306f7bf7"} May 29 16:56:45.443469 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.443433 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-133.ec2.internal" podStartSLOduration=2.443423234 podStartE2EDuration="2.443423234s" podCreationTimestamp="2026-05-29 16:56:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 16:56:45.443362983 +0000 UTC m=+3.473831991" watchObservedRunningTime="2026-05-29 16:56:45.443423234 +0000 UTC m=+3.473892243" May 29 16:56:45.959071 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:45.958992 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs\") pod \"network-metrics-daemon-tz999\" (UID: \"47cbc84a-e410-451b-86f1-222dfcd8d0ad\") " pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:45.959228 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:45.959148 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 16:56:45.959228 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:45.959219 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs podName:47cbc84a-e410-451b-86f1-222dfcd8d0ad nodeName:}" failed. No retries permitted until 2026-05-29 16:56:47.959193885 +0000 UTC m=+5.989662876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs") pod "network-metrics-daemon-tz999" (UID: "47cbc84a-e410-451b-86f1-222dfcd8d0ad") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 16:56:46.160724 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:46.160673 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj2b\" (UniqueName: \"kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b\") pod \"network-check-target-ggsd5\" (UID: \"e1e737e3-e8c5-422a-a103-c227400103f9\") " pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:56:46.160907 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:46.160882 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 16:56:46.160907 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:46.160902 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 16:56:46.161023 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:46.160915 2561 projected.go:194] Error preparing data for projected volume kube-api-access-2vj2b for pod openshift-network-diagnostics/network-check-target-ggsd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 16:56:46.161023 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:46.160979 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b podName:e1e737e3-e8c5-422a-a103-c227400103f9 nodeName:}" failed. No retries permitted until 2026-05-29 16:56:48.160959902 +0000 UTC m=+6.191428896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vj2b" (UniqueName: "kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b") pod "network-check-target-ggsd5" (UID: "e1e737e3-e8c5-422a-a103-c227400103f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 16:56:46.420649 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:46.420617 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:56:46.421158 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:46.420858 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:56:46.446173 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:46.446137 2561 generic.go:358] "Generic (PLEG): container finished" podID="b6ad3b2bb57678d3163019d56ce90007" containerID="4e38824e9bff03907d6235fe6ec79de858ca4313a254d3aa71707dadd708a840" exitCode=0 May 29 16:56:46.447081 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:46.447040 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal" event={"ID":"b6ad3b2bb57678d3163019d56ce90007","Type":"ContainerDied","Data":"4e38824e9bff03907d6235fe6ec79de858ca4313a254d3aa71707dadd708a840"} May 29 16:56:47.420165 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:47.420135 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:47.420346 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:47.420258 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:56:47.466355 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:47.466298 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal" event={"ID":"b6ad3b2bb57678d3163019d56ce90007","Type":"ContainerStarted","Data":"2646a8b665cd127568aacf8c3e13575486ff803d26e7a10139ba2756e140ab77"} May 29 16:56:47.974537 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:47.974497 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs\") pod \"network-metrics-daemon-tz999\" (UID: \"47cbc84a-e410-451b-86f1-222dfcd8d0ad\") " pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:47.974730 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:47.974655 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 16:56:47.974805 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:47.974746 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs podName:47cbc84a-e410-451b-86f1-222dfcd8d0ad nodeName:}" failed. No retries permitted until 2026-05-29 16:56:51.97472304 +0000 UTC m=+10.005192043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs") pod "network-metrics-daemon-tz999" (UID: "47cbc84a-e410-451b-86f1-222dfcd8d0ad") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 16:56:48.175832 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:48.175776 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj2b\" (UniqueName: \"kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b\") pod \"network-check-target-ggsd5\" (UID: \"e1e737e3-e8c5-422a-a103-c227400103f9\") " pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:56:48.175999 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:48.175946 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 16:56:48.175999 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:48.175968 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 16:56:48.175999 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:48.175981 2561 projected.go:194] Error preparing data for projected volume kube-api-access-2vj2b for pod openshift-network-diagnostics/network-check-target-ggsd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 16:56:48.176211 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:48.176041 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b podName:e1e737e3-e8c5-422a-a103-c227400103f9 nodeName:}" failed. No retries permitted until 2026-05-29 16:56:52.176022405 +0000 UTC m=+10.206491399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vj2b" (UniqueName: "kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b") pod "network-check-target-ggsd5" (UID: "e1e737e3-e8c5-422a-a103-c227400103f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 16:56:48.420716 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:48.420378 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:56:48.420716 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:48.420507 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:56:49.420253 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:49.420224 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:49.420699 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:49.420361 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:56:50.279223 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:50.279167 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-133.ec2.internal" podStartSLOduration=7.27914609 podStartE2EDuration="7.27914609s" podCreationTimestamp="2026-05-29 16:56:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 16:56:47.482032646 +0000 UTC m=+5.512501659" watchObservedRunningTime="2026-05-29 16:56:50.27914609 +0000 UTC m=+8.309615098" May 29 16:56:50.279420 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:50.279405 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-t722m"] May 29 16:56:50.285829 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:50.285803 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:50.285957 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:50.285894 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t722m" podUID="0247042d-f2aa-4c79-90d0-2518f915a5f8" May 29 16:56:50.397263 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:50.397231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0247042d-f2aa-4c79-90d0-2518f915a5f8-kubelet-config\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:50.397425 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:50.397269 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:50.397425 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:50.397296 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0247042d-f2aa-4c79-90d0-2518f915a5f8-dbus\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:50.420432 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:50.420366 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:56:50.420941 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:50.420497 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:56:50.498585 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:50.498553 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0247042d-f2aa-4c79-90d0-2518f915a5f8-kubelet-config\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:50.498769 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:50.498599 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:50.498769 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:50.498698 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0247042d-f2aa-4c79-90d0-2518f915a5f8-kubelet-config\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:50.498769 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:50.498739 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 16:56:50.498769 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:50.498757 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0247042d-f2aa-4c79-90d0-2518f915a5f8-dbus\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:50.498997 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:50.498805 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret podName:0247042d-f2aa-4c79-90d0-2518f915a5f8 nodeName:}" failed. No retries permitted until 2026-05-29 16:56:50.99878332 +0000 UTC m=+9.029252326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret") pod "global-pull-secret-syncer-t722m" (UID: "0247042d-f2aa-4c79-90d0-2518f915a5f8") : object "kube-system"/"original-pull-secret" not registered May 29 16:56:50.498997 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:50.498824 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0247042d-f2aa-4c79-90d0-2518f915a5f8-dbus\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:51.002886 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:51.002532 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:51.002886 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:51.002737 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 16:56:51.002886 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:51.002799 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret podName:0247042d-f2aa-4c79-90d0-2518f915a5f8 nodeName:}" failed. No retries permitted until 2026-05-29 16:56:52.002782211 +0000 UTC m=+10.033251211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret") pod "global-pull-secret-syncer-t722m" (UID: "0247042d-f2aa-4c79-90d0-2518f915a5f8") : object "kube-system"/"original-pull-secret" not registered May 29 16:56:51.420661 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:51.420626 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:51.421150 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:51.420774 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t722m" podUID="0247042d-f2aa-4c79-90d0-2518f915a5f8" May 29 16:56:51.421150 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:51.420831 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:51.421150 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:51.420964 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:56:52.010586 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:52.010547 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:52.010792 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:52.010613 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs\") pod \"network-metrics-daemon-tz999\" (UID: \"47cbc84a-e410-451b-86f1-222dfcd8d0ad\") " pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:52.010792 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:52.010731 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 16:56:52.010792 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:52.010795 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret podName:0247042d-f2aa-4c79-90d0-2518f915a5f8 nodeName:}" failed. No retries permitted until 2026-05-29 16:56:54.010780155 +0000 UTC m=+12.041249143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret") pod "global-pull-secret-syncer-t722m" (UID: "0247042d-f2aa-4c79-90d0-2518f915a5f8") : object "kube-system"/"original-pull-secret" not registered May 29 16:56:52.010962 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:52.010737 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 16:56:52.010962 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:52.010851 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs podName:47cbc84a-e410-451b-86f1-222dfcd8d0ad nodeName:}" failed. No retries permitted until 2026-05-29 16:57:00.010838286 +0000 UTC m=+18.041307287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs") pod "network-metrics-daemon-tz999" (UID: "47cbc84a-e410-451b-86f1-222dfcd8d0ad") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 16:56:52.212379 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:52.212341 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj2b\" (UniqueName: \"kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b\") pod \"network-check-target-ggsd5\" (UID: \"e1e737e3-e8c5-422a-a103-c227400103f9\") " pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:56:52.212539 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:52.212498 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 16:56:52.212539 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:52.212516 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 16:56:52.212539 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:52.212532 2561 projected.go:194] Error preparing data for projected volume kube-api-access-2vj2b for pod openshift-network-diagnostics/network-check-target-ggsd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 16:56:52.212720 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:52.212592 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b podName:e1e737e3-e8c5-422a-a103-c227400103f9 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:00.212574173 +0000 UTC m=+18.243043162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vj2b" (UniqueName: "kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b") pod "network-check-target-ggsd5" (UID: "e1e737e3-e8c5-422a-a103-c227400103f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 16:56:52.421280 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:52.421054 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:56:52.421753 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:52.421353 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:56:53.420475 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:53.420445 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:53.420651 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:53.420452 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:53.420651 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:53.420575 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:56:53.420779 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:53.420650 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t722m" podUID="0247042d-f2aa-4c79-90d0-2518f915a5f8" May 29 16:56:54.028572 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:54.028542 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:54.029014 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:54.028711 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 16:56:54.029014 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:54.028774 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret podName:0247042d-f2aa-4c79-90d0-2518f915a5f8 nodeName:}" failed. No retries permitted until 2026-05-29 16:56:58.028757249 +0000 UTC m=+16.059226241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret") pod "global-pull-secret-syncer-t722m" (UID: "0247042d-f2aa-4c79-90d0-2518f915a5f8") : object "kube-system"/"original-pull-secret" not registered May 29 16:56:54.420515 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:54.420432 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:56:54.420666 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:54.420561 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:56:55.420465 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:55.420431 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:55.420465 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:55.420450 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:55.420988 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:55.420568 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:56:55.420988 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:55.420720 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t722m" podUID="0247042d-f2aa-4c79-90d0-2518f915a5f8" May 29 16:56:56.419892 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:56.419859 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:56:56.420143 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:56.419977 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:56:57.420513 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:57.420483 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:57.421035 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:57.420486 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:57.421035 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:57.420603 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:56:57.421035 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:57.420726 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t722m" podUID="0247042d-f2aa-4c79-90d0-2518f915a5f8" May 29 16:56:58.055792 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:58.055751 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:58.055974 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:58.055905 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 16:56:58.056042 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:58.055979 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret podName:0247042d-f2aa-4c79-90d0-2518f915a5f8 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:06.05596115 +0000 UTC m=+24.086430142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret") pod "global-pull-secret-syncer-t722m" (UID: "0247042d-f2aa-4c79-90d0-2518f915a5f8") : object "kube-system"/"original-pull-secret" not registered May 29 16:56:58.420361 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:58.420285 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:56:58.420527 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:58.420389 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:56:59.420237 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:59.420204 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:56:59.420643 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:56:59.420204 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:56:59.420643 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:59.420320 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t722m" podUID="0247042d-f2aa-4c79-90d0-2518f915a5f8" May 29 16:56:59.420643 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:56:59.420384 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:57:00.072003 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:00.071966 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs\") pod \"network-metrics-daemon-tz999\" (UID: \"47cbc84a-e410-451b-86f1-222dfcd8d0ad\") " pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:57:00.072194 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:00.072084 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 16:57:00.072194 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:00.072148 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs podName:47cbc84a-e410-451b-86f1-222dfcd8d0ad nodeName:}" failed. No retries permitted until 2026-05-29 16:57:16.072129095 +0000 UTC m=+34.102598087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs") pod "network-metrics-daemon-tz999" (UID: "47cbc84a-e410-451b-86f1-222dfcd8d0ad") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 16:57:00.273997 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:00.273961 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj2b\" (UniqueName: \"kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b\") pod \"network-check-target-ggsd5\" (UID: \"e1e737e3-e8c5-422a-a103-c227400103f9\") " pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:00.274175 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:00.274095 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 16:57:00.274175 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:00.274117 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 16:57:00.274175 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:00.274129 2561 projected.go:194] Error preparing data for projected volume kube-api-access-2vj2b for pod openshift-network-diagnostics/network-check-target-ggsd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 16:57:00.274334 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:00.274187 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b podName:e1e737e3-e8c5-422a-a103-c227400103f9 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:16.274171138 +0000 UTC m=+34.304640141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vj2b" (UniqueName: "kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b") pod "network-check-target-ggsd5" (UID: "e1e737e3-e8c5-422a-a103-c227400103f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 16:57:00.420682 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:00.420600 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:00.421083 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:00.420724 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:57:01.419776 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:01.419749 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:57:01.419941 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:01.419749 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:57:01.419941 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:01.419855 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t722m" podUID="0247042d-f2aa-4c79-90d0-2518f915a5f8" May 29 16:57:01.420041 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:01.419951 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:57:02.420589 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:02.420562 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:02.421073 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:02.420653 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:57:03.420836 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.420633 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:57:03.421308 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.420644 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:57:03.421308 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:03.420879 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:57:03.421308 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:03.420938 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t722m" podUID="0247042d-f2aa-4c79-90d0-2518f915a5f8" May 29 16:57:03.494178 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.494153 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7mfzc" event={"ID":"23102591-f481-46c7-9a4a-ae10e3ab7f24","Type":"ContainerStarted","Data":"f706e213082cc1d49fdbe4f80ce2619c3195dae454c572365072d214e8cd75ae"} May 29 16:57:03.495301 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.495278 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" event={"ID":"55e53008-1e22-4b0c-a90a-b8d94328e20e","Type":"ContainerStarted","Data":"16f0420129e4d20d4127835638eafb6232adeb3d4b0f252ffc3d2efeedb391ab"} May 29 16:57:03.496564 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.496543 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 16:57:03.496913 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.496893 2561 generic.go:358] "Generic (PLEG): container finished" podID="8b1bfbae-6538-4989-b8a1-446dd10dd72d" containerID="218dea9958d0c118affd2e5aa5a117db91d7ced41ae4d27a06d710ef3793ba4f" exitCode=1 May 29 16:57:03.496997 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.496948 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" event={"ID":"8b1bfbae-6538-4989-b8a1-446dd10dd72d","Type":"ContainerDied","Data":"218dea9958d0c118affd2e5aa5a117db91d7ced41ae4d27a06d710ef3793ba4f"} May 29 16:57:03.496997 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.496978 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" event={"ID":"8b1bfbae-6538-4989-b8a1-446dd10dd72d","Type":"ContainerStarted","Data":"8befc2e1eeebb942a01a480f75c2ca726ebec647fe87abb59af2b67c28ec2ad3"} May 29 16:57:03.498109 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.498076 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-stdtw" event={"ID":"980502e5-812a-42f8-a10b-3ce76f22d753","Type":"ContainerStarted","Data":"543fd8f881ee7d8bf7c22c280108da56979e71c1281ebe6813afaf2cfa9871ef"} May 29 16:57:03.499293 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.499274 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gqk9b" event={"ID":"57bc6055-1278-49c4-820e-7f501bc6552c","Type":"ContainerStarted","Data":"98504e373b083307f290255559dcb5419a969b2c22778ee36f401c8e15142cca"} May 29 16:57:03.500458 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.500441 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bh98g" event={"ID":"c776ba0f-d190-46f1-85e2-874f75d80904","Type":"ContainerStarted","Data":"3700296ff3e51931d74ecc87b56c908428cab4d3475726da8b49c175167206af"} May 29 16:57:03.501622 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.501603 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgpq" event={"ID":"27c5d260-d0e2-438c-8488-bfd82910b177","Type":"ContainerStarted","Data":"e8f41cafd5a1672bc192014ead5e8173cfb8921567fd39796f7f402840290fd7"} May 29 16:57:03.509967 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.509932 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7mfzc" podStartSLOduration=8.534576901 podStartE2EDuration="21.509919644s" podCreationTimestamp="2026-05-29 16:56:42 +0000 UTC" firstStartedPulling="2026-05-29 16:56:45.313164822 +0000 UTC m=+3.343633823" lastFinishedPulling="2026-05-29 16:56:58.288507568 +0000 UTC m=+16.318976566" observedRunningTime="2026-05-29 16:57:03.509528622 +0000 UTC m=+21.539997629" watchObservedRunningTime="2026-05-29 16:57:03.509919644 +0000 UTC m=+21.540388652" May 29 16:57:03.523833 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.523776 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bh98g" podStartSLOduration=3.743225293 podStartE2EDuration="21.523757872s" podCreationTimestamp="2026-05-29 16:56:42 +0000 UTC" firstStartedPulling="2026-05-29 16:56:45.298791052 +0000 UTC m=+3.329260038" lastFinishedPulling="2026-05-29 16:57:03.079323618 +0000 UTC m=+21.109792617" observedRunningTime="2026-05-29 16:57:03.523011938 +0000 UTC m=+21.553480947" watchObservedRunningTime="2026-05-29 16:57:03.523757872 +0000 UTC m=+21.554226884" May 29 16:57:03.540635 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.540598 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-gqk9b" podStartSLOduration=3.729102179 podStartE2EDuration="21.540584951s" podCreationTimestamp="2026-05-29 16:56:42 +0000 UTC" firstStartedPulling="2026-05-29 16:56:45.30496423 +0000 UTC m=+3.335433226" lastFinishedPulling="2026-05-29 16:57:03.116447013 +0000 UTC m=+21.146915998" observedRunningTime="2026-05-29 16:57:03.540277506 +0000 UTC m=+21.570746515" watchObservedRunningTime="2026-05-29 16:57:03.540584951 +0000 UTC m=+21.571053985" May 29 16:57:03.581411 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:03.581360 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-stdtw" podStartSLOduration=3.783751658 podStartE2EDuration="21.581341322s" podCreationTimestamp="2026-05-29 16:56:42 +0000 UTC" firstStartedPulling="2026-05-29 16:56:45.305705774 +0000 UTC m=+3.336174760" lastFinishedPulling="2026-05-29 16:57:03.103295428 +0000 UTC m=+21.133764424" observedRunningTime="2026-05-29 16:57:03.580829463 +0000 UTC m=+21.611298483" watchObservedRunningTime="2026-05-29 16:57:03.581341322 +0000 UTC m=+21.611810331" May 29 16:57:04.420668 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:04.420529 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:04.420797 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:04.420762 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:57:04.505101 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:04.505073 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 16:57:04.505437 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:04.505405 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" event={"ID":"8b1bfbae-6538-4989-b8a1-446dd10dd72d","Type":"ContainerStarted","Data":"f8a43a251e329bce56bf002d0ca12d57504d1cae3c3678913f13e74754c467df"} May 29 16:57:04.505437 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:04.505431 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" event={"ID":"8b1bfbae-6538-4989-b8a1-446dd10dd72d","Type":"ContainerStarted","Data":"1a3e5facd2fb033e789d440887b843f2dc5fc205405a9be7fac151fb00a66360"} May 29 16:57:04.505511 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:04.505441 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" event={"ID":"8b1bfbae-6538-4989-b8a1-446dd10dd72d","Type":"ContainerStarted","Data":"c4b561609e15fabb72c2e7f845d09d35da5f4387a68c1b8c8c9756236fa2644e"} May 29 16:57:04.505511 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:04.505449 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" event={"ID":"8b1bfbae-6538-4989-b8a1-446dd10dd72d","Type":"ContainerStarted","Data":"1325eda372144c58f3627bc2c48aec2cbe0c6cacc3b41251c8fea7e2f6598c25"} May 29 16:57:04.506621 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:04.506598 2561 generic.go:358] "Generic (PLEG): container finished" podID="27c5d260-d0e2-438c-8488-bfd82910b177" containerID="e8f41cafd5a1672bc192014ead5e8173cfb8921567fd39796f7f402840290fd7" exitCode=0 May 29 16:57:04.506747 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:04.506673 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgpq" event={"ID":"27c5d260-d0e2-438c-8488-bfd82910b177","Type":"ContainerDied","Data":"e8f41cafd5a1672bc192014ead5e8173cfb8921567fd39796f7f402840290fd7"} May 29 16:57:04.507896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:04.507873 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zgd4j" event={"ID":"ac04bdb5-2246-4a23-bb8e-23ec69d5ace3","Type":"ContainerStarted","Data":"9e3c4933100bb8d8794f34cce14ea40f195470c2b7f666953ef248366867594c"} May 29 16:57:04.541091 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:04.540396 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zgd4j" podStartSLOduration=4.746369087 podStartE2EDuration="22.54038031s" podCreationTimestamp="2026-05-29 16:56:42 +0000 UTC" firstStartedPulling="2026-05-29 16:56:45.30765283 +0000 UTC m=+3.338121820" lastFinishedPulling="2026-05-29 16:57:03.101664043 +0000 UTC m=+21.132133043" observedRunningTime="2026-05-29 16:57:04.540292929 +0000 UTC m=+22.570761938" watchObservedRunningTime="2026-05-29 16:57:04.54038031 +0000 UTC m=+22.570849320" May 29 16:57:04.629051 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:04.629027 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 29 16:57:05.411975 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:05.411860 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T16:57:04.6290454Z","UUID":"ea63706e-ea9f-4179-8307-1394722fe1f0","Handler":null,"Name":"","Endpoint":""} May 29 16:57:05.415233 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:05.415205 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 29 16:57:05.415233 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:05.415236 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 29 16:57:05.420260 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:05.420230 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:57:05.420380 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:05.420362 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:57:05.420731 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:05.420710 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:57:05.420833 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:05.420817 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t722m" podUID="0247042d-f2aa-4c79-90d0-2518f915a5f8" May 29 16:57:05.511115 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:05.511087 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" event={"ID":"55e53008-1e22-4b0c-a90a-b8d94328e20e","Type":"ContainerStarted","Data":"c908733aaf50534b24dfeee613b949ce618551f8f639df34573b5b107a755ecf"} May 29 16:57:06.119839 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:06.119792 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:57:06.120039 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:06.120014 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 16:57:06.120125 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:06.120113 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret podName:0247042d-f2aa-4c79-90d0-2518f915a5f8 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:22.120094106 +0000 UTC m=+40.150563114 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret") pod "global-pull-secret-syncer-t722m" (UID: "0247042d-f2aa-4c79-90d0-2518f915a5f8") : object "kube-system"/"original-pull-secret" not registered May 29 16:57:06.422931 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:06.422866 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:06.423063 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:06.422952 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:57:06.515271 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:06.515247 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 16:57:06.515847 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:06.515640 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" event={"ID":"8b1bfbae-6538-4989-b8a1-446dd10dd72d","Type":"ContainerStarted","Data":"61cc4aff7d7dac3b4034ec1749a5afc5ea4e5533e5b5e3714ec4730a8f33b44d"} May 29 16:57:06.517338 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:06.517312 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" event={"ID":"55e53008-1e22-4b0c-a90a-b8d94328e20e","Type":"ContainerStarted","Data":"7f80209421407f9ec4b6eccb383c9052c0042e182eb30446c7eaf422292581a4"} May 29 16:57:06.534604 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:06.534556 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z8rc" podStartSLOduration=3.775293225 podStartE2EDuration="24.534539577s" podCreationTimestamp="2026-05-29 16:56:42 +0000 UTC" firstStartedPulling="2026-05-29 16:56:45.308632927 +0000 UTC m=+3.339101919" lastFinishedPulling="2026-05-29 16:57:06.067879285 +0000 UTC m=+24.098348271" observedRunningTime="2026-05-29 16:57:06.534057704 +0000 UTC m=+24.564526703" watchObservedRunningTime="2026-05-29 16:57:06.534539577 +0000 UTC m=+24.565008586" May 29 16:57:06.833831 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:06.833801 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7mfzc" May 29 16:57:06.834762 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:06.834734 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7mfzc" May 29 16:57:07.419863 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:07.419833 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:57:07.419863 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:07.419868 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:57:07.420079 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:07.419957 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t722m" podUID="0247042d-f2aa-4c79-90d0-2518f915a5f8" May 29 16:57:07.420151 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:07.420112 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:57:07.519552 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:07.519518 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7mfzc" May 29 16:57:07.520081 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:07.519967 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7mfzc" May 29 16:57:08.419863 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:08.419663 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:08.419986 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:08.419963 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:57:08.524947 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:08.524841 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 16:57:08.525381 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:08.525354 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" event={"ID":"8b1bfbae-6538-4989-b8a1-446dd10dd72d","Type":"ContainerStarted","Data":"1bf161ecc0e95a07e9d2bb95b1eaab11c0843d2e02979ba37a45c6965f3ea232"} May 29 16:57:08.525894 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:08.525860 2561 scope.go:117] "RemoveContainer" containerID="218dea9958d0c118affd2e5aa5a117db91d7ced41ae4d27a06d710ef3793ba4f" May 29 16:57:08.525973 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:08.525908 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:57:08.525973 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:08.525941 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:57:08.525973 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:08.525954 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:57:08.545173 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:08.545136 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:57:08.546835 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:08.546812 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:57:09.419868 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:09.419831 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:57:09.420033 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:09.419837 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:57:09.420033 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:09.419952 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t722m" podUID="0247042d-f2aa-4c79-90d0-2518f915a5f8" May 29 16:57:09.420131 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:09.420029 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:57:09.532749 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:09.532720 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 16:57:09.533290 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:09.533238 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" event={"ID":"8b1bfbae-6538-4989-b8a1-446dd10dd72d","Type":"ContainerStarted","Data":"45f843680d594dc96dd12c9f59ed90ed2c717dbf53ed0d6c94dc0aad17a38431"} May 29 16:57:09.565955 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:09.565906 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" podStartSLOduration=9.722188124 podStartE2EDuration="27.565892095s" podCreationTimestamp="2026-05-29 16:56:42 +0000 UTC" firstStartedPulling="2026-05-29 16:56:45.306219214 +0000 UTC m=+3.336688206" lastFinishedPulling="2026-05-29 16:57:03.149923187 +0000 UTC m=+21.180392177" observedRunningTime="2026-05-29 16:57:09.565790238 +0000 UTC m=+27.596259247" watchObservedRunningTime="2026-05-29 16:57:09.565892095 +0000 UTC m=+27.596361103" May 29 16:57:10.425533 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:10.425501 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:10.425727 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:10.425625 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:57:10.533945 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:10.533853 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t722m"] May 29 16:57:10.534378 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:10.533975 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:57:10.534378 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:10.534062 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t722m" podUID="0247042d-f2aa-4c79-90d0-2518f915a5f8" May 29 16:57:10.537379 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:10.537303 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tz999"] May 29 16:57:10.537523 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:10.537412 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:57:10.537523 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:10.537505 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:57:10.538235 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:10.538052 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ggsd5"] May 29 16:57:10.538235 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:10.538122 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:10.538235 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:10.538196 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:57:11.538652 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:11.538619 2561 generic.go:358] "Generic (PLEG): container finished" podID="27c5d260-d0e2-438c-8488-bfd82910b177" containerID="0e7c967a7c6c0cdf22f1a265b0f5a10ad6157fd0e436945320558079425d2397" exitCode=0 May 29 16:57:11.539042 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:11.538668 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgpq" event={"ID":"27c5d260-d0e2-438c-8488-bfd82910b177","Type":"ContainerDied","Data":"0e7c967a7c6c0cdf22f1a265b0f5a10ad6157fd0e436945320558079425d2397"} May 29 16:57:12.420365 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:12.420332 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:57:12.420511 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:12.420432 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t722m" podUID="0247042d-f2aa-4c79-90d0-2518f915a5f8" May 29 16:57:12.420511 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:12.420484 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:57:12.420634 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:12.420566 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:57:12.420634 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:12.420602 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:12.420747 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:12.420677 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:57:13.543521 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:13.543486 2561 generic.go:358] "Generic (PLEG): container finished" podID="27c5d260-d0e2-438c-8488-bfd82910b177" containerID="3b95e73c38abd4f78ea29a105f55a7ff846ca916ef5ed84a53f7aa5869fd171b" exitCode=0 May 29 16:57:13.544128 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:13.543533 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgpq" event={"ID":"27c5d260-d0e2-438c-8488-bfd82910b177","Type":"ContainerDied","Data":"3b95e73c38abd4f78ea29a105f55a7ff846ca916ef5ed84a53f7aa5869fd171b"} May 29 16:57:14.420606 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:14.420577 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:57:14.420780 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:14.420675 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t722m" podUID="0247042d-f2aa-4c79-90d0-2518f915a5f8" May 29 16:57:14.420780 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:14.420708 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:57:14.420780 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:14.420763 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:14.420957 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:14.420844 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggsd5" podUID="e1e737e3-e8c5-422a-a103-c227400103f9" May 29 16:57:14.421003 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:14.420949 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tz999" podUID="47cbc84a-e410-451b-86f1-222dfcd8d0ad" May 29 16:57:15.548821 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:15.548627 2561 generic.go:358] "Generic (PLEG): container finished" podID="27c5d260-d0e2-438c-8488-bfd82910b177" containerID="ecaea9156c4b9ead07f3eddbd69c88b1068ded3ad2e1dc8ae3d7bcc2e9a3e2c7" exitCode=0 May 29 16:57:15.549190 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:15.548716 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgpq" event={"ID":"27c5d260-d0e2-438c-8488-bfd82910b177","Type":"ContainerDied","Data":"ecaea9156c4b9ead07f3eddbd69c88b1068ded3ad2e1dc8ae3d7bcc2e9a3e2c7"} May 29 16:57:16.096116 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.096041 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs\") pod \"network-metrics-daemon-tz999\" (UID: \"47cbc84a-e410-451b-86f1-222dfcd8d0ad\") " pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:57:16.096303 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.096165 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 16:57:16.096303 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.096218 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs podName:47cbc84a-e410-451b-86f1-222dfcd8d0ad nodeName:}" failed. No retries permitted until 2026-05-29 16:57:48.096204064 +0000 UTC m=+66.126673049 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs") pod "network-metrics-daemon-tz999" (UID: "47cbc84a-e410-451b-86f1-222dfcd8d0ad") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 16:57:16.298273 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.298232 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj2b\" (UniqueName: \"kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b\") pod \"network-check-target-ggsd5\" (UID: \"e1e737e3-e8c5-422a-a103-c227400103f9\") " pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:16.298490 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.298353 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 16:57:16.298490 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.298367 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 16:57:16.298490 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.298376 2561 projected.go:194] Error preparing data for projected volume kube-api-access-2vj2b for pod openshift-network-diagnostics/network-check-target-ggsd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 16:57:16.298490 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.298428 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b podName:e1e737e3-e8c5-422a-a103-c227400103f9 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:48.298410835 +0000 UTC m=+66.328879824 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vj2b" (UniqueName: "kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b") pod "network-check-target-ggsd5" (UID: "e1e737e3-e8c5-422a-a103-c227400103f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 16:57:16.327835 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.327804 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-133.ec2.internal" event="NodeReady" May 29 16:57:16.328007 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.327939 2561 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 29 16:57:16.360012 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.359955 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-88b8fcd86-2mtfz"] May 29 16:57:16.376678 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.376653 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.378160 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.378128 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-88b8fcd86-2mtfz"] May 29 16:57:16.378751 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.378727 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6"] May 29 16:57:16.380016 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.379997 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 29 16:57:16.380016 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.379997 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vq84q\"" May 29 16:57:16.380821 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.380798 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 29 16:57:16.386429 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.386407 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 29 16:57:16.389075 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.389056 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 29 16:57:16.392528 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.392508 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wdlpr"] May 29 16:57:16.392679 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.392658 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:16.403097 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.402920 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 29 16:57:16.403366 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.403344 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5flcw\"" May 29 16:57:16.404205 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.404183 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 29 16:57:16.404635 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.404614 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 29 16:57:16.405485 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.405464 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 29 16:57:16.408331 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.408309 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-78d54b76f9-bx987"] May 29 16:57:16.408480 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.408462 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wdlpr" May 29 16:57:16.413541 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.413366 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 29 16:57:16.413541 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.413390 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 29 16:57:16.413541 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.413395 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 29 16:57:16.413952 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.413935 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fgcrt\"" May 29 16:57:16.422758 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.422736 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-jvk9t"] May 29 16:57:16.422855 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.422846 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:16.422924 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.422853 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:57:16.422924 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.422854 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:16.422924 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.422854 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:57:16.427529 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.427507 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 16:57:16.427707 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.427664 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 16:57:16.427976 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.427944 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fng4t\"" May 29 16:57:16.428313 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.428296 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 29 16:57:16.428403 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.428349 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 29 16:57:16.433509 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.433488 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gvkkc\"" May 29 16:57:16.433623 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.433605 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 29 16:57:16.434024 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.433995 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 29 16:57:16.434348 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.434330 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 29 16:57:16.435222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.434483 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 16:57:16.435222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.434645 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 29 16:57:16.435222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.434774 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 29 16:57:16.435222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.435078 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8j4sp\"" May 29 16:57:16.441044 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.441026 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.444518 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.444503 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9"] May 29 16:57:16.446875 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.446859 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tlg5v\"" May 29 16:57:16.447220 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.447194 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 29 16:57:16.447312 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.447216 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 29 16:57:16.447841 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.447647 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 29 16:57:16.447841 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.447660 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 29 16:57:16.454418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.454399 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 29 16:57:16.457566 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.457547 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c677647d6-dp45n"] May 29 16:57:16.457861 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.457829 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" May 29 16:57:16.461240 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.461216 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 29 16:57:16.468335 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.468308 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 29 16:57:16.468461 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.468407 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 29 16:57:16.469004 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.468504 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 29 16:57:16.474487 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.474416 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6"] May 29 16:57:16.475037 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.474614 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c677647d6-dp45n" May 29 16:57:16.477531 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.477513 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-l4xbq\"" May 29 16:57:16.477631 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.477575 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 29 16:57:16.489335 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.488985 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6"] May 29 16:57:16.489335 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.489011 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wdlpr"] May 29 16:57:16.489335 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.489043 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c677647d6-dp45n"] May 29 16:57:16.489335 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.489056 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9"] May 29 16:57:16.489335 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.489069 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-jvk9t"] May 29 16:57:16.489335 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.489080 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78d54b76f9-bx987"] May 29 16:57:16.489335 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.489090 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6"] May 29 16:57:16.489335 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.489130 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mggz6"] May 29 16:57:16.499804 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.499769 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-installation-pull-secrets\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.499922 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.499819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czmsg\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-kube-api-access-czmsg\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.499979 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.499928 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-certificates\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.499979 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.499964 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert\") pod \"ingress-canary-wdlpr\" (UID: \"a44d2b9b-42c3-4e55-bbaa-6453218224b7\") " pod="openshift-ingress-canary/ingress-canary-wdlpr" May 29 16:57:16.500078 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.499989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jt5p\" (UniqueName: \"kubernetes.io/projected/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-kube-api-access-2jt5p\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:16.500078 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.500032 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9js7w\" (UniqueName: \"kubernetes.io/projected/a44d2b9b-42c3-4e55-bbaa-6453218224b7-kube-api-access-9js7w\") pod \"ingress-canary-wdlpr\" (UID: \"a44d2b9b-42c3-4e55-bbaa-6453218224b7\") " pod="openshift-ingress-canary/ingress-canary-wdlpr" May 29 16:57:16.500179 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.500107 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:16.500179 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.500138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-image-registry-private-configuration\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.500179 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.500156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-ca-trust-extracted\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.500179 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.500171 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:16.500358 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.500195 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-trusted-ca\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.500358 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.500219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-bound-sa-token\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.500358 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.500251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.506135 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.506116 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mggz6"] May 29 16:57:16.506242 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.506225 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mggz6" May 29 16:57:16.506375 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.506224 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.508855 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.508809 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 29 16:57:16.509047 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.509028 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xwwt6\"" May 29 16:57:16.509155 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.509134 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 29 16:57:16.509249 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.509211 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 29 16:57:16.509351 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.509328 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 29 16:57:16.509454 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.509429 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 29 16:57:16.509454 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.509438 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 29 16:57:16.509566 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.509554 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 29 16:57:16.509619 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.509554 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 29 16:57:16.601485 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.601455 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:16.601485 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.601488 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94hrz\" (UniqueName: \"kubernetes.io/projected/5108e1f2-5160-478c-acaa-075ca785c5c6-kube-api-access-94hrz\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.601518 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.601546 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-image-registry-private-configuration\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.601564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-tmp\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.601580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5108e1f2-5160-478c-acaa-075ca785c5c6-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.601600 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.601617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9spv\" (UniqueName: \"kubernetes.io/projected/acd4c04d-a3da-45f2-94a9-e97dc6a4048f-kube-api-access-b9spv\") pod \"klusterlet-addon-workmgr-784d948f5b-86ff9\" (UID: \"acd4c04d-a3da-45f2-94a9-e97dc6a4048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.601646 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-trusted-ca\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.601659 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls podName:18d06c9c-d13c-4bd0-a23f-6ceffe36743e nodeName:}" failed. No retries permitted until 2026-05-29 16:57:17.101640554 +0000 UTC m=+35.132109566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-vbmm6" (UID: "18d06c9c-d13c-4bd0-a23f-6ceffe36743e") : secret "cluster-monitoring-operator-tls" not found May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.601765 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.601901 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.601912 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b8fcd86-2mtfz: secret "image-registry-tls" not found May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.601899 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-installation-pull-secrets\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.601962 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls podName:b415f2d5-93da-4d4d-bfdd-7252d4ae89f9 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:17.101946206 +0000 UTC m=+35.132415194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls") pod "image-registry-88b8fcd86-2mtfz" (UID: "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9") : secret "image-registry-tls" not found May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.601986 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5108e1f2-5160-478c-acaa-075ca785c5c6-ca\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602018 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwtbh\" (UniqueName: \"kubernetes.io/projected/ee1eec81-b979-4fdd-b042-38a9d11f4261-kube-api-access-bwtbh\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:16.602082 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602054 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-certificates\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602073 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jt5p\" (UniqueName: \"kubernetes.io/projected/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-kube-api-access-2jt5p\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602093 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-serving-cert\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602119 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5108e1f2-5160-478c-acaa-075ca785c5c6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602147 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfrs4\" (UniqueName: \"kubernetes.io/projected/c426533b-1994-4746-81e3-5d35373389a3-kube-api-access-gfrs4\") pod \"managed-serviceaccount-addon-agent-5c677647d6-dp45n\" (UID: \"c426533b-1994-4746-81e3-5d35373389a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c677647d6-dp45n" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602173 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5108e1f2-5160-478c-acaa-075ca785c5c6-hub\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee1eec81-b979-4fdd-b042-38a9d11f4261-tmp-dir\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acd4c04d-a3da-45f2-94a9-e97dc6a4048f-tmp\") pod \"klusterlet-addon-workmgr-784d948f5b-86ff9\" (UID: \"acd4c04d-a3da-45f2-94a9-e97dc6a4048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkw7q\" (UniqueName: \"kubernetes.io/projected/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-kube-api-access-rkw7q\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5108e1f2-5160-478c-acaa-075ca785c5c6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602349 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602370 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-ca-trust-extracted\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602422 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602467 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee1eec81-b979-4fdd-b042-38a9d11f4261-config-volume\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602504 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:16.602891 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602540 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-bound-sa-token\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602580 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czmsg\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-kube-api-access-czmsg\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602593 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-trusted-ca\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602611 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-stats-auth\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602615 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-ca-trust-extracted\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c426533b-1994-4746-81e3-5d35373389a3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c677647d6-dp45n\" (UID: \"c426533b-1994-4746-81e3-5d35373389a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c677647d6-dp45n" May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602665 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert\") pod \"ingress-canary-wdlpr\" (UID: \"a44d2b9b-42c3-4e55-bbaa-6453218224b7\") " pod="openshift-ingress-canary/ingress-canary-wdlpr" May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602663 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-certificates\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602725 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-service-ca-bundle\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.602762 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602765 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9js7w\" (UniqueName: \"kubernetes.io/projected/a44d2b9b-42c3-4e55-bbaa-6453218224b7-kube-api-access-9js7w\") pod \"ingress-canary-wdlpr\" (UID: \"a44d2b9b-42c3-4e55-bbaa-6453218224b7\") " pod="openshift-ingress-canary/ingress-canary-wdlpr" May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602803 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-default-certificate\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.602812 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert podName:a44d2b9b-42c3-4e55-bbaa-6453218224b7 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:17.102799985 +0000 UTC m=+35.133268975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert") pod "ingress-canary-wdlpr" (UID: "a44d2b9b-42c3-4e55-bbaa-6453218224b7") : secret "canary-serving-cert" not found May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602854 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-snapshots\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602903 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4txd9\" (UniqueName: \"kubernetes.io/projected/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-kube-api-access-4txd9\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:16.603334 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602929 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.603834 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.602951 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/acd4c04d-a3da-45f2-94a9-e97dc6a4048f-klusterlet-config\") pod \"klusterlet-addon-workmgr-784d948f5b-86ff9\" (UID: \"acd4c04d-a3da-45f2-94a9-e97dc6a4048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" May 29 16:57:16.605778 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.605762 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-installation-pull-secrets\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.605912 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.605897 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-image-registry-private-configuration\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.611428 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.611359 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czmsg\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-kube-api-access-czmsg\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.611516 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.611436 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-bound-sa-token\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:16.611561 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.611544 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9js7w\" (UniqueName: \"kubernetes.io/projected/a44d2b9b-42c3-4e55-bbaa-6453218224b7-kube-api-access-9js7w\") pod \"ingress-canary-wdlpr\" (UID: \"a44d2b9b-42c3-4e55-bbaa-6453218224b7\") " pod="openshift-ingress-canary/ingress-canary-wdlpr" May 29 16:57:16.611893 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.611877 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jt5p\" (UniqueName: \"kubernetes.io/projected/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-kube-api-access-2jt5p\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:16.703492 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703463 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-stats-auth\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:16.703492 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703497 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c426533b-1994-4746-81e3-5d35373389a3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c677647d6-dp45n\" (UID: \"c426533b-1994-4746-81e3-5d35373389a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c677647d6-dp45n" May 29 16:57:16.703768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703532 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-service-ca-bundle\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.703768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703559 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-default-certificate\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:16.703768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703589 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-snapshots\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.703768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703614 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:16.703768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703639 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4txd9\" (UniqueName: \"kubernetes.io/projected/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-kube-api-access-4txd9\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:16.703768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703666 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.703768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703722 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/acd4c04d-a3da-45f2-94a9-e97dc6a4048f-klusterlet-config\") pod \"klusterlet-addon-workmgr-784d948f5b-86ff9\" (UID: \"acd4c04d-a3da-45f2-94a9-e97dc6a4048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" May 29 16:57:16.703768 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703757 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94hrz\" (UniqueName: \"kubernetes.io/projected/5108e1f2-5160-478c-acaa-075ca785c5c6-kube-api-access-94hrz\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.704113 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703813 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-tmp\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.704113 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703836 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5108e1f2-5160-478c-acaa-075ca785c5c6-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.704113 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703867 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9spv\" (UniqueName: \"kubernetes.io/projected/acd4c04d-a3da-45f2-94a9-e97dc6a4048f-kube-api-access-b9spv\") pod \"klusterlet-addon-workmgr-784d948f5b-86ff9\" (UID: \"acd4c04d-a3da-45f2-94a9-e97dc6a4048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" May 29 16:57:16.704113 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703908 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5108e1f2-5160-478c-acaa-075ca785c5c6-ca\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.704113 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703947 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bwtbh\" (UniqueName: \"kubernetes.io/projected/ee1eec81-b979-4fdd-b042-38a9d11f4261-kube-api-access-bwtbh\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:16.704113 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.703999 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-serving-cert\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.704113 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.704023 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5108e1f2-5160-478c-acaa-075ca785c5c6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.704113 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.704050 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfrs4\" (UniqueName: \"kubernetes.io/projected/c426533b-1994-4746-81e3-5d35373389a3-kube-api-access-gfrs4\") pod \"managed-serviceaccount-addon-agent-5c677647d6-dp45n\" (UID: \"c426533b-1994-4746-81e3-5d35373389a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c677647d6-dp45n" May 29 16:57:16.704113 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.704074 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5108e1f2-5160-478c-acaa-075ca785c5c6-hub\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.704113 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.704096 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee1eec81-b979-4fdd-b042-38a9d11f4261-tmp-dir\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:16.704113 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.704119 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acd4c04d-a3da-45f2-94a9-e97dc6a4048f-tmp\") pod \"klusterlet-addon-workmgr-784d948f5b-86ff9\" (UID: \"acd4c04d-a3da-45f2-94a9-e97dc6a4048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" May 29 16:57:16.704603 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.704148 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkw7q\" (UniqueName: \"kubernetes.io/projected/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-kube-api-access-rkw7q\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.704603 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.704174 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5108e1f2-5160-478c-acaa-075ca785c5c6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.704603 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.704209 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:16.704603 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.704237 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee1eec81-b979-4fdd-b042-38a9d11f4261-config-volume\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:16.704603 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.704263 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:16.704603 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.704362 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-snapshots\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.704603 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.704389 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 16:57:16.704603 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.704390 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-service-ca-bundle\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.704603 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.704446 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs podName:9e8b3057-a3bb-4e0c-9066-52577b25fcd4 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:17.204427602 +0000 UTC m=+35.234896592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs") pod "router-default-78d54b76f9-bx987" (UID: "9e8b3057-a3bb-4e0c-9066-52577b25fcd4") : secret "router-metrics-certs-default" not found May 29 16:57:16.705090 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.704773 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle podName:9e8b3057-a3bb-4e0c-9066-52577b25fcd4 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:17.204755375 +0000 UTC m=+35.235224384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle") pod "router-default-78d54b76f9-bx987" (UID: "9e8b3057-a3bb-4e0c-9066-52577b25fcd4") : configmap references non-existent config key: service-ca.crt May 29 16:57:16.705404 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.705376 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acd4c04d-a3da-45f2-94a9-e97dc6a4048f-tmp\") pod \"klusterlet-addon-workmgr-784d948f5b-86ff9\" (UID: \"acd4c04d-a3da-45f2-94a9-e97dc6a4048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" May 29 16:57:16.705498 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.705413 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-tmp\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.705560 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.705498 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.705766 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.705737 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee1eec81-b979-4fdd-b042-38a9d11f4261-tmp-dir\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:16.707061 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.706627 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5108e1f2-5160-478c-acaa-075ca785c5c6-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.707061 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.706768 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 16:57:16.707061 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:16.706826 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls podName:ee1eec81-b979-4fdd-b042-38a9d11f4261 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:17.206809713 +0000 UTC m=+35.237278702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls") pod "dns-default-mggz6" (UID: "ee1eec81-b979-4fdd-b042-38a9d11f4261") : secret "dns-default-metrics-tls" not found May 29 16:57:16.707290 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.707153 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-stats-auth\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:16.708095 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.708051 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-default-certificate\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:16.708395 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.708370 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5108e1f2-5160-478c-acaa-075ca785c5c6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.708916 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.708887 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee1eec81-b979-4fdd-b042-38a9d11f4261-config-volume\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:16.708916 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.708907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c426533b-1994-4746-81e3-5d35373389a3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c677647d6-dp45n\" (UID: \"c426533b-1994-4746-81e3-5d35373389a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c677647d6-dp45n" May 29 16:57:16.709294 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.709268 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-serving-cert\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.709511 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.709463 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5108e1f2-5160-478c-acaa-075ca785c5c6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.709615 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.709603 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5108e1f2-5160-478c-acaa-075ca785c5c6-hub\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.710026 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.710003 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/acd4c04d-a3da-45f2-94a9-e97dc6a4048f-klusterlet-config\") pod \"klusterlet-addon-workmgr-784d948f5b-86ff9\" (UID: \"acd4c04d-a3da-45f2-94a9-e97dc6a4048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" May 29 16:57:16.710799 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.710765 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5108e1f2-5160-478c-acaa-075ca785c5c6-ca\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.714633 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.714546 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94hrz\" (UniqueName: \"kubernetes.io/projected/5108e1f2-5160-478c-acaa-075ca785c5c6-kube-api-access-94hrz\") pod \"cluster-proxy-proxy-agent-6b996b6c5d-vfst6\" (UID: \"5108e1f2-5160-478c-acaa-075ca785c5c6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.714848 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.714762 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwtbh\" (UniqueName: \"kubernetes.io/projected/ee1eec81-b979-4fdd-b042-38a9d11f4261-kube-api-access-bwtbh\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:16.715035 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.715017 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4txd9\" (UniqueName: \"kubernetes.io/projected/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-kube-api-access-4txd9\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:16.715512 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.715469 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkw7q\" (UniqueName: \"kubernetes.io/projected/49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9-kube-api-access-rkw7q\") pod \"insights-operator-788bf58df5-jvk9t\" (UID: \"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9\") " pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.716151 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.716133 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9spv\" (UniqueName: \"kubernetes.io/projected/acd4c04d-a3da-45f2-94a9-e97dc6a4048f-kube-api-access-b9spv\") pod \"klusterlet-addon-workmgr-784d948f5b-86ff9\" (UID: \"acd4c04d-a3da-45f2-94a9-e97dc6a4048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" May 29 16:57:16.716226 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.716187 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfrs4\" (UniqueName: \"kubernetes.io/projected/c426533b-1994-4746-81e3-5d35373389a3-kube-api-access-gfrs4\") pod \"managed-serviceaccount-addon-agent-5c677647d6-dp45n\" (UID: \"c426533b-1994-4746-81e3-5d35373389a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c677647d6-dp45n" May 29 16:57:16.757392 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.757363 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-ptscs"] May 29 16:57:16.766547 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.766526 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-jvk9t" May 29 16:57:16.773288 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.773271 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" May 29 16:57:16.786310 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.786293 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ptscs" May 29 16:57:16.789634 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.789612 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fxlbd\"" May 29 16:57:16.792046 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.791935 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c677647d6-dp45n" May 29 16:57:16.823436 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.823330 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:57:16.909930 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.909218 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c542210a-b54a-4c1a-8e34-e5d0372453e8-tmp-dir\") pod \"node-resolver-ptscs\" (UID: \"c542210a-b54a-4c1a-8e34-e5d0372453e8\") " pod="openshift-dns/node-resolver-ptscs" May 29 16:57:16.909930 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.909309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c542210a-b54a-4c1a-8e34-e5d0372453e8-hosts-file\") pod \"node-resolver-ptscs\" (UID: \"c542210a-b54a-4c1a-8e34-e5d0372453e8\") " pod="openshift-dns/node-resolver-ptscs" May 29 16:57:16.909930 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.909337 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcmzd\" (UniqueName: \"kubernetes.io/projected/c542210a-b54a-4c1a-8e34-e5d0372453e8-kube-api-access-pcmzd\") pod \"node-resolver-ptscs\" (UID: \"c542210a-b54a-4c1a-8e34-e5d0372453e8\") " pod="openshift-dns/node-resolver-ptscs" May 29 16:57:16.975374 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.975340 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-jvk9t"] May 29 16:57:16.979410 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:57:16.979370 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b43e3a_ca8f_401d_bef1_e0d73e4ebaf9.slice/crio-1d6c496553e54967c5255ef65bc553efda023317a9bc12b632631f697c84d86f WatchSource:0}: Error finding container 1d6c496553e54967c5255ef65bc553efda023317a9bc12b632631f697c84d86f: Status 404 returned error can't find the container with id 1d6c496553e54967c5255ef65bc553efda023317a9bc12b632631f697c84d86f May 29 16:57:16.989075 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.989034 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c677647d6-dp45n"] May 29 16:57:16.990536 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:16.990502 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9"] May 29 16:57:16.991345 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:57:16.991313 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc426533b_1994_4746_81e3_5d35373389a3.slice/crio-cfb86ea74035f0d46ad4c6dcaf07caaeeb187bfe7578b89d78d8f89cc4e00e4e WatchSource:0}: Error finding container cfb86ea74035f0d46ad4c6dcaf07caaeeb187bfe7578b89d78d8f89cc4e00e4e: Status 404 returned error can't find the container with id cfb86ea74035f0d46ad4c6dcaf07caaeeb187bfe7578b89d78d8f89cc4e00e4e May 29 16:57:16.993440 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:57:16.993409 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd4c04d_a3da_45f2_94a9_e97dc6a4048f.slice/crio-899cdffeddab631190bc8477a3fe8d99098f60a28ec3004d024dcd11283ed6ed WatchSource:0}: Error finding container 899cdffeddab631190bc8477a3fe8d99098f60a28ec3004d024dcd11283ed6ed: Status 404 returned error can't find the container with id 899cdffeddab631190bc8477a3fe8d99098f60a28ec3004d024dcd11283ed6ed May 29 16:57:17.011674 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.011649 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c542210a-b54a-4c1a-8e34-e5d0372453e8-tmp-dir\") pod \"node-resolver-ptscs\" (UID: \"c542210a-b54a-4c1a-8e34-e5d0372453e8\") " pod="openshift-dns/node-resolver-ptscs" May 29 16:57:17.011794 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.011736 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c542210a-b54a-4c1a-8e34-e5d0372453e8-hosts-file\") pod \"node-resolver-ptscs\" (UID: \"c542210a-b54a-4c1a-8e34-e5d0372453e8\") " pod="openshift-dns/node-resolver-ptscs" May 29 16:57:17.011794 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.011760 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcmzd\" (UniqueName: \"kubernetes.io/projected/c542210a-b54a-4c1a-8e34-e5d0372453e8-kube-api-access-pcmzd\") pod \"node-resolver-ptscs\" (UID: \"c542210a-b54a-4c1a-8e34-e5d0372453e8\") " pod="openshift-dns/node-resolver-ptscs" May 29 16:57:17.011903 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.011881 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c542210a-b54a-4c1a-8e34-e5d0372453e8-hosts-file\") pod \"node-resolver-ptscs\" (UID: \"c542210a-b54a-4c1a-8e34-e5d0372453e8\") " pod="openshift-dns/node-resolver-ptscs" May 29 16:57:17.012026 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.011999 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c542210a-b54a-4c1a-8e34-e5d0372453e8-tmp-dir\") pod \"node-resolver-ptscs\" (UID: \"c542210a-b54a-4c1a-8e34-e5d0372453e8\") " pod="openshift-dns/node-resolver-ptscs" May 29 16:57:17.015421 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.015390 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6"] May 29 16:57:17.018866 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:57:17.018841 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5108e1f2_5160_478c_acaa_075ca785c5c6.slice/crio-03b542cbf7b083d3939ff1085e8069ce121d48e938588506829f82ea7d3b9856 WatchSource:0}: Error finding container 03b542cbf7b083d3939ff1085e8069ce121d48e938588506829f82ea7d3b9856: Status 404 returned error can't find the container with id 03b542cbf7b083d3939ff1085e8069ce121d48e938588506829f82ea7d3b9856 May 29 16:57:17.021836 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.021815 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcmzd\" (UniqueName: \"kubernetes.io/projected/c542210a-b54a-4c1a-8e34-e5d0372453e8-kube-api-access-pcmzd\") pod \"node-resolver-ptscs\" (UID: \"c542210a-b54a-4c1a-8e34-e5d0372453e8\") " pod="openshift-dns/node-resolver-ptscs" May 29 16:57:17.105401 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.105359 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ptscs" May 29 16:57:17.112358 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.112332 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:17.112473 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.112456 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert\") pod \"ingress-canary-wdlpr\" (UID: \"a44d2b9b-42c3-4e55-bbaa-6453218224b7\") " pod="openshift-ingress-canary/ingress-canary-wdlpr" May 29 16:57:17.112531 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:17.112491 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 16:57:17.112531 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:17.112511 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b8fcd86-2mtfz: secret "image-registry-tls" not found May 29 16:57:17.112679 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.112539 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:17.112679 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:17.112564 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls podName:b415f2d5-93da-4d4d-bfdd-7252d4ae89f9 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:18.112546788 +0000 UTC m=+36.143015777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls") pod "image-registry-88b8fcd86-2mtfz" (UID: "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9") : secret "image-registry-tls" not found May 29 16:57:17.112679 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:17.112625 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 29 16:57:17.112679 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:17.112668 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 16:57:17.112877 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:17.112712 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls podName:18d06c9c-d13c-4bd0-a23f-6ceffe36743e nodeName:}" failed. No retries permitted until 2026-05-29 16:57:18.112680056 +0000 UTC m=+36.143149047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-vbmm6" (UID: "18d06c9c-d13c-4bd0-a23f-6ceffe36743e") : secret "cluster-monitoring-operator-tls" not found May 29 16:57:17.112877 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:17.112751 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert podName:a44d2b9b-42c3-4e55-bbaa-6453218224b7 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:18.112735449 +0000 UTC m=+36.143204451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert") pod "ingress-canary-wdlpr" (UID: "a44d2b9b-42c3-4e55-bbaa-6453218224b7") : secret "canary-serving-cert" not found May 29 16:57:17.113659 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:57:17.113635 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc542210a_b54a_4c1a_8e34_e5d0372453e8.slice/crio-2c6e77ba6a68488ac2e5bfd0fb35668f23c5eef7f61240ca1a9723d1e0fd6e11 WatchSource:0}: Error finding container 2c6e77ba6a68488ac2e5bfd0fb35668f23c5eef7f61240ca1a9723d1e0fd6e11: Status 404 returned error can't find the container with id 2c6e77ba6a68488ac2e5bfd0fb35668f23c5eef7f61240ca1a9723d1e0fd6e11 May 29 16:57:17.214007 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.213821 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:17.214132 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.214039 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:17.214132 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:17.213966 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 16:57:17.214132 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.214093 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:17.214287 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:17.214148 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls podName:ee1eec81-b979-4fdd-b042-38a9d11f4261 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:18.214129892 +0000 UTC m=+36.244598878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls") pod "dns-default-mggz6" (UID: "ee1eec81-b979-4fdd-b042-38a9d11f4261") : secret "dns-default-metrics-tls" not found May 29 16:57:17.214287 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:17.214200 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle podName:9e8b3057-a3bb-4e0c-9066-52577b25fcd4 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:18.214189022 +0000 UTC m=+36.244658023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle") pod "router-default-78d54b76f9-bx987" (UID: "9e8b3057-a3bb-4e0c-9066-52577b25fcd4") : configmap references non-existent config key: service-ca.crt May 29 16:57:17.214287 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:17.214203 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 16:57:17.214287 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:17.214263 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs podName:9e8b3057-a3bb-4e0c-9066-52577b25fcd4 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:18.214245771 +0000 UTC m=+36.244714762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs") pod "router-default-78d54b76f9-bx987" (UID: "9e8b3057-a3bb-4e0c-9066-52577b25fcd4") : secret "router-metrics-certs-default" not found May 29 16:57:17.554032 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.553991 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c677647d6-dp45n" event={"ID":"c426533b-1994-4746-81e3-5d35373389a3","Type":"ContainerStarted","Data":"cfb86ea74035f0d46ad4c6dcaf07caaeeb187bfe7578b89d78d8f89cc4e00e4e"} May 29 16:57:17.555123 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.555088 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" event={"ID":"acd4c04d-a3da-45f2-94a9-e97dc6a4048f","Type":"ContainerStarted","Data":"899cdffeddab631190bc8477a3fe8d99098f60a28ec3004d024dcd11283ed6ed"} May 29 16:57:17.556444 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.556419 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ptscs" event={"ID":"c542210a-b54a-4c1a-8e34-e5d0372453e8","Type":"ContainerStarted","Data":"12323a03618101254f07ff1301bc2950c8c8db163f65176d29c201966cfbc1ac"} May 29 16:57:17.556580 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.556455 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ptscs" event={"ID":"c542210a-b54a-4c1a-8e34-e5d0372453e8","Type":"ContainerStarted","Data":"2c6e77ba6a68488ac2e5bfd0fb35668f23c5eef7f61240ca1a9723d1e0fd6e11"} May 29 16:57:17.557703 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.557668 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" event={"ID":"5108e1f2-5160-478c-acaa-075ca785c5c6","Type":"ContainerStarted","Data":"03b542cbf7b083d3939ff1085e8069ce121d48e938588506829f82ea7d3b9856"} May 29 16:57:17.558744 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.558725 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-jvk9t" event={"ID":"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9","Type":"ContainerStarted","Data":"1d6c496553e54967c5255ef65bc553efda023317a9bc12b632631f697c84d86f"} May 29 16:57:17.575373 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:17.575326 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ptscs" podStartSLOduration=1.575310555 podStartE2EDuration="1.575310555s" podCreationTimestamp="2026-05-29 16:57:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 16:57:17.574237667 +0000 UTC m=+35.604706686" watchObservedRunningTime="2026-05-29 16:57:17.575310555 +0000 UTC m=+35.605779562" May 29 16:57:18.123372 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:18.123334 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert\") pod \"ingress-canary-wdlpr\" (UID: \"a44d2b9b-42c3-4e55-bbaa-6453218224b7\") " pod="openshift-ingress-canary/ingress-canary-wdlpr" May 29 16:57:18.123979 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:18.123452 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:18.123979 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:18.123495 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:18.123979 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:18.123498 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 16:57:18.123979 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:18.123576 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert podName:a44d2b9b-42c3-4e55-bbaa-6453218224b7 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:20.123553409 +0000 UTC m=+38.154022414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert") pod "ingress-canary-wdlpr" (UID: "a44d2b9b-42c3-4e55-bbaa-6453218224b7") : secret "canary-serving-cert" not found May 29 16:57:18.123979 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:18.123611 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 16:57:18.123979 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:18.123626 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b8fcd86-2mtfz: secret "image-registry-tls" not found May 29 16:57:18.123979 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:18.123610 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 29 16:57:18.123979 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:18.123672 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls podName:b415f2d5-93da-4d4d-bfdd-7252d4ae89f9 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:20.123656407 +0000 UTC m=+38.154125398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls") pod "image-registry-88b8fcd86-2mtfz" (UID: "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9") : secret "image-registry-tls" not found May 29 16:57:18.123979 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:18.123798 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls podName:18d06c9c-d13c-4bd0-a23f-6ceffe36743e nodeName:}" failed. No retries permitted until 2026-05-29 16:57:20.123784218 +0000 UTC m=+38.154253207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-vbmm6" (UID: "18d06c9c-d13c-4bd0-a23f-6ceffe36743e") : secret "cluster-monitoring-operator-tls" not found May 29 16:57:18.225848 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:18.224909 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:18.225848 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:18.225059 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:18.225848 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:18.225088 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:18.225848 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:18.225228 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 16:57:18.225848 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:18.225287 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs podName:9e8b3057-a3bb-4e0c-9066-52577b25fcd4 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:20.225269808 +0000 UTC m=+38.255738800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs") pod "router-default-78d54b76f9-bx987" (UID: "9e8b3057-a3bb-4e0c-9066-52577b25fcd4") : secret "router-metrics-certs-default" not found May 29 16:57:18.225848 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:18.225703 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle podName:9e8b3057-a3bb-4e0c-9066-52577b25fcd4 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:20.225670905 +0000 UTC m=+38.256139896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle") pod "router-default-78d54b76f9-bx987" (UID: "9e8b3057-a3bb-4e0c-9066-52577b25fcd4") : configmap references non-existent config key: service-ca.crt May 29 16:57:18.225848 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:18.225777 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 16:57:18.225848 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:18.225813 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls podName:ee1eec81-b979-4fdd-b042-38a9d11f4261 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:20.225799385 +0000 UTC m=+38.256268376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls") pod "dns-default-mggz6" (UID: "ee1eec81-b979-4fdd-b042-38a9d11f4261") : secret "dns-default-metrics-tls" not found May 29 16:57:20.143715 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:20.143333 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:20.143715 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:20.143389 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:20.143715 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:20.143482 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 29 16:57:20.143715 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:20.143520 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert\") pod \"ingress-canary-wdlpr\" (UID: \"a44d2b9b-42c3-4e55-bbaa-6453218224b7\") " pod="openshift-ingress-canary/ingress-canary-wdlpr" May 29 16:57:20.143715 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:20.143550 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls podName:18d06c9c-d13c-4bd0-a23f-6ceffe36743e nodeName:}" failed. No retries permitted until 2026-05-29 16:57:24.143530238 +0000 UTC m=+42.173999246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-vbmm6" (UID: "18d06c9c-d13c-4bd0-a23f-6ceffe36743e") : secret "cluster-monitoring-operator-tls" not found May 29 16:57:20.143715 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:20.143570 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 16:57:20.143715 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:20.143591 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b8fcd86-2mtfz: secret "image-registry-tls" not found May 29 16:57:20.143715 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:20.143607 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 16:57:20.143715 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:20.143643 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls podName:b415f2d5-93da-4d4d-bfdd-7252d4ae89f9 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:24.143626209 +0000 UTC m=+42.174095218 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls") pod "image-registry-88b8fcd86-2mtfz" (UID: "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9") : secret "image-registry-tls" not found May 29 16:57:20.143715 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:20.143662 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert podName:a44d2b9b-42c3-4e55-bbaa-6453218224b7 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:24.143652453 +0000 UTC m=+42.174121444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert") pod "ingress-canary-wdlpr" (UID: "a44d2b9b-42c3-4e55-bbaa-6453218224b7") : secret "canary-serving-cert" not found May 29 16:57:20.244364 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:20.244329 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:20.244532 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:20.244378 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:20.244532 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:20.244439 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:20.244645 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:20.244634 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle podName:9e8b3057-a3bb-4e0c-9066-52577b25fcd4 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:24.24461554 +0000 UTC m=+42.275084531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle") pod "router-default-78d54b76f9-bx987" (UID: "9e8b3057-a3bb-4e0c-9066-52577b25fcd4") : configmap references non-existent config key: service-ca.crt May 29 16:57:20.245065 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:20.245046 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 16:57:20.245154 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:20.245112 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls podName:ee1eec81-b979-4fdd-b042-38a9d11f4261 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:24.245095818 +0000 UTC m=+42.275564812 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls") pod "dns-default-mggz6" (UID: "ee1eec81-b979-4fdd-b042-38a9d11f4261") : secret "dns-default-metrics-tls" not found May 29 16:57:20.245154 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:20.245046 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 16:57:20.245267 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:20.245154 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs podName:9e8b3057-a3bb-4e0c-9066-52577b25fcd4 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:24.245145018 +0000 UTC m=+42.275614006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs") pod "router-default-78d54b76f9-bx987" (UID: "9e8b3057-a3bb-4e0c-9066-52577b25fcd4") : secret "router-metrics-certs-default" not found May 29 16:57:22.000046 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.000009 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx"] May 29 16:57:22.003202 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.003183 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" May 29 16:57:22.006289 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.006229 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 29 16:57:22.006410 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.006288 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 29 16:57:22.006410 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.006292 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 29 16:57:22.007671 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.007650 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tvvkq\"" May 29 16:57:22.012899 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.012879 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx"] May 29 16:57:22.061567 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.061537 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-28snx\" (UID: \"664277ac-f857-434d-b715-0ed3e46b2280\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" May 29 16:57:22.061771 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.061598 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk9pj\" (UniqueName: \"kubernetes.io/projected/664277ac-f857-434d-b715-0ed3e46b2280-kube-api-access-mk9pj\") pod \"cluster-samples-operator-755bbf9bfb-28snx\" (UID: \"664277ac-f857-434d-b715-0ed3e46b2280\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" May 29 16:57:22.109284 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.109247 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-sv9hr"] May 29 16:57:22.113449 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.113427 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-sv9hr" May 29 16:57:22.118592 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.118568 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 29 16:57:22.118951 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.118788 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 29 16:57:22.118951 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.118841 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bz8xp\"" May 29 16:57:22.119745 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.119721 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd"] May 29 16:57:22.123317 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.123298 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-psmjn"] May 29 16:57:22.123472 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.123456 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" May 29 16:57:22.126781 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.126761 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 29 16:57:22.126879 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.126819 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 29 16:57:22.127014 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.126996 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bs2td\"" May 29 16:57:22.127177 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.127138 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 29 16:57:22.127274 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.127215 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 29 16:57:22.127412 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.127385 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:22.127678 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.127139 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf"] May 29 16:57:22.131207 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.131064 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 29 16:57:22.132644 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.132585 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-sv9hr"] May 29 16:57:22.132759 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.132610 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd"] May 29 16:57:22.132843 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.132764 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-z5wjz\"" May 29 16:57:22.132843 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.132773 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-psmjn"] May 29 16:57:22.132843 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.132630 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 29 16:57:22.132843 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.132826 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" May 29 16:57:22.133045 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.132744 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 29 16:57:22.133309 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.133292 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 29 16:57:22.136380 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.136360 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 29 16:57:22.137188 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.136970 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 29 16:57:22.137188 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.137080 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 29 16:57:22.137188 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.137097 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-29j95\"" May 29 16:57:22.137504 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.137486 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 29 16:57:22.138502 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.138483 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 29 16:57:22.147738 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.147713 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf"] May 29 16:57:22.162156 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.162137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/74f07148-f376-4cd0-8014-34d828940db8-serving-cert\") pod \"service-ca-operator-69877444c-bkcwd\" (UID: \"74f07148-f376-4cd0-8014-34d828940db8\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" May 29 16:57:22.162252 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.162177 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4dbc8b6-1456-49f4-9e34-e9036b732e46-config\") pod \"console-operator-86d7c6cc77-psmjn\" (UID: \"f4dbc8b6-1456-49f4-9e34-e9036b732e46\") " pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:22.162252 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.162224 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:57:22.162374 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.162264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff35d618-b26d-4012-acb0-f8ce811fc7a0-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-676kf\" (UID: \"ff35d618-b26d-4012-acb0-f8ce811fc7a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" May 29 16:57:22.162374 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.162299 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc62c\" (UniqueName: \"kubernetes.io/projected/9266cdca-eb8b-4743-a2ef-194d70227971-kube-api-access-kc62c\") pod \"volume-data-source-validator-7598fd5bd-sv9hr\" (UID: \"9266cdca-eb8b-4743-a2ef-194d70227971\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-sv9hr" May 29 16:57:22.162374 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.162325 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cz7w\" (UniqueName: \"kubernetes.io/projected/f4dbc8b6-1456-49f4-9e34-e9036b732e46-kube-api-access-7cz7w\") pod \"console-operator-86d7c6cc77-psmjn\" (UID: \"f4dbc8b6-1456-49f4-9e34-e9036b732e46\") " pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:22.162374 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.162349 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-28snx\" (UID: \"664277ac-f857-434d-b715-0ed3e46b2280\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" May 29 16:57:22.162570 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.162414 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff35d618-b26d-4012-acb0-f8ce811fc7a0-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-676kf\" (UID: \"ff35d618-b26d-4012-acb0-f8ce811fc7a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" May 29 16:57:22.162570 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:22.162429 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 16:57:22.162570 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.162460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd88b\" (UniqueName: \"kubernetes.io/projected/ff35d618-b26d-4012-acb0-f8ce811fc7a0-kube-api-access-nd88b\") pod \"kube-storage-version-migrator-operator-96ddc787c-676kf\" (UID: \"ff35d618-b26d-4012-acb0-f8ce811fc7a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" May 29 16:57:22.162570 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:22.162482 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls podName:664277ac-f857-434d-b715-0ed3e46b2280 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:22.662464638 +0000 UTC m=+40.692933624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-28snx" (UID: "664277ac-f857-434d-b715-0ed3e46b2280") : secret "samples-operator-tls" not found May 29 16:57:22.162570 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.162527 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9pj\" (UniqueName: \"kubernetes.io/projected/664277ac-f857-434d-b715-0ed3e46b2280-kube-api-access-mk9pj\") pod \"cluster-samples-operator-755bbf9bfb-28snx\" (UID: \"664277ac-f857-434d-b715-0ed3e46b2280\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" May 29 16:57:22.162570 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.162559 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4dbc8b6-1456-49f4-9e34-e9036b732e46-serving-cert\") pod \"console-operator-86d7c6cc77-psmjn\" (UID: \"f4dbc8b6-1456-49f4-9e34-e9036b732e46\") " pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:22.162905 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.162581 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72k64\" (UniqueName: \"kubernetes.io/projected/74f07148-f376-4cd0-8014-34d828940db8-kube-api-access-72k64\") pod \"service-ca-operator-69877444c-bkcwd\" (UID: \"74f07148-f376-4cd0-8014-34d828940db8\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" May 29 16:57:22.162905 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.162617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4dbc8b6-1456-49f4-9e34-e9036b732e46-trusted-ca\") pod \"console-operator-86d7c6cc77-psmjn\" (UID: \"f4dbc8b6-1456-49f4-9e34-e9036b732e46\") " pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:22.162905 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.162665 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/74f07148-f376-4cd0-8014-34d828940db8-config\") pod \"service-ca-operator-69877444c-bkcwd\" (UID: \"74f07148-f376-4cd0-8014-34d828940db8\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" May 29 16:57:22.165599 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.165582 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0247042d-f2aa-4c79-90d0-2518f915a5f8-original-pull-secret\") pod \"global-pull-secret-syncer-t722m\" (UID: \"0247042d-f2aa-4c79-90d0-2518f915a5f8\") " pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:57:22.171515 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.171492 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk9pj\" (UniqueName: \"kubernetes.io/projected/664277ac-f857-434d-b715-0ed3e46b2280-kube-api-access-mk9pj\") pod \"cluster-samples-operator-755bbf9bfb-28snx\" (UID: \"664277ac-f857-434d-b715-0ed3e46b2280\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" May 29 16:57:22.263763 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.263668 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff35d618-b26d-4012-acb0-f8ce811fc7a0-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-676kf\" (UID: \"ff35d618-b26d-4012-acb0-f8ce811fc7a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" May 29 16:57:22.263763 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.263726 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kc62c\" (UniqueName: \"kubernetes.io/projected/9266cdca-eb8b-4743-a2ef-194d70227971-kube-api-access-kc62c\") pod \"volume-data-source-validator-7598fd5bd-sv9hr\" (UID: \"9266cdca-eb8b-4743-a2ef-194d70227971\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-sv9hr" May 29 16:57:22.263763 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.263749 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7cz7w\" (UniqueName: \"kubernetes.io/projected/f4dbc8b6-1456-49f4-9e34-e9036b732e46-kube-api-access-7cz7w\") pod \"console-operator-86d7c6cc77-psmjn\" (UID: \"f4dbc8b6-1456-49f4-9e34-e9036b732e46\") " pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:22.264010 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.263794 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff35d618-b26d-4012-acb0-f8ce811fc7a0-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-676kf\" (UID: \"ff35d618-b26d-4012-acb0-f8ce811fc7a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" May 29 16:57:22.264010 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.263935 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nd88b\" (UniqueName: \"kubernetes.io/projected/ff35d618-b26d-4012-acb0-f8ce811fc7a0-kube-api-access-nd88b\") pod \"kube-storage-version-migrator-operator-96ddc787c-676kf\" (UID: \"ff35d618-b26d-4012-acb0-f8ce811fc7a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" May 29 16:57:22.264010 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.263999 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4dbc8b6-1456-49f4-9e34-e9036b732e46-serving-cert\") pod \"console-operator-86d7c6cc77-psmjn\" (UID: \"f4dbc8b6-1456-49f4-9e34-e9036b732e46\") " pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:22.264156 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.264035 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-72k64\" (UniqueName: \"kubernetes.io/projected/74f07148-f376-4cd0-8014-34d828940db8-kube-api-access-72k64\") pod \"service-ca-operator-69877444c-bkcwd\" (UID: \"74f07148-f376-4cd0-8014-34d828940db8\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" May 29 16:57:22.264156 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.264091 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4dbc8b6-1456-49f4-9e34-e9036b732e46-trusted-ca\") pod \"console-operator-86d7c6cc77-psmjn\" (UID: \"f4dbc8b6-1456-49f4-9e34-e9036b732e46\") " pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:22.264156 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.264140 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/74f07148-f376-4cd0-8014-34d828940db8-config\") pod \"service-ca-operator-69877444c-bkcwd\" (UID: \"74f07148-f376-4cd0-8014-34d828940db8\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" May 29 16:57:22.264313 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.264188 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/74f07148-f376-4cd0-8014-34d828940db8-serving-cert\") pod \"service-ca-operator-69877444c-bkcwd\" (UID: \"74f07148-f376-4cd0-8014-34d828940db8\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" May 29 16:57:22.264313 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.264229 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4dbc8b6-1456-49f4-9e34-e9036b732e46-config\") pod \"console-operator-86d7c6cc77-psmjn\" (UID: \"f4dbc8b6-1456-49f4-9e34-e9036b732e46\") " pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:22.267510 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.264264 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff35d618-b26d-4012-acb0-f8ce811fc7a0-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-676kf\" (UID: \"ff35d618-b26d-4012-acb0-f8ce811fc7a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" May 29 16:57:22.267510 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.265108 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/74f07148-f376-4cd0-8014-34d828940db8-config\") pod \"service-ca-operator-69877444c-bkcwd\" (UID: \"74f07148-f376-4cd0-8014-34d828940db8\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" May 29 16:57:22.267510 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.265620 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4dbc8b6-1456-49f4-9e34-e9036b732e46-config\") pod \"console-operator-86d7c6cc77-psmjn\" (UID: \"f4dbc8b6-1456-49f4-9e34-e9036b732e46\") " pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:22.267510 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.265978 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4dbc8b6-1456-49f4-9e34-e9036b732e46-trusted-ca\") pod \"console-operator-86d7c6cc77-psmjn\" (UID: \"f4dbc8b6-1456-49f4-9e34-e9036b732e46\") " pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:22.270198 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.267963 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4dbc8b6-1456-49f4-9e34-e9036b732e46-serving-cert\") pod \"console-operator-86d7c6cc77-psmjn\" (UID: \"f4dbc8b6-1456-49f4-9e34-e9036b732e46\") " pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:22.270198 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.268011 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/74f07148-f376-4cd0-8014-34d828940db8-serving-cert\") pod \"service-ca-operator-69877444c-bkcwd\" (UID: \"74f07148-f376-4cd0-8014-34d828940db8\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" May 29 16:57:22.270882 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.270859 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff35d618-b26d-4012-acb0-f8ce811fc7a0-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-676kf\" (UID: \"ff35d618-b26d-4012-acb0-f8ce811fc7a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" May 29 16:57:22.274440 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.274413 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cz7w\" (UniqueName: \"kubernetes.io/projected/f4dbc8b6-1456-49f4-9e34-e9036b732e46-kube-api-access-7cz7w\") pod \"console-operator-86d7c6cc77-psmjn\" (UID: \"f4dbc8b6-1456-49f4-9e34-e9036b732e46\") " pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:22.274440 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.274441 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72k64\" (UniqueName: \"kubernetes.io/projected/74f07148-f376-4cd0-8014-34d828940db8-kube-api-access-72k64\") pod \"service-ca-operator-69877444c-bkcwd\" (UID: \"74f07148-f376-4cd0-8014-34d828940db8\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" May 29 16:57:22.274719 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.274589 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd88b\" (UniqueName: \"kubernetes.io/projected/ff35d618-b26d-4012-acb0-f8ce811fc7a0-kube-api-access-nd88b\") pod \"kube-storage-version-migrator-operator-96ddc787c-676kf\" (UID: \"ff35d618-b26d-4012-acb0-f8ce811fc7a0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" May 29 16:57:22.274719 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.274614 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc62c\" (UniqueName: \"kubernetes.io/projected/9266cdca-eb8b-4743-a2ef-194d70227971-kube-api-access-kc62c\") pod \"volume-data-source-validator-7598fd5bd-sv9hr\" (UID: \"9266cdca-eb8b-4743-a2ef-194d70227971\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-sv9hr" May 29 16:57:22.424649 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.424618 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-sv9hr" May 29 16:57:22.441260 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.441233 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" May 29 16:57:22.447935 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.447911 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:22.449872 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.449854 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t722m" May 29 16:57:22.454273 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.454253 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" May 29 16:57:22.667404 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:22.667371 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-28snx\" (UID: \"664277ac-f857-434d-b715-0ed3e46b2280\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" May 29 16:57:22.667583 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:22.667546 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 16:57:22.667656 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:22.667641 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls podName:664277ac-f857-434d-b715-0ed3e46b2280 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:23.667617109 +0000 UTC m=+41.698086101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-28snx" (UID: "664277ac-f857-434d-b715-0ed3e46b2280") : secret "samples-operator-tls" not found May 29 16:57:23.675920 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:23.675883 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-28snx\" (UID: \"664277ac-f857-434d-b715-0ed3e46b2280\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" May 29 16:57:23.676350 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:23.676051 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 16:57:23.676350 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:23.676132 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls podName:664277ac-f857-434d-b715-0ed3e46b2280 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:25.676112743 +0000 UTC m=+43.706581740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-28snx" (UID: "664277ac-f857-434d-b715-0ed3e46b2280") : secret "samples-operator-tls" not found May 29 16:57:24.180126 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:24.180079 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:24.180301 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:24.180182 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:24.180301 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:24.180203 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 29 16:57:24.180301 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:24.180281 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls podName:18d06c9c-d13c-4bd0-a23f-6ceffe36743e nodeName:}" failed. No retries permitted until 2026-05-29 16:57:32.180260828 +0000 UTC m=+50.210729816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-vbmm6" (UID: "18d06c9c-d13c-4bd0-a23f-6ceffe36743e") : secret "cluster-monitoring-operator-tls" not found May 29 16:57:24.180301 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:24.180298 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 16:57:24.180499 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:24.180317 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b8fcd86-2mtfz: secret "image-registry-tls" not found May 29 16:57:24.180499 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:24.180353 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls podName:b415f2d5-93da-4d4d-bfdd-7252d4ae89f9 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:32.180342316 +0000 UTC m=+50.210811321 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls") pod "image-registry-88b8fcd86-2mtfz" (UID: "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9") : secret "image-registry-tls" not found May 29 16:57:24.180499 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:24.180373 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert\") pod \"ingress-canary-wdlpr\" (UID: \"a44d2b9b-42c3-4e55-bbaa-6453218224b7\") " pod="openshift-ingress-canary/ingress-canary-wdlpr" May 29 16:57:24.180499 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:24.180482 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 16:57:24.180677 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:24.180520 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert podName:a44d2b9b-42c3-4e55-bbaa-6453218224b7 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:32.180512085 +0000 UTC m=+50.210981070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert") pod "ingress-canary-wdlpr" (UID: "a44d2b9b-42c3-4e55-bbaa-6453218224b7") : secret "canary-serving-cert" not found May 29 16:57:24.280807 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:24.280771 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:24.280990 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:24.280961 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle podName:9e8b3057-a3bb-4e0c-9066-52577b25fcd4 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:32.280938638 +0000 UTC m=+50.311407637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle") pod "router-default-78d54b76f9-bx987" (UID: "9e8b3057-a3bb-4e0c-9066-52577b25fcd4") : configmap references non-existent config key: service-ca.crt May 29 16:57:24.281092 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:24.281075 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:24.281150 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:24.281111 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:24.281237 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:24.281223 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 16:57:24.281299 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:24.281278 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs podName:9e8b3057-a3bb-4e0c-9066-52577b25fcd4 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:32.28126401 +0000 UTC m=+50.311733013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs") pod "router-default-78d54b76f9-bx987" (UID: "9e8b3057-a3bb-4e0c-9066-52577b25fcd4") : secret "router-metrics-certs-default" not found May 29 16:57:24.281299 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:24.281225 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 16:57:24.281385 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:24.281318 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls podName:ee1eec81-b979-4fdd-b042-38a9d11f4261 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:32.281309338 +0000 UTC m=+50.311778348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls") pod "dns-default-mggz6" (UID: "ee1eec81-b979-4fdd-b042-38a9d11f4261") : secret "dns-default-metrics-tls" not found May 29 16:57:25.695087 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:25.695047 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-28snx\" (UID: \"664277ac-f857-434d-b715-0ed3e46b2280\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" May 29 16:57:25.695546 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:25.695216 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 16:57:25.695546 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:25.695300 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls podName:664277ac-f857-434d-b715-0ed3e46b2280 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:29.695279913 +0000 UTC m=+47.725748920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-28snx" (UID: "664277ac-f857-434d-b715-0ed3e46b2280") : secret "samples-operator-tls" not found May 29 16:57:27.445982 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.445929 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf"] May 29 16:57:27.450395 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:57:27.450359 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff35d618_b26d_4012_acb0_f8ce811fc7a0.slice/crio-c6e55c259747d6c0c84c166daa0f4f5b5053a29c250cc2481519f59a7fb8e1ae WatchSource:0}: Error finding container c6e55c259747d6c0c84c166daa0f4f5b5053a29c250cc2481519f59a7fb8e1ae: Status 404 returned error can't find the container with id c6e55c259747d6c0c84c166daa0f4f5b5053a29c250cc2481519f59a7fb8e1ae May 29 16:57:27.466789 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.466642 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-psmjn"] May 29 16:57:27.466789 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:57:27.466774 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4dbc8b6_1456_49f4_9e34_e9036b732e46.slice/crio-dc26dd2074b20e8cf8e05f69405cd9747409bba682ae5cd70a0bc34e34425d4a WatchSource:0}: Error finding container dc26dd2074b20e8cf8e05f69405cd9747409bba682ae5cd70a0bc34e34425d4a: Status 404 returned error can't find the container with id dc26dd2074b20e8cf8e05f69405cd9747409bba682ae5cd70a0bc34e34425d4a May 29 16:57:27.491910 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.490999 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd"] May 29 16:57:27.496469 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.496419 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t722m"] May 29 16:57:27.500045 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:57:27.500017 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0247042d_f2aa_4c79_90d0_2518f915a5f8.slice/crio-762fbe9e71b18ed6cee8fa062f7ade6c4cd437e98552e763e4cf1efeb4075de1 WatchSource:0}: Error finding container 762fbe9e71b18ed6cee8fa062f7ade6c4cd437e98552e763e4cf1efeb4075de1: Status 404 returned error can't find the container with id 762fbe9e71b18ed6cee8fa062f7ade6c4cd437e98552e763e4cf1efeb4075de1 May 29 16:57:27.585187 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.585132 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" event={"ID":"f4dbc8b6-1456-49f4-9e34-e9036b732e46","Type":"ContainerStarted","Data":"dc26dd2074b20e8cf8e05f69405cd9747409bba682ae5cd70a0bc34e34425d4a"} May 29 16:57:27.586453 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.586428 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c677647d6-dp45n" event={"ID":"c426533b-1994-4746-81e3-5d35373389a3","Type":"ContainerStarted","Data":"c17393d0fd3e745ee6bab09acd6934801765a975e01f7e8945f2f92e7131c5d8"} May 29 16:57:27.588680 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.588629 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" event={"ID":"acd4c04d-a3da-45f2-94a9-e97dc6a4048f","Type":"ContainerStarted","Data":"d6909545a2894e2030df6c1df2f555e12937c598233923c6917338fb4be865f2"} May 29 16:57:27.589081 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.589052 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" May 29 16:57:27.590653 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.590623 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" May 29 16:57:27.592975 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.592951 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgpq" event={"ID":"27c5d260-d0e2-438c-8488-bfd82910b177","Type":"ContainerStarted","Data":"dc621e385929d8784475aa0a58a2dbf046c55ecb5857767a3a6819d4d9a37f31"} May 29 16:57:27.594729 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.594703 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" event={"ID":"5108e1f2-5160-478c-acaa-075ca785c5c6","Type":"ContainerStarted","Data":"982d13e4639d390422f234d5e3878c5f6da191febe6b4d925d13f83eb27f50fe"} May 29 16:57:27.595773 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.595750 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t722m" event={"ID":"0247042d-f2aa-4c79-90d0-2518f915a5f8","Type":"ContainerStarted","Data":"762fbe9e71b18ed6cee8fa062f7ade6c4cd437e98552e763e4cf1efeb4075de1"} May 29 16:57:27.597073 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.597034 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-jvk9t" event={"ID":"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9","Type":"ContainerStarted","Data":"56e729da51e00587267bc275912f4c38d4aa832f841f7b72df3f51de6df39a7a"} May 29 16:57:27.598484 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.598461 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" event={"ID":"ff35d618-b26d-4012-acb0-f8ce811fc7a0","Type":"ContainerStarted","Data":"c6e55c259747d6c0c84c166daa0f4f5b5053a29c250cc2481519f59a7fb8e1ae"} May 29 16:57:27.599443 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.599421 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" event={"ID":"74f07148-f376-4cd0-8014-34d828940db8","Type":"ContainerStarted","Data":"b0a6118491e261a437c2360e2cb991c3310bcadf1fe55562a76b9f5361c3829f"} May 29 16:57:27.603887 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.603852 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c677647d6-dp45n" podStartSLOduration=24.203016579 podStartE2EDuration="34.603841524s" podCreationTimestamp="2026-05-29 16:56:53 +0000 UTC" firstStartedPulling="2026-05-29 16:57:16.993899785 +0000 UTC m=+35.024368771" lastFinishedPulling="2026-05-29 16:57:27.39472471 +0000 UTC m=+45.425193716" observedRunningTime="2026-05-29 16:57:27.602321282 +0000 UTC m=+45.632790291" watchObservedRunningTime="2026-05-29 16:57:27.603841524 +0000 UTC m=+45.634310532" May 29 16:57:27.619506 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.619472 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-jvk9t" podStartSLOduration=5.417439959 podStartE2EDuration="15.619461448s" podCreationTimestamp="2026-05-29 16:57:12 +0000 UTC" firstStartedPulling="2026-05-29 16:57:16.985517797 +0000 UTC m=+35.015986800" lastFinishedPulling="2026-05-29 16:57:27.187539293 +0000 UTC m=+45.218008289" observedRunningTime="2026-05-29 16:57:27.619341054 +0000 UTC m=+45.649810067" watchObservedRunningTime="2026-05-29 16:57:27.619461448 +0000 UTC m=+45.649930456" May 29 16:57:27.641948 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.641895 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-784d948f5b-86ff9" podStartSLOduration=24.400892727 podStartE2EDuration="34.641880268s" podCreationTimestamp="2026-05-29 16:56:53 +0000 UTC" firstStartedPulling="2026-05-29 16:57:16.995419404 +0000 UTC m=+35.025888391" lastFinishedPulling="2026-05-29 16:57:27.236406935 +0000 UTC m=+45.266875932" observedRunningTime="2026-05-29 16:57:27.641340577 +0000 UTC m=+45.671809585" watchObservedRunningTime="2026-05-29 16:57:27.641880268 +0000 UTC m=+45.672349278" May 29 16:57:27.684286 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:27.684256 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-sv9hr"] May 29 16:57:27.700579 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:57:27.700533 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9266cdca_eb8b_4743_a2ef_194d70227971.slice/crio-e2e0264579793a6e565b3125f7333d212c9486965153272ab54cacd9a7f306e2 WatchSource:0}: Error finding container e2e0264579793a6e565b3125f7333d212c9486965153272ab54cacd9a7f306e2: Status 404 returned error can't find the container with id e2e0264579793a6e565b3125f7333d212c9486965153272ab54cacd9a7f306e2 May 29 16:57:28.620935 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:28.620896 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-sv9hr" event={"ID":"9266cdca-eb8b-4743-a2ef-194d70227971","Type":"ContainerStarted","Data":"e2e0264579793a6e565b3125f7333d212c9486965153272ab54cacd9a7f306e2"} May 29 16:57:28.632473 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:28.631072 2561 generic.go:358] "Generic (PLEG): container finished" podID="27c5d260-d0e2-438c-8488-bfd82910b177" containerID="dc621e385929d8784475aa0a58a2dbf046c55ecb5857767a3a6819d4d9a37f31" exitCode=0 May 29 16:57:28.632473 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:28.632237 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgpq" event={"ID":"27c5d260-d0e2-438c-8488-bfd82910b177","Type":"ContainerDied","Data":"dc621e385929d8784475aa0a58a2dbf046c55ecb5857767a3a6819d4d9a37f31"} May 29 16:57:29.638710 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:29.638276 2561 generic.go:358] "Generic (PLEG): container finished" podID="27c5d260-d0e2-438c-8488-bfd82910b177" containerID="7271b2bd7ebca09af81081f2848d7bf781134af9f0e27c5fb4ae7c5c07e68b67" exitCode=0 May 29 16:57:29.639188 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:29.638896 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgpq" event={"ID":"27c5d260-d0e2-438c-8488-bfd82910b177","Type":"ContainerDied","Data":"7271b2bd7ebca09af81081f2848d7bf781134af9f0e27c5fb4ae7c5c07e68b67"} May 29 16:57:29.743495 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:29.743457 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-28snx\" (UID: \"664277ac-f857-434d-b715-0ed3e46b2280\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" May 29 16:57:29.744037 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:29.744007 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 16:57:29.744149 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:29.744076 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls podName:664277ac-f857-434d-b715-0ed3e46b2280 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:37.74405612 +0000 UTC m=+55.774525124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-28snx" (UID: "664277ac-f857-434d-b715-0ed3e46b2280") : secret "samples-operator-tls" not found May 29 16:57:30.979251 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:30.979175 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ptscs_c542210a-b54a-4c1a-8e34-e5d0372453e8/dns-node-resolver/0.log" May 29 16:57:31.778663 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:31.778634 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bh98g_c776ba0f-d190-46f1-85e2-874f75d80904/node-ca/0.log" May 29 16:57:32.269394 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.269325 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert\") pod \"ingress-canary-wdlpr\" (UID: \"a44d2b9b-42c3-4e55-bbaa-6453218224b7\") " pod="openshift-ingress-canary/ingress-canary-wdlpr" May 29 16:57:32.269394 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.269387 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:32.269794 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.269427 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:32.269794 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:32.269480 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 16:57:32.269794 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:32.269505 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 29 16:57:32.269794 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:32.269550 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 16:57:32.269794 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:32.269560 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls podName:18d06c9c-d13c-4bd0-a23f-6ceffe36743e nodeName:}" failed. No retries permitted until 2026-05-29 16:57:48.269539727 +0000 UTC m=+66.300008725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-vbmm6" (UID: "18d06c9c-d13c-4bd0-a23f-6ceffe36743e") : secret "cluster-monitoring-operator-tls" not found May 29 16:57:32.269794 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:32.269563 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b8fcd86-2mtfz: secret "image-registry-tls" not found May 29 16:57:32.269794 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:32.269577 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert podName:a44d2b9b-42c3-4e55-bbaa-6453218224b7 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:48.269568707 +0000 UTC m=+66.300037693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert") pod "ingress-canary-wdlpr" (UID: "a44d2b9b-42c3-4e55-bbaa-6453218224b7") : secret "canary-serving-cert" not found May 29 16:57:32.269794 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:32.269606 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls podName:b415f2d5-93da-4d4d-bfdd-7252d4ae89f9 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:48.269594628 +0000 UTC m=+66.300063614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls") pod "image-registry-88b8fcd86-2mtfz" (UID: "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9") : secret "image-registry-tls" not found May 29 16:57:32.370748 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.370709 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:32.370877 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.370822 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:32.370877 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:32.370845 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle podName:9e8b3057-a3bb-4e0c-9066-52577b25fcd4 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:48.370828673 +0000 UTC m=+66.401297664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle") pod "router-default-78d54b76f9-bx987" (UID: "9e8b3057-a3bb-4e0c-9066-52577b25fcd4") : configmap references non-existent config key: service-ca.crt May 29 16:57:32.370997 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.370884 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:32.370997 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:32.370906 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 16:57:32.370997 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:32.370944 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls podName:ee1eec81-b979-4fdd-b042-38a9d11f4261 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:48.370933317 +0000 UTC m=+66.401402303 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls") pod "dns-default-mggz6" (UID: "ee1eec81-b979-4fdd-b042-38a9d11f4261") : secret "dns-default-metrics-tls" not found May 29 16:57:32.370997 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:32.370978 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 16:57:32.371187 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:32.371009 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs podName:9e8b3057-a3bb-4e0c-9066-52577b25fcd4 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:48.371001122 +0000 UTC m=+66.401470108 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs") pod "router-default-78d54b76f9-bx987" (UID: "9e8b3057-a3bb-4e0c-9066-52577b25fcd4") : secret "router-metrics-certs-default" not found May 29 16:57:32.520372 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.520290 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5wsgv"] May 29 16:57:32.536657 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.536631 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5wsgv"] May 29 16:57:32.536838 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.536781 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:32.539881 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.539843 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 29 16:57:32.539881 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.539869 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 29 16:57:32.540134 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.539951 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kt6kk\"" May 29 16:57:32.572492 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.572460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d242ba07-31ed-473d-9b24-c5f63867ba2d-data-volume\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:32.572492 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.572497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:32.572746 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.572611 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d242ba07-31ed-473d-9b24-c5f63867ba2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:32.572746 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.572669 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9gdv\" (UniqueName: \"kubernetes.io/projected/d242ba07-31ed-473d-9b24-c5f63867ba2d-kube-api-access-c9gdv\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:32.572848 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.572762 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d242ba07-31ed-473d-9b24-c5f63867ba2d-crio-socket\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:32.673775 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.673746 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d242ba07-31ed-473d-9b24-c5f63867ba2d-crio-socket\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:32.673941 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.673842 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d242ba07-31ed-473d-9b24-c5f63867ba2d-data-volume\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:32.673941 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.673868 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:32.674078 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.673941 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d242ba07-31ed-473d-9b24-c5f63867ba2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:32.674078 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.673976 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d242ba07-31ed-473d-9b24-c5f63867ba2d-crio-socket\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:32.674078 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.674002 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9gdv\" (UniqueName: \"kubernetes.io/projected/d242ba07-31ed-473d-9b24-c5f63867ba2d-kube-api-access-c9gdv\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:32.674078 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:32.674042 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 29 16:57:32.674257 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:32.674115 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls podName:d242ba07-31ed-473d-9b24-c5f63867ba2d nodeName:}" failed. No retries permitted until 2026-05-29 16:57:33.174094534 +0000 UTC m=+51.204563540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5wsgv" (UID: "d242ba07-31ed-473d-9b24-c5f63867ba2d") : secret "insights-runtime-extractor-tls" not found May 29 16:57:32.674257 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.674248 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d242ba07-31ed-473d-9b24-c5f63867ba2d-data-volume\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:32.674580 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.674559 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d242ba07-31ed-473d-9b24-c5f63867ba2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:32.685703 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:32.685664 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9gdv\" (UniqueName: \"kubernetes.io/projected/d242ba07-31ed-473d-9b24-c5f63867ba2d-kube-api-access-c9gdv\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:33.179000 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:33.178961 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:33.179196 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:33.179099 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 29 16:57:33.179196 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:33.179178 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls podName:d242ba07-31ed-473d-9b24-c5f63867ba2d nodeName:}" failed. No retries permitted until 2026-05-29 16:57:34.179159139 +0000 UTC m=+52.209628138 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5wsgv" (UID: "d242ba07-31ed-473d-9b24-c5f63867ba2d") : secret "insights-runtime-extractor-tls" not found May 29 16:57:34.189781 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.189750 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:34.190129 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:34.189883 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 29 16:57:34.190129 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:34.189941 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls podName:d242ba07-31ed-473d-9b24-c5f63867ba2d nodeName:}" failed. No retries permitted until 2026-05-29 16:57:36.189925332 +0000 UTC m=+54.220394340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5wsgv" (UID: "d242ba07-31ed-473d-9b24-c5f63867ba2d") : secret "insights-runtime-extractor-tls" not found May 29 16:57:34.656089 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.656010 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" event={"ID":"74f07148-f376-4cd0-8014-34d828940db8","Type":"ContainerStarted","Data":"d737098d7f04ed23274a9a823d4d9219282c0ede38db92cba2ebfdecf4f47751"} May 29 16:57:34.657757 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.657735 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/0.log" May 29 16:57:34.657853 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.657774 2561 generic.go:358] "Generic (PLEG): container finished" podID="f4dbc8b6-1456-49f4-9e34-e9036b732e46" containerID="7a77eecb4d88a425a9fd5b3c90dcdf770ccc975401326157e74824ba338db83f" exitCode=255 May 29 16:57:34.657853 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.657847 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" event={"ID":"f4dbc8b6-1456-49f4-9e34-e9036b732e46","Type":"ContainerDied","Data":"7a77eecb4d88a425a9fd5b3c90dcdf770ccc975401326157e74824ba338db83f"} May 29 16:57:34.658041 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.658021 2561 scope.go:117] "RemoveContainer" containerID="7a77eecb4d88a425a9fd5b3c90dcdf770ccc975401326157e74824ba338db83f" May 29 16:57:34.659295 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.659274 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-sv9hr" event={"ID":"9266cdca-eb8b-4743-a2ef-194d70227971","Type":"ContainerStarted","Data":"7c9bbb17168c222bebd520f4072c3bf0d75d84076830face1c37a8b2b6ad6421"} May 29 16:57:34.662450 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.662427 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgpq" event={"ID":"27c5d260-d0e2-438c-8488-bfd82910b177","Type":"ContainerStarted","Data":"58d797f4bc3f7c0dcd62eed10010917ccd3912ccc1678db7cf54c21a20fdc6af"} May 29 16:57:34.664447 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.664428 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" event={"ID":"5108e1f2-5160-478c-acaa-075ca785c5c6","Type":"ContainerStarted","Data":"f3f585c697cc5644da08b8ee0b13570c2e92c0c23743e6f1a5c5b741f5520be3"} May 29 16:57:34.664543 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.664451 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" event={"ID":"5108e1f2-5160-478c-acaa-075ca785c5c6","Type":"ContainerStarted","Data":"d77cbed86e992efdc5723bfbeb2cdf9ea01674e1e0d20d26f08c5493b7bf4acd"} May 29 16:57:34.665760 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.665739 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t722m" event={"ID":"0247042d-f2aa-4c79-90d0-2518f915a5f8","Type":"ContainerStarted","Data":"702dbe1da321bff2fa50e2a8409c690c4463adb8bde15e14d3d10cd3a5c35355"} May 29 16:57:34.666939 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.666918 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" event={"ID":"ff35d618-b26d-4012-acb0-f8ce811fc7a0","Type":"ContainerStarted","Data":"bc2dc8b278b1840f3d4c4acba344727fd1f58b911a7f03e3d49cbd52511bf067"} May 29 16:57:34.675412 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.675369 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" podStartSLOduration=6.321880818 podStartE2EDuration="12.675358452s" podCreationTimestamp="2026-05-29 16:57:22 +0000 UTC" firstStartedPulling="2026-05-29 16:57:27.498814789 +0000 UTC m=+45.529283801" lastFinishedPulling="2026-05-29 16:57:33.852292434 +0000 UTC m=+51.882761435" observedRunningTime="2026-05-29 16:57:34.674838631 +0000 UTC m=+52.705307639" watchObservedRunningTime="2026-05-29 16:57:34.675358452 +0000 UTC m=+52.705827459" May 29 16:57:34.712584 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.712530 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" podStartSLOduration=24.887736139 podStartE2EDuration="41.712512763s" podCreationTimestamp="2026-05-29 16:56:53 +0000 UTC" firstStartedPulling="2026-05-29 16:57:17.020876523 +0000 UTC m=+35.051345509" lastFinishedPulling="2026-05-29 16:57:33.845653132 +0000 UTC m=+51.876122133" observedRunningTime="2026-05-29 16:57:34.711279595 +0000 UTC m=+52.741748605" watchObservedRunningTime="2026-05-29 16:57:34.712512763 +0000 UTC m=+52.742981772" May 29 16:57:34.729004 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.728929 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t722m" podStartSLOduration=37.983728698 podStartE2EDuration="44.72891666s" podCreationTimestamp="2026-05-29 16:56:50 +0000 UTC" firstStartedPulling="2026-05-29 16:57:27.501747098 +0000 UTC m=+45.532216090" lastFinishedPulling="2026-05-29 16:57:34.246935065 +0000 UTC m=+52.277404052" observedRunningTime="2026-05-29 16:57:34.728482027 +0000 UTC m=+52.758951040" watchObservedRunningTime="2026-05-29 16:57:34.72891666 +0000 UTC m=+52.759385710" May 29 16:57:34.744192 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.744143 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-sv9hr" podStartSLOduration=6.600058752 podStartE2EDuration="12.744128304s" podCreationTimestamp="2026-05-29 16:57:22 +0000 UTC" firstStartedPulling="2026-05-29 16:57:27.702963327 +0000 UTC m=+45.733432317" lastFinishedPulling="2026-05-29 16:57:33.847032878 +0000 UTC m=+51.877501869" observedRunningTime="2026-05-29 16:57:34.74256554 +0000 UTC m=+52.773034549" watchObservedRunningTime="2026-05-29 16:57:34.744128304 +0000 UTC m=+52.774597313" May 29 16:57:34.761524 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.761114 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" podStartSLOduration=6.368228151 podStartE2EDuration="12.761099869s" podCreationTimestamp="2026-05-29 16:57:22 +0000 UTC" firstStartedPulling="2026-05-29 16:57:27.453284592 +0000 UTC m=+45.483753590" lastFinishedPulling="2026-05-29 16:57:33.846156308 +0000 UTC m=+51.876625308" observedRunningTime="2026-05-29 16:57:34.759924725 +0000 UTC m=+52.790393732" watchObservedRunningTime="2026-05-29 16:57:34.761099869 +0000 UTC m=+52.791568878" May 29 16:57:34.784669 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:34.784614 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ppgpq" podStartSLOduration=10.835033946 podStartE2EDuration="52.784564724s" podCreationTimestamp="2026-05-29 16:56:42 +0000 UTC" firstStartedPulling="2026-05-29 16:56:45.31294073 +0000 UTC m=+3.343409716" lastFinishedPulling="2026-05-29 16:57:27.262471495 +0000 UTC m=+45.292940494" observedRunningTime="2026-05-29 16:57:34.783443076 +0000 UTC m=+52.813912083" watchObservedRunningTime="2026-05-29 16:57:34.784564724 +0000 UTC m=+52.815033733" May 29 16:57:35.671172 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:35.671147 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/1.log" May 29 16:57:35.671582 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:35.671511 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/0.log" May 29 16:57:35.671582 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:35.671542 2561 generic.go:358] "Generic (PLEG): container finished" podID="f4dbc8b6-1456-49f4-9e34-e9036b732e46" containerID="7a8132cf901e3472102c3d180340b97fabded8094ad4562e76b1d0dc4c4673a7" exitCode=255 May 29 16:57:35.671717 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:35.671659 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" event={"ID":"f4dbc8b6-1456-49f4-9e34-e9036b732e46","Type":"ContainerDied","Data":"7a8132cf901e3472102c3d180340b97fabded8094ad4562e76b1d0dc4c4673a7"} May 29 16:57:35.671774 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:35.671759 2561 scope.go:117] "RemoveContainer" containerID="7a77eecb4d88a425a9fd5b3c90dcdf770ccc975401326157e74824ba338db83f" May 29 16:57:35.671896 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:35.671882 2561 scope.go:117] "RemoveContainer" containerID="7a8132cf901e3472102c3d180340b97fabded8094ad4562e76b1d0dc4c4673a7" May 29 16:57:35.672132 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:35.672078 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-psmjn_openshift-console-operator(f4dbc8b6-1456-49f4-9e34-e9036b732e46)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" podUID="f4dbc8b6-1456-49f4-9e34-e9036b732e46" May 29 16:57:36.208128 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:36.208090 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:36.208362 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:36.208226 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 29 16:57:36.208362 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:36.208290 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls podName:d242ba07-31ed-473d-9b24-c5f63867ba2d nodeName:}" failed. No retries permitted until 2026-05-29 16:57:40.208274998 +0000 UTC m=+58.238743984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5wsgv" (UID: "d242ba07-31ed-473d-9b24-c5f63867ba2d") : secret "insights-runtime-extractor-tls" not found May 29 16:57:36.675527 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:36.675501 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/1.log" May 29 16:57:36.675984 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:36.675873 2561 scope.go:117] "RemoveContainer" containerID="7a8132cf901e3472102c3d180340b97fabded8094ad4562e76b1d0dc4c4673a7" May 29 16:57:36.676065 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:36.676046 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-psmjn_openshift-console-operator(f4dbc8b6-1456-49f4-9e34-e9036b732e46)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" podUID="f4dbc8b6-1456-49f4-9e34-e9036b732e46" May 29 16:57:37.820939 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:37.820903 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-28snx\" (UID: \"664277ac-f857-434d-b715-0ed3e46b2280\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" May 29 16:57:37.821340 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:37.821039 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 29 16:57:37.821340 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:37.821124 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls podName:664277ac-f857-434d-b715-0ed3e46b2280 nodeName:}" failed. No retries permitted until 2026-05-29 16:57:53.82110968 +0000 UTC m=+71.851578665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-28snx" (UID: "664277ac-f857-434d-b715-0ed3e46b2280") : secret "samples-operator-tls" not found May 29 16:57:40.240558 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:40.240527 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:40.240934 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:40.240673 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 29 16:57:40.240934 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:40.240762 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls podName:d242ba07-31ed-473d-9b24-c5f63867ba2d nodeName:}" failed. No retries permitted until 2026-05-29 16:57:48.24074722 +0000 UTC m=+66.271216206 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5wsgv" (UID: "d242ba07-31ed-473d-9b24-c5f63867ba2d") : secret "insights-runtime-extractor-tls" not found May 29 16:57:40.555026 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:40.554990 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bf6q2" May 29 16:57:42.448062 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:42.448031 2561 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:42.448480 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:42.448072 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:57:42.448599 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:42.448520 2561 scope.go:117] "RemoveContainer" containerID="7a8132cf901e3472102c3d180340b97fabded8094ad4562e76b1d0dc4c4673a7" May 29 16:57:42.448772 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:42.448751 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-psmjn_openshift-console-operator(f4dbc8b6-1456-49f4-9e34-e9036b732e46)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" podUID="f4dbc8b6-1456-49f4-9e34-e9036b732e46" May 29 16:57:48.105918 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.105876 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs\") pod \"network-metrics-daemon-tz999\" (UID: \"47cbc84a-e410-451b-86f1-222dfcd8d0ad\") " pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:57:48.108730 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.108707 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 16:57:48.116337 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:48.116313 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 29 16:57:48.116416 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:48.116374 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs podName:47cbc84a-e410-451b-86f1-222dfcd8d0ad nodeName:}" failed. No retries permitted until 2026-05-29 16:58:52.116358854 +0000 UTC m=+130.146827840 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs") pod "network-metrics-daemon-tz999" (UID: "47cbc84a-e410-451b-86f1-222dfcd8d0ad") : secret "metrics-daemon-secret" not found May 29 16:57:48.307007 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.306976 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert\") pod \"ingress-canary-wdlpr\" (UID: \"a44d2b9b-42c3-4e55-bbaa-6453218224b7\") " pod="openshift-ingress-canary/ingress-canary-wdlpr" May 29 16:57:48.307150 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.307045 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:57:48.307150 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.307092 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:57:48.307150 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.307122 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:48.307303 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:48.307193 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 29 16:57:48.307303 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.307240 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj2b\" (UniqueName: \"kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b\") pod \"network-check-target-ggsd5\" (UID: \"e1e737e3-e8c5-422a-a103-c227400103f9\") " pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:48.307303 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:48.307259 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls podName:18d06c9c-d13c-4bd0-a23f-6ceffe36743e nodeName:}" failed. No retries permitted until 2026-05-29 16:58:20.307241681 +0000 UTC m=+98.337710678 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-vbmm6" (UID: "18d06c9c-d13c-4bd0-a23f-6ceffe36743e") : secret "cluster-monitoring-operator-tls" not found May 29 16:57:48.307303 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:48.307193 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 29 16:57:48.307508 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:48.307358 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls podName:d242ba07-31ed-473d-9b24-c5f63867ba2d nodeName:}" failed. No retries permitted until 2026-05-29 16:58:04.307334709 +0000 UTC m=+82.337803699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5wsgv" (UID: "d242ba07-31ed-473d-9b24-c5f63867ba2d") : secret "insights-runtime-extractor-tls" not found May 29 16:57:48.309526 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.309503 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a44d2b9b-42c3-4e55-bbaa-6453218224b7-cert\") pod \"ingress-canary-wdlpr\" (UID: \"a44d2b9b-42c3-4e55-bbaa-6453218224b7\") " pod="openshift-ingress-canary/ingress-canary-wdlpr" May 29 16:57:48.309617 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.309506 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls\") pod \"image-registry-88b8fcd86-2mtfz\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:48.310036 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.310021 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 16:57:48.320960 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.320937 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 16:57:48.330266 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.330248 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vj2b\" (UniqueName: \"kubernetes.io/projected/e1e737e3-e8c5-422a-a103-c227400103f9-kube-api-access-2vj2b\") pod \"network-check-target-ggsd5\" (UID: \"e1e737e3-e8c5-422a-a103-c227400103f9\") " pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:48.408482 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.408430 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:48.408563 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.408511 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:48.408563 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.408530 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:57:48.408628 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:48.408577 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle podName:9e8b3057-a3bb-4e0c-9066-52577b25fcd4 nodeName:}" failed. No retries permitted until 2026-05-29 16:58:20.40856239 +0000 UTC m=+98.439031376 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle") pod "router-default-78d54b76f9-bx987" (UID: "9e8b3057-a3bb-4e0c-9066-52577b25fcd4") : configmap references non-existent config key: service-ca.crt May 29 16:57:48.408628 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:48.408620 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 16:57:48.408723 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:48.408660 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs podName:9e8b3057-a3bb-4e0c-9066-52577b25fcd4 nodeName:}" failed. No retries permitted until 2026-05-29 16:58:20.408649438 +0000 UTC m=+98.439118424 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs") pod "router-default-78d54b76f9-bx987" (UID: "9e8b3057-a3bb-4e0c-9066-52577b25fcd4") : secret "router-metrics-certs-default" not found May 29 16:57:48.410472 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.410456 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee1eec81-b979-4fdd-b042-38a9d11f4261-metrics-tls\") pod \"dns-default-mggz6\" (UID: \"ee1eec81-b979-4fdd-b042-38a9d11f4261\") " pod="openshift-dns/dns-default-mggz6" May 29 16:57:48.491903 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.491877 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vq84q\"" May 29 16:57:48.500318 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.500300 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:48.522636 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.522613 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fgcrt\"" May 29 16:57:48.530442 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.530421 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wdlpr" May 29 16:57:48.536798 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.536723 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gvkkc\"" May 29 16:57:48.544547 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.544528 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:48.621266 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.621198 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xwwt6\"" May 29 16:57:48.628718 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.628296 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mggz6" May 29 16:57:48.641701 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.641659 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-88b8fcd86-2mtfz"] May 29 16:57:48.644524 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:57:48.644494 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb415f2d5_93da_4d4d_bfdd_7252d4ae89f9.slice/crio-ab59540fcd6e2811fc5e16bdc5184bc2a037f2ac4afc9bbfb5b2a556222b6dee WatchSource:0}: Error finding container ab59540fcd6e2811fc5e16bdc5184bc2a037f2ac4afc9bbfb5b2a556222b6dee: Status 404 returned error can't find the container with id ab59540fcd6e2811fc5e16bdc5184bc2a037f2ac4afc9bbfb5b2a556222b6dee May 29 16:57:48.679742 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.679162 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wdlpr"] May 29 16:57:48.691528 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:57:48.688461 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44d2b9b_42c3_4e55_bbaa_6453218224b7.slice/crio-8de8cdf38e205ff76f317fdd5c83700ca6c7857ac1852db6a1e5a2fbcd2d8c3d WatchSource:0}: Error finding container 8de8cdf38e205ff76f317fdd5c83700ca6c7857ac1852db6a1e5a2fbcd2d8c3d: Status 404 returned error can't find the container with id 8de8cdf38e205ff76f317fdd5c83700ca6c7857ac1852db6a1e5a2fbcd2d8c3d May 29 16:57:48.706304 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.706280 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ggsd5"] May 29 16:57:48.714285 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:57:48.714115 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e737e3_e8c5_422a_a103_c227400103f9.slice/crio-87804d542c46ad0d1fedafd3922363be3414be6a5c595eb6ebf5c645d9664013 WatchSource:0}: Error finding container 87804d542c46ad0d1fedafd3922363be3414be6a5c595eb6ebf5c645d9664013: Status 404 returned error can't find the container with id 87804d542c46ad0d1fedafd3922363be3414be6a5c595eb6ebf5c645d9664013 May 29 16:57:48.716121 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.716028 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wdlpr" event={"ID":"a44d2b9b-42c3-4e55-bbaa-6453218224b7","Type":"ContainerStarted","Data":"8de8cdf38e205ff76f317fdd5c83700ca6c7857ac1852db6a1e5a2fbcd2d8c3d"} May 29 16:57:48.718201 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.718120 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" event={"ID":"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9","Type":"ContainerStarted","Data":"ab59540fcd6e2811fc5e16bdc5184bc2a037f2ac4afc9bbfb5b2a556222b6dee"} May 29 16:57:48.787164 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:48.787132 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mggz6"] May 29 16:57:48.789776 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:57:48.789750 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee1eec81_b979_4fdd_b042_38a9d11f4261.slice/crio-feba3315fb17619457ad739f1fca4d87c7876c5b763bd3f8222bd4a764105af6 WatchSource:0}: Error finding container feba3315fb17619457ad739f1fca4d87c7876c5b763bd3f8222bd4a764105af6: Status 404 returned error can't find the container with id feba3315fb17619457ad739f1fca4d87c7876c5b763bd3f8222bd4a764105af6 May 29 16:57:49.723838 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:49.723782 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" event={"ID":"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9","Type":"ContainerStarted","Data":"6bcf67e083978ac486e39d0f9bcaec32f380d0f23ed2d1d5aa0c1b954dbb0fe1"} May 29 16:57:49.724340 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:49.724041 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:57:49.725731 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:49.725704 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mggz6" event={"ID":"ee1eec81-b979-4fdd-b042-38a9d11f4261","Type":"ContainerStarted","Data":"feba3315fb17619457ad739f1fca4d87c7876c5b763bd3f8222bd4a764105af6"} May 29 16:57:49.727025 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:49.726987 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ggsd5" event={"ID":"e1e737e3-e8c5-422a-a103-c227400103f9","Type":"ContainerStarted","Data":"87804d542c46ad0d1fedafd3922363be3414be6a5c595eb6ebf5c645d9664013"} May 29 16:57:49.745447 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:49.745398 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" podStartSLOduration=67.745381771 podStartE2EDuration="1m7.745381771s" podCreationTimestamp="2026-05-29 16:56:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 16:57:49.744722569 +0000 UTC m=+67.775191578" watchObservedRunningTime="2026-05-29 16:57:49.745381771 +0000 UTC m=+67.775850783" May 29 16:57:52.736268 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:52.736232 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mggz6" event={"ID":"ee1eec81-b979-4fdd-b042-38a9d11f4261","Type":"ContainerStarted","Data":"1c6dcafc19017b91084e31e3ba5553df1c7bca6f06b023ea6773b15a82d14aa5"} May 29 16:57:52.736823 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:52.736277 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mggz6" event={"ID":"ee1eec81-b979-4fdd-b042-38a9d11f4261","Type":"ContainerStarted","Data":"53cc019d5a80ae2cae03d7659610ca20a72d0952e22ea0e3037bbab028d7fb99"} May 29 16:57:52.736823 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:52.736375 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mggz6" May 29 16:57:52.737617 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:52.737590 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ggsd5" event={"ID":"e1e737e3-e8c5-422a-a103-c227400103f9","Type":"ContainerStarted","Data":"cc29b99ee799a507f81e26ed2b1f9f609dcb8971cd2b9548e9c53ceb83c084e5"} May 29 16:57:52.737742 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:52.737697 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:57:52.738934 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:52.738914 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wdlpr" event={"ID":"a44d2b9b-42c3-4e55-bbaa-6453218224b7","Type":"ContainerStarted","Data":"1a40c9e88cf53a708012134b6342ed8a0c3b7cd239dbf1f5442674a86c41279d"} May 29 16:57:52.755736 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:52.755675 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-mggz6" podStartSLOduration=33.645409724 podStartE2EDuration="36.755663448s" podCreationTimestamp="2026-05-29 16:57:16 +0000 UTC" firstStartedPulling="2026-05-29 16:57:48.791824699 +0000 UTC m=+66.822293686" lastFinishedPulling="2026-05-29 16:57:51.902078412 +0000 UTC m=+69.932547410" observedRunningTime="2026-05-29 16:57:52.755229646 +0000 UTC m=+70.785698654" watchObservedRunningTime="2026-05-29 16:57:52.755663448 +0000 UTC m=+70.786132450" May 29 16:57:52.771992 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:52.771952 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ggsd5" podStartSLOduration=67.575336861 podStartE2EDuration="1m10.771942227s" podCreationTimestamp="2026-05-29 16:56:42 +0000 UTC" firstStartedPulling="2026-05-29 16:57:48.716278637 +0000 UTC m=+66.746747622" lastFinishedPulling="2026-05-29 16:57:51.912883986 +0000 UTC m=+69.943352988" observedRunningTime="2026-05-29 16:57:52.771171847 +0000 UTC m=+70.801640866" watchObservedRunningTime="2026-05-29 16:57:52.771942227 +0000 UTC m=+70.802411234" May 29 16:57:52.789990 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:52.789958 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wdlpr" podStartSLOduration=33.575124488 podStartE2EDuration="36.789949785s" podCreationTimestamp="2026-05-29 16:57:16 +0000 UTC" firstStartedPulling="2026-05-29 16:57:48.690934032 +0000 UTC m=+66.721403029" lastFinishedPulling="2026-05-29 16:57:51.905759326 +0000 UTC m=+69.936228326" observedRunningTime="2026-05-29 16:57:52.789778414 +0000 UTC m=+70.820247421" watchObservedRunningTime="2026-05-29 16:57:52.789949785 +0000 UTC m=+70.820418787" May 29 16:57:53.420177 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:53.420150 2561 scope.go:117] "RemoveContainer" containerID="7a8132cf901e3472102c3d180340b97fabded8094ad4562e76b1d0dc4c4673a7" May 29 16:57:53.743422 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:53.743341 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 16:57:53.743823 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:53.743729 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/1.log" May 29 16:57:53.743823 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:53.743760 2561 generic.go:358] "Generic (PLEG): container finished" podID="f4dbc8b6-1456-49f4-9e34-e9036b732e46" containerID="1bf519a1e40d52e90fb78d3f76e9296bf8957b2be51db3ae8ff7bfb2ae745d6d" exitCode=255 May 29 16:57:53.743898 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:53.743855 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" event={"ID":"f4dbc8b6-1456-49f4-9e34-e9036b732e46","Type":"ContainerDied","Data":"1bf519a1e40d52e90fb78d3f76e9296bf8957b2be51db3ae8ff7bfb2ae745d6d"} May 29 16:57:53.743932 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:53.743898 2561 scope.go:117] "RemoveContainer" containerID="7a8132cf901e3472102c3d180340b97fabded8094ad4562e76b1d0dc4c4673a7" May 29 16:57:53.744497 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:53.744461 2561 scope.go:117] "RemoveContainer" containerID="1bf519a1e40d52e90fb78d3f76e9296bf8957b2be51db3ae8ff7bfb2ae745d6d" May 29 16:57:53.744650 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:57:53.744627 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-psmjn_openshift-console-operator(f4dbc8b6-1456-49f4-9e34-e9036b732e46)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" podUID="f4dbc8b6-1456-49f4-9e34-e9036b732e46" May 29 16:57:53.860391 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:53.860357 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-28snx\" (UID: \"664277ac-f857-434d-b715-0ed3e46b2280\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" May 29 16:57:53.862551 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:53.862532 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/664277ac-f857-434d-b715-0ed3e46b2280-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-28snx\" (UID: \"664277ac-f857-434d-b715-0ed3e46b2280\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" May 29 16:57:54.117008 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:54.116979 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tvvkq\"" May 29 16:57:54.124536 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:54.124517 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" May 29 16:57:54.242537 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:54.242515 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx"] May 29 16:57:54.748350 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:54.748320 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 16:57:54.749458 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:54.749431 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" event={"ID":"664277ac-f857-434d-b715-0ed3e46b2280","Type":"ContainerStarted","Data":"ce1d98dce5070b4b40a43bf096bf68a0bd97c86addbf5383814b2d1553f38594"} May 29 16:57:56.756319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:56.756284 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" event={"ID":"664277ac-f857-434d-b715-0ed3e46b2280","Type":"ContainerStarted","Data":"3b158219aa1e54efcc4718bafa031ec81b7f4a0fdfe9f478f593282ba16dee96"} May 29 16:57:56.756319 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:56.756323 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" event={"ID":"664277ac-f857-434d-b715-0ed3e46b2280","Type":"ContainerStarted","Data":"6f530cc8deab17d301bb9ba19812b4ed11952f4c2db530f9b5a618685efa574e"} May 29 16:57:56.774139 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:57:56.774093 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-28snx" podStartSLOduration=33.939891088 podStartE2EDuration="35.774080841s" podCreationTimestamp="2026-05-29 16:57:21 +0000 UTC" firstStartedPulling="2026-05-29 16:57:54.276792216 +0000 UTC m=+72.307261202" lastFinishedPulling="2026-05-29 16:57:56.110981955 +0000 UTC m=+74.141450955" observedRunningTime="2026-05-29 16:57:56.772982448 +0000 UTC m=+74.803451457" watchObservedRunningTime="2026-05-29 16:57:56.774080841 +0000 UTC m=+74.804549879" May 29 16:58:02.448307 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:02.448279 2561 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:58:02.448307 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:02.448310 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:58:02.448744 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:02.448600 2561 scope.go:117] "RemoveContainer" containerID="1bf519a1e40d52e90fb78d3f76e9296bf8957b2be51db3ae8ff7bfb2ae745d6d" May 29 16:58:02.448846 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:58:02.448827 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-psmjn_openshift-console-operator(f4dbc8b6-1456-49f4-9e34-e9036b732e46)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" podUID="f4dbc8b6-1456-49f4-9e34-e9036b732e46" May 29 16:58:02.746795 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:02.746702 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mggz6" May 29 16:58:04.347371 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:04.347337 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:58:04.349639 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:04.349615 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d242ba07-31ed-473d-9b24-c5f63867ba2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5wsgv\" (UID: \"d242ba07-31ed-473d-9b24-c5f63867ba2d\") " pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:58:04.650501 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:04.650422 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kt6kk\"" May 29 16:58:04.658769 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:04.658746 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5wsgv" May 29 16:58:04.779014 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:04.778990 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5wsgv"] May 29 16:58:04.781446 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:58:04.781408 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd242ba07_31ed_473d_9b24_c5f63867ba2d.slice/crio-5b963835752ad60ef1d9a1539978d18146126406e0e870f67ef865a0021d3ee9 WatchSource:0}: Error finding container 5b963835752ad60ef1d9a1539978d18146126406e0e870f67ef865a0021d3ee9: Status 404 returned error can't find the container with id 5b963835752ad60ef1d9a1539978d18146126406e0e870f67ef865a0021d3ee9 May 29 16:58:05.782649 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:05.782618 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5wsgv" event={"ID":"d242ba07-31ed-473d-9b24-c5f63867ba2d","Type":"ContainerStarted","Data":"c99c99e2ae523fe8ed91fa5ead1d90f6a4017be1020a7d107a3204f7ea916808"} May 29 16:58:05.782649 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:05.782652 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5wsgv" event={"ID":"d242ba07-31ed-473d-9b24-c5f63867ba2d","Type":"ContainerStarted","Data":"5b963835752ad60ef1d9a1539978d18146126406e0e870f67ef865a0021d3ee9"} May 29 16:58:06.790998 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:06.790959 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5wsgv" event={"ID":"d242ba07-31ed-473d-9b24-c5f63867ba2d","Type":"ContainerStarted","Data":"63eb21d8a31e2104e4b0c0b0ee89d869c423afca1f2597486357442376088b03"} May 29 16:58:08.504993 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:08.504960 2561 patch_prober.go:28] interesting pod/image-registry-88b8fcd86-2mtfz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 29 16:58:08.505339 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:08.505008 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" podUID="b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 16:58:08.797819 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:08.797784 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5wsgv" event={"ID":"d242ba07-31ed-473d-9b24-c5f63867ba2d","Type":"ContainerStarted","Data":"c97591129800f511715e425a5a43f1fae9249ef601b16bfaec51dc7a2092a893"} May 29 16:58:08.815703 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:08.815637 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5wsgv" podStartSLOduration=33.820252005 podStartE2EDuration="36.815623688s" podCreationTimestamp="2026-05-29 16:57:32 +0000 UTC" firstStartedPulling="2026-05-29 16:58:04.910798457 +0000 UTC m=+82.941267443" lastFinishedPulling="2026-05-29 16:58:07.906170125 +0000 UTC m=+85.936639126" observedRunningTime="2026-05-29 16:58:08.814912294 +0000 UTC m=+86.845381313" watchObservedRunningTime="2026-05-29 16:58:08.815623688 +0000 UTC m=+86.846092697" May 29 16:58:10.733590 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:10.733564 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:58:15.420426 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:15.420387 2561 scope.go:117] "RemoveContainer" containerID="1bf519a1e40d52e90fb78d3f76e9296bf8957b2be51db3ae8ff7bfb2ae745d6d" May 29 16:58:15.818112 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:15.818081 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 16:58:15.818273 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:15.818144 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" event={"ID":"f4dbc8b6-1456-49f4-9e34-e9036b732e46","Type":"ContainerStarted","Data":"74e302487be04e32e1c9019a3889aeb8ca63a9704a5a6af7736fd23de8703705"} May 29 16:58:15.818471 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:15.818450 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:58:15.835867 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:15.835826 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" podStartSLOduration=47.458386042 podStartE2EDuration="53.835816137s" podCreationTimestamp="2026-05-29 16:57:22 +0000 UTC" firstStartedPulling="2026-05-29 16:57:27.469189993 +0000 UTC m=+45.499658993" lastFinishedPulling="2026-05-29 16:57:33.846620101 +0000 UTC m=+51.877089088" observedRunningTime="2026-05-29 16:58:15.835354542 +0000 UTC m=+93.865823549" watchObservedRunningTime="2026-05-29 16:58:15.835816137 +0000 UTC m=+93.866285144" May 29 16:58:15.997906 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:15.997883 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-psmjn" May 29 16:58:20.378152 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:20.378103 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:58:20.380448 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:20.380427 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18d06c9c-d13c-4bd0-a23f-6ceffe36743e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-vbmm6\" (UID: \"18d06c9c-d13c-4bd0-a23f-6ceffe36743e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:58:20.479447 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:20.479418 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:58:20.479586 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:20.479461 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:58:20.479992 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:20.479972 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-service-ca-bundle\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:58:20.481679 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:20.481657 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e8b3057-a3bb-4e0c-9066-52577b25fcd4-metrics-certs\") pod \"router-default-78d54b76f9-bx987\" (UID: \"9e8b3057-a3bb-4e0c-9066-52577b25fcd4\") " pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:58:20.608848 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:20.608823 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5flcw\"" May 29 16:58:20.616248 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:20.616233 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" May 29 16:58:20.660408 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:20.660349 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8j4sp\"" May 29 16:58:20.668193 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:20.667820 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:58:20.749440 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:20.749413 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6"] May 29 16:58:20.751021 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:58:20.750995 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d06c9c_d13c_4bd0_a23f_6ceffe36743e.slice/crio-cc9584a5b2f308d346481e070f818b7372c70d14985627486c4570ee5a4fa45a WatchSource:0}: Error finding container cc9584a5b2f308d346481e070f818b7372c70d14985627486c4570ee5a4fa45a: Status 404 returned error can't find the container with id cc9584a5b2f308d346481e070f818b7372c70d14985627486c4570ee5a4fa45a May 29 16:58:20.801068 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:20.801046 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78d54b76f9-bx987"] May 29 16:58:20.803463 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:58:20.803436 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e8b3057_a3bb_4e0c_9066_52577b25fcd4.slice/crio-25465669745a358ebe6adaa6a8e433df07e7bfb5f7a2a3b4404b7e3b4f794466 WatchSource:0}: Error finding container 25465669745a358ebe6adaa6a8e433df07e7bfb5f7a2a3b4404b7e3b4f794466: Status 404 returned error can't find the container with id 25465669745a358ebe6adaa6a8e433df07e7bfb5f7a2a3b4404b7e3b4f794466 May 29 16:58:20.831411 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:20.831383 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78d54b76f9-bx987" event={"ID":"9e8b3057-a3bb-4e0c-9066-52577b25fcd4","Type":"ContainerStarted","Data":"25465669745a358ebe6adaa6a8e433df07e7bfb5f7a2a3b4404b7e3b4f794466"} May 29 16:58:20.832239 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:20.832219 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" event={"ID":"18d06c9c-d13c-4bd0-a23f-6ceffe36743e","Type":"ContainerStarted","Data":"cc9584a5b2f308d346481e070f818b7372c70d14985627486c4570ee5a4fa45a"} May 29 16:58:21.837042 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:21.837003 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78d54b76f9-bx987" event={"ID":"9e8b3057-a3bb-4e0c-9066-52577b25fcd4","Type":"ContainerStarted","Data":"ea3ff685b72297989f7bb6972c1f5d80afa4bf3c8d92f39410d6e03b083a581c"} May 29 16:58:21.857012 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:21.856967 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-78d54b76f9-bx987" podStartSLOduration=69.856952832 podStartE2EDuration="1m9.856952832s" podCreationTimestamp="2026-05-29 16:57:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 16:58:21.854864853 +0000 UTC m=+99.885333888" watchObservedRunningTime="2026-05-29 16:58:21.856952832 +0000 UTC m=+99.887421840" May 29 16:58:22.669136 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:22.669098 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:58:22.671939 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:22.671917 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:58:22.840036 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:22.840003 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:58:22.841418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:22.841317 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-78d54b76f9-bx987" May 29 16:58:23.746539 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:23.746513 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ggsd5" May 29 16:58:23.844162 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:23.844128 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" event={"ID":"18d06c9c-d13c-4bd0-a23f-6ceffe36743e","Type":"ContainerStarted","Data":"621aad1148c87cacdf84127ad4217b89363c4372f49516cfaa15e26095660e8f"} May 29 16:58:23.866000 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:23.865953 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vbmm6" podStartSLOduration=69.600020464 podStartE2EDuration="1m11.865941446s" podCreationTimestamp="2026-05-29 16:57:12 +0000 UTC" firstStartedPulling="2026-05-29 16:58:20.753518816 +0000 UTC m=+98.783987802" lastFinishedPulling="2026-05-29 16:58:23.019439787 +0000 UTC m=+101.049908784" observedRunningTime="2026-05-29 16:58:23.865108046 +0000 UTC m=+101.895577054" watchObservedRunningTime="2026-05-29 16:58:23.865941446 +0000 UTC m=+101.896410453" May 29 16:58:25.439194 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:25.439163 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-88b8fcd86-2mtfz"] May 29 16:58:39.013754 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.013718 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zqwrz"] May 29 16:58:39.019222 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.019201 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.021940 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.021919 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dt92w\"" May 29 16:58:39.022043 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.021920 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 29 16:58:39.022043 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.021920 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 29 16:58:39.023317 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.023301 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 29 16:58:39.023418 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.023342 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 29 16:58:39.131153 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.131117 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58af06c1-8482-4533-9ef2-3cd3423a41cb-root\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.131293 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.131211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-wtmp\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.131293 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.131244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.131293 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.131274 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58af06c1-8482-4533-9ef2-3cd3423a41cb-metrics-client-ca\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.131426 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.131392 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-textfile\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.131473 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.131426 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-tls\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.131473 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.131454 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.131551 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.131480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29gzt\" (UniqueName: \"kubernetes.io/projected/58af06c1-8482-4533-9ef2-3cd3423a41cb-kube-api-access-29gzt\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.131551 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.131498 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58af06c1-8482-4533-9ef2-3cd3423a41cb-sys\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232074 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232042 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-wtmp\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232198 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232079 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232198 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232105 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58af06c1-8482-4533-9ef2-3cd3423a41cb-metrics-client-ca\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232198 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232155 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-textfile\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232198 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232178 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-tls\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232413 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232205 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232413 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232210 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-wtmp\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232413 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232261 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29gzt\" (UniqueName: \"kubernetes.io/projected/58af06c1-8482-4533-9ef2-3cd3423a41cb-kube-api-access-29gzt\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232413 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232303 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58af06c1-8482-4533-9ef2-3cd3423a41cb-sys\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232413 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:58:39.232317 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 29 16:58:39.232413 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232336 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58af06c1-8482-4533-9ef2-3cd3423a41cb-root\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232413 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:58:39.232396 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-tls podName:58af06c1-8482-4533-9ef2-3cd3423a41cb nodeName:}" failed. No retries permitted until 2026-05-29 16:58:39.732373709 +0000 UTC m=+117.762842703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-tls") pod "node-exporter-zqwrz" (UID: "58af06c1-8482-4533-9ef2-3cd3423a41cb") : secret "node-exporter-tls" not found May 29 16:58:39.232413 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232415 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58af06c1-8482-4533-9ef2-3cd3423a41cb-root\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232767 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232484 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58af06c1-8482-4533-9ef2-3cd3423a41cb-sys\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232767 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232521 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-textfile\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232767 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232701 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58af06c1-8482-4533-9ef2-3cd3423a41cb-metrics-client-ca\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.232767 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.232719 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.234485 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.234468 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.240887 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.240863 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29gzt\" (UniqueName: \"kubernetes.io/projected/58af06c1-8482-4533-9ef2-3cd3423a41cb-kube-api-access-29gzt\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.741757 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.741723 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-tls\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.744036 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.744009 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58af06c1-8482-4533-9ef2-3cd3423a41cb-node-exporter-tls\") pod \"node-exporter-zqwrz\" (UID: \"58af06c1-8482-4533-9ef2-3cd3423a41cb\") " pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.928293 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:39.928259 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zqwrz" May 29 16:58:39.939011 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:58:39.938980 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58af06c1_8482_4533_9ef2_3cd3423a41cb.slice/crio-bb403698f44367ec76410a300bc80562fff590f87e0d7cd5a8362a55403bf79a WatchSource:0}: Error finding container bb403698f44367ec76410a300bc80562fff590f87e0d7cd5a8362a55403bf79a: Status 404 returned error can't find the container with id bb403698f44367ec76410a300bc80562fff590f87e0d7cd5a8362a55403bf79a May 29 16:58:40.890252 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:40.890214 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqwrz" event={"ID":"58af06c1-8482-4533-9ef2-3cd3423a41cb","Type":"ContainerStarted","Data":"bb403698f44367ec76410a300bc80562fff590f87e0d7cd5a8362a55403bf79a"} May 29 16:58:41.893757 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:41.893723 2561 generic.go:358] "Generic (PLEG): container finished" podID="58af06c1-8482-4533-9ef2-3cd3423a41cb" containerID="9aafd74c0d9d55170c50964ed67b880f2439922226fc093ac425b2ee72cdd719" exitCode=0 May 29 16:58:41.894202 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:41.893819 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqwrz" event={"ID":"58af06c1-8482-4533-9ef2-3cd3423a41cb","Type":"ContainerDied","Data":"9aafd74c0d9d55170c50964ed67b880f2439922226fc093ac425b2ee72cdd719"} May 29 16:58:41.895083 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:41.895058 2561 generic.go:358] "Generic (PLEG): container finished" podID="74f07148-f376-4cd0-8014-34d828940db8" containerID="d737098d7f04ed23274a9a823d4d9219282c0ede38db92cba2ebfdecf4f47751" exitCode=0 May 29 16:58:41.895185 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:41.895095 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" event={"ID":"74f07148-f376-4cd0-8014-34d828940db8","Type":"ContainerDied","Data":"d737098d7f04ed23274a9a823d4d9219282c0ede38db92cba2ebfdecf4f47751"} May 29 16:58:41.895343 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:41.895330 2561 scope.go:117] "RemoveContainer" containerID="d737098d7f04ed23274a9a823d4d9219282c0ede38db92cba2ebfdecf4f47751" May 29 16:58:42.899177 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:42.899134 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqwrz" event={"ID":"58af06c1-8482-4533-9ef2-3cd3423a41cb","Type":"ContainerStarted","Data":"228aa3010bfa46d16ed2c1e8211c02e635732dbdf5fa98ae585eff52184da35b"} May 29 16:58:42.899177 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:42.899180 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqwrz" event={"ID":"58af06c1-8482-4533-9ef2-3cd3423a41cb","Type":"ContainerStarted","Data":"f78a4ac718bf51d15e8ec42583040ea064b599ea5a933b97b439a75b713ca878"} May 29 16:58:42.900785 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:42.900757 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-bkcwd" event={"ID":"74f07148-f376-4cd0-8014-34d828940db8","Type":"ContainerStarted","Data":"c0a0bdaa1297f24c4a7dfe0acbbcdf054c75e711afdb0864ef3f0a97e1b8f949"} May 29 16:58:42.921468 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:42.921418 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zqwrz" podStartSLOduration=3.746023353 podStartE2EDuration="4.921405133s" podCreationTimestamp="2026-05-29 16:58:38 +0000 UTC" firstStartedPulling="2026-05-29 16:58:39.940767539 +0000 UTC m=+117.971236528" lastFinishedPulling="2026-05-29 16:58:41.11614932 +0000 UTC m=+119.146618308" observedRunningTime="2026-05-29 16:58:42.919458445 +0000 UTC m=+120.949927452" watchObservedRunningTime="2026-05-29 16:58:42.921405133 +0000 UTC m=+120.951874161" May 29 16:58:44.907030 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:44.906995 2561 generic.go:358] "Generic (PLEG): container finished" podID="ff35d618-b26d-4012-acb0-f8ce811fc7a0" containerID="bc2dc8b278b1840f3d4c4acba344727fd1f58b911a7f03e3d49cbd52511bf067" exitCode=0 May 29 16:58:44.907413 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:44.907069 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" event={"ID":"ff35d618-b26d-4012-acb0-f8ce811fc7a0","Type":"ContainerDied","Data":"bc2dc8b278b1840f3d4c4acba344727fd1f58b911a7f03e3d49cbd52511bf067"} May 29 16:58:44.907413 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:44.907384 2561 scope.go:117] "RemoveContainer" containerID="bc2dc8b278b1840f3d4c4acba344727fd1f58b911a7f03e3d49cbd52511bf067" May 29 16:58:45.911457 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:45.911424 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-676kf" event={"ID":"ff35d618-b26d-4012-acb0-f8ce811fc7a0","Type":"ContainerStarted","Data":"486d9256256716974c4951ceb3536c60084cb0248ac86c647d844611bf83217f"} May 29 16:58:50.458641 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.458598 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" podUID="b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" containerName="registry" containerID="cri-o://6bcf67e083978ac486e39d0f9bcaec32f380d0f23ed2d1d5aa0c1b954dbb0fe1" gracePeriod=30 May 29 16:58:50.712800 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.712745 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:58:50.737121 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.737092 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-bound-sa-token\") pod \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " May 29 16:58:50.737257 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.737128 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-installation-pull-secrets\") pod \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " May 29 16:58:50.737257 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.737179 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-certificates\") pod \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " May 29 16:58:50.737257 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.737203 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-image-registry-private-configuration\") pod \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " May 29 16:58:50.737257 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.737228 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls\") pod \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " May 29 16:58:50.737257 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.737247 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-ca-trust-extracted\") pod \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " May 29 16:58:50.737513 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.737262 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-trusted-ca\") pod \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " May 29 16:58:50.737513 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.737277 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czmsg\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-kube-api-access-czmsg\") pod \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\" (UID: \"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9\") " May 29 16:58:50.738460 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.738161 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" (UID: "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 16:58:50.739032 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.738991 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" (UID: "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 16:58:50.739986 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.739963 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" (UID: "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 16:58:50.740105 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.740002 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" (UID: "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 16:58:50.740641 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.740615 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" (UID: "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 16:58:50.740747 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.740616 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-kube-api-access-czmsg" (OuterVolumeSpecName: "kube-api-access-czmsg") pod "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" (UID: "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9"). InnerVolumeSpecName "kube-api-access-czmsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 16:58:50.741093 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.741069 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" (UID: "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 16:58:50.755102 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.755072 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" (UID: "b415f2d5-93da-4d4d-bfdd-7252d4ae89f9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 16:58:50.838281 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.838246 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-bound-sa-token\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 16:58:50.838281 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.838273 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-installation-pull-secrets\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 16:58:50.838281 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.838284 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-certificates\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 16:58:50.838509 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.838293 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-image-registry-private-configuration\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 16:58:50.838509 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.838305 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-registry-tls\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 16:58:50.838509 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.838314 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-ca-trust-extracted\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 16:58:50.838509 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.838323 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-trusted-ca\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 16:58:50.838509 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.838332 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czmsg\" (UniqueName: \"kubernetes.io/projected/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9-kube-api-access-czmsg\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 16:58:50.926292 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.926258 2561 generic.go:358] "Generic (PLEG): container finished" podID="b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" containerID="6bcf67e083978ac486e39d0f9bcaec32f380d0f23ed2d1d5aa0c1b954dbb0fe1" exitCode=0 May 29 16:58:50.926429 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.926327 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" May 29 16:58:50.926429 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.926331 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" event={"ID":"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9","Type":"ContainerDied","Data":"6bcf67e083978ac486e39d0f9bcaec32f380d0f23ed2d1d5aa0c1b954dbb0fe1"} May 29 16:58:50.926429 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.926366 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88b8fcd86-2mtfz" event={"ID":"b415f2d5-93da-4d4d-bfdd-7252d4ae89f9","Type":"ContainerDied","Data":"ab59540fcd6e2811fc5e16bdc5184bc2a037f2ac4afc9bbfb5b2a556222b6dee"} May 29 16:58:50.926429 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.926387 2561 scope.go:117] "RemoveContainer" containerID="6bcf67e083978ac486e39d0f9bcaec32f380d0f23ed2d1d5aa0c1b954dbb0fe1" May 29 16:58:50.936989 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.935678 2561 scope.go:117] "RemoveContainer" containerID="6bcf67e083978ac486e39d0f9bcaec32f380d0f23ed2d1d5aa0c1b954dbb0fe1" May 29 16:58:50.936989 ip-10-0-137-133 kubenswrapper[2561]: E0529 16:58:50.936113 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bcf67e083978ac486e39d0f9bcaec32f380d0f23ed2d1d5aa0c1b954dbb0fe1\": container with ID starting with 6bcf67e083978ac486e39d0f9bcaec32f380d0f23ed2d1d5aa0c1b954dbb0fe1 not found: ID does not exist" containerID="6bcf67e083978ac486e39d0f9bcaec32f380d0f23ed2d1d5aa0c1b954dbb0fe1" May 29 16:58:50.936989 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.936149 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bcf67e083978ac486e39d0f9bcaec32f380d0f23ed2d1d5aa0c1b954dbb0fe1"} err="failed to get container status \"6bcf67e083978ac486e39d0f9bcaec32f380d0f23ed2d1d5aa0c1b954dbb0fe1\": rpc error: code = NotFound desc = could not find container \"6bcf67e083978ac486e39d0f9bcaec32f380d0f23ed2d1d5aa0c1b954dbb0fe1\": container with ID starting with 6bcf67e083978ac486e39d0f9bcaec32f380d0f23ed2d1d5aa0c1b954dbb0fe1 not found: ID does not exist" May 29 16:58:50.950298 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.950273 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-88b8fcd86-2mtfz"] May 29 16:58:50.953347 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:50.953327 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-88b8fcd86-2mtfz"] May 29 16:58:52.146803 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:52.146765 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs\") pod \"network-metrics-daemon-tz999\" (UID: \"47cbc84a-e410-451b-86f1-222dfcd8d0ad\") " pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:58:52.149013 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:52.148995 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cbc84a-e410-451b-86f1-222dfcd8d0ad-metrics-certs\") pod \"network-metrics-daemon-tz999\" (UID: \"47cbc84a-e410-451b-86f1-222dfcd8d0ad\") " pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:58:52.424004 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:52.423907 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" path="/var/lib/kubelet/pods/b415f2d5-93da-4d4d-bfdd-7252d4ae89f9/volumes" May 29 16:58:52.445562 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:52.445537 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fng4t\"" May 29 16:58:52.453649 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:52.453632 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tz999" May 29 16:58:52.570505 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:52.570480 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tz999"] May 29 16:58:52.572841 ip-10-0-137-133 kubenswrapper[2561]: W0529 16:58:52.572815 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47cbc84a_e410_451b_86f1_222dfcd8d0ad.slice/crio-84989501582d9b426064aaaf894366a61a7e3f72657933700005be5216885bb1 WatchSource:0}: Error finding container 84989501582d9b426064aaaf894366a61a7e3f72657933700005be5216885bb1: Status 404 returned error can't find the container with id 84989501582d9b426064aaaf894366a61a7e3f72657933700005be5216885bb1 May 29 16:58:52.934443 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:52.934410 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tz999" event={"ID":"47cbc84a-e410-451b-86f1-222dfcd8d0ad","Type":"ContainerStarted","Data":"84989501582d9b426064aaaf894366a61a7e3f72657933700005be5216885bb1"} May 29 16:58:53.939127 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:53.939093 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tz999" event={"ID":"47cbc84a-e410-451b-86f1-222dfcd8d0ad","Type":"ContainerStarted","Data":"504b7250652629b3cf38956da17b56b335dfc6fae7dde96e7e6c224554eb51ea"} May 29 16:58:53.939127 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:53.939130 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tz999" event={"ID":"47cbc84a-e410-451b-86f1-222dfcd8d0ad","Type":"ContainerStarted","Data":"f9f770f997580d934c12462f4a3f3ae8f48cf571b8f332f210b351f3dbc9c0c1"} May 29 16:58:53.955766 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:53.955727 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tz999" podStartSLOduration=131.02429453 podStartE2EDuration="2m11.955713442s" podCreationTimestamp="2026-05-29 16:56:42 +0000 UTC" firstStartedPulling="2026-05-29 16:58:52.574552236 +0000 UTC m=+130.605021222" lastFinishedPulling="2026-05-29 16:58:53.505971138 +0000 UTC m=+131.536440134" observedRunningTime="2026-05-29 16:58:53.955506112 +0000 UTC m=+131.985975133" watchObservedRunningTime="2026-05-29 16:58:53.955713442 +0000 UTC m=+131.986182450" May 29 16:58:58.957533 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:58.957500 2561 generic.go:358] "Generic (PLEG): container finished" podID="49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9" containerID="56e729da51e00587267bc275912f4c38d4aa832f841f7b72df3f51de6df39a7a" exitCode=0 May 29 16:58:58.957914 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:58.957543 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-jvk9t" event={"ID":"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9","Type":"ContainerDied","Data":"56e729da51e00587267bc275912f4c38d4aa832f841f7b72df3f51de6df39a7a"} May 29 16:58:58.957914 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:58.957888 2561 scope.go:117] "RemoveContainer" containerID="56e729da51e00587267bc275912f4c38d4aa832f841f7b72df3f51de6df39a7a" May 29 16:58:59.826942 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:59.826915 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78d54b76f9-bx987_9e8b3057-a3bb-4e0c-9066-52577b25fcd4/router/0.log" May 29 16:58:59.839108 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:59.839089 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wdlpr_a44d2b9b-42c3-4e55-bbaa-6453218224b7/serve-healthcheck-canary/0.log" May 29 16:58:59.962135 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:58:59.962103 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-jvk9t" event={"ID":"49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9","Type":"ContainerStarted","Data":"82368fca3f8021401d2f5b5bdd5a45b5db9aa85196a0636fabdfc4337d2a01c4"} May 29 16:59:06.825079 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:59:06.825037 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" podUID="5108e1f2-5160-478c-acaa-075ca785c5c6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 29 16:59:16.825227 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:59:16.825186 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" podUID="5108e1f2-5160-478c-acaa-075ca785c5c6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 29 16:59:26.824379 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:59:26.824290 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" podUID="5108e1f2-5160-478c-acaa-075ca785c5c6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 29 16:59:26.824379 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:59:26.824358 2561 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" May 29 16:59:26.824843 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:59:26.824825 2561 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"f3f585c697cc5644da08b8ee0b13570c2e92c0c23743e6f1a5c5b741f5520be3"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 29 16:59:26.824888 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:59:26.824862 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" podUID="5108e1f2-5160-478c-acaa-075ca785c5c6" containerName="service-proxy" containerID="cri-o://f3f585c697cc5644da08b8ee0b13570c2e92c0c23743e6f1a5c5b741f5520be3" gracePeriod=30 May 29 16:59:27.049609 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:59:27.049579 2561 generic.go:358] "Generic (PLEG): container finished" podID="5108e1f2-5160-478c-acaa-075ca785c5c6" containerID="f3f585c697cc5644da08b8ee0b13570c2e92c0c23743e6f1a5c5b741f5520be3" exitCode=2 May 29 16:59:27.049745 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:59:27.049620 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" event={"ID":"5108e1f2-5160-478c-acaa-075ca785c5c6","Type":"ContainerDied","Data":"f3f585c697cc5644da08b8ee0b13570c2e92c0c23743e6f1a5c5b741f5520be3"} May 29 16:59:27.049745 ip-10-0-137-133 kubenswrapper[2561]: I0529 16:59:27.049645 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b996b6c5d-vfst6" event={"ID":"5108e1f2-5160-478c-acaa-075ca785c5c6","Type":"ContainerStarted","Data":"2508d0c08668752251e9b79ec2e2da7e9a43dd30fd1e2eadc1663466a3f8f591"} May 29 17:01:42.344630 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:42.344601 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:01:42.346825 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:42.346798 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:01:42.352461 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:42.352440 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:01:42.354761 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:42.354743 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:01:42.356211 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:42.356190 2561 kubelet.go:1628] "Image garbage collection succeeded" May 29 17:01:45.794512 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.794474 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz"] May 29 17:01:45.796841 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.794810 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" containerName="registry" May 29 17:01:45.796841 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.794822 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" containerName="registry" May 29 17:01:45.796841 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.794878 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="b415f2d5-93da-4d4d-bfdd-7252d4ae89f9" containerName="registry" May 29 17:01:45.797712 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.797680 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.802576 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.802554 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 29 17:01:45.802716 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.802697 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 29 17:01:45.803068 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.803048 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 29 17:01:45.803169 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.803066 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-57nb9\"" May 29 17:01:45.803169 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.803145 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 29 17:01:45.814558 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.814533 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz"] May 29 17:01:45.844996 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.844975 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.845108 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.845009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqv9v\" (UniqueName: \"kubernetes.io/projected/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-kube-api-access-sqv9v\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.845108 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.845039 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-manifests\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.845108 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.845104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-webhook-cert\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.845229 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.845130 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-tmp\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.945416 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.945394 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-webhook-cert\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.945513 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.945424 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-tmp\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.945513 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.945460 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.945513 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.945496 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqv9v\" (UniqueName: \"kubernetes.io/projected/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-kube-api-access-sqv9v\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.945624 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.945528 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-manifests\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.945923 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.945905 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-manifests\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.947634 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.947610 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-tmp\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.947966 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.947946 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-webhook-cert\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.947966 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.947960 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:45.960585 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:45.960567 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqv9v\" (UniqueName: \"kubernetes.io/projected/6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6-kube-api-access-sqv9v\") pod \"opendatahub-operator-controller-manager-598f575fbf-g7tzz\" (UID: \"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6\") " pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:46.107769 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:46.107696 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:46.236846 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:46.236816 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz"] May 29 17:01:46.239566 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:01:46.239543 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea51e8d_4ecb_41dc_90ff_6b6a9846cca6.slice/crio-33e190d38e4156f2fa98a53b37fd3c06cc2c419f9ee3fba15aba36689f1adb65 WatchSource:0}: Error finding container 33e190d38e4156f2fa98a53b37fd3c06cc2c419f9ee3fba15aba36689f1adb65: Status 404 returned error can't find the container with id 33e190d38e4156f2fa98a53b37fd3c06cc2c419f9ee3fba15aba36689f1adb65 May 29 17:01:46.241187 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:46.241171 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 17:01:46.425729 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:46.425643 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" event={"ID":"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6","Type":"ContainerStarted","Data":"33e190d38e4156f2fa98a53b37fd3c06cc2c419f9ee3fba15aba36689f1adb65"} May 29 17:01:49.439439 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:49.439363 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" event={"ID":"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6","Type":"ContainerStarted","Data":"c4e4489e38b4eafd31239f19d289d4d7a265e505594c75bcc10f8cd5e4242032"} May 29 17:01:50.443422 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:50.443335 2561 generic.go:358] "Generic (PLEG): container finished" podID="6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6" containerID="c4e4489e38b4eafd31239f19d289d4d7a265e505594c75bcc10f8cd5e4242032" exitCode=0 May 29 17:01:50.443422 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:50.443370 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" event={"ID":"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6","Type":"ContainerDied","Data":"c4e4489e38b4eafd31239f19d289d4d7a265e505594c75bcc10f8cd5e4242032"} May 29 17:01:51.447975 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:51.447937 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" event={"ID":"6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6","Type":"ContainerStarted","Data":"0c6604319351e24e3f788cd6099105216034e5da6a6c7387029a3a4c98c1f53b"} May 29 17:01:51.448383 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:51.448044 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:01:51.475600 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:01:51.475543 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" podStartSLOduration=1.857712531 podStartE2EDuration="6.475529366s" podCreationTimestamp="2026-05-29 17:01:45 +0000 UTC" firstStartedPulling="2026-05-29 17:01:46.241288807 +0000 UTC m=+304.271757793" lastFinishedPulling="2026-05-29 17:01:50.859105637 +0000 UTC m=+308.889574628" observedRunningTime="2026-05-29 17:01:51.47281632 +0000 UTC m=+309.503285338" watchObservedRunningTime="2026-05-29 17:01:51.475529366 +0000 UTC m=+309.505998376" May 29 17:02:02.452939 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:02.452907 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-598f575fbf-g7tzz" May 29 17:02:07.907366 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:07.907325 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-9txnd"] May 29 17:02:07.917430 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:07.917403 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-9txnd" May 29 17:02:07.918123 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:07.918101 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-9txnd"] May 29 17:02:07.920831 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:07.920811 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" May 29 17:02:08.011387 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:08.011343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e539e4a0-0459-46e3-a460-71b764077d26-tls-certs\") pod \"model-serving-api-6577596cd5-9txnd\" (UID: \"e539e4a0-0459-46e3-a460-71b764077d26\") " pod="opendatahub/model-serving-api-6577596cd5-9txnd" May 29 17:02:08.011387 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:08.011399 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzjsm\" (UniqueName: \"kubernetes.io/projected/e539e4a0-0459-46e3-a460-71b764077d26-kube-api-access-wzjsm\") pod \"model-serving-api-6577596cd5-9txnd\" (UID: \"e539e4a0-0459-46e3-a460-71b764077d26\") " pod="opendatahub/model-serving-api-6577596cd5-9txnd" May 29 17:02:08.112640 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:08.112604 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e539e4a0-0459-46e3-a460-71b764077d26-tls-certs\") pod \"model-serving-api-6577596cd5-9txnd\" (UID: \"e539e4a0-0459-46e3-a460-71b764077d26\") " pod="opendatahub/model-serving-api-6577596cd5-9txnd" May 29 17:02:08.112640 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:08.112645 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wzjsm\" (UniqueName: \"kubernetes.io/projected/e539e4a0-0459-46e3-a460-71b764077d26-kube-api-access-wzjsm\") pod \"model-serving-api-6577596cd5-9txnd\" (UID: \"e539e4a0-0459-46e3-a460-71b764077d26\") " pod="opendatahub/model-serving-api-6577596cd5-9txnd" May 29 17:02:08.115009 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:08.114990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e539e4a0-0459-46e3-a460-71b764077d26-tls-certs\") pod \"model-serving-api-6577596cd5-9txnd\" (UID: \"e539e4a0-0459-46e3-a460-71b764077d26\") " pod="opendatahub/model-serving-api-6577596cd5-9txnd" May 29 17:02:08.121867 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:08.121840 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzjsm\" (UniqueName: \"kubernetes.io/projected/e539e4a0-0459-46e3-a460-71b764077d26-kube-api-access-wzjsm\") pod \"model-serving-api-6577596cd5-9txnd\" (UID: \"e539e4a0-0459-46e3-a460-71b764077d26\") " pod="opendatahub/model-serving-api-6577596cd5-9txnd" May 29 17:02:08.230586 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:08.230507 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-9txnd" May 29 17:02:08.357169 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:08.357144 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-9txnd"] May 29 17:02:08.359257 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:02:08.359224 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode539e4a0_0459_46e3_a460_71b764077d26.slice/crio-acb786548e5945a145a76aabfa58c2c60904a11e6f24c472b0ce7e9bb2f9ded1 WatchSource:0}: Error finding container acb786548e5945a145a76aabfa58c2c60904a11e6f24c472b0ce7e9bb2f9ded1: Status 404 returned error can't find the container with id acb786548e5945a145a76aabfa58c2c60904a11e6f24c472b0ce7e9bb2f9ded1 May 29 17:02:08.496224 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:08.496159 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-9txnd" event={"ID":"e539e4a0-0459-46e3-a460-71b764077d26","Type":"ContainerStarted","Data":"acb786548e5945a145a76aabfa58c2c60904a11e6f24c472b0ce7e9bb2f9ded1"} May 29 17:02:11.508165 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:11.508134 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-9txnd" event={"ID":"e539e4a0-0459-46e3-a460-71b764077d26","Type":"ContainerStarted","Data":"fae67fe337ec076a910d7ae1e12019571fc39f7143259d051cb0bf246baca825"} May 29 17:02:11.508541 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:11.508226 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-9txnd" May 29 17:02:11.524682 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:11.524640 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-9txnd" podStartSLOduration=1.925770434 podStartE2EDuration="4.524626667s" podCreationTimestamp="2026-05-29 17:02:07 +0000 UTC" firstStartedPulling="2026-05-29 17:02:08.360851105 +0000 UTC m=+326.391320091" lastFinishedPulling="2026-05-29 17:02:10.959707334 +0000 UTC m=+328.990176324" observedRunningTime="2026-05-29 17:02:11.523244704 +0000 UTC m=+329.553713713" watchObservedRunningTime="2026-05-29 17:02:11.524626667 +0000 UTC m=+329.555095657" May 29 17:02:15.003995 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.003962 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx"] May 29 17:02:15.007186 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.007167 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:15.010083 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.010065 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 29 17:02:15.010202 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.010065 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 29 17:02:15.010202 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.010107 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 29 17:02:15.011590 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.011574 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 29 17:02:15.011640 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.011596 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 29 17:02:15.011677 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.011656 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hlfb6\"" May 29 17:02:15.017302 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.017282 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx"] May 29 17:02:15.071141 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.071117 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c4ec572e-27e3-4f68-9e80-fc8ea1d2407e-manager-config\") pod \"lws-controller-manager-674dbbfb6b-2dxxx\" (UID: \"c4ec572e-27e3-4f68-9e80-fc8ea1d2407e\") " pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:15.071239 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.071152 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4ec572e-27e3-4f68-9e80-fc8ea1d2407e-cert\") pod \"lws-controller-manager-674dbbfb6b-2dxxx\" (UID: \"c4ec572e-27e3-4f68-9e80-fc8ea1d2407e\") " pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:15.071239 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.071171 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vqpr\" (UniqueName: \"kubernetes.io/projected/c4ec572e-27e3-4f68-9e80-fc8ea1d2407e-kube-api-access-8vqpr\") pod \"lws-controller-manager-674dbbfb6b-2dxxx\" (UID: \"c4ec572e-27e3-4f68-9e80-fc8ea1d2407e\") " pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:15.071239 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.071195 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4ec572e-27e3-4f68-9e80-fc8ea1d2407e-metrics-cert\") pod \"lws-controller-manager-674dbbfb6b-2dxxx\" (UID: \"c4ec572e-27e3-4f68-9e80-fc8ea1d2407e\") " pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:15.175373 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.175328 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c4ec572e-27e3-4f68-9e80-fc8ea1d2407e-manager-config\") pod \"lws-controller-manager-674dbbfb6b-2dxxx\" (UID: \"c4ec572e-27e3-4f68-9e80-fc8ea1d2407e\") " pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:15.175548 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.175392 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4ec572e-27e3-4f68-9e80-fc8ea1d2407e-cert\") pod \"lws-controller-manager-674dbbfb6b-2dxxx\" (UID: \"c4ec572e-27e3-4f68-9e80-fc8ea1d2407e\") " pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:15.175548 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.175425 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vqpr\" (UniqueName: \"kubernetes.io/projected/c4ec572e-27e3-4f68-9e80-fc8ea1d2407e-kube-api-access-8vqpr\") pod \"lws-controller-manager-674dbbfb6b-2dxxx\" (UID: \"c4ec572e-27e3-4f68-9e80-fc8ea1d2407e\") " pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:15.175548 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.175462 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4ec572e-27e3-4f68-9e80-fc8ea1d2407e-metrics-cert\") pod \"lws-controller-manager-674dbbfb6b-2dxxx\" (UID: \"c4ec572e-27e3-4f68-9e80-fc8ea1d2407e\") " pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:15.176115 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.176089 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c4ec572e-27e3-4f68-9e80-fc8ea1d2407e-manager-config\") pod \"lws-controller-manager-674dbbfb6b-2dxxx\" (UID: \"c4ec572e-27e3-4f68-9e80-fc8ea1d2407e\") " pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:15.178021 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.177992 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4ec572e-27e3-4f68-9e80-fc8ea1d2407e-metrics-cert\") pod \"lws-controller-manager-674dbbfb6b-2dxxx\" (UID: \"c4ec572e-27e3-4f68-9e80-fc8ea1d2407e\") " pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:15.178126 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.178061 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4ec572e-27e3-4f68-9e80-fc8ea1d2407e-cert\") pod \"lws-controller-manager-674dbbfb6b-2dxxx\" (UID: \"c4ec572e-27e3-4f68-9e80-fc8ea1d2407e\") " pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:15.188929 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.188907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vqpr\" (UniqueName: \"kubernetes.io/projected/c4ec572e-27e3-4f68-9e80-fc8ea1d2407e-kube-api-access-8vqpr\") pod \"lws-controller-manager-674dbbfb6b-2dxxx\" (UID: \"c4ec572e-27e3-4f68-9e80-fc8ea1d2407e\") " pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:15.317284 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.317257 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:15.437882 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.437859 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx"] May 29 17:02:15.440285 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:02:15.440259 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ec572e_27e3_4f68_9e80_fc8ea1d2407e.slice/crio-4f3058fc7c4160a346dc310926f84f901206be32816f480b534d10f580d3a939 WatchSource:0}: Error finding container 4f3058fc7c4160a346dc310926f84f901206be32816f480b534d10f580d3a939: Status 404 returned error can't find the container with id 4f3058fc7c4160a346dc310926f84f901206be32816f480b534d10f580d3a939 May 29 17:02:15.521185 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:15.521149 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" event={"ID":"c4ec572e-27e3-4f68-9e80-fc8ea1d2407e","Type":"ContainerStarted","Data":"4f3058fc7c4160a346dc310926f84f901206be32816f480b534d10f580d3a939"} May 29 17:02:18.537545 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:18.537501 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" event={"ID":"c4ec572e-27e3-4f68-9e80-fc8ea1d2407e","Type":"ContainerStarted","Data":"871dcc16242becf5460c06566a7d0fc82f6b99cd981c8ed934d888cc334747e0"} May 29 17:02:18.538017 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:18.537663 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:18.557592 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:18.557544 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" podStartSLOduration=1.862860293 podStartE2EDuration="4.557533081s" podCreationTimestamp="2026-05-29 17:02:14 +0000 UTC" firstStartedPulling="2026-05-29 17:02:15.4421369 +0000 UTC m=+333.472605886" lastFinishedPulling="2026-05-29 17:02:18.13680968 +0000 UTC m=+336.167278674" observedRunningTime="2026-05-29 17:02:18.557146868 +0000 UTC m=+336.587615886" watchObservedRunningTime="2026-05-29 17:02:18.557533081 +0000 UTC m=+336.588002089" May 29 17:02:22.515480 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:22.515455 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-9txnd" May 29 17:02:23.551059 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:23.551021 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-76cb944577-jg5lw"] May 29 17:02:23.554626 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:23.554606 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-76cb944577-jg5lw" May 29 17:02:23.558089 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:23.558066 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" May 29 17:02:23.558205 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:23.558173 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nmb7p\"" May 29 17:02:23.566630 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:23.566608 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-76cb944577-jg5lw"] May 29 17:02:23.646815 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:23.646785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd-redirect-config\") pod \"dashboard-redirect-76cb944577-jg5lw\" (UID: \"fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd\") " pod="opendatahub/dashboard-redirect-76cb944577-jg5lw" May 29 17:02:23.646969 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:23.646837 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k822h\" (UniqueName: \"kubernetes.io/projected/fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd-kube-api-access-k822h\") pod \"dashboard-redirect-76cb944577-jg5lw\" (UID: \"fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd\") " pod="opendatahub/dashboard-redirect-76cb944577-jg5lw" May 29 17:02:23.747849 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:23.747815 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd-redirect-config\") pod \"dashboard-redirect-76cb944577-jg5lw\" (UID: \"fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd\") " pod="opendatahub/dashboard-redirect-76cb944577-jg5lw" May 29 17:02:23.748004 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:23.747868 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k822h\" (UniqueName: \"kubernetes.io/projected/fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd-kube-api-access-k822h\") pod \"dashboard-redirect-76cb944577-jg5lw\" (UID: \"fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd\") " pod="opendatahub/dashboard-redirect-76cb944577-jg5lw" May 29 17:02:23.748568 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:23.748550 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd-redirect-config\") pod \"dashboard-redirect-76cb944577-jg5lw\" (UID: \"fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd\") " pod="opendatahub/dashboard-redirect-76cb944577-jg5lw" May 29 17:02:23.758383 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:23.758357 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k822h\" (UniqueName: \"kubernetes.io/projected/fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd-kube-api-access-k822h\") pod \"dashboard-redirect-76cb944577-jg5lw\" (UID: \"fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd\") " pod="opendatahub/dashboard-redirect-76cb944577-jg5lw" May 29 17:02:23.864631 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:23.864553 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-76cb944577-jg5lw" May 29 17:02:23.990626 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:23.990605 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-76cb944577-jg5lw"] May 29 17:02:23.992738 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:02:23.992676 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd46ead8_7a69_4d1d_9fdb_c1db82b19fbd.slice/crio-8fee22ad1d6fd2b70e1608ebb4509e63a0437e6c010687abdfe8b8dbec44b1f2 WatchSource:0}: Error finding container 8fee22ad1d6fd2b70e1608ebb4509e63a0437e6c010687abdfe8b8dbec44b1f2: Status 404 returned error can't find the container with id 8fee22ad1d6fd2b70e1608ebb4509e63a0437e6c010687abdfe8b8dbec44b1f2 May 29 17:02:24.556735 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:24.556645 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-76cb944577-jg5lw" event={"ID":"fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd","Type":"ContainerStarted","Data":"8fee22ad1d6fd2b70e1608ebb4509e63a0437e6c010687abdfe8b8dbec44b1f2"} May 29 17:02:26.563997 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:26.563960 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-76cb944577-jg5lw" event={"ID":"fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd","Type":"ContainerStarted","Data":"cd5a90f77aec4803b424974ea7e5d8dc8bb1f4630de4f9f61ef69ee4ce46c70e"} May 29 17:02:26.601614 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:26.601564 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-76cb944577-jg5lw" podStartSLOduration=1.23589499 podStartE2EDuration="3.601549533s" podCreationTimestamp="2026-05-29 17:02:23 +0000 UTC" firstStartedPulling="2026-05-29 17:02:23.993951066 +0000 UTC m=+342.024420056" lastFinishedPulling="2026-05-29 17:02:26.35960561 +0000 UTC m=+344.390074599" observedRunningTime="2026-05-29 17:02:26.599619176 +0000 UTC m=+344.630088183" watchObservedRunningTime="2026-05-29 17:02:26.601549533 +0000 UTC m=+344.632018604" May 29 17:02:29.543406 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:29.543377 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-674dbbfb6b-2dxxx" May 29 17:02:37.484699 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.484656 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl"] May 29 17:02:37.489238 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.489221 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.492509 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.492484 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 29 17:02:37.492638 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.492549 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fhk4x\"" May 29 17:02:37.499965 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.499943 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl"] May 29 17:02:37.556825 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.556794 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.556965 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.556829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.556965 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.556869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8kcn\" (UniqueName: \"kubernetes.io/projected/1dbca7ac-967e-4264-adca-b115fae3942c-kube-api-access-s8kcn\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.556965 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.556900 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dbca7ac-967e-4264-adca-b115fae3942c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.556965 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.556934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dbca7ac-967e-4264-adca-b115fae3942c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.556965 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.556956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.557163 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.556980 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.557163 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.557045 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.557163 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.557074 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dbca7ac-967e-4264-adca-b115fae3942c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.657370 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.657340 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dbca7ac-967e-4264-adca-b115fae3942c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.657370 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.657375 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.657585 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.657396 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.657585 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.657420 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.657585 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.657547 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dbca7ac-967e-4264-adca-b115fae3942c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.657772 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.657607 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.657772 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.657645 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.657772 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.657721 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8kcn\" (UniqueName: \"kubernetes.io/projected/1dbca7ac-967e-4264-adca-b115fae3942c-kube-api-access-s8kcn\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.657772 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.657767 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dbca7ac-967e-4264-adca-b115fae3942c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.657964 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.657777 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.657964 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.657866 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.658073 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.657968 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.658129 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.658065 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.658372 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.658349 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dbca7ac-967e-4264-adca-b115fae3942c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.659792 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.659772 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dbca7ac-967e-4264-adca-b115fae3942c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.660019 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.660003 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dbca7ac-967e-4264-adca-b115fae3942c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.665518 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.665494 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dbca7ac-967e-4264-adca-b115fae3942c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.665605 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.665569 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8kcn\" (UniqueName: \"kubernetes.io/projected/1dbca7ac-967e-4264-adca-b115fae3942c-kube-api-access-s8kcn\") pod \"data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl\" (UID: \"1dbca7ac-967e-4264-adca-b115fae3942c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.800112 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.800081 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:37.925764 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:37.925666 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl"] May 29 17:02:37.928027 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:02:37.928002 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbca7ac_967e_4264_adca_b115fae3942c.slice/crio-d85e513b499dae0a1ec31ec223d7b785829512c62d0c203ab62be973221db03d WatchSource:0}: Error finding container d85e513b499dae0a1ec31ec223d7b785829512c62d0c203ab62be973221db03d: Status 404 returned error can't find the container with id d85e513b499dae0a1ec31ec223d7b785829512c62d0c203ab62be973221db03d May 29 17:02:38.604100 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:38.604072 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" event={"ID":"1dbca7ac-967e-4264-adca-b115fae3942c","Type":"ContainerStarted","Data":"d85e513b499dae0a1ec31ec223d7b785829512c62d0c203ab62be973221db03d"} May 29 17:02:40.556461 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:40.556417 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 29 17:02:40.556751 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:40.556490 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 29 17:02:40.556751 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:40.556516 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 29 17:02:41.616830 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:41.616795 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" event={"ID":"1dbca7ac-967e-4264-adca-b115fae3942c","Type":"ContainerStarted","Data":"d4af478c89220fd097a25f86037bf39f67c43ff0a71afe95351a4dbb7dda5783"} May 29 17:02:41.661387 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:41.661342 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" podStartSLOduration=2.035070259 podStartE2EDuration="4.661328172s" podCreationTimestamp="2026-05-29 17:02:37 +0000 UTC" firstStartedPulling="2026-05-29 17:02:37.929915878 +0000 UTC m=+355.960384864" lastFinishedPulling="2026-05-29 17:02:40.556173778 +0000 UTC m=+358.586642777" observedRunningTime="2026-05-29 17:02:41.658295288 +0000 UTC m=+359.688764316" watchObservedRunningTime="2026-05-29 17:02:41.661328172 +0000 UTC m=+359.691797179" May 29 17:02:41.801036 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:41.801005 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:41.805431 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:41.805410 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:42.620425 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:42.620386 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:02:42.621395 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:02:42.621377 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl" May 29 17:03:48.302118 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:48.302088 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-8mvbd"] May 29 17:03:48.305415 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:48.305398 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8mvbd" May 29 17:03:48.309655 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:48.309636 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 29 17:03:48.309787 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:48.309731 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mkl9b\"" May 29 17:03:48.311045 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:48.311016 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 29 17:03:48.311045 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:48.311031 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 29 17:03:48.328355 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:48.328328 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-8mvbd"] May 29 17:03:48.416064 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:48.416037 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdpd5\" (UniqueName: \"kubernetes.io/projected/ad468d7f-4465-458f-b96e-cd89e09db92e-kube-api-access-sdpd5\") pod \"dns-operator-controller-manager-648d5c98bc-8mvbd\" (UID: \"ad468d7f-4465-458f-b96e-cd89e09db92e\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8mvbd" May 29 17:03:48.516660 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:48.516634 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdpd5\" (UniqueName: \"kubernetes.io/projected/ad468d7f-4465-458f-b96e-cd89e09db92e-kube-api-access-sdpd5\") pod \"dns-operator-controller-manager-648d5c98bc-8mvbd\" (UID: \"ad468d7f-4465-458f-b96e-cd89e09db92e\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8mvbd" May 29 17:03:48.525078 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:48.525051 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdpd5\" (UniqueName: \"kubernetes.io/projected/ad468d7f-4465-458f-b96e-cd89e09db92e-kube-api-access-sdpd5\") pod \"dns-operator-controller-manager-648d5c98bc-8mvbd\" (UID: \"ad468d7f-4465-458f-b96e-cd89e09db92e\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8mvbd" May 29 17:03:48.615265 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:48.615174 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8mvbd" May 29 17:03:48.739856 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:48.739800 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-8mvbd"] May 29 17:03:48.742079 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:03:48.742049 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad468d7f_4465_458f_b96e_cd89e09db92e.slice/crio-c8d77cf1983765597f35d3581d64a06a956c4cead69d5d267e53718bcf6f4e6f WatchSource:0}: Error finding container c8d77cf1983765597f35d3581d64a06a956c4cead69d5d267e53718bcf6f4e6f: Status 404 returned error can't find the container with id c8d77cf1983765597f35d3581d64a06a956c4cead69d5d267e53718bcf6f4e6f May 29 17:03:48.823082 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:48.823057 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8mvbd" event={"ID":"ad468d7f-4465-458f-b96e-cd89e09db92e","Type":"ContainerStarted","Data":"c8d77cf1983765597f35d3581d64a06a956c4cead69d5d267e53718bcf6f4e6f"} May 29 17:03:51.836013 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:51.835975 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8mvbd" event={"ID":"ad468d7f-4465-458f-b96e-cd89e09db92e","Type":"ContainerStarted","Data":"44fab2405dc0a03bc93bacf80d9b706737cbe0b4dab83628839a9d419eea1cbc"} May 29 17:03:51.836460 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:51.836107 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8mvbd" May 29 17:03:51.858815 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:51.858771 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8mvbd" podStartSLOduration=1.498418461 podStartE2EDuration="3.858759084s" podCreationTimestamp="2026-05-29 17:03:48 +0000 UTC" firstStartedPulling="2026-05-29 17:03:48.743839938 +0000 UTC m=+426.774308929" lastFinishedPulling="2026-05-29 17:03:51.104180566 +0000 UTC m=+429.134649552" observedRunningTime="2026-05-29 17:03:51.857458637 +0000 UTC m=+429.887927676" watchObservedRunningTime="2026-05-29 17:03:51.858759084 +0000 UTC m=+429.889228162" May 29 17:03:52.691531 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:52.691498 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w"] May 29 17:03:52.694713 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:52.694677 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" May 29 17:03:52.698318 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:52.698299 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-djg7n\"" May 29 17:03:52.707984 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:52.707961 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w"] May 29 17:03:52.753873 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:52.753848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98d4cb69-8ed7-4c37-ab28-d64fa9b7c236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vlp9w\" (UID: \"98d4cb69-8ed7-4c37-ab28-d64fa9b7c236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" May 29 17:03:52.753983 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:52.753884 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztvlz\" (UniqueName: \"kubernetes.io/projected/98d4cb69-8ed7-4c37-ab28-d64fa9b7c236-kube-api-access-ztvlz\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vlp9w\" (UID: \"98d4cb69-8ed7-4c37-ab28-d64fa9b7c236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" May 29 17:03:52.855056 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:52.855014 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98d4cb69-8ed7-4c37-ab28-d64fa9b7c236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vlp9w\" (UID: \"98d4cb69-8ed7-4c37-ab28-d64fa9b7c236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" May 29 17:03:52.855056 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:52.855061 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ztvlz\" (UniqueName: \"kubernetes.io/projected/98d4cb69-8ed7-4c37-ab28-d64fa9b7c236-kube-api-access-ztvlz\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vlp9w\" (UID: \"98d4cb69-8ed7-4c37-ab28-d64fa9b7c236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" May 29 17:03:52.855540 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:52.855437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98d4cb69-8ed7-4c37-ab28-d64fa9b7c236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vlp9w\" (UID: \"98d4cb69-8ed7-4c37-ab28-d64fa9b7c236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" May 29 17:03:52.871077 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:52.871050 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztvlz\" (UniqueName: \"kubernetes.io/projected/98d4cb69-8ed7-4c37-ab28-d64fa9b7c236-kube-api-access-ztvlz\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vlp9w\" (UID: \"98d4cb69-8ed7-4c37-ab28-d64fa9b7c236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" May 29 17:03:53.004830 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:53.004768 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" May 29 17:03:53.135730 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:53.135703 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w"] May 29 17:03:53.137873 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:03:53.137844 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d4cb69_8ed7_4c37_ab28_d64fa9b7c236.slice/crio-74031f0ef79a4039295f1688746b4ebb753fbfd9a3ceadade0fbdfdabe752c81 WatchSource:0}: Error finding container 74031f0ef79a4039295f1688746b4ebb753fbfd9a3ceadade0fbdfdabe752c81: Status 404 returned error can't find the container with id 74031f0ef79a4039295f1688746b4ebb753fbfd9a3ceadade0fbdfdabe752c81 May 29 17:03:53.844033 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:53.843992 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" event={"ID":"98d4cb69-8ed7-4c37-ab28-d64fa9b7c236","Type":"ContainerStarted","Data":"74031f0ef79a4039295f1688746b4ebb753fbfd9a3ceadade0fbdfdabe752c81"} May 29 17:03:58.861827 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:58.861791 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" event={"ID":"98d4cb69-8ed7-4c37-ab28-d64fa9b7c236","Type":"ContainerStarted","Data":"691e1c87c209f59bd5942a161a68726d525befbef0f6e68ed9c0c8fe8ee27114"} May 29 17:03:58.862248 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:58.861908 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" May 29 17:03:58.883831 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:03:58.883781 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" podStartSLOduration=1.617369064 podStartE2EDuration="6.883770865s" podCreationTimestamp="2026-05-29 17:03:52 +0000 UTC" firstStartedPulling="2026-05-29 17:03:53.14088886 +0000 UTC m=+431.171357850" lastFinishedPulling="2026-05-29 17:03:58.407290662 +0000 UTC m=+436.437759651" observedRunningTime="2026-05-29 17:03:58.88243995 +0000 UTC m=+436.912908958" watchObservedRunningTime="2026-05-29 17:03:58.883770865 +0000 UTC m=+436.914239873" May 29 17:04:02.841478 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:02.841453 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8mvbd" May 29 17:04:09.867286 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:09.867258 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" May 29 17:04:11.568260 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.568224 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w"] May 29 17:04:11.568635 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.568450 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" podUID="98d4cb69-8ed7-4c37-ab28-d64fa9b7c236" containerName="manager" containerID="cri-o://691e1c87c209f59bd5942a161a68726d525befbef0f6e68ed9c0c8fe8ee27114" gracePeriod=2 May 29 17:04:11.573783 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.573757 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w"] May 29 17:04:11.597802 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.597776 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw"] May 29 17:04:11.598178 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.598162 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d4cb69-8ed7-4c37-ab28-d64fa9b7c236" containerName="manager" May 29 17:04:11.598178 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.598179 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d4cb69-8ed7-4c37-ab28-d64fa9b7c236" containerName="manager" May 29 17:04:11.598278 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.598243 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="98d4cb69-8ed7-4c37-ab28-d64fa9b7c236" containerName="manager" May 29 17:04:11.601087 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.601070 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" May 29 17:04:11.603736 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.603702 2561 status_manager.go:895] "Failed to get status for pod" podUID="98d4cb69-8ed7-4c37-ab28-d64fa9b7c236" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vlp9w\" is forbidden: User \"system:node:ip-10-0-137-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-133.ec2.internal' and this object" May 29 17:04:11.615329 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.614675 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w"] May 29 17:04:11.618112 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.618094 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw"] May 29 17:04:11.618221 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.618210 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" May 29 17:04:11.637734 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.637712 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w"] May 29 17:04:11.656577 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.656552 2561 status_manager.go:895] "Failed to get status for pod" podUID="98d4cb69-8ed7-4c37-ab28-d64fa9b7c236" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vlp9w\" is forbidden: User \"system:node:ip-10-0-137-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-133.ec2.internal' and this object" May 29 17:04:11.706517 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.706484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-795x8\" (UniqueName: \"kubernetes.io/projected/d6e91517-6efa-4a2a-8036-0abd380ca9e0-kube-api-access-795x8\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w\" (UID: \"d6e91517-6efa-4a2a-8036-0abd380ca9e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" May 29 17:04:11.706660 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.706525 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdfvv\" (UniqueName: \"kubernetes.io/projected/b37bef02-2450-46a6-a573-1b85b8dc70f0-kube-api-access-fdfvv\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cqcvw\" (UID: \"b37bef02-2450-46a6-a573-1b85b8dc70f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" May 29 17:04:11.706660 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.706547 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6e91517-6efa-4a2a-8036-0abd380ca9e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w\" (UID: \"d6e91517-6efa-4a2a-8036-0abd380ca9e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" May 29 17:04:11.706660 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.706611 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b37bef02-2450-46a6-a573-1b85b8dc70f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cqcvw\" (UID: \"b37bef02-2450-46a6-a573-1b85b8dc70f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" May 29 17:04:11.800284 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.800264 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" May 29 17:04:11.802846 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.802820 2561 status_manager.go:895] "Failed to get status for pod" podUID="98d4cb69-8ed7-4c37-ab28-d64fa9b7c236" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vlp9w\" is forbidden: User \"system:node:ip-10-0-137-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-133.ec2.internal' and this object" May 29 17:04:11.807183 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.807162 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-795x8\" (UniqueName: \"kubernetes.io/projected/d6e91517-6efa-4a2a-8036-0abd380ca9e0-kube-api-access-795x8\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w\" (UID: \"d6e91517-6efa-4a2a-8036-0abd380ca9e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" May 29 17:04:11.807239 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.807196 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdfvv\" (UniqueName: \"kubernetes.io/projected/b37bef02-2450-46a6-a573-1b85b8dc70f0-kube-api-access-fdfvv\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cqcvw\" (UID: \"b37bef02-2450-46a6-a573-1b85b8dc70f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" May 29 17:04:11.807239 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.807227 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6e91517-6efa-4a2a-8036-0abd380ca9e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w\" (UID: \"d6e91517-6efa-4a2a-8036-0abd380ca9e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" May 29 17:04:11.807308 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.807258 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b37bef02-2450-46a6-a573-1b85b8dc70f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cqcvw\" (UID: \"b37bef02-2450-46a6-a573-1b85b8dc70f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" May 29 17:04:11.807543 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.807511 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6e91517-6efa-4a2a-8036-0abd380ca9e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w\" (UID: \"d6e91517-6efa-4a2a-8036-0abd380ca9e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" May 29 17:04:11.807608 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.807593 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b37bef02-2450-46a6-a573-1b85b8dc70f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cqcvw\" (UID: \"b37bef02-2450-46a6-a573-1b85b8dc70f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" May 29 17:04:11.816506 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.816482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdfvv\" (UniqueName: \"kubernetes.io/projected/b37bef02-2450-46a6-a573-1b85b8dc70f0-kube-api-access-fdfvv\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cqcvw\" (UID: \"b37bef02-2450-46a6-a573-1b85b8dc70f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" May 29 17:04:11.816592 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.816545 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-795x8\" (UniqueName: \"kubernetes.io/projected/d6e91517-6efa-4a2a-8036-0abd380ca9e0-kube-api-access-795x8\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w\" (UID: \"d6e91517-6efa-4a2a-8036-0abd380ca9e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" May 29 17:04:11.903068 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.902994 2561 generic.go:358] "Generic (PLEG): container finished" podID="98d4cb69-8ed7-4c37-ab28-d64fa9b7c236" containerID="691e1c87c209f59bd5942a161a68726d525befbef0f6e68ed9c0c8fe8ee27114" exitCode=0 May 29 17:04:11.903068 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.903036 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" May 29 17:04:11.903208 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.903094 2561 scope.go:117] "RemoveContainer" containerID="691e1c87c209f59bd5942a161a68726d525befbef0f6e68ed9c0c8fe8ee27114" May 29 17:04:11.905789 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.905762 2561 status_manager.go:895] "Failed to get status for pod" podUID="98d4cb69-8ed7-4c37-ab28-d64fa9b7c236" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vlp9w\" is forbidden: User \"system:node:ip-10-0-137-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-133.ec2.internal' and this object" May 29 17:04:11.908029 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.908010 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98d4cb69-8ed7-4c37-ab28-d64fa9b7c236-extensions-socket-volume\") pod \"98d4cb69-8ed7-4c37-ab28-d64fa9b7c236\" (UID: \"98d4cb69-8ed7-4c37-ab28-d64fa9b7c236\") " May 29 17:04:11.908122 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.908051 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztvlz\" (UniqueName: \"kubernetes.io/projected/98d4cb69-8ed7-4c37-ab28-d64fa9b7c236-kube-api-access-ztvlz\") pod \"98d4cb69-8ed7-4c37-ab28-d64fa9b7c236\" (UID: \"98d4cb69-8ed7-4c37-ab28-d64fa9b7c236\") " May 29 17:04:11.908467 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.908445 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98d4cb69-8ed7-4c37-ab28-d64fa9b7c236-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "98d4cb69-8ed7-4c37-ab28-d64fa9b7c236" (UID: "98d4cb69-8ed7-4c37-ab28-d64fa9b7c236"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 17:04:11.910110 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.910091 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d4cb69-8ed7-4c37-ab28-d64fa9b7c236-kube-api-access-ztvlz" (OuterVolumeSpecName: "kube-api-access-ztvlz") pod "98d4cb69-8ed7-4c37-ab28-d64fa9b7c236" (UID: "98d4cb69-8ed7-4c37-ab28-d64fa9b7c236"). InnerVolumeSpecName "kube-api-access-ztvlz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 17:04:11.910931 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.910907 2561 scope.go:117] "RemoveContainer" containerID="691e1c87c209f59bd5942a161a68726d525befbef0f6e68ed9c0c8fe8ee27114" May 29 17:04:11.911142 ip-10-0-137-133 kubenswrapper[2561]: E0529 17:04:11.911123 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"691e1c87c209f59bd5942a161a68726d525befbef0f6e68ed9c0c8fe8ee27114\": container with ID starting with 691e1c87c209f59bd5942a161a68726d525befbef0f6e68ed9c0c8fe8ee27114 not found: ID does not exist" containerID="691e1c87c209f59bd5942a161a68726d525befbef0f6e68ed9c0c8fe8ee27114" May 29 17:04:11.911185 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.911148 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"691e1c87c209f59bd5942a161a68726d525befbef0f6e68ed9c0c8fe8ee27114"} err="failed to get container status \"691e1c87c209f59bd5942a161a68726d525befbef0f6e68ed9c0c8fe8ee27114\": rpc error: code = NotFound desc = could not find container \"691e1c87c209f59bd5942a161a68726d525befbef0f6e68ed9c0c8fe8ee27114\": container with ID starting with 691e1c87c209f59bd5942a161a68726d525befbef0f6e68ed9c0c8fe8ee27114 not found: ID does not exist" May 29 17:04:11.948460 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.948440 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" May 29 17:04:11.955077 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:11.955054 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" May 29 17:04:12.009147 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.009083 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98d4cb69-8ed7-4c37-ab28-d64fa9b7c236-extensions-socket-volume\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 17:04:12.009147 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.009117 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztvlz\" (UniqueName: \"kubernetes.io/projected/98d4cb69-8ed7-4c37-ab28-d64fa9b7c236-kube-api-access-ztvlz\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 17:04:12.081661 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.081633 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw"] May 29 17:04:12.083931 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:04:12.083897 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb37bef02_2450_46a6_a573_1b85b8dc70f0.slice/crio-2548144b03a0235b0ef9501f3ec5ada247823733d8d44f30a1d9a8d5f822b4d4 WatchSource:0}: Error finding container 2548144b03a0235b0ef9501f3ec5ada247823733d8d44f30a1d9a8d5f822b4d4: Status 404 returned error can't find the container with id 2548144b03a0235b0ef9501f3ec5ada247823733d8d44f30a1d9a8d5f822b4d4 May 29 17:04:12.117406 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.117386 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w"] May 29 17:04:12.121809 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:04:12.121782 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e91517_6efa_4a2a_8036_0abd380ca9e0.slice/crio-779fd4d9c0f645dee5ab3c831ce8a4d7a6ed4eb9df461a77d4889e50cf7dc960 WatchSource:0}: Error finding container 779fd4d9c0f645dee5ab3c831ce8a4d7a6ed4eb9df461a77d4889e50cf7dc960: Status 404 returned error can't find the container with id 779fd4d9c0f645dee5ab3c831ce8a4d7a6ed4eb9df461a77d4889e50cf7dc960 May 29 17:04:12.215294 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.215262 2561 status_manager.go:895] "Failed to get status for pod" podUID="98d4cb69-8ed7-4c37-ab28-d64fa9b7c236" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vlp9w\" is forbidden: User \"system:node:ip-10-0-137-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-133.ec2.internal' and this object" May 29 17:04:12.426179 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.426108 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98d4cb69-8ed7-4c37-ab28-d64fa9b7c236" path="/var/lib/kubelet/pods/98d4cb69-8ed7-4c37-ab28-d64fa9b7c236/volumes" May 29 17:04:12.464484 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.464447 2561 status_manager.go:895] "Failed to get status for pod" podUID="98d4cb69-8ed7-4c37-ab28-d64fa9b7c236" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vlp9w" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vlp9w\" is forbidden: User \"system:node:ip-10-0-137-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-133.ec2.internal' and this object" May 29 17:04:12.909460 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.909427 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" event={"ID":"d6e91517-6efa-4a2a-8036-0abd380ca9e0","Type":"ContainerStarted","Data":"da45e68bda55d5dab488341adc7ded7884978bd5182d466b1919359c4f16910c"} May 29 17:04:12.909460 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.909467 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" event={"ID":"d6e91517-6efa-4a2a-8036-0abd380ca9e0","Type":"ContainerStarted","Data":"779fd4d9c0f645dee5ab3c831ce8a4d7a6ed4eb9df461a77d4889e50cf7dc960"} May 29 17:04:12.910024 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.909537 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" May 29 17:04:12.911152 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.911122 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" event={"ID":"b37bef02-2450-46a6-a573-1b85b8dc70f0","Type":"ContainerStarted","Data":"69fd81d94c9daf2f6e09f533a3ca72185fc4b7e267bbd7425bf9d8fb451b35bd"} May 29 17:04:12.911152 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.911151 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" event={"ID":"b37bef02-2450-46a6-a573-1b85b8dc70f0","Type":"ContainerStarted","Data":"2548144b03a0235b0ef9501f3ec5ada247823733d8d44f30a1d9a8d5f822b4d4"} May 29 17:04:12.911341 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.911244 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" May 29 17:04:12.932151 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.932113 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" podStartSLOduration=1.9320998729999999 podStartE2EDuration="1.932099873s" podCreationTimestamp="2026-05-29 17:04:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:04:12.930577634 +0000 UTC m=+450.961046668" watchObservedRunningTime="2026-05-29 17:04:12.932099873 +0000 UTC m=+450.962568880" May 29 17:04:12.953573 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:12.953523 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" podStartSLOduration=1.953509191 podStartE2EDuration="1.953509191s" podCreationTimestamp="2026-05-29 17:04:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:04:12.951558757 +0000 UTC m=+450.982027778" watchObservedRunningTime="2026-05-29 17:04:12.953509191 +0000 UTC m=+450.983978201" May 29 17:04:23.917363 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:23.917331 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" May 29 17:04:23.917863 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:23.917383 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" May 29 17:04:23.993081 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:23.993050 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw"] May 29 17:04:23.993290 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:23.993252 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" podUID="b37bef02-2450-46a6-a573-1b85b8dc70f0" containerName="manager" containerID="cri-o://69fd81d94c9daf2f6e09f533a3ca72185fc4b7e267bbd7425bf9d8fb451b35bd" gracePeriod=10 May 29 17:04:24.240407 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.240389 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" May 29 17:04:24.337013 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.336985 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm"] May 29 17:04:24.337361 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.337345 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b37bef02-2450-46a6-a573-1b85b8dc70f0" containerName="manager" May 29 17:04:24.337442 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.337363 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b37bef02-2450-46a6-a573-1b85b8dc70f0" containerName="manager" May 29 17:04:24.337442 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.337432 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="b37bef02-2450-46a6-a573-1b85b8dc70f0" containerName="manager" May 29 17:04:24.340709 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.340676 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" May 29 17:04:24.352493 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.352470 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm"] May 29 17:04:24.415546 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.415524 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdfvv\" (UniqueName: \"kubernetes.io/projected/b37bef02-2450-46a6-a573-1b85b8dc70f0-kube-api-access-fdfvv\") pod \"b37bef02-2450-46a6-a573-1b85b8dc70f0\" (UID: \"b37bef02-2450-46a6-a573-1b85b8dc70f0\") " May 29 17:04:24.415722 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.415595 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b37bef02-2450-46a6-a573-1b85b8dc70f0-extensions-socket-volume\") pod \"b37bef02-2450-46a6-a573-1b85b8dc70f0\" (UID: \"b37bef02-2450-46a6-a573-1b85b8dc70f0\") " May 29 17:04:24.415934 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.415916 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b37bef02-2450-46a6-a573-1b85b8dc70f0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b37bef02-2450-46a6-a573-1b85b8dc70f0" (UID: "b37bef02-2450-46a6-a573-1b85b8dc70f0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 17:04:24.417614 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.417585 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b37bef02-2450-46a6-a573-1b85b8dc70f0-kube-api-access-fdfvv" (OuterVolumeSpecName: "kube-api-access-fdfvv") pod "b37bef02-2450-46a6-a573-1b85b8dc70f0" (UID: "b37bef02-2450-46a6-a573-1b85b8dc70f0"). InnerVolumeSpecName "kube-api-access-fdfvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 17:04:24.516847 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.516779 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h289v\" (UniqueName: \"kubernetes.io/projected/37740036-f5bb-413e-92ba-84c3d0b6e992-kube-api-access-h289v\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c5hcm\" (UID: \"37740036-f5bb-413e-92ba-84c3d0b6e992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" May 29 17:04:24.516847 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.516832 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37740036-f5bb-413e-92ba-84c3d0b6e992-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c5hcm\" (UID: \"37740036-f5bb-413e-92ba-84c3d0b6e992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" May 29 17:04:24.516998 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.516904 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b37bef02-2450-46a6-a573-1b85b8dc70f0-extensions-socket-volume\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 17:04:24.516998 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.516920 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdfvv\" (UniqueName: \"kubernetes.io/projected/b37bef02-2450-46a6-a573-1b85b8dc70f0-kube-api-access-fdfvv\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 17:04:24.617629 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.617596 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h289v\" (UniqueName: \"kubernetes.io/projected/37740036-f5bb-413e-92ba-84c3d0b6e992-kube-api-access-h289v\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c5hcm\" (UID: \"37740036-f5bb-413e-92ba-84c3d0b6e992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" May 29 17:04:24.617783 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.617653 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37740036-f5bb-413e-92ba-84c3d0b6e992-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c5hcm\" (UID: \"37740036-f5bb-413e-92ba-84c3d0b6e992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" May 29 17:04:24.617994 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.617977 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37740036-f5bb-413e-92ba-84c3d0b6e992-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c5hcm\" (UID: \"37740036-f5bb-413e-92ba-84c3d0b6e992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" May 29 17:04:24.628055 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.628032 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h289v\" (UniqueName: \"kubernetes.io/projected/37740036-f5bb-413e-92ba-84c3d0b6e992-kube-api-access-h289v\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c5hcm\" (UID: \"37740036-f5bb-413e-92ba-84c3d0b6e992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" May 29 17:04:24.649374 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.649351 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" May 29 17:04:24.774502 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.774478 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm"] May 29 17:04:24.776598 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:04:24.776573 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37740036_f5bb_413e_92ba_84c3d0b6e992.slice/crio-deae45f053c2a6ba63233a49c3c53e3b1e23caff7e22aec3357ff1981dca4b4e WatchSource:0}: Error finding container deae45f053c2a6ba63233a49c3c53e3b1e23caff7e22aec3357ff1981dca4b4e: Status 404 returned error can't find the container with id deae45f053c2a6ba63233a49c3c53e3b1e23caff7e22aec3357ff1981dca4b4e May 29 17:04:24.952481 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.952446 2561 generic.go:358] "Generic (PLEG): container finished" podID="b37bef02-2450-46a6-a573-1b85b8dc70f0" containerID="69fd81d94c9daf2f6e09f533a3ca72185fc4b7e267bbd7425bf9d8fb451b35bd" exitCode=0 May 29 17:04:24.952938 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.952532 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" May 29 17:04:24.952938 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.952538 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" event={"ID":"b37bef02-2450-46a6-a573-1b85b8dc70f0","Type":"ContainerDied","Data":"69fd81d94c9daf2f6e09f533a3ca72185fc4b7e267bbd7425bf9d8fb451b35bd"} May 29 17:04:24.952938 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.952582 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw" event={"ID":"b37bef02-2450-46a6-a573-1b85b8dc70f0","Type":"ContainerDied","Data":"2548144b03a0235b0ef9501f3ec5ada247823733d8d44f30a1d9a8d5f822b4d4"} May 29 17:04:24.952938 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.952604 2561 scope.go:117] "RemoveContainer" containerID="69fd81d94c9daf2f6e09f533a3ca72185fc4b7e267bbd7425bf9d8fb451b35bd" May 29 17:04:24.954022 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.953996 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" event={"ID":"37740036-f5bb-413e-92ba-84c3d0b6e992","Type":"ContainerStarted","Data":"19a49a654ca7b314ec4e695efd796a234d66cf7a4967d5b5436b4047a444c17b"} May 29 17:04:24.954133 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.954034 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" event={"ID":"37740036-f5bb-413e-92ba-84c3d0b6e992","Type":"ContainerStarted","Data":"deae45f053c2a6ba63233a49c3c53e3b1e23caff7e22aec3357ff1981dca4b4e"} May 29 17:04:24.954207 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.954141 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" May 29 17:04:24.960849 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.960833 2561 scope.go:117] "RemoveContainer" containerID="69fd81d94c9daf2f6e09f533a3ca72185fc4b7e267bbd7425bf9d8fb451b35bd" May 29 17:04:24.961096 ip-10-0-137-133 kubenswrapper[2561]: E0529 17:04:24.961077 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69fd81d94c9daf2f6e09f533a3ca72185fc4b7e267bbd7425bf9d8fb451b35bd\": container with ID starting with 69fd81d94c9daf2f6e09f533a3ca72185fc4b7e267bbd7425bf9d8fb451b35bd not found: ID does not exist" containerID="69fd81d94c9daf2f6e09f533a3ca72185fc4b7e267bbd7425bf9d8fb451b35bd" May 29 17:04:24.961159 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.961108 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69fd81d94c9daf2f6e09f533a3ca72185fc4b7e267bbd7425bf9d8fb451b35bd"} err="failed to get container status \"69fd81d94c9daf2f6e09f533a3ca72185fc4b7e267bbd7425bf9d8fb451b35bd\": rpc error: code = NotFound desc = could not find container \"69fd81d94c9daf2f6e09f533a3ca72185fc4b7e267bbd7425bf9d8fb451b35bd\": container with ID starting with 69fd81d94c9daf2f6e09f533a3ca72185fc4b7e267bbd7425bf9d8fb451b35bd not found: ID does not exist" May 29 17:04:24.978526 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:24.978486 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" podStartSLOduration=0.978476771 podStartE2EDuration="978.476771ms" podCreationTimestamp="2026-05-29 17:04:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:04:24.977360287 +0000 UTC m=+463.007829295" watchObservedRunningTime="2026-05-29 17:04:24.978476771 +0000 UTC m=+463.008945779" May 29 17:04:25.002882 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:25.002857 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw"] May 29 17:04:25.008448 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:25.008424 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cqcvw"] May 29 17:04:26.424355 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:26.424324 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b37bef02-2450-46a6-a573-1b85b8dc70f0" path="/var/lib/kubelet/pods/b37bef02-2450-46a6-a573-1b85b8dc70f0/volumes" May 29 17:04:35.961100 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:35.961066 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" May 29 17:04:36.015027 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:36.014995 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w"] May 29 17:04:36.015269 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:36.015224 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" podUID="d6e91517-6efa-4a2a-8036-0abd380ca9e0" containerName="manager" containerID="cri-o://da45e68bda55d5dab488341adc7ded7884978bd5182d466b1919359c4f16910c" gracePeriod=10 May 29 17:04:36.259240 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:36.259219 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" May 29 17:04:36.305641 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:36.305613 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-795x8\" (UniqueName: \"kubernetes.io/projected/d6e91517-6efa-4a2a-8036-0abd380ca9e0-kube-api-access-795x8\") pod \"d6e91517-6efa-4a2a-8036-0abd380ca9e0\" (UID: \"d6e91517-6efa-4a2a-8036-0abd380ca9e0\") " May 29 17:04:36.305772 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:36.305739 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6e91517-6efa-4a2a-8036-0abd380ca9e0-extensions-socket-volume\") pod \"d6e91517-6efa-4a2a-8036-0abd380ca9e0\" (UID: \"d6e91517-6efa-4a2a-8036-0abd380ca9e0\") " May 29 17:04:36.306104 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:36.306081 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6e91517-6efa-4a2a-8036-0abd380ca9e0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d6e91517-6efa-4a2a-8036-0abd380ca9e0" (UID: "d6e91517-6efa-4a2a-8036-0abd380ca9e0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 17:04:36.307703 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:36.307668 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6e91517-6efa-4a2a-8036-0abd380ca9e0-kube-api-access-795x8" (OuterVolumeSpecName: "kube-api-access-795x8") pod "d6e91517-6efa-4a2a-8036-0abd380ca9e0" (UID: "d6e91517-6efa-4a2a-8036-0abd380ca9e0"). InnerVolumeSpecName "kube-api-access-795x8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 17:04:36.406922 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:36.406895 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6e91517-6efa-4a2a-8036-0abd380ca9e0-extensions-socket-volume\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 17:04:36.406922 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:36.406918 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-795x8\" (UniqueName: \"kubernetes.io/projected/d6e91517-6efa-4a2a-8036-0abd380ca9e0-kube-api-access-795x8\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 17:04:36.999468 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:36.999433 2561 generic.go:358] "Generic (PLEG): container finished" podID="d6e91517-6efa-4a2a-8036-0abd380ca9e0" containerID="da45e68bda55d5dab488341adc7ded7884978bd5182d466b1919359c4f16910c" exitCode=0 May 29 17:04:36.999924 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:36.999489 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" event={"ID":"d6e91517-6efa-4a2a-8036-0abd380ca9e0","Type":"ContainerDied","Data":"da45e68bda55d5dab488341adc7ded7884978bd5182d466b1919359c4f16910c"} May 29 17:04:36.999924 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:36.999494 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" May 29 17:04:36.999924 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:36.999514 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w" event={"ID":"d6e91517-6efa-4a2a-8036-0abd380ca9e0","Type":"ContainerDied","Data":"779fd4d9c0f645dee5ab3c831ce8a4d7a6ed4eb9df461a77d4889e50cf7dc960"} May 29 17:04:36.999924 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:36.999529 2561 scope.go:117] "RemoveContainer" containerID="da45e68bda55d5dab488341adc7ded7884978bd5182d466b1919359c4f16910c" May 29 17:04:37.007708 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:37.007675 2561 scope.go:117] "RemoveContainer" containerID="da45e68bda55d5dab488341adc7ded7884978bd5182d466b1919359c4f16910c" May 29 17:04:37.007942 ip-10-0-137-133 kubenswrapper[2561]: E0529 17:04:37.007924 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da45e68bda55d5dab488341adc7ded7884978bd5182d466b1919359c4f16910c\": container with ID starting with da45e68bda55d5dab488341adc7ded7884978bd5182d466b1919359c4f16910c not found: ID does not exist" containerID="da45e68bda55d5dab488341adc7ded7884978bd5182d466b1919359c4f16910c" May 29 17:04:37.007989 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:37.007967 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da45e68bda55d5dab488341adc7ded7884978bd5182d466b1919359c4f16910c"} err="failed to get container status \"da45e68bda55d5dab488341adc7ded7884978bd5182d466b1919359c4f16910c\": rpc error: code = NotFound desc = could not find container \"da45e68bda55d5dab488341adc7ded7884978bd5182d466b1919359c4f16910c\": container with ID starting with da45e68bda55d5dab488341adc7ded7884978bd5182d466b1919359c4f16910c not found: ID does not exist" May 29 17:04:37.019314 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:37.019292 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w"] May 29 17:04:37.023091 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:37.023072 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ksf7w"] May 29 17:04:38.424078 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:38.424047 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6e91517-6efa-4a2a-8036-0abd380ca9e0" path="/var/lib/kubelet/pods/d6e91517-6efa-4a2a-8036-0abd380ca9e0/volumes" May 29 17:04:40.332608 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.332571 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m"] May 29 17:04:40.332979 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.332898 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6e91517-6efa-4a2a-8036-0abd380ca9e0" containerName="manager" May 29 17:04:40.332979 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.332910 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6e91517-6efa-4a2a-8036-0abd380ca9e0" containerName="manager" May 29 17:04:40.332979 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.332966 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6e91517-6efa-4a2a-8036-0abd380ca9e0" containerName="manager" May 29 17:04:40.335257 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.335240 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.339107 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.339088 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-p24mk\"" May 29 17:04:40.370055 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.370023 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m"] May 29 17:04:40.439041 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.439008 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.439211 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.439043 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.439211 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.439175 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.439338 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.439228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-workload-certs\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.439338 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.439274 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istio-data\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.439338 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.439332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istio-token\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.439490 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.439380 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-workload-socket\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.439490 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.439420 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-credential-socket\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.439490 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.439455 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqbnt\" (UniqueName: \"kubernetes.io/projected/3f699578-8e86-4925-b5bf-7e4fe8b097bd-kube-api-access-nqbnt\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.540863 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.540833 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.541020 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.540872 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-workload-certs\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.541020 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.540891 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istio-data\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.541020 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.540917 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istio-token\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.541190 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.541054 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-workload-socket\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.541190 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.541102 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-credential-socket\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.541190 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.541139 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nqbnt\" (UniqueName: \"kubernetes.io/projected/3f699578-8e86-4925-b5bf-7e4fe8b097bd-kube-api-access-nqbnt\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.541190 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.541177 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.541374 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.541216 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.541374 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.541270 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-workload-certs\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.541535 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.541478 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-credential-socket\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.541653 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.541623 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istio-data\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.541653 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.541643 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-workload-socket\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.541864 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.541841 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.543209 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.543182 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.543571 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.543552 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.549236 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.549203 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqbnt\" (UniqueName: \"kubernetes.io/projected/3f699578-8e86-4925-b5bf-7e4fe8b097bd-kube-api-access-nqbnt\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.549322 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.549304 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f699578-8e86-4925-b5bf-7e4fe8b097bd-istio-token\") pod \"maas-default-gateway-openshift-default-7d44956ff5-hd48m\" (UID: \"3f699578-8e86-4925-b5bf-7e4fe8b097bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.645094 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.645008 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:40.802838 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.802811 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m"] May 29 17:04:40.804721 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:04:40.804680 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f699578_8e86_4925_b5bf_7e4fe8b097bd.slice/crio-6097df9d5f7bbd83c75c01d0c7d3d59aec14f24a36dedfe40123b820ad40b7d4 WatchSource:0}: Error finding container 6097df9d5f7bbd83c75c01d0c7d3d59aec14f24a36dedfe40123b820ad40b7d4: Status 404 returned error can't find the container with id 6097df9d5f7bbd83c75c01d0c7d3d59aec14f24a36dedfe40123b820ad40b7d4 May 29 17:04:40.806671 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.806643 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 29 17:04:40.806788 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.806722 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 29 17:04:40.806788 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:40.806751 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 29 17:04:41.015578 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:41.015497 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" event={"ID":"3f699578-8e86-4925-b5bf-7e4fe8b097bd","Type":"ContainerStarted","Data":"78ef08c78bd334ac0373d993bc3cd01b6eb47462e304096245212992d9abb058"} May 29 17:04:41.015578 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:41.015535 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" event={"ID":"3f699578-8e86-4925-b5bf-7e4fe8b097bd","Type":"ContainerStarted","Data":"6097df9d5f7bbd83c75c01d0c7d3d59aec14f24a36dedfe40123b820ad40b7d4"} May 29 17:04:41.036045 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:41.035992 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" podStartSLOduration=1.035974205 podStartE2EDuration="1.035974205s" podCreationTimestamp="2026-05-29 17:04:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:04:41.033907842 +0000 UTC m=+479.064376849" watchObservedRunningTime="2026-05-29 17:04:41.035974205 +0000 UTC m=+479.066443214" May 29 17:04:41.646108 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:41.646069 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:41.650859 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:41.650833 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:42.019231 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:42.019146 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:42.020122 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:42.020104 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d44956ff5-hd48m" May 29 17:04:57.400595 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:57.400560 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-gnllj"] May 29 17:04:57.403654 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:57.403637 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-gnllj" May 29 17:04:57.406554 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:57.406530 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xgshf\"" May 29 17:04:57.408911 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:57.408881 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-gnllj"] May 29 17:04:57.485581 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:57.485555 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmfqb\" (UniqueName: \"kubernetes.io/projected/15e4ba67-26d6-493e-8e88-1b3d9a8a911a-kube-api-access-gmfqb\") pod \"authorino-7498df8756-gnllj\" (UID: \"15e4ba67-26d6-493e-8e88-1b3d9a8a911a\") " pod="kuadrant-system/authorino-7498df8756-gnllj" May 29 17:04:57.587044 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:57.587006 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmfqb\" (UniqueName: \"kubernetes.io/projected/15e4ba67-26d6-493e-8e88-1b3d9a8a911a-kube-api-access-gmfqb\") pod \"authorino-7498df8756-gnllj\" (UID: \"15e4ba67-26d6-493e-8e88-1b3d9a8a911a\") " pod="kuadrant-system/authorino-7498df8756-gnllj" May 29 17:04:57.594917 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:57.594894 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmfqb\" (UniqueName: \"kubernetes.io/projected/15e4ba67-26d6-493e-8e88-1b3d9a8a911a-kube-api-access-gmfqb\") pod \"authorino-7498df8756-gnllj\" (UID: \"15e4ba67-26d6-493e-8e88-1b3d9a8a911a\") " pod="kuadrant-system/authorino-7498df8756-gnllj" May 29 17:04:57.713431 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:57.713360 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-gnllj" May 29 17:04:57.838236 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:57.838211 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-gnllj"] May 29 17:04:57.840119 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:04:57.840093 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15e4ba67_26d6_493e_8e88_1b3d9a8a911a.slice/crio-0562e69ac67ee0c78533bf72fed7f3b771d51f43457e1222551f1744d0a3c841 WatchSource:0}: Error finding container 0562e69ac67ee0c78533bf72fed7f3b771d51f43457e1222551f1744d0a3c841: Status 404 returned error can't find the container with id 0562e69ac67ee0c78533bf72fed7f3b771d51f43457e1222551f1744d0a3c841 May 29 17:04:58.071288 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:04:58.071259 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-gnllj" event={"ID":"15e4ba67-26d6-493e-8e88-1b3d9a8a911a","Type":"ContainerStarted","Data":"0562e69ac67ee0c78533bf72fed7f3b771d51f43457e1222551f1744d0a3c841"} May 29 17:05:01.083921 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:01.083880 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-gnllj" event={"ID":"15e4ba67-26d6-493e-8e88-1b3d9a8a911a","Type":"ContainerStarted","Data":"1cf221da4591fe7e58128074cba52e389b17a69abe62a1d4daba28f2555c0c17"} May 29 17:05:01.099673 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:01.099622 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-gnllj" podStartSLOduration=1.33762113 podStartE2EDuration="4.099608022s" podCreationTimestamp="2026-05-29 17:04:57 +0000 UTC" firstStartedPulling="2026-05-29 17:04:57.841367236 +0000 UTC m=+495.871836222" lastFinishedPulling="2026-05-29 17:05:00.603354119 +0000 UTC m=+498.633823114" observedRunningTime="2026-05-29 17:05:01.099164798 +0000 UTC m=+499.129633805" watchObservedRunningTime="2026-05-29 17:05:01.099608022 +0000 UTC m=+499.130077030" May 29 17:05:49.074722 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:49.074634 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 17:05:49.078786 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:49.078769 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 29 17:05:49.081614 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:49.081581 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" May 29 17:05:49.081614 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:49.081610 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" May 29 17:05:49.081818 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:49.081581 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" May 29 17:05:49.082887 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:49.082869 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-8ft74\"" May 29 17:05:49.086942 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:49.086921 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 17:05:49.215666 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:49.215636 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqmhn\" (UniqueName: \"kubernetes.io/projected/7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3-kube-api-access-qqmhn\") pod \"maas-keycloak-0\" (UID: \"7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3\") " pod="keycloak-system/maas-keycloak-0" May 29 17:05:49.316776 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:49.316751 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qqmhn\" (UniqueName: \"kubernetes.io/projected/7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3-kube-api-access-qqmhn\") pod \"maas-keycloak-0\" (UID: \"7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3\") " pod="keycloak-system/maas-keycloak-0" May 29 17:05:49.325872 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:49.325816 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqmhn\" (UniqueName: \"kubernetes.io/projected/7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3-kube-api-access-qqmhn\") pod \"maas-keycloak-0\" (UID: \"7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3\") " pod="keycloak-system/maas-keycloak-0" May 29 17:05:49.388746 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:49.388718 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 29 17:05:49.514137 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:49.514113 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 17:05:49.516029 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:05:49.516004 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d68e2a9_ff28_4ef7_a8e4_2cc01b1afdb3.slice/crio-b8b24113df31467a654960bb51b9bff13ab3639296a017f53f1d025be2e3fd2a WatchSource:0}: Error finding container b8b24113df31467a654960bb51b9bff13ab3639296a017f53f1d025be2e3fd2a: Status 404 returned error can't find the container with id b8b24113df31467a654960bb51b9bff13ab3639296a017f53f1d025be2e3fd2a May 29 17:05:50.256070 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:50.256034 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3","Type":"ContainerStarted","Data":"b8b24113df31467a654960bb51b9bff13ab3639296a017f53f1d025be2e3fd2a"} May 29 17:05:54.274530 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:54.274434 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3","Type":"ContainerStarted","Data":"e2b09767e3535ae23e3a48192f85db46e9d814f95f6f9886e597ca9f977be792"} May 29 17:05:54.293890 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:54.293835 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.91123506 podStartE2EDuration="5.293820476s" podCreationTimestamp="2026-05-29 17:05:49 +0000 UTC" firstStartedPulling="2026-05-29 17:05:49.517258168 +0000 UTC m=+547.547727157" lastFinishedPulling="2026-05-29 17:05:53.899843584 +0000 UTC m=+551.930312573" observedRunningTime="2026-05-29 17:05:54.292183454 +0000 UTC m=+552.322652476" watchObservedRunningTime="2026-05-29 17:05:54.293820476 +0000 UTC m=+552.324289484" May 29 17:05:54.389872 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:54.389817 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" May 29 17:05:54.391976 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:54.391937 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" May 29 17:05:55.389937 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:55.389886 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" May 29 17:05:56.389282 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:56.389235 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" May 29 17:05:57.389585 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:57.389532 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" May 29 17:05:58.389252 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:58.389196 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" May 29 17:05:59.390293 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:59.390243 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" May 29 17:05:59.391363 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:05:59.391335 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" May 29 17:06:00.389327 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:00.389275 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" May 29 17:06:01.390328 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:01.390280 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" May 29 17:06:02.389598 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:02.389541 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" May 29 17:06:03.389856 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:03.389811 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" May 29 17:06:04.389568 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:04.389515 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" May 29 17:06:05.389884 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:05.389835 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" May 29 17:06:06.389799 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:06.389749 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" May 29 17:06:07.517042 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:07.517000 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" May 29 17:06:07.535824 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:07.535772 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 17:06:17.522833 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:17.522796 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" May 29 17:06:19.993954 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:19.993918 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-gnllj"] May 29 17:06:19.994316 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:19.994112 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-gnllj" podUID="15e4ba67-26d6-493e-8e88-1b3d9a8a911a" containerName="authorino" containerID="cri-o://1cf221da4591fe7e58128074cba52e389b17a69abe62a1d4daba28f2555c0c17" gracePeriod=30 May 29 17:06:20.237275 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:20.237253 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-gnllj" May 29 17:06:20.315802 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:20.315765 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmfqb\" (UniqueName: \"kubernetes.io/projected/15e4ba67-26d6-493e-8e88-1b3d9a8a911a-kube-api-access-gmfqb\") pod \"15e4ba67-26d6-493e-8e88-1b3d9a8a911a\" (UID: \"15e4ba67-26d6-493e-8e88-1b3d9a8a911a\") " May 29 17:06:20.317757 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:20.317728 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15e4ba67-26d6-493e-8e88-1b3d9a8a911a-kube-api-access-gmfqb" (OuterVolumeSpecName: "kube-api-access-gmfqb") pod "15e4ba67-26d6-493e-8e88-1b3d9a8a911a" (UID: "15e4ba67-26d6-493e-8e88-1b3d9a8a911a"). InnerVolumeSpecName "kube-api-access-gmfqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 17:06:20.388351 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:20.388326 2561 generic.go:358] "Generic (PLEG): container finished" podID="15e4ba67-26d6-493e-8e88-1b3d9a8a911a" containerID="1cf221da4591fe7e58128074cba52e389b17a69abe62a1d4daba28f2555c0c17" exitCode=0 May 29 17:06:20.388470 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:20.388374 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-gnllj" May 29 17:06:20.388470 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:20.388379 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-gnllj" event={"ID":"15e4ba67-26d6-493e-8e88-1b3d9a8a911a","Type":"ContainerDied","Data":"1cf221da4591fe7e58128074cba52e389b17a69abe62a1d4daba28f2555c0c17"} May 29 17:06:20.388470 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:20.388400 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-gnllj" event={"ID":"15e4ba67-26d6-493e-8e88-1b3d9a8a911a","Type":"ContainerDied","Data":"0562e69ac67ee0c78533bf72fed7f3b771d51f43457e1222551f1744d0a3c841"} May 29 17:06:20.388470 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:20.388415 2561 scope.go:117] "RemoveContainer" containerID="1cf221da4591fe7e58128074cba52e389b17a69abe62a1d4daba28f2555c0c17" May 29 17:06:20.396762 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:20.396744 2561 scope.go:117] "RemoveContainer" containerID="1cf221da4591fe7e58128074cba52e389b17a69abe62a1d4daba28f2555c0c17" May 29 17:06:20.397029 ip-10-0-137-133 kubenswrapper[2561]: E0529 17:06:20.397010 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cf221da4591fe7e58128074cba52e389b17a69abe62a1d4daba28f2555c0c17\": container with ID starting with 1cf221da4591fe7e58128074cba52e389b17a69abe62a1d4daba28f2555c0c17 not found: ID does not exist" containerID="1cf221da4591fe7e58128074cba52e389b17a69abe62a1d4daba28f2555c0c17" May 29 17:06:20.397080 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:20.397037 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cf221da4591fe7e58128074cba52e389b17a69abe62a1d4daba28f2555c0c17"} err="failed to get container status \"1cf221da4591fe7e58128074cba52e389b17a69abe62a1d4daba28f2555c0c17\": rpc error: code = NotFound desc = could not find container \"1cf221da4591fe7e58128074cba52e389b17a69abe62a1d4daba28f2555c0c17\": container with ID starting with 1cf221da4591fe7e58128074cba52e389b17a69abe62a1d4daba28f2555c0c17 not found: ID does not exist" May 29 17:06:20.408209 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:20.408183 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-gnllj"] May 29 17:06:20.411791 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:20.411743 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-gnllj"] May 29 17:06:20.416615 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:20.416598 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmfqb\" (UniqueName: \"kubernetes.io/projected/15e4ba67-26d6-493e-8e88-1b3d9a8a911a-kube-api-access-gmfqb\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 17:06:20.425006 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:20.424981 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15e4ba67-26d6-493e-8e88-1b3d9a8a911a" path="/var/lib/kubelet/pods/15e4ba67-26d6-493e-8e88-1b3d9a8a911a/volumes" May 29 17:06:23.534975 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.534941 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54454c55bd-gdw6s"] May 29 17:06:23.535344 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.535260 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e4ba67-26d6-493e-8e88-1b3d9a8a911a" containerName="authorino" May 29 17:06:23.535344 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.535270 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e4ba67-26d6-493e-8e88-1b3d9a8a911a" containerName="authorino" May 29 17:06:23.535344 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.535328 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="15e4ba67-26d6-493e-8e88-1b3d9a8a911a" containerName="authorino" May 29 17:06:23.537535 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.537518 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54454c55bd-gdw6s" May 29 17:06:23.541148 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.541126 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 29 17:06:23.541265 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.541126 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qxrw7\"" May 29 17:06:23.545740 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.545719 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54454c55bd-gdw6s"] May 29 17:06:23.641545 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.641507 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srptt\" (UniqueName: \"kubernetes.io/projected/5099df5d-21b8-48e7-9230-92a0be841837-kube-api-access-srptt\") pod \"maas-controller-54454c55bd-gdw6s\" (UID: \"5099df5d-21b8-48e7-9230-92a0be841837\") " pod="opendatahub/maas-controller-54454c55bd-gdw6s" May 29 17:06:23.718702 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.718658 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c66df4598-hx2j4"] May 29 17:06:23.720815 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.720799 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66df4598-hx2j4" May 29 17:06:23.731528 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.731507 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c66df4598-hx2j4"] May 29 17:06:23.742344 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.742320 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srptt\" (UniqueName: \"kubernetes.io/projected/5099df5d-21b8-48e7-9230-92a0be841837-kube-api-access-srptt\") pod \"maas-controller-54454c55bd-gdw6s\" (UID: \"5099df5d-21b8-48e7-9230-92a0be841837\") " pod="opendatahub/maas-controller-54454c55bd-gdw6s" May 29 17:06:23.751343 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.751323 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srptt\" (UniqueName: \"kubernetes.io/projected/5099df5d-21b8-48e7-9230-92a0be841837-kube-api-access-srptt\") pod \"maas-controller-54454c55bd-gdw6s\" (UID: \"5099df5d-21b8-48e7-9230-92a0be841837\") " pod="opendatahub/maas-controller-54454c55bd-gdw6s" May 29 17:06:23.842831 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.842765 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rchk\" (UniqueName: \"kubernetes.io/projected/1d54b97c-496b-4c07-beae-e2bd5e8ddb01-kube-api-access-2rchk\") pod \"maas-controller-5c66df4598-hx2j4\" (UID: \"1d54b97c-496b-4c07-beae-e2bd5e8ddb01\") " pod="opendatahub/maas-controller-5c66df4598-hx2j4" May 29 17:06:23.848699 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.848670 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54454c55bd-gdw6s" May 29 17:06:23.943216 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.943181 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rchk\" (UniqueName: \"kubernetes.io/projected/1d54b97c-496b-4c07-beae-e2bd5e8ddb01-kube-api-access-2rchk\") pod \"maas-controller-5c66df4598-hx2j4\" (UID: \"1d54b97c-496b-4c07-beae-e2bd5e8ddb01\") " pod="opendatahub/maas-controller-5c66df4598-hx2j4" May 29 17:06:23.952565 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.952535 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rchk\" (UniqueName: \"kubernetes.io/projected/1d54b97c-496b-4c07-beae-e2bd5e8ddb01-kube-api-access-2rchk\") pod \"maas-controller-5c66df4598-hx2j4\" (UID: \"1d54b97c-496b-4c07-beae-e2bd5e8ddb01\") " pod="opendatahub/maas-controller-5c66df4598-hx2j4" May 29 17:06:23.973918 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:23.973896 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54454c55bd-gdw6s"] May 29 17:06:23.975511 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:06:23.975482 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5099df5d_21b8_48e7_9230_92a0be841837.slice/crio-a0116a8a434ffe5ef4cb200402ebfc7e9638ed01329bb4ab38cce2c1d653bec1 WatchSource:0}: Error finding container a0116a8a434ffe5ef4cb200402ebfc7e9638ed01329bb4ab38cce2c1d653bec1: Status 404 returned error can't find the container with id a0116a8a434ffe5ef4cb200402ebfc7e9638ed01329bb4ab38cce2c1d653bec1 May 29 17:06:24.030213 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:24.030187 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66df4598-hx2j4" May 29 17:06:24.154378 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:24.154306 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c66df4598-hx2j4"] May 29 17:06:24.156461 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:06:24.156431 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d54b97c_496b_4c07_beae_e2bd5e8ddb01.slice/crio-a85244edecba974bd99c15b9a8e30edc3279fca074450cbb0bab3f9b15cd16c3 WatchSource:0}: Error finding container a85244edecba974bd99c15b9a8e30edc3279fca074450cbb0bab3f9b15cd16c3: Status 404 returned error can't find the container with id a85244edecba974bd99c15b9a8e30edc3279fca074450cbb0bab3f9b15cd16c3 May 29 17:06:24.406710 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:24.406602 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54454c55bd-gdw6s" event={"ID":"5099df5d-21b8-48e7-9230-92a0be841837","Type":"ContainerStarted","Data":"a0116a8a434ffe5ef4cb200402ebfc7e9638ed01329bb4ab38cce2c1d653bec1"} May 29 17:06:24.407628 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:24.407599 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66df4598-hx2j4" event={"ID":"1d54b97c-496b-4c07-beae-e2bd5e8ddb01","Type":"ContainerStarted","Data":"a85244edecba974bd99c15b9a8e30edc3279fca074450cbb0bab3f9b15cd16c3"} May 29 17:06:27.419963 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:27.419922 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54454c55bd-gdw6s" event={"ID":"5099df5d-21b8-48e7-9230-92a0be841837","Type":"ContainerStarted","Data":"c6da761a067139f97221c1de8aeaceef0a3777634ad291c0e90ede92c7fa298b"} May 29 17:06:27.420459 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:27.419992 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54454c55bd-gdw6s" May 29 17:06:27.421521 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:27.421492 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66df4598-hx2j4" event={"ID":"1d54b97c-496b-4c07-beae-e2bd5e8ddb01","Type":"ContainerStarted","Data":"c052aec039c42ee6012ec149c9fb848e87302509709dc26f8eb51814d8882cf6"} May 29 17:06:27.421634 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:27.421612 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c66df4598-hx2j4" May 29 17:06:27.439946 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:27.439904 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-54454c55bd-gdw6s" podStartSLOduration=1.702107552 podStartE2EDuration="4.439891782s" podCreationTimestamp="2026-05-29 17:06:23 +0000 UTC" firstStartedPulling="2026-05-29 17:06:23.976799101 +0000 UTC m=+582.007268091" lastFinishedPulling="2026-05-29 17:06:26.714583332 +0000 UTC m=+584.745052321" observedRunningTime="2026-05-29 17:06:27.437550816 +0000 UTC m=+585.468019823" watchObservedRunningTime="2026-05-29 17:06:27.439891782 +0000 UTC m=+585.470360790" May 29 17:06:27.459227 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:27.459185 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5c66df4598-hx2j4" podStartSLOduration=1.897689396 podStartE2EDuration="4.459172926s" podCreationTimestamp="2026-05-29 17:06:23 +0000 UTC" firstStartedPulling="2026-05-29 17:06:24.157738923 +0000 UTC m=+582.188207909" lastFinishedPulling="2026-05-29 17:06:26.719222247 +0000 UTC m=+584.749691439" observedRunningTime="2026-05-29 17:06:27.457123102 +0000 UTC m=+585.487592111" watchObservedRunningTime="2026-05-29 17:06:27.459172926 +0000 UTC m=+585.489641978" May 29 17:06:38.431112 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:38.431084 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54454c55bd-gdw6s" May 29 17:06:38.431520 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:38.431129 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c66df4598-hx2j4" May 29 17:06:38.488514 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:38.488485 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54454c55bd-gdw6s"] May 29 17:06:38.488706 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:38.488661 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-54454c55bd-gdw6s" podUID="5099df5d-21b8-48e7-9230-92a0be841837" containerName="manager" containerID="cri-o://c6da761a067139f97221c1de8aeaceef0a3777634ad291c0e90ede92c7fa298b" gracePeriod=30 May 29 17:06:38.725494 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:38.725472 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54454c55bd-gdw6s" May 29 17:06:38.868120 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:38.868091 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srptt\" (UniqueName: \"kubernetes.io/projected/5099df5d-21b8-48e7-9230-92a0be841837-kube-api-access-srptt\") pod \"5099df5d-21b8-48e7-9230-92a0be841837\" (UID: \"5099df5d-21b8-48e7-9230-92a0be841837\") " May 29 17:06:38.870190 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:38.870162 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5099df5d-21b8-48e7-9230-92a0be841837-kube-api-access-srptt" (OuterVolumeSpecName: "kube-api-access-srptt") pod "5099df5d-21b8-48e7-9230-92a0be841837" (UID: "5099df5d-21b8-48e7-9230-92a0be841837"). InnerVolumeSpecName "kube-api-access-srptt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 17:06:38.969317 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:38.969257 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srptt\" (UniqueName: \"kubernetes.io/projected/5099df5d-21b8-48e7-9230-92a0be841837-kube-api-access-srptt\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 17:06:39.465767 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:39.465733 2561 generic.go:358] "Generic (PLEG): container finished" podID="5099df5d-21b8-48e7-9230-92a0be841837" containerID="c6da761a067139f97221c1de8aeaceef0a3777634ad291c0e90ede92c7fa298b" exitCode=0 May 29 17:06:39.466203 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:39.465777 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54454c55bd-gdw6s" event={"ID":"5099df5d-21b8-48e7-9230-92a0be841837","Type":"ContainerDied","Data":"c6da761a067139f97221c1de8aeaceef0a3777634ad291c0e90ede92c7fa298b"} May 29 17:06:39.466203 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:39.465798 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54454c55bd-gdw6s" event={"ID":"5099df5d-21b8-48e7-9230-92a0be841837","Type":"ContainerDied","Data":"a0116a8a434ffe5ef4cb200402ebfc7e9638ed01329bb4ab38cce2c1d653bec1"} May 29 17:06:39.466203 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:39.465805 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54454c55bd-gdw6s" May 29 17:06:39.466203 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:39.465815 2561 scope.go:117] "RemoveContainer" containerID="c6da761a067139f97221c1de8aeaceef0a3777634ad291c0e90ede92c7fa298b" May 29 17:06:39.474525 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:39.474506 2561 scope.go:117] "RemoveContainer" containerID="c6da761a067139f97221c1de8aeaceef0a3777634ad291c0e90ede92c7fa298b" May 29 17:06:39.474794 ip-10-0-137-133 kubenswrapper[2561]: E0529 17:06:39.474776 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6da761a067139f97221c1de8aeaceef0a3777634ad291c0e90ede92c7fa298b\": container with ID starting with c6da761a067139f97221c1de8aeaceef0a3777634ad291c0e90ede92c7fa298b not found: ID does not exist" containerID="c6da761a067139f97221c1de8aeaceef0a3777634ad291c0e90ede92c7fa298b" May 29 17:06:39.474852 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:39.474806 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6da761a067139f97221c1de8aeaceef0a3777634ad291c0e90ede92c7fa298b"} err="failed to get container status \"c6da761a067139f97221c1de8aeaceef0a3777634ad291c0e90ede92c7fa298b\": rpc error: code = NotFound desc = could not find container \"c6da761a067139f97221c1de8aeaceef0a3777634ad291c0e90ede92c7fa298b\": container with ID starting with c6da761a067139f97221c1de8aeaceef0a3777634ad291c0e90ede92c7fa298b not found: ID does not exist" May 29 17:06:39.487196 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:39.487173 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54454c55bd-gdw6s"] May 29 17:06:39.490620 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:39.490599 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54454c55bd-gdw6s"] May 29 17:06:40.425307 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:40.425277 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5099df5d-21b8-48e7-9230-92a0be841837" path="/var/lib/kubelet/pods/5099df5d-21b8-48e7-9230-92a0be841837/volumes" May 29 17:06:42.376893 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:42.376868 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:06:42.377559 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:42.377533 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:06:42.384216 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:42.384197 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:06:42.385069 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:42.385048 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:06:57.910281 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:57.910206 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6c7b68fff6-kqp9f"] May 29 17:06:57.912273 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:57.910550 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5099df5d-21b8-48e7-9230-92a0be841837" containerName="manager" May 29 17:06:57.912273 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:57.910562 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5099df5d-21b8-48e7-9230-92a0be841837" containerName="manager" May 29 17:06:57.912273 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:57.910633 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="5099df5d-21b8-48e7-9230-92a0be841837" containerName="manager" May 29 17:06:57.912946 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:57.912931 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6c7b68fff6-kqp9f" May 29 17:06:57.915773 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:57.915753 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 29 17:06:57.920264 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:57.920245 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6c7b68fff6-kqp9f"] May 29 17:06:57.927983 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:57.927959 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx8hv\" (UniqueName: \"kubernetes.io/projected/3b3a63f9-2a67-419d-afbb-63970474736e-kube-api-access-nx8hv\") pod \"maas-api-6c7b68fff6-kqp9f\" (UID: \"3b3a63f9-2a67-419d-afbb-63970474736e\") " pod="opendatahub/maas-api-6c7b68fff6-kqp9f" May 29 17:06:57.928148 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:57.927987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b3a63f9-2a67-419d-afbb-63970474736e-maas-api-tls\") pod \"maas-api-6c7b68fff6-kqp9f\" (UID: \"3b3a63f9-2a67-419d-afbb-63970474736e\") " pod="opendatahub/maas-api-6c7b68fff6-kqp9f" May 29 17:06:58.028941 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.028902 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nx8hv\" (UniqueName: \"kubernetes.io/projected/3b3a63f9-2a67-419d-afbb-63970474736e-kube-api-access-nx8hv\") pod \"maas-api-6c7b68fff6-kqp9f\" (UID: \"3b3a63f9-2a67-419d-afbb-63970474736e\") " pod="opendatahub/maas-api-6c7b68fff6-kqp9f" May 29 17:06:58.029127 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.028950 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b3a63f9-2a67-419d-afbb-63970474736e-maas-api-tls\") pod \"maas-api-6c7b68fff6-kqp9f\" (UID: \"3b3a63f9-2a67-419d-afbb-63970474736e\") " pod="opendatahub/maas-api-6c7b68fff6-kqp9f" May 29 17:06:58.029127 ip-10-0-137-133 kubenswrapper[2561]: E0529 17:06:58.029102 2561 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found May 29 17:06:58.029234 ip-10-0-137-133 kubenswrapper[2561]: E0529 17:06:58.029217 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b3a63f9-2a67-419d-afbb-63970474736e-maas-api-tls podName:3b3a63f9-2a67-419d-afbb-63970474736e nodeName:}" failed. No retries permitted until 2026-05-29 17:06:58.529190082 +0000 UTC m=+616.559659101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3b3a63f9-2a67-419d-afbb-63970474736e-maas-api-tls") pod "maas-api-6c7b68fff6-kqp9f" (UID: "3b3a63f9-2a67-419d-afbb-63970474736e") : secret "maas-api-serving-cert" not found May 29 17:06:58.040988 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.040956 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx8hv\" (UniqueName: \"kubernetes.io/projected/3b3a63f9-2a67-419d-afbb-63970474736e-kube-api-access-nx8hv\") pod \"maas-api-6c7b68fff6-kqp9f\" (UID: \"3b3a63f9-2a67-419d-afbb-63970474736e\") " pod="opendatahub/maas-api-6c7b68fff6-kqp9f" May 29 17:06:58.359491 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.359456 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-4jd86"] May 29 17:06:58.362461 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.362446 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-4jd86" May 29 17:06:58.365281 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.365258 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 29 17:06:58.365403 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.365333 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vspcm\"" May 29 17:06:58.372037 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.372015 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-4jd86"] May 29 17:06:58.432485 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.432453 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z52mm\" (UniqueName: \"kubernetes.io/projected/871abee6-4e4c-4edb-83cd-96a08419c4f6-kube-api-access-z52mm\") pod \"payload-processing-58b6c8fdc7-4jd86\" (UID: \"871abee6-4e4c-4edb-83cd-96a08419c4f6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-4jd86" May 29 17:06:58.533055 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.533017 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b3a63f9-2a67-419d-afbb-63970474736e-maas-api-tls\") pod \"maas-api-6c7b68fff6-kqp9f\" (UID: \"3b3a63f9-2a67-419d-afbb-63970474736e\") " pod="opendatahub/maas-api-6c7b68fff6-kqp9f" May 29 17:06:58.533224 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.533144 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z52mm\" (UniqueName: \"kubernetes.io/projected/871abee6-4e4c-4edb-83cd-96a08419c4f6-kube-api-access-z52mm\") pod \"payload-processing-58b6c8fdc7-4jd86\" (UID: \"871abee6-4e4c-4edb-83cd-96a08419c4f6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-4jd86" May 29 17:06:58.535580 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.535559 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b3a63f9-2a67-419d-afbb-63970474736e-maas-api-tls\") pod \"maas-api-6c7b68fff6-kqp9f\" (UID: \"3b3a63f9-2a67-419d-afbb-63970474736e\") " pod="opendatahub/maas-api-6c7b68fff6-kqp9f" May 29 17:06:58.549808 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.549782 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z52mm\" (UniqueName: \"kubernetes.io/projected/871abee6-4e4c-4edb-83cd-96a08419c4f6-kube-api-access-z52mm\") pod \"payload-processing-58b6c8fdc7-4jd86\" (UID: \"871abee6-4e4c-4edb-83cd-96a08419c4f6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-4jd86" May 29 17:06:58.673302 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.673217 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-4jd86" May 29 17:06:58.801803 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.801773 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-4jd86"] May 29 17:06:58.804960 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:06:58.804936 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871abee6_4e4c_4edb_83cd_96a08419c4f6.slice/crio-dfcee6f7933e9e8f4850fdac25aa88ad7cf13f355e20c03f6cfd9cd5b9b37cc5 WatchSource:0}: Error finding container dfcee6f7933e9e8f4850fdac25aa88ad7cf13f355e20c03f6cfd9cd5b9b37cc5: Status 404 returned error can't find the container with id dfcee6f7933e9e8f4850fdac25aa88ad7cf13f355e20c03f6cfd9cd5b9b37cc5 May 29 17:06:58.806740 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.806723 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 17:06:58.823832 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.823803 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6c7b68fff6-kqp9f" May 29 17:06:58.948029 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:58.947989 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6c7b68fff6-kqp9f"] May 29 17:06:58.948955 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:06:58.948928 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b3a63f9_2a67_419d_afbb_63970474736e.slice/crio-190320031be2fcb426bf93a3bb5d27d19146cb7d7aefbc44d2cb26a9116eb956 WatchSource:0}: Error finding container 190320031be2fcb426bf93a3bb5d27d19146cb7d7aefbc44d2cb26a9116eb956: Status 404 returned error can't find the container with id 190320031be2fcb426bf93a3bb5d27d19146cb7d7aefbc44d2cb26a9116eb956 May 29 17:06:59.539977 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:59.539937 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6c7b68fff6-kqp9f" event={"ID":"3b3a63f9-2a67-419d-afbb-63970474736e","Type":"ContainerStarted","Data":"190320031be2fcb426bf93a3bb5d27d19146cb7d7aefbc44d2cb26a9116eb956"} May 29 17:06:59.541105 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:06:59.541077 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-4jd86" event={"ID":"871abee6-4e4c-4edb-83cd-96a08419c4f6","Type":"ContainerStarted","Data":"dfcee6f7933e9e8f4850fdac25aa88ad7cf13f355e20c03f6cfd9cd5b9b37cc5"} May 29 17:07:02.553978 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:02.553938 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6c7b68fff6-kqp9f" event={"ID":"3b3a63f9-2a67-419d-afbb-63970474736e","Type":"ContainerStarted","Data":"8553c81d156df50bb51e5704aa2af58c84fa521c9511763aa58fb0b40fb31c0d"} May 29 17:07:02.554456 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:02.554066 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6c7b68fff6-kqp9f" May 29 17:07:02.555232 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:02.555212 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-4jd86" event={"ID":"871abee6-4e4c-4edb-83cd-96a08419c4f6","Type":"ContainerStarted","Data":"80c9db0ef8d882be24344ae3356b9035e9e22ad50f8dff2a34b0c26ecc697c95"} May 29 17:07:02.555379 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:02.555368 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-4jd86" May 29 17:07:02.571617 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:02.571579 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6c7b68fff6-kqp9f" podStartSLOduration=2.676614015 podStartE2EDuration="5.571568102s" podCreationTimestamp="2026-05-29 17:06:57 +0000 UTC" firstStartedPulling="2026-05-29 17:06:58.950196387 +0000 UTC m=+616.980665373" lastFinishedPulling="2026-05-29 17:07:01.845150474 +0000 UTC m=+619.875619460" observedRunningTime="2026-05-29 17:07:02.570180207 +0000 UTC m=+620.600649215" watchObservedRunningTime="2026-05-29 17:07:02.571568102 +0000 UTC m=+620.602037110" May 29 17:07:02.586738 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:02.586700 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-4jd86" podStartSLOduration=1.496442876 podStartE2EDuration="4.586673881s" podCreationTimestamp="2026-05-29 17:06:58 +0000 UTC" firstStartedPulling="2026-05-29 17:06:58.806862382 +0000 UTC m=+616.837331371" lastFinishedPulling="2026-05-29 17:07:01.897093389 +0000 UTC m=+619.927562376" observedRunningTime="2026-05-29 17:07:02.58585257 +0000 UTC m=+620.616321579" watchObservedRunningTime="2026-05-29 17:07:02.586673881 +0000 UTC m=+620.617142889" May 29 17:07:08.564376 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:08.564350 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6c7b68fff6-kqp9f" May 29 17:07:10.569611 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:10.569582 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 17:07:10.570038 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:10.569830 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" containerID="cri-o://e2b09767e3535ae23e3a48192f85db46e9d814f95f6f9886e597ca9f977be792" gracePeriod=30 May 29 17:07:12.114709 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.114673 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 29 17:07:12.152952 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.152926 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqmhn\" (UniqueName: \"kubernetes.io/projected/7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3-kube-api-access-qqmhn\") pod \"7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3\" (UID: \"7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3\") " May 29 17:07:12.155146 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.155110 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3-kube-api-access-qqmhn" (OuterVolumeSpecName: "kube-api-access-qqmhn") pod "7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" (UID: "7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3"). InnerVolumeSpecName "kube-api-access-qqmhn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 17:07:12.253960 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.253885 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqmhn\" (UniqueName: \"kubernetes.io/projected/7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3-kube-api-access-qqmhn\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 17:07:12.591265 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.591230 2561 generic.go:358] "Generic (PLEG): container finished" podID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerID="e2b09767e3535ae23e3a48192f85db46e9d814f95f6f9886e597ca9f977be792" exitCode=143 May 29 17:07:12.591463 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.591297 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 29 17:07:12.591463 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.591318 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3","Type":"ContainerDied","Data":"e2b09767e3535ae23e3a48192f85db46e9d814f95f6f9886e597ca9f977be792"} May 29 17:07:12.591463 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.591356 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3","Type":"ContainerDied","Data":"b8b24113df31467a654960bb51b9bff13ab3639296a017f53f1d025be2e3fd2a"} May 29 17:07:12.591463 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.591371 2561 scope.go:117] "RemoveContainer" containerID="e2b09767e3535ae23e3a48192f85db46e9d814f95f6f9886e597ca9f977be792" May 29 17:07:12.600639 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.600622 2561 scope.go:117] "RemoveContainer" containerID="e2b09767e3535ae23e3a48192f85db46e9d814f95f6f9886e597ca9f977be792" May 29 17:07:12.600891 ip-10-0-137-133 kubenswrapper[2561]: E0529 17:07:12.600868 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2b09767e3535ae23e3a48192f85db46e9d814f95f6f9886e597ca9f977be792\": container with ID starting with e2b09767e3535ae23e3a48192f85db46e9d814f95f6f9886e597ca9f977be792 not found: ID does not exist" containerID="e2b09767e3535ae23e3a48192f85db46e9d814f95f6f9886e597ca9f977be792" May 29 17:07:12.600950 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.600907 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2b09767e3535ae23e3a48192f85db46e9d814f95f6f9886e597ca9f977be792"} err="failed to get container status \"e2b09767e3535ae23e3a48192f85db46e9d814f95f6f9886e597ca9f977be792\": rpc error: code = NotFound desc = could not find container \"e2b09767e3535ae23e3a48192f85db46e9d814f95f6f9886e597ca9f977be792\": container with ID starting with e2b09767e3535ae23e3a48192f85db46e9d814f95f6f9886e597ca9f977be792 not found: ID does not exist" May 29 17:07:12.610053 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.610032 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 17:07:12.613624 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.613606 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 17:07:12.634185 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.634159 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 17:07:12.634514 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.634502 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" May 29 17:07:12.634564 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.634516 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" May 29 17:07:12.634599 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.634587 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" containerName="keycloak" May 29 17:07:12.639021 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.639008 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 29 17:07:12.641612 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.641594 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" May 29 17:07:12.641817 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.641801 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-8ft74\"" May 29 17:07:12.641912 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.641895 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" May 29 17:07:12.641978 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.641965 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" May 29 17:07:12.642027 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.642001 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" May 29 17:07:12.645274 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.645248 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 17:07:12.758274 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.758235 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/65e75bac-5919-4888-8848-99559ff86bc7-test-realms\") pod \"maas-keycloak-0\" (UID: \"65e75bac-5919-4888-8848-99559ff86bc7\") " pod="keycloak-system/maas-keycloak-0" May 29 17:07:12.758440 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.758344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5x27\" (UniqueName: \"kubernetes.io/projected/65e75bac-5919-4888-8848-99559ff86bc7-kube-api-access-c5x27\") pod \"maas-keycloak-0\" (UID: \"65e75bac-5919-4888-8848-99559ff86bc7\") " pod="keycloak-system/maas-keycloak-0" May 29 17:07:12.859520 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.859438 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/65e75bac-5919-4888-8848-99559ff86bc7-test-realms\") pod \"maas-keycloak-0\" (UID: \"65e75bac-5919-4888-8848-99559ff86bc7\") " pod="keycloak-system/maas-keycloak-0" May 29 17:07:12.859520 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.859516 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5x27\" (UniqueName: \"kubernetes.io/projected/65e75bac-5919-4888-8848-99559ff86bc7-kube-api-access-c5x27\") pod \"maas-keycloak-0\" (UID: \"65e75bac-5919-4888-8848-99559ff86bc7\") " pod="keycloak-system/maas-keycloak-0" May 29 17:07:12.860145 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.860126 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/65e75bac-5919-4888-8848-99559ff86bc7-test-realms\") pod \"maas-keycloak-0\" (UID: \"65e75bac-5919-4888-8848-99559ff86bc7\") " pod="keycloak-system/maas-keycloak-0" May 29 17:07:12.869652 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.869625 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5x27\" (UniqueName: \"kubernetes.io/projected/65e75bac-5919-4888-8848-99559ff86bc7-kube-api-access-c5x27\") pod \"maas-keycloak-0\" (UID: \"65e75bac-5919-4888-8848-99559ff86bc7\") " pod="keycloak-system/maas-keycloak-0" May 29 17:07:12.948639 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:12.948610 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 29 17:07:13.075820 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:13.075797 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 29 17:07:13.078133 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:07:13.078107 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e75bac_5919_4888_8848_99559ff86bc7.slice/crio-b016f4114ac8255c3b8b27bddf1521903a7974deec9d035d0821523296054982 WatchSource:0}: Error finding container b016f4114ac8255c3b8b27bddf1521903a7974deec9d035d0821523296054982: Status 404 returned error can't find the container with id b016f4114ac8255c3b8b27bddf1521903a7974deec9d035d0821523296054982 May 29 17:07:13.561582 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:13.561551 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-4jd86" May 29 17:07:13.598668 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:13.598634 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"65e75bac-5919-4888-8848-99559ff86bc7","Type":"ContainerStarted","Data":"56acec826bd945e475e93135d915f95bb87a3693c774cdcfe5ff97fb12a0ae68"} May 29 17:07:13.598668 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:13.598673 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"65e75bac-5919-4888-8848-99559ff86bc7","Type":"ContainerStarted","Data":"b016f4114ac8255c3b8b27bddf1521903a7974deec9d035d0821523296054982"} May 29 17:07:13.615565 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:13.615506 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.30673585 podStartE2EDuration="1.615491417s" podCreationTimestamp="2026-05-29 17:07:12 +0000 UTC" firstStartedPulling="2026-05-29 17:07:13.079901721 +0000 UTC m=+631.110370710" lastFinishedPulling="2026-05-29 17:07:13.388657292 +0000 UTC m=+631.419126277" observedRunningTime="2026-05-29 17:07:13.614855559 +0000 UTC m=+631.645324569" watchObservedRunningTime="2026-05-29 17:07:13.615491417 +0000 UTC m=+631.645960425" May 29 17:07:13.949722 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:13.949667 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" May 29 17:07:13.951003 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:13.950967 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="65e75bac-5919-4888-8848-99559ff86bc7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" May 29 17:07:14.427930 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:14.427895 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3" path="/var/lib/kubelet/pods/7d68e2a9-ff28-4ef7-a8e4-2cc01b1afdb3/volumes" May 29 17:07:14.949240 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:14.949194 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="65e75bac-5919-4888-8848-99559ff86bc7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" May 29 17:07:15.949159 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:15.949117 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="65e75bac-5919-4888-8848-99559ff86bc7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" May 29 17:07:16.949149 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:16.949097 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="65e75bac-5919-4888-8848-99559ff86bc7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" May 29 17:07:17.949652 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:17.949610 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="65e75bac-5919-4888-8848-99559ff86bc7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" May 29 17:07:18.949744 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:18.949675 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="65e75bac-5919-4888-8848-99559ff86bc7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" May 29 17:07:19.950138 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:19.950092 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="65e75bac-5919-4888-8848-99559ff86bc7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" May 29 17:07:20.949605 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:20.949551 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="65e75bac-5919-4888-8848-99559ff86bc7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" May 29 17:07:21.949603 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:21.949562 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="65e75bac-5919-4888-8848-99559ff86bc7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" May 29 17:07:22.948909 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:22.948863 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" May 29 17:07:22.949235 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:22.949202 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="65e75bac-5919-4888-8848-99559ff86bc7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" May 29 17:07:23.949958 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:23.949905 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="65e75bac-5919-4888-8848-99559ff86bc7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" May 29 17:07:24.949463 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:24.949410 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="65e75bac-5919-4888-8848-99559ff86bc7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" May 29 17:07:25.949651 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:25.949606 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="65e75bac-5919-4888-8848-99559ff86bc7" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" May 29 17:07:27.086058 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:27.085997 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" May 29 17:07:27.108100 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:27.108051 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="65e75bac-5919-4888-8848-99559ff86bc7" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 17:07:37.092075 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:07:37.092039 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" May 29 17:08:07.275485 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.275446 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb"] May 29 17:08:07.278384 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.278353 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.281628 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.281376 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 29 17:08:07.283135 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.283109 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7ck7w\"" May 29 17:08:07.283248 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.283142 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 29 17:08:07.283248 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.283147 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 29 17:08:07.290340 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.290314 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb"] May 29 17:08:07.336371 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.336338 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d41598a1-dca5-4533-862b-a75b85dcd497-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.336525 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.336396 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvw8l\" (UniqueName: \"kubernetes.io/projected/d41598a1-dca5-4533-862b-a75b85dcd497-kube-api-access-jvw8l\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.336525 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.336427 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d41598a1-dca5-4533-862b-a75b85dcd497-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.336525 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.336470 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d41598a1-dca5-4533-862b-a75b85dcd497-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.336525 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.336521 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d41598a1-dca5-4533-862b-a75b85dcd497-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.336712 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.336548 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d41598a1-dca5-4533-862b-a75b85dcd497-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.437215 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.437174 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d41598a1-dca5-4533-862b-a75b85dcd497-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.437402 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.437231 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d41598a1-dca5-4533-862b-a75b85dcd497-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.437402 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.437250 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d41598a1-dca5-4533-862b-a75b85dcd497-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.437402 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.437277 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d41598a1-dca5-4533-862b-a75b85dcd497-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.437402 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.437306 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvw8l\" (UniqueName: \"kubernetes.io/projected/d41598a1-dca5-4533-862b-a75b85dcd497-kube-api-access-jvw8l\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.437402 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.437336 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d41598a1-dca5-4533-862b-a75b85dcd497-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.437673 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.437624 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d41598a1-dca5-4533-862b-a75b85dcd497-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.437752 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.437667 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d41598a1-dca5-4533-862b-a75b85dcd497-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.437752 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.437734 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d41598a1-dca5-4533-862b-a75b85dcd497-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.439535 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.439517 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d41598a1-dca5-4533-862b-a75b85dcd497-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.439738 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.439721 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d41598a1-dca5-4533-862b-a75b85dcd497-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.445442 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.445412 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvw8l\" (UniqueName: \"kubernetes.io/projected/d41598a1-dca5-4533-862b-a75b85dcd497-kube-api-access-jvw8l\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb\" (UID: \"d41598a1-dca5-4533-862b-a75b85dcd497\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.590969 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.590934 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:07.722504 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.722479 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb"] May 29 17:08:07.724254 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:08:07.724217 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd41598a1_dca5_4533_862b_a75b85dcd497.slice/crio-f10a31a182cd3b95d00d2b76f8bee632e7bd7e59fe1d5669e04109d4cd69e8bf WatchSource:0}: Error finding container f10a31a182cd3b95d00d2b76f8bee632e7bd7e59fe1d5669e04109d4cd69e8bf: Status 404 returned error can't find the container with id f10a31a182cd3b95d00d2b76f8bee632e7bd7e59fe1d5669e04109d4cd69e8bf May 29 17:08:07.812196 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:07.812161 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" event={"ID":"d41598a1-dca5-4533-862b-a75b85dcd497","Type":"ContainerStarted","Data":"f10a31a182cd3b95d00d2b76f8bee632e7bd7e59fe1d5669e04109d4cd69e8bf"} May 29 17:08:12.832130 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:12.832093 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" event={"ID":"d41598a1-dca5-4533-862b-a75b85dcd497","Type":"ContainerStarted","Data":"b2a8ee9d1a7a5091bc4a1c850795cc7e25ed8e1d47b53af58ad375c9336dd3d4"} May 29 17:08:13.836483 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:13.836448 2561 generic.go:358] "Generic (PLEG): container finished" podID="d41598a1-dca5-4533-862b-a75b85dcd497" containerID="b2a8ee9d1a7a5091bc4a1c850795cc7e25ed8e1d47b53af58ad375c9336dd3d4" exitCode=0 May 29 17:08:13.836875 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:13.836537 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" event={"ID":"d41598a1-dca5-4533-862b-a75b85dcd497","Type":"ContainerDied","Data":"b2a8ee9d1a7a5091bc4a1c850795cc7e25ed8e1d47b53af58ad375c9336dd3d4"} May 29 17:08:15.845816 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:15.845777 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" event={"ID":"d41598a1-dca5-4533-862b-a75b85dcd497","Type":"ContainerStarted","Data":"bc4b3eb3eb38ff0312f04d45086705476db60526e373cdcb376dc5ce6cb44723"} May 29 17:08:15.864906 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:15.864813 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" podStartSLOduration=0.990230324 podStartE2EDuration="8.864800666s" podCreationTimestamp="2026-05-29 17:08:07 +0000 UTC" firstStartedPulling="2026-05-29 17:08:07.726406898 +0000 UTC m=+685.756875884" lastFinishedPulling="2026-05-29 17:08:15.600977232 +0000 UTC m=+693.631446226" observedRunningTime="2026-05-29 17:08:15.862934543 +0000 UTC m=+693.893403572" watchObservedRunningTime="2026-05-29 17:08:15.864800666 +0000 UTC m=+693.895269673" May 29 17:08:17.591593 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:17.591555 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:17.592009 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:17.591606 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:17.605228 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:17.605200 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:17.864940 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:17.864857 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb" May 29 17:08:31.200839 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.200752 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg"] May 29 17:08:31.203726 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.203707 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.206890 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.206866 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 29 17:08:31.214860 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.214827 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg"] May 29 17:08:31.355048 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.355017 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e91eb02-2b38-4e60-8509-8d5afe295672-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.355228 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.355077 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e91eb02-2b38-4e60-8509-8d5afe295672-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.355228 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.355110 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7t4m\" (UniqueName: \"kubernetes.io/projected/3e91eb02-2b38-4e60-8509-8d5afe295672-kube-api-access-q7t4m\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.355228 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.355133 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3e91eb02-2b38-4e60-8509-8d5afe295672-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.355228 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.355152 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e91eb02-2b38-4e60-8509-8d5afe295672-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.355228 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.355187 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e91eb02-2b38-4e60-8509-8d5afe295672-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.455708 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.455590 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e91eb02-2b38-4e60-8509-8d5afe295672-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.455708 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.455650 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7t4m\" (UniqueName: \"kubernetes.io/projected/3e91eb02-2b38-4e60-8509-8d5afe295672-kube-api-access-q7t4m\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.455708 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.455678 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3e91eb02-2b38-4e60-8509-8d5afe295672-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.456001 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.455730 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e91eb02-2b38-4e60-8509-8d5afe295672-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.456001 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.455770 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e91eb02-2b38-4e60-8509-8d5afe295672-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.456001 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.455907 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e91eb02-2b38-4e60-8509-8d5afe295672-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.456176 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.456072 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e91eb02-2b38-4e60-8509-8d5afe295672-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.456176 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.456097 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3e91eb02-2b38-4e60-8509-8d5afe295672-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.456326 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.456308 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e91eb02-2b38-4e60-8509-8d5afe295672-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.458066 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.458048 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e91eb02-2b38-4e60-8509-8d5afe295672-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.458397 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.458381 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e91eb02-2b38-4e60-8509-8d5afe295672-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.464090 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.464064 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7t4m\" (UniqueName: \"kubernetes.io/projected/3e91eb02-2b38-4e60-8509-8d5afe295672-kube-api-access-q7t4m\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-rgssg\" (UID: \"3e91eb02-2b38-4e60-8509-8d5afe295672\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.517052 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.517019 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:31.651642 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.651614 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg"] May 29 17:08:31.653859 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:08:31.653831 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e91eb02_2b38_4e60_8509_8d5afe295672.slice/crio-00581280da93b1a5f91cb2822cdfd7132b3e63457c01982bfb56c9e521a3684e WatchSource:0}: Error finding container 00581280da93b1a5f91cb2822cdfd7132b3e63457c01982bfb56c9e521a3684e: Status 404 returned error can't find the container with id 00581280da93b1a5f91cb2822cdfd7132b3e63457c01982bfb56c9e521a3684e May 29 17:08:31.904462 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.904427 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" event={"ID":"3e91eb02-2b38-4e60-8509-8d5afe295672","Type":"ContainerStarted","Data":"c04acffcebe6290cd744f54948190b117e47ff7eda281473361763cd5443d040"} May 29 17:08:31.904462 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:31.904468 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" event={"ID":"3e91eb02-2b38-4e60-8509-8d5afe295672","Type":"ContainerStarted","Data":"00581280da93b1a5f91cb2822cdfd7132b3e63457c01982bfb56c9e521a3684e"} May 29 17:08:33.913604 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:33.913563 2561 generic.go:358] "Generic (PLEG): container finished" podID="3e91eb02-2b38-4e60-8509-8d5afe295672" containerID="c04acffcebe6290cd744f54948190b117e47ff7eda281473361763cd5443d040" exitCode=0 May 29 17:08:33.914007 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:33.913646 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" event={"ID":"3e91eb02-2b38-4e60-8509-8d5afe295672","Type":"ContainerDied","Data":"c04acffcebe6290cd744f54948190b117e47ff7eda281473361763cd5443d040"} May 29 17:08:34.918337 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:34.918305 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" event={"ID":"3e91eb02-2b38-4e60-8509-8d5afe295672","Type":"ContainerStarted","Data":"9ddbdd08a506dd8984ada34683b2ec1907640e9a5762366e646935b59ebe1a80"} May 29 17:08:34.938498 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:34.938437 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" podStartSLOduration=3.680586302 podStartE2EDuration="3.938419189s" podCreationTimestamp="2026-05-29 17:08:31 +0000 UTC" firstStartedPulling="2026-05-29 17:08:33.914495217 +0000 UTC m=+711.944964217" lastFinishedPulling="2026-05-29 17:08:34.172328116 +0000 UTC m=+712.202797104" observedRunningTime="2026-05-29 17:08:34.935329879 +0000 UTC m=+712.965798882" watchObservedRunningTime="2026-05-29 17:08:34.938419189 +0000 UTC m=+712.968888198" May 29 17:08:37.692197 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.692139 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p"] May 29 17:08:37.694769 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.694744 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.697831 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.697811 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 29 17:08:37.703316 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.703296 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p"] May 29 17:08:37.813182 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.813140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63bae881-fb0a-4b40-8c7d-69e5e00d5418-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.813182 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.813188 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsqzf\" (UniqueName: \"kubernetes.io/projected/63bae881-fb0a-4b40-8c7d-69e5e00d5418-kube-api-access-wsqzf\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.813427 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.813290 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63bae881-fb0a-4b40-8c7d-69e5e00d5418-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.813427 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.813394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63bae881-fb0a-4b40-8c7d-69e5e00d5418-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.813427 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.813421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63bae881-fb0a-4b40-8c7d-69e5e00d5418-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.813551 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.813440 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63bae881-fb0a-4b40-8c7d-69e5e00d5418-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.915020 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.914974 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63bae881-fb0a-4b40-8c7d-69e5e00d5418-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.915210 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.915037 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63bae881-fb0a-4b40-8c7d-69e5e00d5418-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.915210 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.915068 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63bae881-fb0a-4b40-8c7d-69e5e00d5418-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.915210 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.915109 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63bae881-fb0a-4b40-8c7d-69e5e00d5418-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.915210 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.915152 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsqzf\" (UniqueName: \"kubernetes.io/projected/63bae881-fb0a-4b40-8c7d-69e5e00d5418-kube-api-access-wsqzf\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.915423 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.915223 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63bae881-fb0a-4b40-8c7d-69e5e00d5418-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.915654 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.915618 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63bae881-fb0a-4b40-8c7d-69e5e00d5418-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.915827 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.915754 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63bae881-fb0a-4b40-8c7d-69e5e00d5418-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.916037 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.916014 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63bae881-fb0a-4b40-8c7d-69e5e00d5418-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.917642 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.917618 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63bae881-fb0a-4b40-8c7d-69e5e00d5418-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.918424 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.918402 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63bae881-fb0a-4b40-8c7d-69e5e00d5418-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:37.923389 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:37.923368 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsqzf\" (UniqueName: \"kubernetes.io/projected/63bae881-fb0a-4b40-8c7d-69e5e00d5418-kube-api-access-wsqzf\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p\" (UID: \"63bae881-fb0a-4b40-8c7d-69e5e00d5418\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:38.006066 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:38.005979 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:38.136212 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:38.136185 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p"] May 29 17:08:38.138147 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:08:38.138116 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63bae881_fb0a_4b40_8c7d_69e5e00d5418.slice/crio-15c1062c7db9fa4625cdb2f5ba15c6d7f833e75ed386c52faf1409061b0b8416 WatchSource:0}: Error finding container 15c1062c7db9fa4625cdb2f5ba15c6d7f833e75ed386c52faf1409061b0b8416: Status 404 returned error can't find the container with id 15c1062c7db9fa4625cdb2f5ba15c6d7f833e75ed386c52faf1409061b0b8416 May 29 17:08:38.933673 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:38.933633 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" event={"ID":"63bae881-fb0a-4b40-8c7d-69e5e00d5418","Type":"ContainerStarted","Data":"b1b1a3172f4510b186d17c0d05bdea711266900a000ae9d1cf87edb4051e7128"} May 29 17:08:38.933673 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:38.933672 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" event={"ID":"63bae881-fb0a-4b40-8c7d-69e5e00d5418","Type":"ContainerStarted","Data":"15c1062c7db9fa4625cdb2f5ba15c6d7f833e75ed386c52faf1409061b0b8416"} May 29 17:08:39.941301 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:39.941262 2561 generic.go:358] "Generic (PLEG): container finished" podID="63bae881-fb0a-4b40-8c7d-69e5e00d5418" containerID="b1b1a3172f4510b186d17c0d05bdea711266900a000ae9d1cf87edb4051e7128" exitCode=0 May 29 17:08:39.941764 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:39.941341 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" event={"ID":"63bae881-fb0a-4b40-8c7d-69e5e00d5418","Type":"ContainerDied","Data":"b1b1a3172f4510b186d17c0d05bdea711266900a000ae9d1cf87edb4051e7128"} May 29 17:08:40.945640 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:40.945605 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" event={"ID":"63bae881-fb0a-4b40-8c7d-69e5e00d5418","Type":"ContainerStarted","Data":"b3a408ab8f592b460eec6ad4114b9708d082971ba6abae8298a378fcf752be64"} May 29 17:08:40.965307 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:40.965261 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" podStartSLOduration=3.614249803 podStartE2EDuration="3.965248595s" podCreationTimestamp="2026-05-29 17:08:37 +0000 UTC" firstStartedPulling="2026-05-29 17:08:39.941858262 +0000 UTC m=+717.972327249" lastFinishedPulling="2026-05-29 17:08:40.292857055 +0000 UTC m=+718.323326041" observedRunningTime="2026-05-29 17:08:40.96334925 +0000 UTC m=+718.993818294" watchObservedRunningTime="2026-05-29 17:08:40.965248595 +0000 UTC m=+718.995717602" May 29 17:08:41.517366 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:41.517334 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:41.517572 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:41.517392 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:41.530003 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:41.529978 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:41.961328 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:41.961301 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-rgssg" May 29 17:08:48.006564 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:48.006524 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:48.007169 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:48.006575 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:48.019163 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:48.019139 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:08:48.987998 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:08:48.987967 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p" May 29 17:11:42.409025 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:42.408816 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:11:42.411640 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:42.411616 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:11:42.416909 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:42.416891 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:11:42.419355 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:42.419335 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:11:47.264404 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.264366 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c66df4598-hx2j4"] May 29 17:11:47.264859 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.264700 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5c66df4598-hx2j4" podUID="1d54b97c-496b-4c07-beae-e2bd5e8ddb01" containerName="manager" containerID="cri-o://c052aec039c42ee6012ec149c9fb848e87302509709dc26f8eb51814d8882cf6" gracePeriod=30 May 29 17:11:47.517998 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.517927 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66df4598-hx2j4" May 29 17:11:47.592181 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.592153 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rchk\" (UniqueName: \"kubernetes.io/projected/1d54b97c-496b-4c07-beae-e2bd5e8ddb01-kube-api-access-2rchk\") pod \"1d54b97c-496b-4c07-beae-e2bd5e8ddb01\" (UID: \"1d54b97c-496b-4c07-beae-e2bd5e8ddb01\") " May 29 17:11:47.594190 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.594162 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d54b97c-496b-4c07-beae-e2bd5e8ddb01-kube-api-access-2rchk" (OuterVolumeSpecName: "kube-api-access-2rchk") pod "1d54b97c-496b-4c07-beae-e2bd5e8ddb01" (UID: "1d54b97c-496b-4c07-beae-e2bd5e8ddb01"). InnerVolumeSpecName "kube-api-access-2rchk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 17:11:47.613305 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.613277 2561 generic.go:358] "Generic (PLEG): container finished" podID="1d54b97c-496b-4c07-beae-e2bd5e8ddb01" containerID="c052aec039c42ee6012ec149c9fb848e87302509709dc26f8eb51814d8882cf6" exitCode=0 May 29 17:11:47.613428 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.613343 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66df4598-hx2j4" May 29 17:11:47.613428 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.613358 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66df4598-hx2j4" event={"ID":"1d54b97c-496b-4c07-beae-e2bd5e8ddb01","Type":"ContainerDied","Data":"c052aec039c42ee6012ec149c9fb848e87302509709dc26f8eb51814d8882cf6"} May 29 17:11:47.613428 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.613401 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66df4598-hx2j4" event={"ID":"1d54b97c-496b-4c07-beae-e2bd5e8ddb01","Type":"ContainerDied","Data":"a85244edecba974bd99c15b9a8e30edc3279fca074450cbb0bab3f9b15cd16c3"} May 29 17:11:47.613428 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.613418 2561 scope.go:117] "RemoveContainer" containerID="c052aec039c42ee6012ec149c9fb848e87302509709dc26f8eb51814d8882cf6" May 29 17:11:47.621947 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.621794 2561 scope.go:117] "RemoveContainer" containerID="c052aec039c42ee6012ec149c9fb848e87302509709dc26f8eb51814d8882cf6" May 29 17:11:47.622145 ip-10-0-137-133 kubenswrapper[2561]: E0529 17:11:47.622113 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c052aec039c42ee6012ec149c9fb848e87302509709dc26f8eb51814d8882cf6\": container with ID starting with c052aec039c42ee6012ec149c9fb848e87302509709dc26f8eb51814d8882cf6 not found: ID does not exist" containerID="c052aec039c42ee6012ec149c9fb848e87302509709dc26f8eb51814d8882cf6" May 29 17:11:47.622237 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.622155 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c052aec039c42ee6012ec149c9fb848e87302509709dc26f8eb51814d8882cf6"} err="failed to get container status \"c052aec039c42ee6012ec149c9fb848e87302509709dc26f8eb51814d8882cf6\": rpc error: code = NotFound desc = could not find container \"c052aec039c42ee6012ec149c9fb848e87302509709dc26f8eb51814d8882cf6\": container with ID starting with c052aec039c42ee6012ec149c9fb848e87302509709dc26f8eb51814d8882cf6 not found: ID does not exist" May 29 17:11:47.635335 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.635316 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c66df4598-hx2j4"] May 29 17:11:47.639771 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.639750 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c66df4598-hx2j4"] May 29 17:11:47.693129 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:47.693107 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rchk\" (UniqueName: \"kubernetes.io/projected/1d54b97c-496b-4c07-beae-e2bd5e8ddb01-kube-api-access-2rchk\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 17:11:48.392272 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:48.392230 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c66df4598-85bf2"] May 29 17:11:48.392829 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:48.392810 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d54b97c-496b-4c07-beae-e2bd5e8ddb01" containerName="manager" May 29 17:11:48.392920 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:48.392831 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d54b97c-496b-4c07-beae-e2bd5e8ddb01" containerName="manager" May 29 17:11:48.392974 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:48.392935 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="1d54b97c-496b-4c07-beae-e2bd5e8ddb01" containerName="manager" May 29 17:11:48.396973 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:48.396952 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66df4598-85bf2" May 29 17:11:48.399909 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:48.399889 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 29 17:11:48.401371 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:48.401352 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qxrw7\"" May 29 17:11:48.403593 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:48.403571 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c66df4598-85bf2"] May 29 17:11:48.426264 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:48.426233 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d54b97c-496b-4c07-beae-e2bd5e8ddb01" path="/var/lib/kubelet/pods/1d54b97c-496b-4c07-beae-e2bd5e8ddb01/volumes" May 29 17:11:48.501035 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:48.501004 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4nt2\" (UniqueName: \"kubernetes.io/projected/6c7360ac-f79b-4c73-8602-4c763334ff64-kube-api-access-d4nt2\") pod \"maas-controller-5c66df4598-85bf2\" (UID: \"6c7360ac-f79b-4c73-8602-4c763334ff64\") " pod="opendatahub/maas-controller-5c66df4598-85bf2" May 29 17:11:48.601929 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:48.601895 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4nt2\" (UniqueName: \"kubernetes.io/projected/6c7360ac-f79b-4c73-8602-4c763334ff64-kube-api-access-d4nt2\") pod \"maas-controller-5c66df4598-85bf2\" (UID: \"6c7360ac-f79b-4c73-8602-4c763334ff64\") " pod="opendatahub/maas-controller-5c66df4598-85bf2" May 29 17:11:48.616638 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:48.616614 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4nt2\" (UniqueName: \"kubernetes.io/projected/6c7360ac-f79b-4c73-8602-4c763334ff64-kube-api-access-d4nt2\") pod \"maas-controller-5c66df4598-85bf2\" (UID: \"6c7360ac-f79b-4c73-8602-4c763334ff64\") " pod="opendatahub/maas-controller-5c66df4598-85bf2" May 29 17:11:48.708843 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:48.708775 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66df4598-85bf2" May 29 17:11:48.834803 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:48.834775 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c66df4598-85bf2"] May 29 17:11:48.836882 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:11:48.836857 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7360ac_f79b_4c73_8602_4c763334ff64.slice/crio-5b8a37515264232402aa2c0028d78566fbcc2a5d889ac9e467fd144b5ae1250d WatchSource:0}: Error finding container 5b8a37515264232402aa2c0028d78566fbcc2a5d889ac9e467fd144b5ae1250d: Status 404 returned error can't find the container with id 5b8a37515264232402aa2c0028d78566fbcc2a5d889ac9e467fd144b5ae1250d May 29 17:11:49.622019 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:49.621941 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66df4598-85bf2" event={"ID":"6c7360ac-f79b-4c73-8602-4c763334ff64","Type":"ContainerStarted","Data":"39c57aa5b161ebfd944ac5d772edabced72a3ea45efc5ceccf2f99a037166c3f"} May 29 17:11:49.622019 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:49.621975 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66df4598-85bf2" event={"ID":"6c7360ac-f79b-4c73-8602-4c763334ff64","Type":"ContainerStarted","Data":"5b8a37515264232402aa2c0028d78566fbcc2a5d889ac9e467fd144b5ae1250d"} May 29 17:11:49.622434 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:49.622078 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c66df4598-85bf2" May 29 17:11:49.639443 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:11:49.639382 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5c66df4598-85bf2" podStartSLOduration=1.132116334 podStartE2EDuration="1.639368676s" podCreationTimestamp="2026-05-29 17:11:48 +0000 UTC" firstStartedPulling="2026-05-29 17:11:48.83822756 +0000 UTC m=+906.868696546" lastFinishedPulling="2026-05-29 17:11:49.345479898 +0000 UTC m=+907.375948888" observedRunningTime="2026-05-29 17:11:49.637375317 +0000 UTC m=+907.667844327" watchObservedRunningTime="2026-05-29 17:11:49.639368676 +0000 UTC m=+907.669837743" May 29 17:12:00.631339 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:12:00.631299 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c66df4598-85bf2" May 29 17:16:42.435263 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:16:42.435237 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:16:42.442282 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:16:42.442264 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:16:42.442453 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:16:42.442440 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:16:42.449128 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:16:42.449111 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:21:42.463834 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:21:42.463795 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:21:42.470451 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:21:42.470428 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:21:42.471411 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:21:42.471389 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:21:42.477097 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:21:42.477080 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:22:15.466735 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:15.466627 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm"] May 29 17:22:15.467228 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:15.466878 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" podUID="37740036-f5bb-413e-92ba-84c3d0b6e992" containerName="manager" containerID="cri-o://19a49a654ca7b314ec4e695efd796a234d66cf7a4967d5b5436b4047a444c17b" gracePeriod=10 May 29 17:22:16.220256 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.220233 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" May 29 17:22:16.254276 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.254250 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h289v\" (UniqueName: \"kubernetes.io/projected/37740036-f5bb-413e-92ba-84c3d0b6e992-kube-api-access-h289v\") pod \"37740036-f5bb-413e-92ba-84c3d0b6e992\" (UID: \"37740036-f5bb-413e-92ba-84c3d0b6e992\") " May 29 17:22:16.254434 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.254318 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37740036-f5bb-413e-92ba-84c3d0b6e992-extensions-socket-volume\") pod \"37740036-f5bb-413e-92ba-84c3d0b6e992\" (UID: \"37740036-f5bb-413e-92ba-84c3d0b6e992\") " May 29 17:22:16.254828 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.254800 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37740036-f5bb-413e-92ba-84c3d0b6e992-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "37740036-f5bb-413e-92ba-84c3d0b6e992" (UID: "37740036-f5bb-413e-92ba-84c3d0b6e992"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 17:22:16.256441 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.256417 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37740036-f5bb-413e-92ba-84c3d0b6e992-kube-api-access-h289v" (OuterVolumeSpecName: "kube-api-access-h289v") pod "37740036-f5bb-413e-92ba-84c3d0b6e992" (UID: "37740036-f5bb-413e-92ba-84c3d0b6e992"). InnerVolumeSpecName "kube-api-access-h289v". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 17:22:16.355441 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.355408 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h289v\" (UniqueName: \"kubernetes.io/projected/37740036-f5bb-413e-92ba-84c3d0b6e992-kube-api-access-h289v\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 17:22:16.355441 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.355437 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37740036-f5bb-413e-92ba-84c3d0b6e992-extensions-socket-volume\") on node \"ip-10-0-137-133.ec2.internal\" DevicePath \"\"" May 29 17:22:16.838987 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.838951 2561 generic.go:358] "Generic (PLEG): container finished" podID="37740036-f5bb-413e-92ba-84c3d0b6e992" containerID="19a49a654ca7b314ec4e695efd796a234d66cf7a4967d5b5436b4047a444c17b" exitCode=0 May 29 17:22:16.839389 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.839010 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" May 29 17:22:16.839389 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.839025 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" event={"ID":"37740036-f5bb-413e-92ba-84c3d0b6e992","Type":"ContainerDied","Data":"19a49a654ca7b314ec4e695efd796a234d66cf7a4967d5b5436b4047a444c17b"} May 29 17:22:16.839389 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.839063 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm" event={"ID":"37740036-f5bb-413e-92ba-84c3d0b6e992","Type":"ContainerDied","Data":"deae45f053c2a6ba63233a49c3c53e3b1e23caff7e22aec3357ff1981dca4b4e"} May 29 17:22:16.839389 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.839083 2561 scope.go:117] "RemoveContainer" containerID="19a49a654ca7b314ec4e695efd796a234d66cf7a4967d5b5436b4047a444c17b" May 29 17:22:16.848143 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.848126 2561 scope.go:117] "RemoveContainer" containerID="19a49a654ca7b314ec4e695efd796a234d66cf7a4967d5b5436b4047a444c17b" May 29 17:22:16.848427 ip-10-0-137-133 kubenswrapper[2561]: E0529 17:22:16.848407 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19a49a654ca7b314ec4e695efd796a234d66cf7a4967d5b5436b4047a444c17b\": container with ID starting with 19a49a654ca7b314ec4e695efd796a234d66cf7a4967d5b5436b4047a444c17b not found: ID does not exist" containerID="19a49a654ca7b314ec4e695efd796a234d66cf7a4967d5b5436b4047a444c17b" May 29 17:22:16.848473 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.848436 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19a49a654ca7b314ec4e695efd796a234d66cf7a4967d5b5436b4047a444c17b"} err="failed to get container status \"19a49a654ca7b314ec4e695efd796a234d66cf7a4967d5b5436b4047a444c17b\": rpc error: code = NotFound desc = could not find container \"19a49a654ca7b314ec4e695efd796a234d66cf7a4967d5b5436b4047a444c17b\": container with ID starting with 19a49a654ca7b314ec4e695efd796a234d66cf7a4967d5b5436b4047a444c17b not found: ID does not exist" May 29 17:22:16.859260 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.859238 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm"] May 29 17:22:16.862736 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:16.862715 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c5hcm"] May 29 17:22:18.424778 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:22:18.424747 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37740036-f5bb-413e-92ba-84c3d0b6e992" path="/var/lib/kubelet/pods/37740036-f5bb-413e-92ba-84c3d0b6e992/volumes" May 29 17:23:21.677404 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:21.677369 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5"] May 29 17:23:21.677891 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:21.677747 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37740036-f5bb-413e-92ba-84c3d0b6e992" containerName="manager" May 29 17:23:21.677891 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:21.677758 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="37740036-f5bb-413e-92ba-84c3d0b6e992" containerName="manager" May 29 17:23:21.677891 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:21.677829 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="37740036-f5bb-413e-92ba-84c3d0b6e992" containerName="manager" May 29 17:23:21.680834 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:21.680818 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5" May 29 17:23:21.684031 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:21.684011 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-djg7n\"" May 29 17:23:21.692964 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:21.692942 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5"] May 29 17:23:21.801093 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:21.801069 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c950bf3c-9f25-4e27-83b6-3d3d1b62a04d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kpsw5\" (UID: \"c950bf3c-9f25-4e27-83b6-3d3d1b62a04d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5" May 29 17:23:21.801224 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:21.801114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnkjf\" (UniqueName: \"kubernetes.io/projected/c950bf3c-9f25-4e27-83b6-3d3d1b62a04d-kube-api-access-pnkjf\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kpsw5\" (UID: \"c950bf3c-9f25-4e27-83b6-3d3d1b62a04d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5" May 29 17:23:21.902378 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:21.902347 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c950bf3c-9f25-4e27-83b6-3d3d1b62a04d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kpsw5\" (UID: \"c950bf3c-9f25-4e27-83b6-3d3d1b62a04d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5" May 29 17:23:21.902503 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:21.902395 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnkjf\" (UniqueName: \"kubernetes.io/projected/c950bf3c-9f25-4e27-83b6-3d3d1b62a04d-kube-api-access-pnkjf\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kpsw5\" (UID: \"c950bf3c-9f25-4e27-83b6-3d3d1b62a04d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5" May 29 17:23:21.902741 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:21.902720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c950bf3c-9f25-4e27-83b6-3d3d1b62a04d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kpsw5\" (UID: \"c950bf3c-9f25-4e27-83b6-3d3d1b62a04d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5" May 29 17:23:21.913518 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:21.913495 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnkjf\" (UniqueName: \"kubernetes.io/projected/c950bf3c-9f25-4e27-83b6-3d3d1b62a04d-kube-api-access-pnkjf\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kpsw5\" (UID: \"c950bf3c-9f25-4e27-83b6-3d3d1b62a04d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5" May 29 17:23:21.991573 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:21.991513 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5" May 29 17:23:22.124206 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:22.124160 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5"] May 29 17:23:22.126673 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:23:22.126643 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc950bf3c_9f25_4e27_83b6_3d3d1b62a04d.slice/crio-f9973a561baed2e63f4c88cba4294a715bedb5c0fb5e699b688e76a29148eba3 WatchSource:0}: Error finding container f9973a561baed2e63f4c88cba4294a715bedb5c0fb5e699b688e76a29148eba3: Status 404 returned error can't find the container with id f9973a561baed2e63f4c88cba4294a715bedb5c0fb5e699b688e76a29148eba3 May 29 17:23:22.129135 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:22.129113 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 17:23:23.070798 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:23.070762 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5" event={"ID":"c950bf3c-9f25-4e27-83b6-3d3d1b62a04d","Type":"ContainerStarted","Data":"0100ae1515455c847e0e011c2006854e6400862b275ac30de8b5736e30c7a3ef"} May 29 17:23:23.070798 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:23.070800 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5" event={"ID":"c950bf3c-9f25-4e27-83b6-3d3d1b62a04d","Type":"ContainerStarted","Data":"f9973a561baed2e63f4c88cba4294a715bedb5c0fb5e699b688e76a29148eba3"} May 29 17:23:23.071248 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:23.070930 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5" May 29 17:23:23.095851 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:23.095789 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5" podStartSLOduration=2.095767667 podStartE2EDuration="2.095767667s" podCreationTimestamp="2026-05-29 17:23:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:23:23.093396241 +0000 UTC m=+1601.123865245" watchObservedRunningTime="2026-05-29 17:23:23.095767667 +0000 UTC m=+1601.126236679" May 29 17:23:34.076343 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:23:34.076308 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kpsw5" May 29 17:26:42.491940 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:26:42.491914 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:26:42.496848 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:26:42.496828 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:26:42.499429 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:26:42.499405 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:26:42.504353 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:26:42.504333 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:31:42.519495 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:31:42.519467 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:31:42.525344 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:31:42.525321 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:31:42.526838 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:31:42.526818 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:31:42.532678 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:31:42.532661 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:33:25.500914 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:25.500883 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-76cb944577-jg5lw_fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd/nginx/0.log" May 29 17:33:25.860608 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:25.860581 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6c7b68fff6-kqp9f_3b3a63f9-2a67-419d-afbb-63970474736e/maas-api/0.log" May 29 17:33:26.206212 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:26.206130 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c66df4598-85bf2_6c7360ac-f79b-4c73-8602-4c763334ff64/manager/0.log" May 29 17:33:26.320265 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:26.320237 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-9txnd_e539e4a0-0459-46e3-a460-71b764077d26/server/0.log" May 29 17:33:26.559995 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:26.559970 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598f575fbf-g7tzz_6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6/copy-manifests/0.log" May 29 17:33:26.566608 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:26.566589 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598f575fbf-g7tzz_6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6/manager/0.log" May 29 17:33:28.555790 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:28.555756 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-8mvbd_ad468d7f-4465-458f-b96e-cd89e09db92e/manager/0.log" May 29 17:33:28.931959 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:28.931878 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-kpsw5_c950bf3c-9f25-4e27-83b6-3d3d1b62a04d/manager/0.log" May 29 17:33:29.541005 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:29.540977 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl_1dbca7ac-967e-4264-adca-b115fae3942c/istio-proxy/0.log" May 29 17:33:30.012263 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:30.012177 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d44956ff5-hd48m_3f699578-8e86-4925-b5bf-7e4fe8b097bd/istio-proxy/0.log" May 29 17:33:30.136647 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:30.136600 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-4jd86_871abee6-4e4c-4edb-83cd-96a08419c4f6/payload-processing/0.log" May 29 17:33:30.253626 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:30.253573 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78d54b76f9-bx987_9e8b3057-a3bb-4e0c-9066-52577b25fcd4/router/0.log" May 29 17:33:30.626319 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:30.626292 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb_d41598a1-dca5-4533-862b-a75b85dcd497/storage-initializer/0.log" May 29 17:33:30.632277 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:30.632252 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-ksdrb_d41598a1-dca5-4533-862b-a75b85dcd497/main/0.log" May 29 17:33:30.751894 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:30.751860 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-rgssg_3e91eb02-2b38-4e60-8509-8d5afe295672/storage-initializer/0.log" May 29 17:33:30.758537 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:30.758515 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-rgssg_3e91eb02-2b38-4e60-8509-8d5afe295672/main/0.log" May 29 17:33:30.876231 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:30.876204 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p_63bae881-fb0a-4b40-8c7d-69e5e00d5418/storage-initializer/0.log" May 29 17:33:30.883275 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:30.883191 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-s4x6p_63bae881-fb0a-4b40-8c7d-69e5e00d5418/main/0.log" May 29 17:33:38.989550 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:38.989515 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t722m_0247042d-f2aa-4c79-90d0-2518f915a5f8/global-pull-secret-syncer/0.log" May 29 17:33:39.034096 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:39.034070 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7mfzc_23102591-f481-46c7-9a4a-ae10e3ab7f24/konnectivity-agent/0.log" May 29 17:33:39.122703 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:39.122658 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-133.ec2.internal_08ed79040e29d0c7963204127ead4896/haproxy/0.log" May 29 17:33:43.768465 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:43.768431 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-8mvbd_ad468d7f-4465-458f-b96e-cd89e09db92e/manager/0.log" May 29 17:33:43.883437 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:43.883402 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-kpsw5_c950bf3c-9f25-4e27-83b6-3d3d1b62a04d/manager/0.log" May 29 17:33:45.400363 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:45.400314 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-vbmm6_18d06c9c-d13c-4bd0-a23f-6ceffe36743e/cluster-monitoring-operator/0.log" May 29 17:33:45.742845 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:45.742758 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zqwrz_58af06c1-8482-4533-9ef2-3cd3423a41cb/node-exporter/0.log" May 29 17:33:45.760184 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:45.760157 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zqwrz_58af06c1-8482-4533-9ef2-3cd3423a41cb/kube-rbac-proxy/0.log" May 29 17:33:45.780234 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:45.780210 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zqwrz_58af06c1-8482-4533-9ef2-3cd3423a41cb/init-textfile/0.log" May 29 17:33:47.949264 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:47.949237 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/2.log" May 29 17:33:47.954259 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:47.954240 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-psmjn_f4dbc8b6-1456-49f4-9e34-e9036b732e46/console-operator/3.log" May 29 17:33:49.014830 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.014802 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-sv9hr_9266cdca-eb8b-4743-a2ef-194d70227971/volume-data-source-validator/0.log" May 29 17:33:49.638852 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.638811 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm"] May 29 17:33:49.642070 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.642050 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.644873 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.644847 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7r7t9\"/\"kube-root-ca.crt\"" May 29 17:33:49.646227 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.646208 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7r7t9\"/\"openshift-service-ca.crt\"" May 29 17:33:49.646302 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.646208 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7r7t9\"/\"default-dockercfg-52q9n\"" May 29 17:33:49.649945 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.649918 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm"] May 29 17:33:49.701646 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.701620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/462edde2-3c58-414c-a666-fb4a5d7a9275-lib-modules\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.701772 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.701657 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/462edde2-3c58-414c-a666-fb4a5d7a9275-podres\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.701772 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.701694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xndb\" (UniqueName: \"kubernetes.io/projected/462edde2-3c58-414c-a666-fb4a5d7a9275-kube-api-access-2xndb\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.701862 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.701784 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/462edde2-3c58-414c-a666-fb4a5d7a9275-sys\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.701901 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.701886 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/462edde2-3c58-414c-a666-fb4a5d7a9275-proc\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.802835 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.802799 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/462edde2-3c58-414c-a666-fb4a5d7a9275-proc\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.802997 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.802863 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/462edde2-3c58-414c-a666-fb4a5d7a9275-lib-modules\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.802997 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.802904 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/462edde2-3c58-414c-a666-fb4a5d7a9275-podres\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.802997 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.802926 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/462edde2-3c58-414c-a666-fb4a5d7a9275-proc\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.803162 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.803022 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/462edde2-3c58-414c-a666-fb4a5d7a9275-podres\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.803162 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.803037 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/462edde2-3c58-414c-a666-fb4a5d7a9275-lib-modules\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.803162 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.803042 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xndb\" (UniqueName: \"kubernetes.io/projected/462edde2-3c58-414c-a666-fb4a5d7a9275-kube-api-access-2xndb\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.803162 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.803095 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/462edde2-3c58-414c-a666-fb4a5d7a9275-sys\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.803369 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.803174 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/462edde2-3c58-414c-a666-fb4a5d7a9275-sys\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.811183 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.811159 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xndb\" (UniqueName: \"kubernetes.io/projected/462edde2-3c58-414c-a666-fb4a5d7a9275-kube-api-access-2xndb\") pod \"perf-node-gather-daemonset-b2mzm\" (UID: \"462edde2-3c58-414c-a666-fb4a5d7a9275\") " pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.952629 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.952549 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:49.989076 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:49.989048 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mggz6_ee1eec81-b979-4fdd-b042-38a9d11f4261/dns/0.log" May 29 17:33:50.010647 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:50.010589 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mggz6_ee1eec81-b979-4fdd-b042-38a9d11f4261/kube-rbac-proxy/0.log" May 29 17:33:50.063610 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:50.063577 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ptscs_c542210a-b54a-4c1a-8e34-e5d0372453e8/dns-node-resolver/0.log" May 29 17:33:50.081822 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:50.081801 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm"] May 29 17:33:50.084530 ip-10-0-137-133 kubenswrapper[2561]: W0529 17:33:50.084503 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod462edde2_3c58_414c_a666_fb4a5d7a9275.slice/crio-0726bdc90a87ebc0537ebd13c995a44d51a7a6c3366be6f05f66690a07339c92 WatchSource:0}: Error finding container 0726bdc90a87ebc0537ebd13c995a44d51a7a6c3366be6f05f66690a07339c92: Status 404 returned error can't find the container with id 0726bdc90a87ebc0537ebd13c995a44d51a7a6c3366be6f05f66690a07339c92 May 29 17:33:50.086306 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:50.086281 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 17:33:50.280403 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:50.280370 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" event={"ID":"462edde2-3c58-414c-a666-fb4a5d7a9275","Type":"ContainerStarted","Data":"a681783850d627f423ad913918bd0183acaace75190a0319d653812e7d07e3cd"} May 29 17:33:50.280403 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:50.280407 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" event={"ID":"462edde2-3c58-414c-a666-fb4a5d7a9275","Type":"ContainerStarted","Data":"0726bdc90a87ebc0537ebd13c995a44d51a7a6c3366be6f05f66690a07339c92"} May 29 17:33:50.280633 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:50.280439 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:50.296368 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:50.296322 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" podStartSLOduration=1.296310048 podStartE2EDuration="1.296310048s" podCreationTimestamp="2026-05-29 17:33:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:33:50.295228605 +0000 UTC m=+2228.325697611" watchObservedRunningTime="2026-05-29 17:33:50.296310048 +0000 UTC m=+2228.326779056" May 29 17:33:50.598800 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:50.598763 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bh98g_c776ba0f-d190-46f1-85e2-874f75d80904/node-ca/0.log" May 29 17:33:51.428183 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:51.428139 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-85dcf9bb54nqqsl_1dbca7ac-967e-4264-adca-b115fae3942c/istio-proxy/0.log" May 29 17:33:51.608857 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:51.608824 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d44956ff5-hd48m_3f699578-8e86-4925-b5bf-7e4fe8b097bd/istio-proxy/0.log" May 29 17:33:51.665097 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:51.665070 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-4jd86_871abee6-4e4c-4edb-83cd-96a08419c4f6/payload-processing/0.log" May 29 17:33:51.685355 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:51.685295 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78d54b76f9-bx987_9e8b3057-a3bb-4e0c-9066-52577b25fcd4/router/0.log" May 29 17:33:52.214251 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:52.214226 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wdlpr_a44d2b9b-42c3-4e55-bbaa-6453218224b7/serve-healthcheck-canary/0.log" May 29 17:33:52.661476 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:52.661429 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-jvk9t_49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9/insights-operator/0.log" May 29 17:33:52.662022 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:52.661873 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-jvk9t_49b43e3a-ca8f-401d-bef1-e0d73e4ebaf9/insights-operator/1.log" May 29 17:33:52.680322 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:52.680299 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5wsgv_d242ba07-31ed-473d-9b24-c5f63867ba2d/kube-rbac-proxy/0.log" May 29 17:33:52.698994 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:52.698973 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5wsgv_d242ba07-31ed-473d-9b24-c5f63867ba2d/exporter/0.log" May 29 17:33:52.717139 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:52.717121 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5wsgv_d242ba07-31ed-473d-9b24-c5f63867ba2d/extractor/0.log" May 29 17:33:54.795894 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:54.795818 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-76cb944577-jg5lw_fd46ead8-7a69-4d1d-9fdb-c1db82b19fbd/nginx/0.log" May 29 17:33:54.929512 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:54.929484 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6c7b68fff6-kqp9f_3b3a63f9-2a67-419d-afbb-63970474736e/maas-api/0.log" May 29 17:33:55.041640 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:55.041610 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c66df4598-85bf2_6c7360ac-f79b-4c73-8602-4c763334ff64/manager/0.log" May 29 17:33:55.059792 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:55.059727 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-9txnd_e539e4a0-0459-46e3-a460-71b764077d26/server/0.log" May 29 17:33:55.123810 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:55.123785 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598f575fbf-g7tzz_6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6/manager/0.log" May 29 17:33:55.143925 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:55.143903 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-598f575fbf-g7tzz_6ea51e8d-4ecb-41dc-90ff-6b6a9846cca6/copy-manifests/0.log" May 29 17:33:56.294589 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:56.294566 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7r7t9/perf-node-gather-daemonset-b2mzm" May 29 17:33:56.612827 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:33:56.612746 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-674dbbfb6b-2dxxx_c4ec572e-27e3-4f68-9e80-fc8ea1d2407e/manager/0.log" May 29 17:34:01.790587 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:01.790561 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-676kf_ff35d618-b26d-4012-acb0-f8ce811fc7a0/kube-storage-version-migrator-operator/1.log" May 29 17:34:01.792014 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:01.791984 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-676kf_ff35d618-b26d-4012-acb0-f8ce811fc7a0/kube-storage-version-migrator-operator/0.log" May 29 17:34:03.305468 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:03.305436 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppgpq_27c5d260-d0e2-438c-8488-bfd82910b177/kube-multus-additional-cni-plugins/0.log" May 29 17:34:03.323191 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:03.323170 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppgpq_27c5d260-d0e2-438c-8488-bfd82910b177/egress-router-binary-copy/0.log" May 29 17:34:03.340882 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:03.340857 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppgpq_27c5d260-d0e2-438c-8488-bfd82910b177/cni-plugins/0.log" May 29 17:34:03.358770 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:03.358747 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppgpq_27c5d260-d0e2-438c-8488-bfd82910b177/bond-cni-plugin/0.log" May 29 17:34:03.376657 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:03.376638 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppgpq_27c5d260-d0e2-438c-8488-bfd82910b177/routeoverride-cni/0.log" May 29 17:34:03.394459 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:03.394440 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppgpq_27c5d260-d0e2-438c-8488-bfd82910b177/whereabouts-cni-bincopy/0.log" May 29 17:34:03.412164 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:03.412143 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppgpq_27c5d260-d0e2-438c-8488-bfd82910b177/whereabouts-cni/0.log" May 29 17:34:03.440404 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:03.440378 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gqk9b_57bc6055-1278-49c4-820e-7f501bc6552c/kube-multus/0.log" May 29 17:34:03.567891 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:03.567817 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tz999_47cbc84a-e410-451b-86f1-222dfcd8d0ad/network-metrics-daemon/0.log" May 29 17:34:03.587924 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:03.587903 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tz999_47cbc84a-e410-451b-86f1-222dfcd8d0ad/kube-rbac-proxy/0.log" May 29 17:34:04.425254 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:04.425178 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-controller/0.log" May 29 17:34:04.440395 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:04.440369 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/0.log" May 29 17:34:04.449612 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:04.449595 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovn-acl-logging/1.log" May 29 17:34:04.465345 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:04.465329 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/kube-rbac-proxy-node/0.log" May 29 17:34:04.486569 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:04.486552 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/kube-rbac-proxy-ovn-metrics/0.log" May 29 17:34:04.507030 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:04.507013 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/northd/0.log" May 29 17:34:04.528698 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:04.528670 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/nbdb/0.log" May 29 17:34:04.547766 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:04.547737 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/sbdb/0.log" May 29 17:34:04.639334 ip-10-0-137-133 kubenswrapper[2561]: I0529 17:34:04.639310 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bf6q2_8b1bfbae-6538-4989-b8a1-446dd10dd72d/ovnkube-controller/0.log"