Jun 03 21:27:37.420159 ip-10-0-141-134 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 21:27:37.420171 ip-10-0-141-134 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 21:27:37.420178 ip-10-0-141-134 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 21:27:37.420321 ip-10-0-141-134 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 21:27:47.661906 ip-10-0-141-134 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 21:27:47.661923 ip-10-0-141-134 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a3c1b36f8dfe46c49cd9474aad975185 -- Jun 03 21:30:00.708270 ip-10-0-141-134 systemd[1]: Starting Kubernetes Kubelet... Jun 03 21:30:01.160158 ip-10-0-141-134 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:30:01.160158 ip-10-0-141-134 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 21:30:01.160158 ip-10-0-141-134 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:30:01.160158 ip-10-0-141-134 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 21:30:01.160158 ip-10-0-141-134 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:30:01.162261 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.162173 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 21:30:01.169015 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.168998 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:30:01.169015 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169016 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169020 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169023 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169026 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169030 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169038 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169042 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169046 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169050 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169053 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169057 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169060 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169063 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169066 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169069 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169072 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169075 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169078 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169080 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169083 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:30:01.169086 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169085 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169088 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169090 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169094 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169096 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169099 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169102 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169105 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169107 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169110 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169112 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169115 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169117 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169120 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169123 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169125 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169128 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169130 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169133 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169136 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:30:01.169560 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169138 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169140 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169144 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169146 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169149 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169151 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169153 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169156 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169159 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169161 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169164 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169166 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169170 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169172 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169176 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169178 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169181 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169183 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169186 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169189 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:30:01.170057 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169191 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169194 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169196 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169200 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169204 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169206 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169210 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169213 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169216 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169219 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169221 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169227 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169229 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169232 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169235 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169238 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169241 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169245 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:30:01.170577 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169249 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169253 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169255 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169258 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169261 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169263 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169266 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169268 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169272 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169275 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169278 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169281 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169284 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169287 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169289 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169292 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169294 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169297 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.169300 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170049 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170056 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:30:01.171024 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170059 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170061 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170066 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170070 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170074 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170078 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170081 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170084 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170087 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170089 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170093 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170095 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170098 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170101 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170103 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170106 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170108 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170111 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170114 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:30:01.171618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170118 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170121 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170124 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170126 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170130 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170132 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170135 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170137 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170140 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170143 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170145 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170148 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170150 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170152 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170155 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170158 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170160 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170163 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170166 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:30:01.172129 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170172 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170176 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170178 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170181 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170184 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170186 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170190 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170192 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170195 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170198 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170200 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170203 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170205 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170208 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170211 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170214 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170217 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170219 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170222 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170225 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:30:01.172618 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170227 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170231 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170235 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170238 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170240 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170243 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170247 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170250 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170253 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170257 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170261 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170264 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170267 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170270 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170273 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170276 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170279 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170282 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170285 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170288 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:30:01.173152 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170291 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170293 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170296 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170299 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170302 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170304 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170307 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170310 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170312 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170315 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170317 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170320 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170322 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170325 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170327 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170330 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170332 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170335 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170696 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170701 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:30:01.173702 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170703 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170706 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170710 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170714 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170717 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170720 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170724 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170727 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170729 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170733 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170736 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170738 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170741 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170744 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170747 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170749 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170752 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170754 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170757 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:30:01.174260 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170760 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170762 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170765 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170768 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170771 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170773 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170776 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170780 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170784 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170787 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170789 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170792 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170795 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170797 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170800 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170803 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170805 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170808 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170810 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170814 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:30:01.174794 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170817 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170820 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170823 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170825 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170828 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170831 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170833 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170836 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170839 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170841 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170844 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170846 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170849 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170851 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170854 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170856 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170859 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170861 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170864 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170866 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:30:01.175357 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170874 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170877 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170880 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170883 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170886 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170888 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170891 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170894 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170896 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170899 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170901 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170904 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170907 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170910 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170912 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170915 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170917 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170920 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170922 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:30:01.175958 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170925 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170929 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170932 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170935 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170938 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170941 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170958 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170961 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170963 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170967 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170969 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170972 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170974 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170979 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170982 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170984 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170987 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.170990 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171068 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171080 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171086 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 21:30:01.176510 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171090 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171094 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171098 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171102 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171106 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171110 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171114 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171117 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171120 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171124 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171127 2574 flags.go:64] FLAG: --cgroup-root="" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171129 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171132 2574 flags.go:64] FLAG: --client-ca-file="" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171135 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171138 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171143 2574 flags.go:64] FLAG: --cluster-domain="" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171145 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171149 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171152 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171155 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171159 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171162 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171165 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 21:30:01.177091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171169 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171173 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171176 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171179 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171182 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171186 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171191 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171193 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171196 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171199 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171202 2574 flags.go:64] FLAG: --enable-server="true" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171206 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171210 2574 flags.go:64] FLAG: --event-burst="100" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171213 2574 flags.go:64] FLAG: --event-qps="50" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171216 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171219 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171223 2574 flags.go:64] FLAG: --eviction-hard="" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171227 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171229 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171232 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171235 2574 flags.go:64] FLAG: --eviction-soft="" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171238 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171241 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171244 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171246 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 21:30:01.177658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171249 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171252 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171255 2574 flags.go:64] FLAG: --feature-gates="" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171259 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171262 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171265 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171268 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171271 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171275 2574 flags.go:64] FLAG: --help="false" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171278 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171281 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171284 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171288 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171292 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171295 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171298 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171300 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171303 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171306 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171309 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171312 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171315 2574 flags.go:64] FLAG: --kube-reserved="" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171318 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171321 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 21:30:01.178354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171324 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171327 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171330 2574 flags.go:64] FLAG: --lock-file="" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171332 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171335 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171338 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171344 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171346 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171349 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171352 2574 flags.go:64] FLAG: --logging-format="text" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171355 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171358 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171361 2574 flags.go:64] FLAG: --manifest-url="" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171363 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171368 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171371 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171376 2574 flags.go:64] FLAG: --max-pods="110" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171379 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171382 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171385 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171393 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171396 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171399 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171402 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171409 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 21:30:01.178999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171412 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171415 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171419 2574 flags.go:64] FLAG: --pod-cidr="" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171421 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171427 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171430 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171433 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171437 2574 flags.go:64] FLAG: --port="10250" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171440 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171443 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-044a903427989a93a" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171446 2574 flags.go:64] FLAG: --qos-reserved="" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171449 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171452 2574 flags.go:64] FLAG: --register-node="true" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171455 2574 flags.go:64] FLAG: --register-with-taints="" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171459 2574 flags.go:64] FLAG: --registry-burst="10" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171462 2574 flags.go:64] FLAG: --registry-qps="5" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171464 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171467 2574 flags.go:64] FLAG: --reserved-memory="" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171471 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171474 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171477 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171480 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171483 2574 flags.go:64] FLAG: --runonce="false" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171486 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171490 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 21:30:01.179597 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171493 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171496 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171500 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171503 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171507 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171510 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171512 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171515 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171518 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171521 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171524 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171527 2574 flags.go:64] FLAG: --system-cgroups="" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171530 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171535 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171538 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171542 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171547 2574 flags.go:64] FLAG: --tls-min-version="" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171550 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171552 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171556 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171558 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171561 2574 flags.go:64] FLAG: --v="2" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171566 2574 flags.go:64] FLAG: --version="false" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171570 2574 flags.go:64] FLAG: --vmodule="" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171574 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 21:30:01.180605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171577 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171690 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171693 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171697 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171699 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171702 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171706 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171709 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171712 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171716 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171718 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171723 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171726 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171729 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171732 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171735 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171738 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171740 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171743 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171746 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:30:01.181330 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171748 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171751 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171753 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171757 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171759 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171762 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171764 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171767 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171770 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171772 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171775 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171777 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171780 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171783 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171786 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171788 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171790 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171793 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171796 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:30:01.181865 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171798 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171801 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171805 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171808 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171810 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171813 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171816 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171818 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171821 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171823 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171826 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171828 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171833 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171835 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171838 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171840 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171843 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171846 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171848 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171851 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:30:01.182346 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171853 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171856 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171859 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171861 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171864 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171867 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171869 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171872 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171874 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171877 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171880 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171885 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171888 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171891 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171895 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171900 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171904 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171907 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171909 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:30:01.182855 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171912 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171915 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171917 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171920 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171923 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171925 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171928 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171930 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171933 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171937 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171941 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171960 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171962 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171965 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171968 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171970 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171973 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171975 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171978 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171987 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:30:01.184121 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.171991 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.171996 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.180753 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.180788 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.181664 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.181741 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182008 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182018 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182022 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182026 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182029 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182032 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182035 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182038 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182040 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:30:01.184643 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182043 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182046 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182048 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182051 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182053 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182057 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182059 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182062 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182065 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182067 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182070 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182072 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182075 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182077 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182080 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182083 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182085 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182088 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182090 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182093 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:30:01.185033 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182095 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182098 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182102 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182109 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182112 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182114 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182117 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182120 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182123 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182125 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182128 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182132 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182137 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182140 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182143 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182146 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182149 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182152 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182155 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182157 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:30:01.185508 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182160 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182163 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182165 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182168 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182170 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182173 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182175 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182179 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182183 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182187 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182190 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182192 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182195 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182198 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182203 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182206 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182209 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182212 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:30:01.186020 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182216 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182219 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182222 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182225 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182228 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182231 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182234 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182236 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182239 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182242 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182245 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182248 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182250 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182253 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182255 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182258 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182261 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182263 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182266 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182269 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:30:01.186451 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182271 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182274 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182276 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182279 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182282 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182284 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182287 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182289 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182293 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182295 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182298 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.182303 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182423 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182427 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182430 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:30:01.186935 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182433 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182436 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182439 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182442 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182444 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182447 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182450 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182452 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182455 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182457 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182466 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182469 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182473 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182477 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182479 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182482 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182484 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182487 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182489 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:30:01.187312 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182492 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182495 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182498 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182500 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182503 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182506 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182509 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182512 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182515 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182518 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182520 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182523 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182525 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182528 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182531 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182534 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182536 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182539 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182541 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182544 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:30:01.187787 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182546 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182549 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182551 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182554 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182563 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182566 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182568 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182570 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182573 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182576 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182578 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182581 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182583 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182586 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182588 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182591 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182594 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182596 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182599 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:30:01.188434 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182603 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182607 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182610 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182613 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182616 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182619 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182622 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182624 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182627 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182630 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182632 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182635 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182638 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182640 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182643 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182645 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182648 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182650 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182659 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182661 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:30:01.188881 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182664 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182667 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182670 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182672 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182675 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182677 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182680 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182683 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182685 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182688 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182690 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182693 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182695 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182698 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182700 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182703 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:30:01.189375 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:01.182705 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:30:01.189760 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.182710 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:30:01.189760 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.182827 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 21:30:01.189760 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.186268 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 21:30:01.189760 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.187989 2574 server.go:1019] "Starting client certificate rotation" Jun 03 21:30:01.189760 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.188099 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 21:30:01.189760 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.188130 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 21:30:01.190970 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.190956 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 21:30:01.195230 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.195209 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 21:30:01.211343 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.211322 2574 log.go:25] "Validated CRI v1 runtime API" Jun 03 21:30:01.215100 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.215084 2574 log.go:25] "Validated CRI v1 image API" Jun 03 21:30:01.215188 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.215168 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 21:30:01.215940 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.215920 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 21:30:01.218739 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.218719 2574 fs.go:135] Filesystem UUIDs: map[00646c22-ac5e-439d-a243-a59b4a0cb48d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cac9c307-d533-4aa2-aabe-f007c4b1dc8a:/dev/nvme0n1p4] Jun 03 21:30:01.218801 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.218738 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 21:30:01.224604 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.224497 2574 manager.go:216] Machine: {Timestamp:2026-06-03 21:30:01.223046619 +0000 UTC m=+0.383539520 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114501 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20068963d929504e815a3a4a24ee17 SystemUUID:ec200689-63d9-2950-4e81-5a3a4a24ee17 BootID:a3c1b36f-8dfe-46c4-9cd9-474aad975185 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a4:5d:41:a4:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a4:5d:41:a4:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:c5:aa:bf:85:01 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 21:30:01.224604 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.224598 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 21:30:01.224718 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.224677 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 21:30:01.228295 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.228244 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 21:30:01.228429 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.228273 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-134.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 21:30:01.229164 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.229154 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 21:30:01.229202 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.229166 2574 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 21:30:01.229202 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.229174 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 21:30:01.229977 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.229967 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 21:30:01.231222 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.231212 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 21:30:01.235619 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.235608 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 03 21:30:01.235754 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.235744 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 21:30:01.235790 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.235785 2574 kubelet.go:486] "Attempting to sync node with API server" Jun 03 21:30:01.235818 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.235798 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 21:30:01.235818 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.235808 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 21:30:01.235818 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.235817 2574 kubelet.go:398] "Adding apiserver pod source" Jun 03 21:30:01.235890 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.235836 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 21:30:01.236406 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.236374 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 21:30:01.236406 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.236409 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 21:30:01.240443 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.240416 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 21:30:01.242814 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.242800 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 21:30:01.242887 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.242833 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 21:30:01.244185 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.244172 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 21:30:01.244185 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.244189 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 21:30:01.244298 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.244195 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 21:30:01.244298 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.244202 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 21:30:01.244298 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.244213 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 21:30:01.244298 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.244221 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 21:30:01.244298 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.244232 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 21:30:01.244298 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.244237 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 21:30:01.244298 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.244245 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 21:30:01.244298 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.244250 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 21:30:01.244298 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.244259 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 21:30:01.244298 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.244264 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 21:30:01.245184 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.245175 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 21:30:01.245220 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.245184 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 21:30:01.246686 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.246657 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 21:30:01.246775 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.246681 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 21:30:01.246775 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.246692 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-134.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 21:30:01.248423 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.248408 2574 server.go:1268] "Started kubelet" Jun 03 21:30:01.248541 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.248486 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 21:30:01.248601 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.248529 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 21:30:01.248663 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.248649 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 21:30:01.249246 ip-10-0-141-134 systemd[1]: Started Kubernetes Kubelet. Jun 03 21:30:01.250606 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.250590 2574 server.go:310] "Adding debug handlers to kubelet server" Jun 03 21:30:01.250767 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.250750 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 21:30:01.257877 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.257857 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 21:30:01.259221 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.259207 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 21:30:01.259291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.259224 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 21:30:01.259342 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.259327 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-134.ec2.internal\" not found" Jun 03 21:30:01.259919 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.259899 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 21:30:01.259919 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.259902 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 21:30:01.260078 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.260003 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 21:30:01.260136 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.260096 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 03 21:30:01.260136 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.260106 2574 reconciler.go:29] "Reconciler: start to sync state" Jun 03 21:30:01.260229 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.260145 2574 factory.go:55] Registering systemd factory Jun 03 21:30:01.260229 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.260156 2574 factory.go:223] Registration of the systemd container factory successfully Jun 03 21:30:01.260416 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.260399 2574 factory.go:153] Registering CRI-O factory Jun 03 21:30:01.260416 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.260418 2574 factory.go:223] Registration of the crio container factory successfully Jun 03 21:30:01.260555 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.260471 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 21:30:01.260555 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.260493 2574 factory.go:103] Registering Raw factory Jun 03 21:30:01.260555 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.260509 2574 manager.go:1196] Started watching for new ooms in manager Jun 03 21:30:01.260936 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.260920 2574 manager.go:349] Starting recovery of all containers Jun 03 21:30:01.263234 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.263071 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 21:30:01.264222 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.262997 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-134.ec2.internal.18b5af82281b3d90 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-134.ec2.internal,UID:ip-10-0-141-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-134.ec2.internal,},FirstTimestamp:2026-06-03 21:30:01.248382352 +0000 UTC m=+0.408875253,LastTimestamp:2026-06-03 21:30:01.248382352 +0000 UTC m=+0.408875253,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-134.ec2.internal,}" Jun 03 21:30:01.268286 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.268260 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h5v9x" Jun 03 21:30:01.270143 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.270117 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 21:30:01.273813 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.273780 2574 manager.go:354] Recovery completed Jun 03 21:30:01.273980 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.273963 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h5v9x" Jun 03 21:30:01.278829 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.278816 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:30:01.280643 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.280625 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:30:01.280706 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.280660 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:30:01.280706 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.280675 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:30:01.281218 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.281205 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 21:30:01.281287 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.281219 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 21:30:01.281287 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.281210 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:30:01.281287 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.281238 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 03 21:30:01.281838 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.281823 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:30:01.281872 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.281851 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:30:01.281872 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.281864 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:30:01.282268 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.282185 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-134.ec2.internal.18b5af822a0785ac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-134.ec2.internal,UID:ip-10-0-141-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-134.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-134.ec2.internal,},FirstTimestamp:2026-06-03 21:30:01.280644524 +0000 UTC m=+0.441137411,LastTimestamp:2026-06-03 21:30:01.280644524 +0000 UTC m=+0.441137411,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-134.ec2.internal,}" Jun 03 21:30:01.282940 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.282927 2574 policy_none.go:49] "None policy: Start" Jun 03 21:30:01.283017 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.282958 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 21:30:01.283017 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.282972 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 21:30:01.284714 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.284700 2574 policy_none.go:47] "Start" Jun 03 21:30:01.318533 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.318519 2574 manager.go:337] "Starting Device Plugin manager" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.318548 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.318558 2574 server.go:87] "Starting device plugin registration server" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.318759 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.318772 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.318848 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.318967 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.318980 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.319574 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.319635 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-134.ec2.internal\" not found" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.330216 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.331603 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.331650 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.331673 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.331709 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 21:30:01.342336 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.334774 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:30:01.419186 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.419156 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:30:01.420335 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.420317 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:30:01.420459 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.420349 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:30:01.420459 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.420367 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:30:01.420459 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.420394 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.430750 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.430728 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.430839 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.430752 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-134.ec2.internal\": node \"ip-10-0-141-134.ec2.internal\" not found" Jun 03 21:30:01.432744 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.432727 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-134.ec2.internal"] Jun 03 21:30:01.432794 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.432785 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:30:01.434508 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.434492 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:30:01.434596 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.434522 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:30:01.434596 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.434536 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:30:01.437125 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.437112 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:30:01.437221 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.437209 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.437261 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.437248 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:30:01.438305 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.438289 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:30:01.438305 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.438301 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:30:01.438428 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.438331 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:30:01.438428 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.438344 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:30:01.438428 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.438399 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:30:01.438514 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.438430 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:30:01.440643 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.440624 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.440719 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.440654 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:30:01.441337 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.441324 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:30:01.441404 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.441347 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:30:01.441404 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.441357 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:30:01.454489 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.454473 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-134.ec2.internal\" not found" node="ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.457921 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.457905 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-134.ec2.internal\" not found" node="ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.460063 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.460049 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-134.ec2.internal\" not found" Jun 03 21:30:01.461724 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.461709 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c92255e243f52f2137b97cabc47e811f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal\" (UID: \"c92255e243f52f2137b97cabc47e811f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.461770 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.461734 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c92255e243f52f2137b97cabc47e811f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal\" (UID: \"c92255e243f52f2137b97cabc47e811f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.461770 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.461752 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/94f58f1173546d0833b3c3c2dbbc5151-config\") pod \"kube-apiserver-proxy-ip-10-0-141-134.ec2.internal\" (UID: \"94f58f1173546d0833b3c3c2dbbc5151\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.560370 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.560304 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-134.ec2.internal\" not found" Jun 03 21:30:01.562501 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.562482 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c92255e243f52f2137b97cabc47e811f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal\" (UID: \"c92255e243f52f2137b97cabc47e811f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.562548 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.562510 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c92255e243f52f2137b97cabc47e811f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal\" (UID: \"c92255e243f52f2137b97cabc47e811f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.562548 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.562533 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/94f58f1173546d0833b3c3c2dbbc5151-config\") pod \"kube-apiserver-proxy-ip-10-0-141-134.ec2.internal\" (UID: \"94f58f1173546d0833b3c3c2dbbc5151\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.562610 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.562563 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c92255e243f52f2137b97cabc47e811f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal\" (UID: \"c92255e243f52f2137b97cabc47e811f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.562610 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.562567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/94f58f1173546d0833b3c3c2dbbc5151-config\") pod \"kube-apiserver-proxy-ip-10-0-141-134.ec2.internal\" (UID: \"94f58f1173546d0833b3c3c2dbbc5151\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.562672 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.562616 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c92255e243f52f2137b97cabc47e811f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal\" (UID: \"c92255e243f52f2137b97cabc47e811f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.660817 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.660778 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-134.ec2.internal\" not found" Jun 03 21:30:01.761528 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.761492 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-134.ec2.internal\" not found" Jun 03 21:30:01.761528 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.761514 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.762618 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:01.762601 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-134.ec2.internal" Jun 03 21:30:01.861912 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.861827 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-134.ec2.internal\" not found" Jun 03 21:30:01.962368 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:01.962321 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-134.ec2.internal\" not found" Jun 03 21:30:02.062935 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:02.062893 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-134.ec2.internal\" not found" Jun 03 21:30:02.154225 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:02.154136 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:30:02.163864 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:02.163840 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-134.ec2.internal\" not found" Jun 03 21:30:02.187173 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:02.187153 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 21:30:02.187315 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:02.187294 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 21:30:02.187359 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:02.187314 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 21:30:02.264255 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:02.264228 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-134.ec2.internal\" not found" Jun 03 21:30:02.278179 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:02.278135 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 21:25:01 +0000 UTC" deadline="2028-02-21 02:15:45.050004606 +0000 UTC" Jun 03 21:30:02.278247 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:02.278181 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15052h45m42.771828042s" Jun 03 21:30:02.355288 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:02.355264 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:30:02.360069 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:02.360052 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal" Jun 03 21:30:02.375704 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:02.375684 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 21:30:02.376706 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:02.376689 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-134.ec2.internal" Jun 03 21:30:02.389014 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:02.388991 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 21:30:02.407124 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:02.406566 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc92255e243f52f2137b97cabc47e811f.slice/crio-17b4147ee51bc8ad2e47fc21966822e1a4bdb62ab5a947165a115ddbacff61a8 WatchSource:0}: Error finding container 17b4147ee51bc8ad2e47fc21966822e1a4bdb62ab5a947165a115ddbacff61a8: Status 404 returned error can't find the container with id 17b4147ee51bc8ad2e47fc21966822e1a4bdb62ab5a947165a115ddbacff61a8 Jun 03 21:30:02.407858 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:02.407826 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f58f1173546d0833b3c3c2dbbc5151.slice/crio-b1c47520eedba1604b537d4fb64e3111c06631fe185c9e1cbecff99fc04304c9 WatchSource:0}: Error finding container b1c47520eedba1604b537d4fb64e3111c06631fe185c9e1cbecff99fc04304c9: Status 404 returned error can't find the container with id b1c47520eedba1604b537d4fb64e3111c06631fe185c9e1cbecff99fc04304c9 Jun 03 21:30:02.412585 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:02.412566 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:30:02.470630 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:02.470608 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:30:03.236868 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.236834 2574 apiserver.go:52] "Watching apiserver" Jun 03 21:30:03.246385 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.246352 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 21:30:03.246786 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.246747 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-5xwxp","openshift-ovn-kubernetes/ovnkube-node-xnnsg","kube-system/global-pull-secret-syncer-bcm8v","kube-system/konnectivity-agent-9thtn","kube-system/kube-apiserver-proxy-ip-10-0-141-134.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st","openshift-cluster-node-tuning-operator/tuned-t9bx8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal","openshift-multus/multus-additional-cni-plugins-mh6hm","openshift-network-diagnostics/network-check-target-8bt2h","openshift-dns/node-resolver-4qjn6","openshift-image-registry/node-ca-2q9p5","openshift-multus/multus-dq8xx","openshift-multus/network-metrics-daemon-rcbhk"] Jun 03 21:30:03.249013 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.248988 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.251056 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.251037 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qjn6" Jun 03 21:30:03.251844 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.251820 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2m8zp\"" Jun 03 21:30:03.251844 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.251835 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:30:03.252091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.251873 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 21:30:03.253437 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.253241 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 21:30:03.253437 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.253275 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 21:30:03.253437 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.253379 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p9h5w\"" Jun 03 21:30:03.253643 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.253506 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:03.253643 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.253567 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:03.255663 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.255645 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9thtn" Jun 03 21:30:03.257812 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.257791 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 21:30:03.257915 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.257817 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 21:30:03.258061 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.258044 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:03.258137 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.258061 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hpx5r\"" Jun 03 21:30:03.258137 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.258111 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:03.259866 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.259848 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 21:30:03.260205 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.260147 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.262281 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.262255 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 21:30:03.262281 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.262267 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 21:30:03.262445 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.262385 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p7kdj\"" Jun 03 21:30:03.262445 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.262423 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.262555 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.262522 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 21:30:03.264533 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.264318 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s5vfg\"" Jun 03 21:30:03.264533 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.264335 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 21:30:03.264692 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.264608 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 21:30:03.265125 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.265104 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 21:30:03.265125 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.265120 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 21:30:03.265296 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.265280 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.265372 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.265354 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 21:30:03.267510 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.267155 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.267510 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.267250 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 21:30:03.267510 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.267470 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sbv77\"" Jun 03 21:30:03.269346 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.269297 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 21:30:03.269658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.269567 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:03.269658 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.269638 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:03.270319 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.270299 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4k8kl\"" Jun 03 21:30:03.270425 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.270337 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 21:30:03.270425 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.270366 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 21:30:03.270529 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.270302 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 21:30:03.270529 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.270300 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 21:30:03.270638 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.270571 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 21:30:03.270638 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.270624 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 21:30:03.271609 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.271585 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkgxd\" (UniqueName: \"kubernetes.io/projected/5de8b995-a02a-4656-9d2e-ac20d31fb96c-kube-api-access-fkgxd\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:03.271714 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.271622 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d234ba0a-d9b7-4c4c-8198-501b74d44672-agent-certs\") pod \"konnectivity-agent-9thtn\" (UID: \"d234ba0a-d9b7-4c4c-8198-501b74d44672\") " pod="kube-system/konnectivity-agent-9thtn" Jun 03 21:30:03.271714 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.271648 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-modprobe-d\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.271714 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.271672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-tuned\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.271714 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.271698 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee37aacc-f650-4207-8162-b21ee9928e9b-tmp\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.271908 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.271725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2536758-10d6-4ebb-8f50-09038d91191b-cnibin\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.271908 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.271748 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2536758-10d6-4ebb-8f50-09038d91191b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.271908 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.271771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zjk8\" (UniqueName: \"kubernetes.io/projected/b2536758-10d6-4ebb-8f50-09038d91191b-kube-api-access-9zjk8\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.271908 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.271834 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8084eecf-3233-41e7-a360-b2ad82fc8899-hosts-file\") pod \"node-resolver-4qjn6\" (UID: \"8084eecf-3233-41e7-a360-b2ad82fc8899\") " pod="openshift-dns/node-resolver-4qjn6" Jun 03 21:30:03.272283 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.271878 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-device-dir\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.272437 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272334 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:03.272437 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272383 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:03.272549 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-run\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.272549 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-sys\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.272635 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8084eecf-3233-41e7-a360-b2ad82fc8899-tmp-dir\") pod \"node-resolver-4qjn6\" (UID: \"8084eecf-3233-41e7-a360-b2ad82fc8899\") " pod="openshift-dns/node-resolver-4qjn6" Jun 03 21:30:03.272635 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.272635 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-registration-dir\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.272773 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272663 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2536758-10d6-4ebb-8f50-09038d91191b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.272773 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272698 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef9739dc-ca42-4f19-861f-6450aab361b5-dbus\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:03.272773 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-systemd\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.272773 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2536758-10d6-4ebb-8f50-09038d91191b-os-release\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.272983 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2536758-10d6-4ebb-8f50-09038d91191b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.272983 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272823 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d234ba0a-d9b7-4c4c-8198-501b74d44672-konnectivity-ca\") pod \"konnectivity-agent-9thtn\" (UID: \"d234ba0a-d9b7-4c4c-8198-501b74d44672\") " pod="kube-system/konnectivity-agent-9thtn" Jun 03 21:30:03.272983 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272853 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-lib-modules\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.272983 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272883 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-host\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.272983 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-etc-selinux\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.272983 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.272939 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-sys-fs\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.274800 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.274779 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2536758-10d6-4ebb-8f50-09038d91191b-system-cni-dir\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.274903 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.274832 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5xwxp" Jun 03 21:30:03.275548 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.274833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef9739dc-ca42-4f19-861f-6450aab361b5-kubelet-config\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:03.275548 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.275298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-kubernetes\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.275548 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.275435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-sysctl-d\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.275548 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.275465 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-sysctl-conf\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.275548 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.275497 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-var-lib-kubelet\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.275548 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.275530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2dnc\" (UniqueName: \"kubernetes.io/projected/8084eecf-3233-41e7-a360-b2ad82fc8899-kube-api-access-s2dnc\") pod \"node-resolver-4qjn6\" (UID: \"8084eecf-3233-41e7-a360-b2ad82fc8899\") " pod="openshift-dns/node-resolver-4qjn6" Jun 03 21:30:03.275872 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.275611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqb57\" (UniqueName: \"kubernetes.io/projected/636aa090-3355-4fa0-a449-b1dd15f18979-kube-api-access-gqb57\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.275872 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.275642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-sysconfig\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.275872 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.275670 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjwml\" (UniqueName: \"kubernetes.io/projected/ee37aacc-f650-4207-8162-b21ee9928e9b-kube-api-access-cjwml\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.275872 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.275711 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-socket-dir\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.275872 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.275744 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2536758-10d6-4ebb-8f50-09038d91191b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.277334 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.277242 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2q9p5" Jun 03 21:30:03.277428 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.277400 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:30:03.277886 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.277502 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 21:30:03.277886 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.277769 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 21:30:03.277886 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.277802 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zfvf2\"" Jun 03 21:30:03.279615 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.279594 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 21:30:03.279719 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.279686 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9lndw\"" Jun 03 21:30:03.280158 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.279919 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 21:30:03.280158 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.279990 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 21:30:03.293346 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.293298 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7rt8b" Jun 03 21:30:03.299444 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.299424 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7rt8b" Jun 03 21:30:03.312449 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.312360 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:30:03.337331 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.337278 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-134.ec2.internal" event={"ID":"94f58f1173546d0833b3c3c2dbbc5151","Type":"ContainerStarted","Data":"b1c47520eedba1604b537d4fb64e3111c06631fe185c9e1cbecff99fc04304c9"} Jun 03 21:30:03.338641 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.338613 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal" event={"ID":"c92255e243f52f2137b97cabc47e811f","Type":"ContainerStarted","Data":"17b4147ee51bc8ad2e47fc21966822e1a4bdb62ab5a947165a115ddbacff61a8"} Jun 03 21:30:03.361508 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.361437 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 21:30:03.376552 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376514 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef9739dc-ca42-4f19-861f-6450aab361b5-dbus\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:03.376694 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-etc-openvswitch\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.376694 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376595 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-989m5\" (UniqueName: \"kubernetes.io/projected/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-kube-api-access-989m5\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.376694 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376621 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f1bd416-ec0a-4201-9582-e7fdc92716fb-host-slash\") pod \"iptables-alerter-5xwxp\" (UID: \"5f1bd416-ec0a-4201-9582-e7fdc92716fb\") " pod="openshift-network-operator/iptables-alerter-5xwxp" Jun 03 21:30:03.376851 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376689 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef9739dc-ca42-4f19-861f-6450aab361b5-dbus\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:03.376851 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376687 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ff19efc-23e1-46a6-bb9d-0a7c58155f5d-host\") pod \"node-ca-2q9p5\" (UID: \"9ff19efc-23e1-46a6-bb9d-0a7c58155f5d\") " pod="openshift-image-registry/node-ca-2q9p5" Jun 03 21:30:03.376851 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2536758-10d6-4ebb-8f50-09038d91191b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.376851 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376778 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-run-netns\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.376851 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376806 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef9739dc-ca42-4f19-861f-6450aab361b5-kubelet-config\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:03.376851 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376829 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-kubernetes\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376855 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-sysctl-d\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376874 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-var-lib-kubelet\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-multus-socket-dir-parent\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376907 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef9739dc-ca42-4f19-861f-6450aab361b5-kubelet-config\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-multus-conf-dir\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376967 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-run-multus-certs\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.376986 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-etc-kubernetes\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377014 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqb57\" (UniqueName: \"kubernetes.io/projected/636aa090-3355-4fa0-a449-b1dd15f18979-kube-api-access-gqb57\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-sysconfig\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377049 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-sysctl-d\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377061 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjwml\" (UniqueName: \"kubernetes.io/projected/ee37aacc-f650-4207-8162-b21ee9928e9b-kube-api-access-cjwml\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377097 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-kubernetes\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-node-log\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377157 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-cni-bin\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377161 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-var-lib-kubelet\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.377191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377182 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-ovnkube-script-lib\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377208 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f1bd416-ec0a-4201-9582-e7fdc92716fb-iptables-alerter-script\") pod \"iptables-alerter-5xwxp\" (UID: \"5f1bd416-ec0a-4201-9582-e7fdc92716fb\") " pod="openshift-network-operator/iptables-alerter-5xwxp" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377223 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-sysconfig\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377244 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-socket-dir\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-system-cni-dir\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-multus-cni-dir\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377361 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-run-netns\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377393 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2536758-10d6-4ebb-8f50-09038d91191b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377395 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-log-socket\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-env-overrides\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377523 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-socket-dir\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377531 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d234ba0a-d9b7-4c4c-8198-501b74d44672-agent-certs\") pod \"konnectivity-agent-9thtn\" (UID: \"d234ba0a-d9b7-4c4c-8198-501b74d44672\") " pod="kube-system/konnectivity-agent-9thtn" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee37aacc-f650-4207-8162-b21ee9928e9b-tmp\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-var-lib-cni-bin\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377675 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-var-lib-cni-multus\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-ovnkube-config\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377826 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm47b\" (UniqueName: \"kubernetes.io/projected/9ff19efc-23e1-46a6-bb9d-0a7c58155f5d-kube-api-access-hm47b\") pod \"node-ca-2q9p5\" (UID: \"9ff19efc-23e1-46a6-bb9d-0a7c58155f5d\") " pod="openshift-image-registry/node-ca-2q9p5" Jun 03 21:30:03.378065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377859 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2536758-10d6-4ebb-8f50-09038d91191b-cnibin\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377850 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377888 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zjk8\" (UniqueName: \"kubernetes.io/projected/b2536758-10d6-4ebb-8f50-09038d91191b-kube-api-access-9zjk8\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-os-release\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.377985 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-systemd-units\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378013 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-var-lib-openvswitch\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-device-dir\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378085 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378140 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2536758-10d6-4ebb-8f50-09038d91191b-cnibin\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-sys\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8084eecf-3233-41e7-a360-b2ad82fc8899-tmp-dir\") pod \"node-resolver-4qjn6\" (UID: \"8084eecf-3233-41e7-a360-b2ad82fc8899\") " pod="openshift-dns/node-resolver-4qjn6" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378266 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-systemd\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378315 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-kubelet\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.378328 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-slash\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378375 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-device-dir\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.378880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378427 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-sys\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.378436 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378479 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.378512 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs podName:5de8b995-a02a-4656-9d2e-ac20d31fb96c nodeName:}" failed. No retries permitted until 2026-06-03 21:30:03.878490217 +0000 UTC m=+3.038983105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs") pod "network-metrics-daemon-rcbhk" (UID: "5de8b995-a02a-4656-9d2e-ac20d31fb96c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378525 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-systemd\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378563 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-run-ovn\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-ovn-node-metrics-cert\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378621 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8084eecf-3233-41e7-a360-b2ad82fc8899-tmp-dir\") pod \"node-resolver-4qjn6\" (UID: \"8084eecf-3233-41e7-a360-b2ad82fc8899\") " pod="openshift-dns/node-resolver-4qjn6" Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpxdt\" (UniqueName: \"kubernetes.io/projected/5f1bd416-ec0a-4201-9582-e7fdc92716fb-kube-api-access-fpxdt\") pod \"iptables-alerter-5xwxp\" (UID: \"5f1bd416-ec0a-4201-9582-e7fdc92716fb\") " pod="openshift-network-operator/iptables-alerter-5xwxp" Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.378683 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret podName:ef9739dc-ca42-4f19-861f-6450aab361b5 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:03.878666013 +0000 UTC m=+3.039158900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret") pod "global-pull-secret-syncer-bcm8v" (UID: "ef9739dc-ca42-4f19-861f-6450aab361b5") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2536758-10d6-4ebb-8f50-09038d91191b-os-release\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378732 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d234ba0a-d9b7-4c4c-8198-501b74d44672-konnectivity-ca\") pod \"konnectivity-agent-9thtn\" (UID: \"d234ba0a-d9b7-4c4c-8198-501b74d44672\") " pod="kube-system/konnectivity-agent-9thtn" Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378758 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-lib-modules\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-host\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378796 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2536758-10d6-4ebb-8f50-09038d91191b-os-release\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378804 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-var-lib-kubelet\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.379723 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378837 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9cbj\" (UniqueName: \"kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj\") pod \"network-check-target-8bt2h\" (UID: \"5be7aee8-69cb-4a45-a050-f59d3286eaa2\") " pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378862 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ff19efc-23e1-46a6-bb9d-0a7c58155f5d-serviceca\") pod \"node-ca-2q9p5\" (UID: \"9ff19efc-23e1-46a6-bb9d-0a7c58155f5d\") " pod="openshift-image-registry/node-ca-2q9p5" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378893 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-host\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-etc-selinux\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.378896 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-etc-selinux\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379010 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-lib-modules\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-sys-fs\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379081 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-sys-fs\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2536758-10d6-4ebb-8f50-09038d91191b-system-cni-dir\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379124 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-sysctl-conf\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379147 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-run-systemd\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379172 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dnc\" (UniqueName: \"kubernetes.io/projected/8084eecf-3233-41e7-a360-b2ad82fc8899-kube-api-access-s2dnc\") pod \"node-resolver-4qjn6\" (UID: \"8084eecf-3233-41e7-a360-b2ad82fc8899\") " pod="openshift-dns/node-resolver-4qjn6" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379240 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2536758-10d6-4ebb-8f50-09038d91191b-system-cni-dir\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379266 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d234ba0a-d9b7-4c4c-8198-501b74d44672-konnectivity-ca\") pod \"konnectivity-agent-9thtn\" (UID: \"d234ba0a-d9b7-4c4c-8198-501b74d44672\") " pod="kube-system/konnectivity-agent-9thtn" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379270 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-cnibin\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379289 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-sysctl-conf\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnw6r\" (UniqueName: \"kubernetes.io/projected/aec4f361-86f0-460d-b894-8e60ac0e0c2d-kube-api-access-gnw6r\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.380505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-cni-netd\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379445 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379479 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2536758-10d6-4ebb-8f50-09038d91191b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379503 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkgxd\" (UniqueName: \"kubernetes.io/projected/5de8b995-a02a-4656-9d2e-ac20d31fb96c-kube-api-access-fkgxd\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aec4f361-86f0-460d-b894-8e60ac0e0c2d-cni-binary-copy\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379681 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2536758-10d6-4ebb-8f50-09038d91191b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379721 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-modprobe-d\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-tuned\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379773 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-run-openvswitch\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379803 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2536758-10d6-4ebb-8f50-09038d91191b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379828 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-run-k8s-cni-cncf-io\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379833 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-modprobe-d\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-hostroot\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-run-ovn-kubernetes\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379903 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8084eecf-3233-41e7-a360-b2ad82fc8899-hosts-file\") pod \"node-resolver-4qjn6\" (UID: \"8084eecf-3233-41e7-a360-b2ad82fc8899\") " pod="openshift-dns/node-resolver-4qjn6" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379928 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-run\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.379971 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aec4f361-86f0-460d-b894-8e60ac0e0c2d-multus-daemon-config\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.381291 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.380006 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-registration-dir\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.382131 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.380031 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2536758-10d6-4ebb-8f50-09038d91191b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.382131 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.380544 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2536758-10d6-4ebb-8f50-09038d91191b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.382131 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.380620 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8084eecf-3233-41e7-a360-b2ad82fc8899-hosts-file\") pod \"node-resolver-4qjn6\" (UID: \"8084eecf-3233-41e7-a360-b2ad82fc8899\") " pod="openshift-dns/node-resolver-4qjn6" Jun 03 21:30:03.382131 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.380665 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2536758-10d6-4ebb-8f50-09038d91191b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.382131 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.380672 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee37aacc-f650-4207-8162-b21ee9928e9b-run\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.382131 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.380722 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/636aa090-3355-4fa0-a449-b1dd15f18979-registration-dir\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.383135 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.382621 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee37aacc-f650-4207-8162-b21ee9928e9b-etc-tuned\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.383135 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.382663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee37aacc-f650-4207-8162-b21ee9928e9b-tmp\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.383135 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.383072 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d234ba0a-d9b7-4c4c-8198-501b74d44672-agent-certs\") pod \"konnectivity-agent-9thtn\" (UID: \"d234ba0a-d9b7-4c4c-8198-501b74d44672\") " pod="kube-system/konnectivity-agent-9thtn" Jun 03 21:30:03.387543 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.387516 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjwml\" (UniqueName: \"kubernetes.io/projected/ee37aacc-f650-4207-8162-b21ee9928e9b-kube-api-access-cjwml\") pod \"tuned-t9bx8\" (UID: \"ee37aacc-f650-4207-8162-b21ee9928e9b\") " pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.387632 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.387521 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqb57\" (UniqueName: \"kubernetes.io/projected/636aa090-3355-4fa0-a449-b1dd15f18979-kube-api-access-gqb57\") pod \"aws-ebs-csi-driver-node-5m4st\" (UID: \"636aa090-3355-4fa0-a449-b1dd15f18979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.388684 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.388642 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2dnc\" (UniqueName: \"kubernetes.io/projected/8084eecf-3233-41e7-a360-b2ad82fc8899-kube-api-access-s2dnc\") pod \"node-resolver-4qjn6\" (UID: \"8084eecf-3233-41e7-a360-b2ad82fc8899\") " pod="openshift-dns/node-resolver-4qjn6" Jun 03 21:30:03.389612 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.388908 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkgxd\" (UniqueName: \"kubernetes.io/projected/5de8b995-a02a-4656-9d2e-ac20d31fb96c-kube-api-access-fkgxd\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:03.391373 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.391349 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zjk8\" (UniqueName: \"kubernetes.io/projected/b2536758-10d6-4ebb-8f50-09038d91191b-kube-api-access-9zjk8\") pod \"multus-additional-cni-plugins-mh6hm\" (UID: \"b2536758-10d6-4ebb-8f50-09038d91191b\") " pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.481332 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481286 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-systemd-units\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.481332 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-var-lib-openvswitch\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.481564 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481375 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-kubelet\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.481564 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-slash\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.481564 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481417 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-run-ovn\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.481564 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481444 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-ovn-node-metrics-cert\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.481564 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpxdt\" (UniqueName: \"kubernetes.io/projected/5f1bd416-ec0a-4201-9582-e7fdc92716fb-kube-api-access-fpxdt\") pod \"iptables-alerter-5xwxp\" (UID: \"5f1bd416-ec0a-4201-9582-e7fdc92716fb\") " pod="openshift-network-operator/iptables-alerter-5xwxp" Jun 03 21:30:03.481564 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-var-lib-kubelet\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.481564 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481505 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cbj\" (UniqueName: \"kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj\") pod \"network-check-target-8bt2h\" (UID: \"5be7aee8-69cb-4a45-a050-f59d3286eaa2\") " pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:03.481564 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481520 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ff19efc-23e1-46a6-bb9d-0a7c58155f5d-serviceca\") pod \"node-ca-2q9p5\" (UID: \"9ff19efc-23e1-46a6-bb9d-0a7c58155f5d\") " pod="openshift-image-registry/node-ca-2q9p5" Jun 03 21:30:03.481564 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481539 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-run-systemd\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.481564 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481562 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-cnibin\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnw6r\" (UniqueName: \"kubernetes.io/projected/aec4f361-86f0-460d-b894-8e60ac0e0c2d-kube-api-access-gnw6r\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481608 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-cni-netd\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481634 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aec4f361-86f0-460d-b894-8e60ac0e0c2d-cni-binary-copy\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481670 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-run-openvswitch\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-run-k8s-cni-cncf-io\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481717 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-hostroot\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481732 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-run-ovn-kubernetes\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481750 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aec4f361-86f0-460d-b894-8e60ac0e0c2d-multus-daemon-config\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481777 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-etc-openvswitch\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481797 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-989m5\" (UniqueName: \"kubernetes.io/projected/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-kube-api-access-989m5\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481815 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f1bd416-ec0a-4201-9582-e7fdc92716fb-host-slash\") pod \"iptables-alerter-5xwxp\" (UID: \"5f1bd416-ec0a-4201-9582-e7fdc92716fb\") " pod="openshift-network-operator/iptables-alerter-5xwxp" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ff19efc-23e1-46a6-bb9d-0a7c58155f5d-host\") pod \"node-ca-2q9p5\" (UID: \"9ff19efc-23e1-46a6-bb9d-0a7c58155f5d\") " pod="openshift-image-registry/node-ca-2q9p5" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481874 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-run-openvswitch\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481877 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-run-ovn\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481873 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-run-systemd\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481916 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-run-k8s-cni-cncf-io\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.482050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481882 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ff19efc-23e1-46a6-bb9d-0a7c58155f5d-host\") pod \"node-ca-2q9p5\" (UID: \"9ff19efc-23e1-46a6-bb9d-0a7c58155f5d\") " pod="openshift-image-registry/node-ca-2q9p5" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481962 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481984 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-cni-netd\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.481999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-run-ovn-kubernetes\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482024 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-kubelet\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482032 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-slash\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482055 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-hostroot\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-systemd-units\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482099 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-var-lib-kubelet\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482216 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-cnibin\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482262 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f1bd416-ec0a-4201-9582-e7fdc92716fb-host-slash\") pod \"iptables-alerter-5xwxp\" (UID: \"5f1bd416-ec0a-4201-9582-e7fdc92716fb\") " pod="openshift-network-operator/iptables-alerter-5xwxp" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482262 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-etc-openvswitch\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-var-lib-openvswitch\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482354 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-run-netns\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-multus-socket-dir-parent\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482413 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-multus-conf-dir\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482439 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-run-multus-certs\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482457 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-multus-socket-dir-parent\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.482761 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-etc-kubernetes\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482476 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-multus-conf-dir\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482499 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-node-log\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482413 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-run-netns\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482501 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-etc-kubernetes\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482526 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-cni-bin\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482539 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-run-multus-certs\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-ovnkube-script-lib\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aec4f361-86f0-460d-b894-8e60ac0e0c2d-multus-daemon-config\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-host-cni-bin\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482552 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-node-log\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482578 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f1bd416-ec0a-4201-9582-e7fdc92716fb-iptables-alerter-script\") pod \"iptables-alerter-5xwxp\" (UID: \"5f1bd416-ec0a-4201-9582-e7fdc92716fb\") " pod="openshift-network-operator/iptables-alerter-5xwxp" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482625 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-system-cni-dir\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482649 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-multus-cni-dir\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482661 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aec4f361-86f0-460d-b894-8e60ac0e0c2d-cni-binary-copy\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482673 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-run-netns\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-log-socket\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482723 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-system-cni-dir\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.483563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482736 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-env-overrides\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482741 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ff19efc-23e1-46a6-bb9d-0a7c58155f5d-serviceca\") pod \"node-ca-2q9p5\" (UID: \"9ff19efc-23e1-46a6-bb9d-0a7c58155f5d\") " pod="openshift-image-registry/node-ca-2q9p5" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482759 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-multus-cni-dir\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482764 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-run-netns\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482762 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-var-lib-cni-bin\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482801 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-log-socket\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482837 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-var-lib-cni-bin\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-var-lib-cni-multus\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482918 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-ovnkube-config\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482961 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm47b\" (UniqueName: \"kubernetes.io/projected/9ff19efc-23e1-46a6-bb9d-0a7c58155f5d-kube-api-access-hm47b\") pod \"node-ca-2q9p5\" (UID: \"9ff19efc-23e1-46a6-bb9d-0a7c58155f5d\") " pod="openshift-image-registry/node-ca-2q9p5" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.482987 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-os-release\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.483033 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-host-var-lib-cni-multus\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.483057 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f1bd416-ec0a-4201-9582-e7fdc92716fb-iptables-alerter-script\") pod \"iptables-alerter-5xwxp\" (UID: \"5f1bd416-ec0a-4201-9582-e7fdc92716fb\") " pod="openshift-network-operator/iptables-alerter-5xwxp" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.483068 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aec4f361-86f0-460d-b894-8e60ac0e0c2d-os-release\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.483769 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-env-overrides\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.483846 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-ovnkube-script-lib\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.484387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.483931 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-ovnkube-config\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.485122 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.484700 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-ovn-node-metrics-cert\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.493054 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.492711 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:30:03.493054 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.492740 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:30:03.493054 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.492754 2574 projected.go:196] Error preparing data for projected volume kube-api-access-r9cbj for pod openshift-network-diagnostics/network-check-target-8bt2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:30:03.493054 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.492829 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj podName:5be7aee8-69cb-4a45-a050-f59d3286eaa2 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:03.992813696 +0000 UTC m=+3.153306567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r9cbj" (UniqueName: "kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj") pod "network-check-target-8bt2h" (UID: "5be7aee8-69cb-4a45-a050-f59d3286eaa2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:30:03.493332 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.493315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-989m5\" (UniqueName: \"kubernetes.io/projected/56a87d39-88ec-4fbd-a3c0-24a060c3e42a-kube-api-access-989m5\") pod \"ovnkube-node-xnnsg\" (UID: \"56a87d39-88ec-4fbd-a3c0-24a060c3e42a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.493510 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.493482 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpxdt\" (UniqueName: \"kubernetes.io/projected/5f1bd416-ec0a-4201-9582-e7fdc92716fb-kube-api-access-fpxdt\") pod \"iptables-alerter-5xwxp\" (UID: \"5f1bd416-ec0a-4201-9582-e7fdc92716fb\") " pod="openshift-network-operator/iptables-alerter-5xwxp" Jun 03 21:30:03.493932 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.493914 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm47b\" (UniqueName: \"kubernetes.io/projected/9ff19efc-23e1-46a6-bb9d-0a7c58155f5d-kube-api-access-hm47b\") pod \"node-ca-2q9p5\" (UID: \"9ff19efc-23e1-46a6-bb9d-0a7c58155f5d\") " pod="openshift-image-registry/node-ca-2q9p5" Jun 03 21:30:03.494572 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.494543 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnw6r\" (UniqueName: \"kubernetes.io/projected/aec4f361-86f0-460d-b894-8e60ac0e0c2d-kube-api-access-gnw6r\") pod \"multus-dq8xx\" (UID: \"aec4f361-86f0-460d-b894-8e60ac0e0c2d\") " pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.561727 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.561692 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" Jun 03 21:30:03.569214 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.569191 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qjn6" Jun 03 21:30:03.582788 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.582763 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9thtn" Jun 03 21:30:03.586181 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.586157 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" Jun 03 21:30:03.593749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.593727 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mh6hm" Jun 03 21:30:03.601421 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.601405 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dq8xx" Jun 03 21:30:03.610009 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.609984 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:03.617655 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.617636 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5xwxp" Jun 03 21:30:03.623586 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.623561 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2q9p5" Jun 03 21:30:03.885620 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.885541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:03.885620 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:03.885583 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:03.885812 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.885691 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:30:03.885812 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.885756 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs podName:5de8b995-a02a-4656-9d2e-ac20d31fb96c nodeName:}" failed. No retries permitted until 2026-06-03 21:30:04.885743651 +0000 UTC m=+4.046236520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs") pod "network-metrics-daemon-rcbhk" (UID: "5de8b995-a02a-4656-9d2e-ac20d31fb96c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:30:03.885812 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.885695 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:30:03.885927 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:03.885843 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret podName:ef9739dc-ca42-4f19-861f-6450aab361b5 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:04.885827998 +0000 UTC m=+4.046320885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret") pod "global-pull-secret-syncer-bcm8v" (UID: "ef9739dc-ca42-4f19-861f-6450aab361b5") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:30:04.087958 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:04.087909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cbj\" (UniqueName: \"kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj\") pod \"network-check-target-8bt2h\" (UID: \"5be7aee8-69cb-4a45-a050-f59d3286eaa2\") " pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:04.088137 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:04.088118 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:30:04.088195 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:04.088145 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:30:04.088195 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:04.088158 2574 projected.go:196] Error preparing data for projected volume kube-api-access-r9cbj for pod openshift-network-diagnostics/network-check-target-8bt2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:30:04.088304 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:04.088228 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj podName:5be7aee8-69cb-4a45-a050-f59d3286eaa2 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:05.088208254 +0000 UTC m=+4.248701145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9cbj" (UniqueName: "kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj") pod "network-check-target-8bt2h" (UID: "5be7aee8-69cb-4a45-a050-f59d3286eaa2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:30:04.303683 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:04.303509 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 21:25:03 +0000 UTC" deadline="2028-03-05 18:56:11.367135984 +0000 UTC" Jun 03 21:30:04.303683 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:04.303679 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15381h26m7.063460007s" Jun 03 21:30:04.314925 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:04.314899 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636aa090_3355_4fa0_a449_b1dd15f18979.slice/crio-5bee8ba1e89b78c1c8c384b8a19839cac0f20942995be5be63d3d3f964182854 WatchSource:0}: Error finding container 5bee8ba1e89b78c1c8c384b8a19839cac0f20942995be5be63d3d3f964182854: Status 404 returned error can't find the container with id 5bee8ba1e89b78c1c8c384b8a19839cac0f20942995be5be63d3d3f964182854 Jun 03 21:30:04.320747 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:04.320675 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee37aacc_f650_4207_8162_b21ee9928e9b.slice/crio-9293fc91fa281dc418adbd16c92b5bb9af228d11c3642000006ffeff1414bc05 WatchSource:0}: Error finding container 9293fc91fa281dc418adbd16c92b5bb9af228d11c3642000006ffeff1414bc05: Status 404 returned error can't find the container with id 9293fc91fa281dc418adbd16c92b5bb9af228d11c3642000006ffeff1414bc05 Jun 03 21:30:04.323552 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:04.323522 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1bd416_ec0a_4201_9582_e7fdc92716fb.slice/crio-57f2ba20b14d3b6fddd258acf59d29ecdc3eae08875e0f77bd6f3ba1f915afba WatchSource:0}: Error finding container 57f2ba20b14d3b6fddd258acf59d29ecdc3eae08875e0f77bd6f3ba1f915afba: Status 404 returned error can't find the container with id 57f2ba20b14d3b6fddd258acf59d29ecdc3eae08875e0f77bd6f3ba1f915afba Jun 03 21:30:04.326230 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:04.326202 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8084eecf_3233_41e7_a360_b2ad82fc8899.slice/crio-e890f72bb9cc30b6d965c0527cc02a2c028275549e365e9657abe69398393265 WatchSource:0}: Error finding container e890f72bb9cc30b6d965c0527cc02a2c028275549e365e9657abe69398393265: Status 404 returned error can't find the container with id e890f72bb9cc30b6d965c0527cc02a2c028275549e365e9657abe69398393265 Jun 03 21:30:04.327079 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:04.327060 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff19efc_23e1_46a6_bb9d_0a7c58155f5d.slice/crio-60467fb4fa3a90ee5cfbe30602ba7b0b16812fc2a6eb3760687aa489711f7740 WatchSource:0}: Error finding container 60467fb4fa3a90ee5cfbe30602ba7b0b16812fc2a6eb3760687aa489711f7740: Status 404 returned error can't find the container with id 60467fb4fa3a90ee5cfbe30602ba7b0b16812fc2a6eb3760687aa489711f7740 Jun 03 21:30:04.328069 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:04.328050 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a87d39_88ec_4fbd_a3c0_24a060c3e42a.slice/crio-149a9c778f4154a348e28298988b0c27de10ba164fdde86af7e8834f759aa5e0 WatchSource:0}: Error finding container 149a9c778f4154a348e28298988b0c27de10ba164fdde86af7e8834f759aa5e0: Status 404 returned error can't find the container with id 149a9c778f4154a348e28298988b0c27de10ba164fdde86af7e8834f759aa5e0 Jun 03 21:30:04.329870 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:04.329750 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2536758_10d6_4ebb_8f50_09038d91191b.slice/crio-a8da4b9f979b12093c69eadb450fb4a2f1140ca5a56acf94c9c152eabe3a0d00 WatchSource:0}: Error finding container a8da4b9f979b12093c69eadb450fb4a2f1140ca5a56acf94c9c152eabe3a0d00: Status 404 returned error can't find the container with id a8da4b9f979b12093c69eadb450fb4a2f1140ca5a56acf94c9c152eabe3a0d00 Jun 03 21:30:04.330588 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:04.330566 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec4f361_86f0_460d_b894_8e60ac0e0c2d.slice/crio-c8a23038ea5bc8cc3f597202db5afb7d02708d35cbffb49ac2a434042087f7bb WatchSource:0}: Error finding container c8a23038ea5bc8cc3f597202db5afb7d02708d35cbffb49ac2a434042087f7bb: Status 404 returned error can't find the container with id c8a23038ea5bc8cc3f597202db5afb7d02708d35cbffb49ac2a434042087f7bb Jun 03 21:30:04.331679 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:04.331659 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd234ba0a_d9b7_4c4c_8198_501b74d44672.slice/crio-2bb53eecb9a204b32d45b17d10e25fae87440996080bf563f5f623179e86df7c WatchSource:0}: Error finding container 2bb53eecb9a204b32d45b17d10e25fae87440996080bf563f5f623179e86df7c: Status 404 returned error can't find the container with id 2bb53eecb9a204b32d45b17d10e25fae87440996080bf563f5f623179e86df7c Jun 03 21:30:04.341128 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:04.341078 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" event={"ID":"ee37aacc-f650-4207-8162-b21ee9928e9b","Type":"ContainerStarted","Data":"9293fc91fa281dc418adbd16c92b5bb9af228d11c3642000006ffeff1414bc05"} Jun 03 21:30:04.342271 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:04.342209 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" event={"ID":"636aa090-3355-4fa0-a449-b1dd15f18979","Type":"ContainerStarted","Data":"5bee8ba1e89b78c1c8c384b8a19839cac0f20942995be5be63d3d3f964182854"} Jun 03 21:30:04.343419 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:04.343387 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dq8xx" event={"ID":"aec4f361-86f0-460d-b894-8e60ac0e0c2d","Type":"ContainerStarted","Data":"c8a23038ea5bc8cc3f597202db5afb7d02708d35cbffb49ac2a434042087f7bb"} Jun 03 21:30:04.344798 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:04.344772 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mh6hm" event={"ID":"b2536758-10d6-4ebb-8f50-09038d91191b","Type":"ContainerStarted","Data":"a8da4b9f979b12093c69eadb450fb4a2f1140ca5a56acf94c9c152eabe3a0d00"} Jun 03 21:30:04.345991 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:04.345970 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9thtn" event={"ID":"d234ba0a-d9b7-4c4c-8198-501b74d44672","Type":"ContainerStarted","Data":"2bb53eecb9a204b32d45b17d10e25fae87440996080bf563f5f623179e86df7c"} Jun 03 21:30:04.347312 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:04.347286 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" event={"ID":"56a87d39-88ec-4fbd-a3c0-24a060c3e42a","Type":"ContainerStarted","Data":"149a9c778f4154a348e28298988b0c27de10ba164fdde86af7e8834f759aa5e0"} Jun 03 21:30:04.348315 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:04.348291 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2q9p5" event={"ID":"9ff19efc-23e1-46a6-bb9d-0a7c58155f5d","Type":"ContainerStarted","Data":"60467fb4fa3a90ee5cfbe30602ba7b0b16812fc2a6eb3760687aa489711f7740"} Jun 03 21:30:04.349310 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:04.349291 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qjn6" event={"ID":"8084eecf-3233-41e7-a360-b2ad82fc8899","Type":"ContainerStarted","Data":"e890f72bb9cc30b6d965c0527cc02a2c028275549e365e9657abe69398393265"} Jun 03 21:30:04.350375 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:04.350344 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5xwxp" event={"ID":"5f1bd416-ec0a-4201-9582-e7fdc92716fb","Type":"ContainerStarted","Data":"57f2ba20b14d3b6fddd258acf59d29ecdc3eae08875e0f77bd6f3ba1f915afba"} Jun 03 21:30:04.893969 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:04.893868 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:04.893969 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:04.893925 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:04.894187 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:04.894080 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:30:04.894187 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:04.894144 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs podName:5de8b995-a02a-4656-9d2e-ac20d31fb96c nodeName:}" failed. No retries permitted until 2026-06-03 21:30:06.894124425 +0000 UTC m=+6.054617316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs") pod "network-metrics-daemon-rcbhk" (UID: "5de8b995-a02a-4656-9d2e-ac20d31fb96c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:30:04.894597 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:04.894529 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:30:04.894597 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:04.894587 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret podName:ef9739dc-ca42-4f19-861f-6450aab361b5 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:06.894570126 +0000 UTC m=+6.055063013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret") pod "global-pull-secret-syncer-bcm8v" (UID: "ef9739dc-ca42-4f19-861f-6450aab361b5") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:30:05.096694 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:05.095937 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cbj\" (UniqueName: \"kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj\") pod \"network-check-target-8bt2h\" (UID: \"5be7aee8-69cb-4a45-a050-f59d3286eaa2\") " pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:05.096694 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:05.096202 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:30:05.096694 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:05.096237 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:30:05.096694 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:05.096250 2574 projected.go:196] Error preparing data for projected volume kube-api-access-r9cbj for pod openshift-network-diagnostics/network-check-target-8bt2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:30:05.096694 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:05.096317 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj podName:5be7aee8-69cb-4a45-a050-f59d3286eaa2 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:07.096297585 +0000 UTC m=+6.256790469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9cbj" (UniqueName: "kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj") pod "network-check-target-8bt2h" (UID: "5be7aee8-69cb-4a45-a050-f59d3286eaa2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:30:05.218777 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:05.218697 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:30:05.304160 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:05.304096 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 21:25:03 +0000 UTC" deadline="2028-03-18 12:24:27.130631158 +0000 UTC" Jun 03 21:30:05.304160 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:05.304158 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15686h54m21.826477281s" Jun 03 21:30:05.337669 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:05.336857 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:05.337669 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:05.337026 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:05.337669 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:05.337413 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:05.337669 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:05.337514 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:05.337669 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:05.337568 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:05.337669 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:05.337634 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:05.363993 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:05.363938 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-134.ec2.internal" event={"ID":"94f58f1173546d0833b3c3c2dbbc5151","Type":"ContainerStarted","Data":"fb81f67a9058026f70f505a971e4f1127549fee15d0441c703fcd9a7c16d4a5d"} Jun 03 21:30:05.368419 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:05.367877 2574 generic.go:356] "Generic (PLEG): container finished" podID="c92255e243f52f2137b97cabc47e811f" containerID="1cc243d591998b2d5fea7f8e866c862ec1298e8b6e416d7415517d81da115cd1" exitCode=0 Jun 03 21:30:05.368419 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:05.367917 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal" event={"ID":"c92255e243f52f2137b97cabc47e811f","Type":"ContainerDied","Data":"1cc243d591998b2d5fea7f8e866c862ec1298e8b6e416d7415517d81da115cd1"} Jun 03 21:30:05.380006 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:05.379227 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-134.ec2.internal" podStartSLOduration=3.379209256 podStartE2EDuration="3.379209256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:05.379130675 +0000 UTC m=+4.539623566" watchObservedRunningTime="2026-06-03 21:30:05.379209256 +0000 UTC m=+4.539702148" Jun 03 21:30:06.401939 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:06.401902 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal" event={"ID":"c92255e243f52f2137b97cabc47e811f","Type":"ContainerStarted","Data":"c155d24695a650916a407af055e47a125e99d7ea03f3c1c55f98a8ec9731fa80"} Jun 03 21:30:06.418224 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:06.418167 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-134.ec2.internal" podStartSLOduration=4.418143462 podStartE2EDuration="4.418143462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:06.417357684 +0000 UTC m=+5.577850576" watchObservedRunningTime="2026-06-03 21:30:06.418143462 +0000 UTC m=+5.578636355" Jun 03 21:30:06.911338 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:06.911175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:06.911338 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:06.911231 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:06.911698 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:06.911405 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:30:06.911698 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:06.911470 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs podName:5de8b995-a02a-4656-9d2e-ac20d31fb96c nodeName:}" failed. No retries permitted until 2026-06-03 21:30:10.911450628 +0000 UTC m=+10.071943520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs") pod "network-metrics-daemon-rcbhk" (UID: "5de8b995-a02a-4656-9d2e-ac20d31fb96c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:30:06.912061 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:06.911941 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:30:06.912061 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:06.912020 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret podName:ef9739dc-ca42-4f19-861f-6450aab361b5 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:10.912003436 +0000 UTC m=+10.072496325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret") pod "global-pull-secret-syncer-bcm8v" (UID: "ef9739dc-ca42-4f19-861f-6450aab361b5") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:30:07.113653 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:07.113071 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cbj\" (UniqueName: \"kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj\") pod \"network-check-target-8bt2h\" (UID: \"5be7aee8-69cb-4a45-a050-f59d3286eaa2\") " pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:07.113653 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:07.113238 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:30:07.113653 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:07.113257 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:30:07.113653 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:07.113270 2574 projected.go:196] Error preparing data for projected volume kube-api-access-r9cbj for pod openshift-network-diagnostics/network-check-target-8bt2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:30:07.113653 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:07.113327 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj podName:5be7aee8-69cb-4a45-a050-f59d3286eaa2 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:11.113309157 +0000 UTC m=+10.273802049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9cbj" (UniqueName: "kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj") pod "network-check-target-8bt2h" (UID: "5be7aee8-69cb-4a45-a050-f59d3286eaa2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:30:07.335132 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:07.334347 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:07.335132 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:07.334480 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:07.335132 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:07.334844 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:07.335132 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:07.334919 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:07.335132 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:07.334983 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:07.335132 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:07.335052 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:09.332960 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:09.332402 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:09.332960 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:09.332550 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:09.332960 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:09.332773 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:09.332960 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:09.332895 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:09.332960 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:09.332939 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:09.333642 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:09.333033 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:10.948365 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:10.948158 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:10.948365 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:10.948268 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:10.948365 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:10.948342 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:30:10.948929 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:10.948411 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs podName:5de8b995-a02a-4656-9d2e-ac20d31fb96c nodeName:}" failed. No retries permitted until 2026-06-03 21:30:18.948391634 +0000 UTC m=+18.108884515 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs") pod "network-metrics-daemon-rcbhk" (UID: "5de8b995-a02a-4656-9d2e-ac20d31fb96c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:30:10.948929 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:10.948346 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:30:10.948929 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:10.948733 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret podName:ef9739dc-ca42-4f19-861f-6450aab361b5 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:18.948707208 +0000 UTC m=+18.109200090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret") pod "global-pull-secret-syncer-bcm8v" (UID: "ef9739dc-ca42-4f19-861f-6450aab361b5") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:30:11.150056 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:11.150012 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cbj\" (UniqueName: \"kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj\") pod \"network-check-target-8bt2h\" (UID: \"5be7aee8-69cb-4a45-a050-f59d3286eaa2\") " pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:11.150237 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:11.150174 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:30:11.150237 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:11.150194 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:30:11.150237 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:11.150208 2574 projected.go:196] Error preparing data for projected volume kube-api-access-r9cbj for pod openshift-network-diagnostics/network-check-target-8bt2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:30:11.150407 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:11.150267 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj podName:5be7aee8-69cb-4a45-a050-f59d3286eaa2 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:19.150249344 +0000 UTC m=+18.310742235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9cbj" (UniqueName: "kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj") pod "network-check-target-8bt2h" (UID: "5be7aee8-69cb-4a45-a050-f59d3286eaa2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:30:11.333084 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:11.332980 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:11.333243 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:11.333120 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:11.333243 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:11.333199 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:11.333352 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:11.333271 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:11.333352 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:11.333294 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:11.333450 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:11.333380 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:13.335480 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:13.335402 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:13.335480 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:13.335443 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:13.335989 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:13.335513 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:13.335989 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:13.335533 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:13.335989 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:13.335598 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:13.335989 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:13.335674 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:15.332433 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:15.332394 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:15.332433 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:15.332437 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:15.332905 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:15.332395 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:15.332905 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:15.332534 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:15.332905 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:15.332625 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:15.332905 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:15.332714 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:17.332602 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:17.332571 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:17.332602 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:17.332586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:17.333135 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:17.332695 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:17.333135 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:17.332746 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:17.333135 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:17.332779 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:17.333135 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:17.332849 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:19.004602 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:19.004556 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:19.005129 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:19.004680 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:30:19.005129 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:19.004701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:19.005129 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:19.004751 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret podName:ef9739dc-ca42-4f19-861f-6450aab361b5 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:35.00473502 +0000 UTC m=+34.165227905 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret") pod "global-pull-secret-syncer-bcm8v" (UID: "ef9739dc-ca42-4f19-861f-6450aab361b5") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:30:19.005129 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:19.004849 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:30:19.005129 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:19.004895 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs podName:5de8b995-a02a-4656-9d2e-ac20d31fb96c nodeName:}" failed. No retries permitted until 2026-06-03 21:30:35.004883098 +0000 UTC m=+34.165375967 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs") pod "network-metrics-daemon-rcbhk" (UID: "5de8b995-a02a-4656-9d2e-ac20d31fb96c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:30:19.205930 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:19.205893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cbj\" (UniqueName: \"kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj\") pod \"network-check-target-8bt2h\" (UID: \"5be7aee8-69cb-4a45-a050-f59d3286eaa2\") " pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:19.206141 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:19.206109 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:30:19.206141 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:19.206135 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:30:19.206141 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:19.206148 2574 projected.go:196] Error preparing data for projected volume kube-api-access-r9cbj for pod openshift-network-diagnostics/network-check-target-8bt2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:30:19.206343 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:19.206205 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj podName:5be7aee8-69cb-4a45-a050-f59d3286eaa2 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:35.206188513 +0000 UTC m=+34.366681382 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9cbj" (UniqueName: "kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj") pod "network-check-target-8bt2h" (UID: "5be7aee8-69cb-4a45-a050-f59d3286eaa2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:30:19.333004 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:19.332905 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:19.333153 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:19.332905 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:19.333153 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:19.333076 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:19.333153 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:19.333094 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:19.333304 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:19.333206 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:19.333352 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:19.333295 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:21.333397 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:21.333360 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:21.333880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:21.333473 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:21.333880 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:21.333493 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:21.333880 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:21.333618 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:21.333880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:21.333677 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:21.333880 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:21.333746 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:23.332995 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.332677 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:23.333589 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:23.333073 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:23.333589 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.332751 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:23.333589 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:23.333131 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:23.333589 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.332679 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:23.333589 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:23.333200 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:23.436489 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.436460 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" event={"ID":"56a87d39-88ec-4fbd-a3c0-24a060c3e42a","Type":"ContainerStarted","Data":"8e2c8686ee3bc904ba9eff011fc7b96a99d8b03971708cb9c53cb8f14a318f29"} Jun 03 21:30:23.436609 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.436554 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" event={"ID":"56a87d39-88ec-4fbd-a3c0-24a060c3e42a","Type":"ContainerStarted","Data":"10dff97f1bb830405d0ad7b47c5805b62f2ed60d474f85ef26152a03750d660e"} Jun 03 21:30:23.436609 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.436604 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" event={"ID":"56a87d39-88ec-4fbd-a3c0-24a060c3e42a","Type":"ContainerStarted","Data":"917a695d3ecaf23009d0a52458bdded119ffb7564874544bc723bae0f83a4eb8"} Jun 03 21:30:23.436705 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.436650 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" event={"ID":"56a87d39-88ec-4fbd-a3c0-24a060c3e42a","Type":"ContainerStarted","Data":"ff6572d554791aefbd5c83288529fc18bc017478a36c0910e007f15a6ee4bddd"} Jun 03 21:30:23.437816 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.437792 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2q9p5" event={"ID":"9ff19efc-23e1-46a6-bb9d-0a7c58155f5d","Type":"ContainerStarted","Data":"2d2a17f1ac2b1adb29e5ad79887a3e36947ee92900ef709d5197b182070e3549"} Jun 03 21:30:23.439020 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.438999 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qjn6" event={"ID":"8084eecf-3233-41e7-a360-b2ad82fc8899","Type":"ContainerStarted","Data":"1d91e207eaaf037a11014c70a9e9854f15160dc3677d03e81fd6f16a89885ad4"} Jun 03 21:30:23.440257 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.440233 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" event={"ID":"ee37aacc-f650-4207-8162-b21ee9928e9b","Type":"ContainerStarted","Data":"60c5686b76fce999a519e6819b493ee947892e7bee80f96f6f6e1ef1886988ac"} Jun 03 21:30:23.441547 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.441525 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" event={"ID":"636aa090-3355-4fa0-a449-b1dd15f18979","Type":"ContainerStarted","Data":"15c86d829253cb95e799e52be983d2a34140b8087f8daa484d1e213f21639191"} Jun 03 21:30:23.442718 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.442693 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dq8xx" event={"ID":"aec4f361-86f0-460d-b894-8e60ac0e0c2d","Type":"ContainerStarted","Data":"3eff57b13e9c9bdc92dfba0649e112200a55a2f42bda3a11f596e3d9ce3174a0"} Jun 03 21:30:23.444031 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.444008 2574 generic.go:356] "Generic (PLEG): container finished" podID="b2536758-10d6-4ebb-8f50-09038d91191b" containerID="0f7930e82b99dcdee8f2f4eaea122a7b4678f2349c41003adc5219cd449abfd2" exitCode=0 Jun 03 21:30:23.444120 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.444087 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mh6hm" event={"ID":"b2536758-10d6-4ebb-8f50-09038d91191b","Type":"ContainerDied","Data":"0f7930e82b99dcdee8f2f4eaea122a7b4678f2349c41003adc5219cd449abfd2"} Jun 03 21:30:23.445402 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.445374 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9thtn" event={"ID":"d234ba0a-d9b7-4c4c-8198-501b74d44672","Type":"ContainerStarted","Data":"d9c3adddaa47363718fb8260af73eb477b11237a11ac0775e2ae656b229f7cde"} Jun 03 21:30:23.455221 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.455178 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2q9p5" podStartSLOduration=3.923651995 podStartE2EDuration="22.455166323s" totalImagesPullingTime="18.531514328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:23.454824733 +0000 UTC m=+22.615317625" watchObservedRunningTime="2026-06-03 21:30:23.455166323 +0000 UTC m=+22.615659213" Jun 03 21:30:23.486886 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.486845 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4qjn6" podStartSLOduration=3.975558292 podStartE2EDuration="22.486829159s" totalImagesPullingTime="18.511270867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:23.486466012 +0000 UTC m=+22.646958902" watchObservedRunningTime="2026-06-03 21:30:23.486829159 +0000 UTC m=+22.647322049" Jun 03 21:30:23.487006 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.486962 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dq8xx" podStartSLOduration=3.917584245 podStartE2EDuration="22.486940518s" totalImagesPullingTime="18.569356273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:23.470438487 +0000 UTC m=+22.630931378" watchObservedRunningTime="2026-06-03 21:30:23.486940518 +0000 UTC m=+22.647433408" Jun 03 21:30:23.531118 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.531071 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t9bx8" podStartSLOduration=3.974102266 podStartE2EDuration="22.531054915s" totalImagesPullingTime="18.556952649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:23.530202333 +0000 UTC m=+22.690695223" watchObservedRunningTime="2026-06-03 21:30:23.531054915 +0000 UTC m=+22.691547805" Jun 03 21:30:23.547711 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.547643 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9thtn" podStartSLOduration=8.841865711 podStartE2EDuration="22.547624058s" totalImagesPullingTime="13.705758347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:23.547377601 +0000 UTC m=+22.707870493" watchObservedRunningTime="2026-06-03 21:30:23.547624058 +0000 UTC m=+22.708116950" Jun 03 21:30:23.815462 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.815366 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9thtn" Jun 03 21:30:23.816062 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:23.816042 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9thtn" Jun 03 21:30:24.388846 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:24.388814 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 21:30:24.451380 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:24.451341 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" event={"ID":"56a87d39-88ec-4fbd-a3c0-24a060c3e42a","Type":"ContainerStarted","Data":"f8c9e35b5ed3e0608d7a73077423471f490fa66078ead64cbb4c72e0216e0e3e"} Jun 03 21:30:24.451580 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:24.451441 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" event={"ID":"56a87d39-88ec-4fbd-a3c0-24a060c3e42a","Type":"ContainerStarted","Data":"a4b253b74ad7b9fd8006e1111257d8d6f8e8d0320fd68ed664ff81a2cb5f4b54"} Jun 03 21:30:24.455837 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:24.455762 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5xwxp" event={"ID":"5f1bd416-ec0a-4201-9582-e7fdc92716fb","Type":"ContainerStarted","Data":"80b53986c1170eda0074d62d5688581488f78a2e17cfe300e35e6d9762dd0264"} Jun 03 21:30:24.457904 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:24.457878 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" event={"ID":"636aa090-3355-4fa0-a449-b1dd15f18979","Type":"ContainerStarted","Data":"cb3669c54fc219f97d71a4f8fd7b054b076139c9601f4ae65fe37197fada6fa1"} Jun 03 21:30:24.458393 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:24.458372 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9thtn" Jun 03 21:30:24.458849 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:24.458826 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9thtn" Jun 03 21:30:24.470383 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:24.470290 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5xwxp" podStartSLOduration=4.917478064 podStartE2EDuration="23.470272042s" totalImagesPullingTime="18.552793978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:24.469674033 +0000 UTC m=+23.630166926" watchObservedRunningTime="2026-06-03 21:30:24.470272042 +0000 UTC m=+23.630764934" Jun 03 21:30:25.332604 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:25.332490 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T21:30:24.388840869Z","UUID":"1496b84f-6727-457b-bb94-d0a2c144a5f9","Handler":null,"Name":"","Endpoint":""} Jun 03 21:30:25.332902 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:25.332643 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:25.332902 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:25.332659 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:25.332902 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:25.332766 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:25.332902 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:25.332816 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:25.333116 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:25.332911 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:25.333116 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:25.333018 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:25.334327 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:25.334287 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 21:30:25.334327 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:25.334321 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 21:30:26.465800 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:26.465578 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" event={"ID":"636aa090-3355-4fa0-a449-b1dd15f18979","Type":"ContainerStarted","Data":"f46e9e2517c89ac3ae0f77dc7b1416f143767e91f32f21c73b0267e8f7aa1a0d"} Jun 03 21:30:26.469741 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:26.469497 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" event={"ID":"56a87d39-88ec-4fbd-a3c0-24a060c3e42a","Type":"ContainerStarted","Data":"1d59f5ff0894c9f4964c41d2213b7494fcbdc44356efb134faeac2f57b8afdeb"} Jun 03 21:30:26.483809 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:26.483761 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5m4st" podStartSLOduration=4.691270364 podStartE2EDuration="25.483746199s" totalImagesPullingTime="20.792475835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:26.483581051 +0000 UTC m=+25.644073943" watchObservedRunningTime="2026-06-03 21:30:26.483746199 +0000 UTC m=+25.644239087" Jun 03 21:30:27.332764 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:27.332679 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:27.332936 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:27.332685 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:27.332936 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:27.332818 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:27.332936 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:27.332833 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:27.332936 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:27.332929 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:27.333174 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:27.333049 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:28.477319 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:28.477051 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" event={"ID":"56a87d39-88ec-4fbd-a3c0-24a060c3e42a","Type":"ContainerStarted","Data":"05a2b5ecad365766422536032135245574f039c2a6e7baebd19536cbac38d099"} Jun 03 21:30:28.478207 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:28.477330 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:28.478207 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:28.477391 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:28.479017 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:28.478994 2574 generic.go:356] "Generic (PLEG): container finished" podID="b2536758-10d6-4ebb-8f50-09038d91191b" containerID="ecff8ef50bf5f2ae461bb74be1791850709b3da22c7a3d7c5b34807b48d854a9" exitCode=0 Jun 03 21:30:28.479142 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:28.479022 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mh6hm" event={"ID":"b2536758-10d6-4ebb-8f50-09038d91191b","Type":"ContainerDied","Data":"ecff8ef50bf5f2ae461bb74be1791850709b3da22c7a3d7c5b34807b48d854a9"} Jun 03 21:30:28.493479 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:28.493460 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:28.506231 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:28.506190 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" podStartSLOduration=8.877783215000001 podStartE2EDuration="27.506176322s" totalImagesPullingTime="18.628393107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:28.505920128 +0000 UTC m=+27.666413018" watchObservedRunningTime="2026-06-03 21:30:28.506176322 +0000 UTC m=+27.666669212" Jun 03 21:30:29.332792 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:29.332764 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:29.332792 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:29.332783 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:29.333037 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:29.332783 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:29.333037 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:29.332865 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:29.333037 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:29.332963 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:29.333037 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:29.333014 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:29.481711 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:29.481679 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:29.496586 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:29.496561 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:30:29.888143 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:29.888065 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bcm8v"] Jun 03 21:30:29.888325 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:29.888177 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:29.888325 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:29.888261 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:29.895355 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:29.895332 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8bt2h"] Jun 03 21:30:29.895469 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:29.895417 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:29.895538 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:29.895517 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:29.898623 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:29.898597 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rcbhk"] Jun 03 21:30:29.898735 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:29.898696 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:29.898828 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:29.898808 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:30.485987 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:30.485933 2574 generic.go:356] "Generic (PLEG): container finished" podID="b2536758-10d6-4ebb-8f50-09038d91191b" containerID="b7b950ed816e979ac684bf0972f6b8641c866aa5d976adcbc7458b4642e904aa" exitCode=0 Jun 03 21:30:30.485987 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:30.485982 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mh6hm" event={"ID":"b2536758-10d6-4ebb-8f50-09038d91191b","Type":"ContainerDied","Data":"b7b950ed816e979ac684bf0972f6b8641c866aa5d976adcbc7458b4642e904aa"} Jun 03 21:30:31.332913 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:31.332879 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:31.333095 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:31.332993 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:31.333095 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:31.333040 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:31.333171 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:31.333130 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:32.333013 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:32.332779 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:32.333349 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:32.333038 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:32.493201 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:32.493149 2574 generic.go:356] "Generic (PLEG): container finished" podID="b2536758-10d6-4ebb-8f50-09038d91191b" containerID="11079083968da5b31f2235572732fcb952fab8f1063699c75e3281797f8e17cb" exitCode=0 Jun 03 21:30:32.493357 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:32.493211 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mh6hm" event={"ID":"b2536758-10d6-4ebb-8f50-09038d91191b","Type":"ContainerDied","Data":"11079083968da5b31f2235572732fcb952fab8f1063699c75e3281797f8e17cb"} Jun 03 21:30:33.332197 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:33.332137 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:33.332414 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:33.332261 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:33.332414 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:33.332315 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:33.332489 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:33.332413 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:34.332042 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:34.332006 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:34.332601 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:34.332127 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:35.015594 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:35.015559 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:35.015594 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:35.015599 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:35.015837 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:35.015724 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:30:35.015837 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:35.015785 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs podName:5de8b995-a02a-4656-9d2e-ac20d31fb96c nodeName:}" failed. No retries permitted until 2026-06-03 21:31:07.015765423 +0000 UTC m=+66.176258292 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs") pod "network-metrics-daemon-rcbhk" (UID: "5de8b995-a02a-4656-9d2e-ac20d31fb96c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:30:35.015837 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:35.015722 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:30:35.016026 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:35.015872 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret podName:ef9739dc-ca42-4f19-861f-6450aab361b5 nodeName:}" failed. No retries permitted until 2026-06-03 21:31:07.01585348 +0000 UTC m=+66.176346374 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret") pod "global-pull-secret-syncer-bcm8v" (UID: "ef9739dc-ca42-4f19-861f-6450aab361b5") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:30:35.216903 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:35.216866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cbj\" (UniqueName: \"kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj\") pod \"network-check-target-8bt2h\" (UID: \"5be7aee8-69cb-4a45-a050-f59d3286eaa2\") " pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:35.217076 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:35.217025 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:30:35.217076 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:35.217047 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:30:35.217076 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:35.217060 2574 projected.go:196] Error preparing data for projected volume kube-api-access-r9cbj for pod openshift-network-diagnostics/network-check-target-8bt2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:30:35.217227 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:35.217118 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj podName:5be7aee8-69cb-4a45-a050-f59d3286eaa2 nodeName:}" failed. No retries permitted until 2026-06-03 21:31:07.217098117 +0000 UTC m=+66.377590988 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9cbj" (UniqueName: "kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj") pod "network-check-target-8bt2h" (UID: "5be7aee8-69cb-4a45-a050-f59d3286eaa2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:30:35.332725 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:35.332638 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:35.333313 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:35.332774 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:30:35.333313 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:35.332800 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:35.333313 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:35.332902 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcm8v" podUID="ef9739dc-ca42-4f19-861f-6450aab361b5" Jun 03 21:30:36.331991 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.331958 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:36.332175 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:36.332062 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bt2h" podUID="5be7aee8-69cb-4a45-a050-f59d3286eaa2" Jun 03 21:30:36.631751 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.631682 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-134.ec2.internal" event="NodeReady" Jun 03 21:30:36.632202 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.631820 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 21:30:36.666891 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.666859 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d6577f7f-hl892"] Jun 03 21:30:36.669610 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.669589 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.671794 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.671769 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 21:30:36.671913 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.671781 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 21:30:36.671994 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.671918 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 21:30:36.672172 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.672159 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6m9lg\"" Jun 03 21:30:36.682987 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.680563 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 21:30:36.684424 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.684401 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8dcpk"] Jun 03 21:30:36.687272 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.687254 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d6577f7f-hl892"] Jun 03 21:30:36.687354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.687332 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:36.688903 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.688883 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jsbh9"] Jun 03 21:30:36.689739 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.689720 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 21:30:36.689823 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.689800 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x7hbm\"" Jun 03 21:30:36.689886 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.689727 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 21:30:36.692190 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.692169 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jsbh9" Jun 03 21:30:36.695198 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.695179 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 21:30:36.695448 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.695425 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-97rvb\"" Jun 03 21:30:36.695448 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.695435 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 21:30:36.695580 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.695426 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 21:30:36.696696 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.696676 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8dcpk"] Jun 03 21:30:36.700852 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.700832 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jsbh9"] Jun 03 21:30:36.827408 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.827387 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02da8b3c-0c85-415e-8c2e-bbda6e77a851-ca-trust-extracted\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.827489 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.827419 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:36.827489 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.827439 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d9rx\" (UniqueName: \"kubernetes.io/projected/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-kube-api-access-7d9rx\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:36.827489 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.827456 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75d06df5-a8a1-4f2c-8564-7c46da054383-cert\") pod \"ingress-canary-jsbh9\" (UID: \"75d06df5-a8a1-4f2c-8564-7c46da054383\") " pod="openshift-ingress-canary/ingress-canary-jsbh9" Jun 03 21:30:36.827489 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.827473 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh2ln\" (UniqueName: \"kubernetes.io/projected/75d06df5-a8a1-4f2c-8564-7c46da054383-kube-api-access-sh2ln\") pod \"ingress-canary-jsbh9\" (UID: \"75d06df5-a8a1-4f2c-8564-7c46da054383\") " pod="openshift-ingress-canary/ingress-canary-jsbh9" Jun 03 21:30:36.827732 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.827571 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02da8b3c-0c85-415e-8c2e-bbda6e77a851-trusted-ca\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.827732 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.827635 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-tmp-dir\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:36.827732 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.827682 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.827732 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.827701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-config-volume\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:36.827732 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.827719 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02da8b3c-0c85-415e-8c2e-bbda6e77a851-image-registry-private-configuration\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.827928 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.827740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-certificates\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.827928 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.827779 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02da8b3c-0c85-415e-8c2e-bbda6e77a851-installation-pull-secrets\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.827928 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.827803 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-bound-sa-token\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.827928 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.827852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzkp7\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-kube-api-access-lzkp7\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.855099 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.855073 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:36.928214 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02da8b3c-0c85-415e-8c2e-bbda6e77a851-trusted-ca\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.928333 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-tmp-dir\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:36.928333 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.928333 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928289 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-config-volume\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:36.928333 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928320 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02da8b3c-0c85-415e-8c2e-bbda6e77a851-image-registry-private-configuration\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.928518 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928399 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-certificates\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.928518 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02da8b3c-0c85-415e-8c2e-bbda6e77a851-installation-pull-secrets\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.928518 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:36.928405 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:30:36.928518 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-bound-sa-token\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.928518 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:36.928481 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6577f7f-hl892: secret "image-registry-tls" not found Jun 03 21:30:36.928746 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzkp7\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-kube-api-access-lzkp7\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.928746 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:36.928577 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls podName:02da8b3c-0c85-415e-8c2e-bbda6e77a851 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:37.428559973 +0000 UTC m=+36.589052845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls") pod "image-registry-7d6577f7f-hl892" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851") : secret "image-registry-tls" not found Jun 03 21:30:36.928746 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02da8b3c-0c85-415e-8c2e-bbda6e77a851-ca-trust-extracted\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.928746 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928631 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:36.928746 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d9rx\" (UniqueName: \"kubernetes.io/projected/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-kube-api-access-7d9rx\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:36.928746 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75d06df5-a8a1-4f2c-8564-7c46da054383-cert\") pod \"ingress-canary-jsbh9\" (UID: \"75d06df5-a8a1-4f2c-8564-7c46da054383\") " pod="openshift-ingress-canary/ingress-canary-jsbh9" Jun 03 21:30:36.928746 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928690 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-tmp-dir\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:36.928746 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.928708 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh2ln\" (UniqueName: \"kubernetes.io/projected/75d06df5-a8a1-4f2c-8564-7c46da054383-kube-api-access-sh2ln\") pod \"ingress-canary-jsbh9\" (UID: \"75d06df5-a8a1-4f2c-8564-7c46da054383\") " pod="openshift-ingress-canary/ingress-canary-jsbh9" Jun 03 21:30:36.929216 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.929007 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-config-volume\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:36.929216 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:36.929106 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:30:36.929216 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:36.929157 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls podName:50dd4927-55d7-4ac2-b9fc-34cf27a08b7f nodeName:}" failed. No retries permitted until 2026-06-03 21:30:37.429139001 +0000 UTC m=+36.589631888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls") pod "dns-default-8dcpk" (UID: "50dd4927-55d7-4ac2-b9fc-34cf27a08b7f") : secret "dns-default-metrics-tls" not found Jun 03 21:30:36.929355 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.929302 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02da8b3c-0c85-415e-8c2e-bbda6e77a851-ca-trust-extracted\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.929406 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.929379 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02da8b3c-0c85-415e-8c2e-bbda6e77a851-trusted-ca\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.929451 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.929437 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-certificates\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.932477 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.932447 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02da8b3c-0c85-415e-8c2e-bbda6e77a851-image-registry-private-configuration\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.932582 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.932436 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02da8b3c-0c85-415e-8c2e-bbda6e77a851-installation-pull-secrets\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.932582 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.932560 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75d06df5-a8a1-4f2c-8564-7c46da054383-cert\") pod \"ingress-canary-jsbh9\" (UID: \"75d06df5-a8a1-4f2c-8564-7c46da054383\") " pod="openshift-ingress-canary/ingress-canary-jsbh9" Jun 03 21:30:36.937625 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.937600 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d9rx\" (UniqueName: \"kubernetes.io/projected/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-kube-api-access-7d9rx\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:36.938071 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.938053 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-bound-sa-token\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.938175 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.938156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh2ln\" (UniqueName: \"kubernetes.io/projected/75d06df5-a8a1-4f2c-8564-7c46da054383-kube-api-access-sh2ln\") pod \"ingress-canary-jsbh9\" (UID: \"75d06df5-a8a1-4f2c-8564-7c46da054383\") " pod="openshift-ingress-canary/ingress-canary-jsbh9" Jun 03 21:30:36.939246 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.939228 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzkp7\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-kube-api-access-lzkp7\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:36.945303 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:36.945277 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:37.002442 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:37.002405 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jsbh9" Jun 03 21:30:37.133476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:37.133450 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jsbh9"] Jun 03 21:30:37.136640 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:30:37.136609 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d06df5_a8a1_4f2c_8564_7c46da054383.slice/crio-07f51af321d9ac8bf9baed90ce4a73fc56260dd13ba43f7e1ebc627774683efa WatchSource:0}: Error finding container 07f51af321d9ac8bf9baed90ce4a73fc56260dd13ba43f7e1ebc627774683efa: Status 404 returned error can't find the container with id 07f51af321d9ac8bf9baed90ce4a73fc56260dd13ba43f7e1ebc627774683efa Jun 03 21:30:37.332081 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:37.332044 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:30:37.332237 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:37.332044 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:30:37.334477 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:37.334455 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 21:30:37.334593 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:37.334498 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 21:30:37.334593 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:37.334466 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvgnm\"" Jun 03 21:30:37.432803 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:37.432713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:37.432973 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:37.432829 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:37.432973 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:37.432877 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:30:37.432973 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:37.432897 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6577f7f-hl892: secret "image-registry-tls" not found Jun 03 21:30:37.433139 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:37.432979 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:30:37.433139 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:37.432986 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls podName:02da8b3c-0c85-415e-8c2e-bbda6e77a851 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:38.432964825 +0000 UTC m=+37.593457719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls") pod "image-registry-7d6577f7f-hl892" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851") : secret "image-registry-tls" not found Jun 03 21:30:37.433139 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:37.433025 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls podName:50dd4927-55d7-4ac2-b9fc-34cf27a08b7f nodeName:}" failed. No retries permitted until 2026-06-03 21:30:38.433014945 +0000 UTC m=+37.593507826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls") pod "dns-default-8dcpk" (UID: "50dd4927-55d7-4ac2-b9fc-34cf27a08b7f") : secret "dns-default-metrics-tls" not found Jun 03 21:30:37.509308 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:37.509277 2574 generic.go:356] "Generic (PLEG): container finished" podID="b2536758-10d6-4ebb-8f50-09038d91191b" containerID="11d685ca8298f731978b778bd08ba7b09cd7dd458931159e6e0d07b7b16db9ea" exitCode=0 Jun 03 21:30:37.509459 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:37.509345 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mh6hm" event={"ID":"b2536758-10d6-4ebb-8f50-09038d91191b","Type":"ContainerDied","Data":"11d685ca8298f731978b778bd08ba7b09cd7dd458931159e6e0d07b7b16db9ea"} Jun 03 21:30:37.510498 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:37.510477 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jsbh9" event={"ID":"75d06df5-a8a1-4f2c-8564-7c46da054383","Type":"ContainerStarted","Data":"07f51af321d9ac8bf9baed90ce4a73fc56260dd13ba43f7e1ebc627774683efa"} Jun 03 21:30:38.180881 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:38.180837 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:38.332407 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:38.332369 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:30:38.334909 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:38.334883 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 21:30:38.335050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:38.334996 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 21:30:38.335103 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:38.335048 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pfkft\"" Jun 03 21:30:38.440904 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:38.440812 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:38.440904 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:38.440864 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:38.441117 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:38.440989 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:30:38.441117 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:38.441054 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls podName:50dd4927-55d7-4ac2-b9fc-34cf27a08b7f nodeName:}" failed. No retries permitted until 2026-06-03 21:30:40.441036501 +0000 UTC m=+39.601529370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls") pod "dns-default-8dcpk" (UID: "50dd4927-55d7-4ac2-b9fc-34cf27a08b7f") : secret "dns-default-metrics-tls" not found Jun 03 21:30:38.441117 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:38.440994 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:30:38.441117 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:38.441088 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6577f7f-hl892: secret "image-registry-tls" not found Jun 03 21:30:38.441271 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:38.441168 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls podName:02da8b3c-0c85-415e-8c2e-bbda6e77a851 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:40.441155655 +0000 UTC m=+39.601648524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls") pod "image-registry-7d6577f7f-hl892" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851") : secret "image-registry-tls" not found Jun 03 21:30:38.516762 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:38.516719 2574 generic.go:356] "Generic (PLEG): container finished" podID="b2536758-10d6-4ebb-8f50-09038d91191b" containerID="e0f2d2cddbf64805d2f80247fd9412cd14626cca9b95cfb6fc31527a99d48e26" exitCode=0 Jun 03 21:30:38.516762 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:38.516763 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mh6hm" event={"ID":"b2536758-10d6-4ebb-8f50-09038d91191b","Type":"ContainerDied","Data":"e0f2d2cddbf64805d2f80247fd9412cd14626cca9b95cfb6fc31527a99d48e26"} Jun 03 21:30:39.522205 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:39.522018 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mh6hm" event={"ID":"b2536758-10d6-4ebb-8f50-09038d91191b","Type":"ContainerStarted","Data":"6b7d8d0f7c25f460439d6c49d55efcedaa4f72d851faf8585c4ee770595765f6"} Jun 03 21:30:39.546265 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:39.546213 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mh6hm" podStartSLOduration=9.021866006 podStartE2EDuration="38.546196087s" totalImagesPullingTime="29.524330081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:39.545135848 +0000 UTC m=+38.705628739" watchObservedRunningTime="2026-06-03 21:30:39.546196087 +0000 UTC m=+38.706689007" Jun 03 21:30:39.667175 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:39.667137 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:39.767573 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:39.767543 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:40.200618 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:40.200572 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:40.273110 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:40.273079 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:40.456187 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:40.456101 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:40.456187 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:40.456150 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:40.456366 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:40.456247 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:30:40.456366 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:40.456254 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:30:40.456366 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:40.456314 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls podName:50dd4927-55d7-4ac2-b9fc-34cf27a08b7f nodeName:}" failed. No retries permitted until 2026-06-03 21:30:44.456299444 +0000 UTC m=+43.616792313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls") pod "dns-default-8dcpk" (UID: "50dd4927-55d7-4ac2-b9fc-34cf27a08b7f") : secret "dns-default-metrics-tls" not found Jun 03 21:30:40.456366 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:40.456258 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6577f7f-hl892: secret "image-registry-tls" not found Jun 03 21:30:40.456487 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:40.456384 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls podName:02da8b3c-0c85-415e-8c2e-bbda6e77a851 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:44.456372423 +0000 UTC m=+43.616865292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls") pod "image-registry-7d6577f7f-hl892" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851") : secret "image-registry-tls" not found Jun 03 21:30:40.526346 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:40.526305 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jsbh9" event={"ID":"75d06df5-a8a1-4f2c-8564-7c46da054383","Type":"ContainerStarted","Data":"25d053fe3311e572a1ccb9affcd86ea3d0261bd0217d0eee79926c33e033c4ed"} Jun 03 21:30:40.543630 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:40.543582 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jsbh9" podStartSLOduration=1.962603249 podStartE2EDuration="4.543566505s" totalImagesPullingTime="2.580963256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:40.543263185 +0000 UTC m=+39.703756077" watchObservedRunningTime="2026-06-03 21:30:40.543566505 +0000 UTC m=+39.704059395" Jun 03 21:30:44.485106 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:44.485065 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:44.485470 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:44.485139 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:44.485470 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:44.485210 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:30:44.485470 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:44.485272 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:30:44.485470 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:44.485288 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6577f7f-hl892: secret "image-registry-tls" not found Jun 03 21:30:44.485470 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:44.485275 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls podName:50dd4927-55d7-4ac2-b9fc-34cf27a08b7f nodeName:}" failed. No retries permitted until 2026-06-03 21:30:52.48525739 +0000 UTC m=+51.645750260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls") pod "dns-default-8dcpk" (UID: "50dd4927-55d7-4ac2-b9fc-34cf27a08b7f") : secret "dns-default-metrics-tls" not found Jun 03 21:30:44.485470 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:44.485361 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls podName:02da8b3c-0c85-415e-8c2e-bbda6e77a851 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:52.485339782 +0000 UTC m=+51.645832666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls") pod "image-registry-7d6577f7f-hl892" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851") : secret "image-registry-tls" not found Jun 03 21:30:47.986128 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:47.986087 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:48.042824 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:48.042795 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:49.824394 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:49.824364 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:49.922693 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:49.922659 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:50.536065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:50.536029 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:50.639020 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:50.638987 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:50.718992 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:50.718939 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:51.564573 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:51.564538 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:51.664747 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:51.664712 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:52.268858 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:52.268825 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:52.370648 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:52.370614 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:52.463316 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:52.463281 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:52.527074 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:52.526997 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:30:52.548192 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:52.548168 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:30:52.548283 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:52.548213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:30:52.548333 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:52.548320 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:30:52.548396 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:52.548387 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls podName:50dd4927-55d7-4ac2-b9fc-34cf27a08b7f nodeName:}" failed. No retries permitted until 2026-06-03 21:31:08.548373121 +0000 UTC m=+67.708865995 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls") pod "dns-default-8dcpk" (UID: "50dd4927-55d7-4ac2-b9fc-34cf27a08b7f") : secret "dns-default-metrics-tls" not found Jun 03 21:30:52.548442 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:52.548323 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:30:52.548442 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:52.548425 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6577f7f-hl892: secret "image-registry-tls" not found Jun 03 21:30:52.548501 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:30:52.548467 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls podName:02da8b3c-0c85-415e-8c2e-bbda6e77a851 nodeName:}" failed. No retries permitted until 2026-06-03 21:31:08.548455203 +0000 UTC m=+67.708948088 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls") pod "image-registry-7d6577f7f-hl892" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851") : secret "image-registry-tls" not found Jun 03 21:30:53.503886 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:30:53.503845 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:31:01.503739 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:01.503713 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xnnsg" Jun 03 21:31:01.656488 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:01.656436 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:31:01.757856 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:01.757773 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:31:02.878032 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:02.878000 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:31:02.938278 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:02.938249 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:31:04.647137 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:04.647100 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:31:04.719323 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:04.719290 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:31:07.054853 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.054815 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:31:07.054853 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.054855 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:31:07.057419 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.057398 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 21:31:07.057475 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.057452 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 21:31:07.065213 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:31:07.065192 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 21:31:07.065298 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:31:07.065263 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs podName:5de8b995-a02a-4656-9d2e-ac20d31fb96c nodeName:}" failed. No retries permitted until 2026-06-03 21:32:11.065245474 +0000 UTC m=+130.225738342 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs") pod "network-metrics-daemon-rcbhk" (UID: "5de8b995-a02a-4656-9d2e-ac20d31fb96c") : secret "metrics-daemon-secret" not found Jun 03 21:31:07.068726 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.068702 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef9739dc-ca42-4f19-861f-6450aab361b5-original-pull-secret\") pod \"global-pull-secret-syncer-bcm8v\" (UID: \"ef9739dc-ca42-4f19-861f-6450aab361b5\") " pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:31:07.255795 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.255748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cbj\" (UniqueName: \"kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj\") pod \"network-check-target-8bt2h\" (UID: \"5be7aee8-69cb-4a45-a050-f59d3286eaa2\") " pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:31:07.258651 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.258632 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 21:31:07.268909 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.268893 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 21:31:07.279026 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.279004 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9cbj\" (UniqueName: \"kubernetes.io/projected/5be7aee8-69cb-4a45-a050-f59d3286eaa2-kube-api-access-r9cbj\") pod \"network-check-target-8bt2h\" (UID: \"5be7aee8-69cb-4a45-a050-f59d3286eaa2\") " pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:31:07.347203 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.347184 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcm8v" Jun 03 21:31:07.443725 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.443701 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pfkft\"" Jun 03 21:31:07.451538 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.451515 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:31:07.465777 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.465755 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bcm8v"] Jun 03 21:31:07.467937 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:31:07.467915 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9739dc_ca42_4f19_861f_6450aab361b5.slice/crio-d0aaf9f5c7a790e31189ab9b13a3f1cb7d9409f5853bab53419dbdfcd3028ca7 WatchSource:0}: Error finding container d0aaf9f5c7a790e31189ab9b13a3f1cb7d9409f5853bab53419dbdfcd3028ca7: Status 404 returned error can't find the container with id d0aaf9f5c7a790e31189ab9b13a3f1cb7d9409f5853bab53419dbdfcd3028ca7 Jun 03 21:31:07.583739 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.583701 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8bt2h"] Jun 03 21:31:07.587764 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:31:07.587731 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be7aee8_69cb_4a45_a050_f59d3286eaa2.slice/crio-f2b340d11b52e7f44ba5410f279dc0c8fbbaa0ca1fa1e2cbb770e91f83326ed3 WatchSource:0}: Error finding container f2b340d11b52e7f44ba5410f279dc0c8fbbaa0ca1fa1e2cbb770e91f83326ed3: Status 404 returned error can't find the container with id f2b340d11b52e7f44ba5410f279dc0c8fbbaa0ca1fa1e2cbb770e91f83326ed3 Jun 03 21:31:07.588261 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.588232 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bcm8v" event={"ID":"ef9739dc-ca42-4f19-861f-6450aab361b5","Type":"ContainerStarted","Data":"d0aaf9f5c7a790e31189ab9b13a3f1cb7d9409f5853bab53419dbdfcd3028ca7"} Jun 03 21:31:07.740721 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.740640 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:31:07.802519 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:07.802481 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:31:08.567722 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:08.567685 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:31:08.568273 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:31:08.567843 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:31:08.568273 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:31:08.567866 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6577f7f-hl892: secret "image-registry-tls" not found Jun 03 21:31:08.568273 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:31:08.567930 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:31:08.568273 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:08.567842 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:31:08.568273 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:31:08.567933 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls podName:02da8b3c-0c85-415e-8c2e-bbda6e77a851 nodeName:}" failed. No retries permitted until 2026-06-03 21:31:40.567908804 +0000 UTC m=+99.728401677 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls") pod "image-registry-7d6577f7f-hl892" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851") : secret "image-registry-tls" not found Jun 03 21:31:08.568273 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:31:08.568018 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls podName:50dd4927-55d7-4ac2-b9fc-34cf27a08b7f nodeName:}" failed. No retries permitted until 2026-06-03 21:31:40.567992381 +0000 UTC m=+99.728485259 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls") pod "dns-default-8dcpk" (UID: "50dd4927-55d7-4ac2-b9fc-34cf27a08b7f") : secret "dns-default-metrics-tls" not found Jun 03 21:31:08.593054 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:08.593010 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8bt2h" event={"ID":"5be7aee8-69cb-4a45-a050-f59d3286eaa2","Type":"ContainerStarted","Data":"f2b340d11b52e7f44ba5410f279dc0c8fbbaa0ca1fa1e2cbb770e91f83326ed3"} Jun 03 21:31:12.604933 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:12.604899 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bcm8v" event={"ID":"ef9739dc-ca42-4f19-861f-6450aab361b5","Type":"ContainerStarted","Data":"ddb268562f50bb250e370cb99f2725890ba225d9ae1d99eb2f3474df9d6fcb7b"} Jun 03 21:31:12.606502 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:12.606481 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8bt2h" event={"ID":"5be7aee8-69cb-4a45-a050-f59d3286eaa2","Type":"ContainerStarted","Data":"c559363c5899a25b69ab3826553a15d931fd4b4026da162ff9d48031751ca1da"} Jun 03 21:31:12.606630 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:12.606531 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:31:12.636849 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:12.636808 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bcm8v" podStartSLOduration=66.924025458 podStartE2EDuration="1m11.636795386s" totalImagesPullingTime="4.712769928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:31:12.621106587 +0000 UTC m=+71.781599479" watchObservedRunningTime="2026-06-03 21:31:12.636795386 +0000 UTC m=+71.797288277" Jun 03 21:31:12.637299 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:12.637276 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8bt2h" podStartSLOduration=67.049211152 podStartE2EDuration="1m11.637272162s" totalImagesPullingTime="4.58806101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:31:12.636633201 +0000 UTC m=+71.797126092" watchObservedRunningTime="2026-06-03 21:31:12.637272162 +0000 UTC m=+71.797765053" Jun 03 21:31:15.388805 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:15.388773 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:31:15.451383 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:15.451345 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:31:28.595201 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:28.595071 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:31:28.652594 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:28.652565 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:31:28.718317 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:28.718288 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:31:40.600916 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:40.600881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:31:40.601288 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:40.600933 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:31:40.601288 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:31:40.601046 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:31:40.601288 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:31:40.601052 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:31:40.601288 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:31:40.601130 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls podName:50dd4927-55d7-4ac2-b9fc-34cf27a08b7f nodeName:}" failed. No retries permitted until 2026-06-03 21:32:44.601113403 +0000 UTC m=+163.761606288 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls") pod "dns-default-8dcpk" (UID: "50dd4927-55d7-4ac2-b9fc-34cf27a08b7f") : secret "dns-default-metrics-tls" not found Jun 03 21:31:40.601288 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:31:40.601060 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6577f7f-hl892: secret "image-registry-tls" not found Jun 03 21:31:40.601288 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:31:40.601240 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls podName:02da8b3c-0c85-415e-8c2e-bbda6e77a851 nodeName:}" failed. No retries permitted until 2026-06-03 21:32:44.601223533 +0000 UTC m=+163.761716406 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls") pod "image-registry-7d6577f7f-hl892" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851") : secret "image-registry-tls" not found Jun 03 21:31:43.611806 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:31:43.611762 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8bt2h" Jun 03 21:32:11.115031 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:32:11.114943 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:32:11.115536 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:32:11.115213 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 21:32:11.115536 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:32:11.115302 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs podName:5de8b995-a02a-4656-9d2e-ac20d31fb96c nodeName:}" failed. No retries permitted until 2026-06-03 21:34:13.115278696 +0000 UTC m=+252.275771587 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs") pod "network-metrics-daemon-rcbhk" (UID: "5de8b995-a02a-4656-9d2e-ac20d31fb96c") : secret "metrics-daemon-secret" not found Jun 03 21:32:39.679299 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:32:39.679255 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" podUID="02da8b3c-0c85-415e-8c2e-bbda6e77a851" Jun 03 21:32:39.697101 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:32:39.697052 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8dcpk" podUID="50dd4927-55d7-4ac2-b9fc-34cf27a08b7f" Jun 03 21:32:39.807577 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:32:39.807551 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8dcpk" Jun 03 21:32:39.807691 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:32:39.807587 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:32:40.342669 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:32:40.342624 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rcbhk" podUID="5de8b995-a02a-4656-9d2e-ac20d31fb96c" Jun 03 21:32:44.643037 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:32:44.642994 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:32:44.643464 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:32:44.643067 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:32:44.643464 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:32:44.643142 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:32:44.643464 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:32:44.643206 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:32:44.643464 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:32:44.643222 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6577f7f-hl892: secret "image-registry-tls" not found Jun 03 21:32:44.643464 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:32:44.643234 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls podName:50dd4927-55d7-4ac2-b9fc-34cf27a08b7f nodeName:}" failed. No retries permitted until 2026-06-03 21:34:46.643217962 +0000 UTC m=+285.803710843 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls") pod "dns-default-8dcpk" (UID: "50dd4927-55d7-4ac2-b9fc-34cf27a08b7f") : secret "dns-default-metrics-tls" not found Jun 03 21:32:44.643464 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:32:44.643271 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls podName:02da8b3c-0c85-415e-8c2e-bbda6e77a851 nodeName:}" failed. No retries permitted until 2026-06-03 21:34:46.643259074 +0000 UTC m=+285.803751946 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls") pod "image-registry-7d6577f7f-hl892" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851") : secret "image-registry-tls" not found Jun 03 21:32:54.332000 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:32:54.331920 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:32:56.617642 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:32:56.617604 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:24.842750 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.842714 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wspxj"] Jun 03 21:33:24.845435 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.845412 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wspxj" Jun 03 21:33:24.847043 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.847005 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5"] Jun 03 21:33:24.848023 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.848002 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2gqkv\"" Jun 03 21:33:24.849637 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.849619 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4jd9"] Jun 03 21:33:24.849734 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.849715 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" Jun 03 21:33:24.851819 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.851789 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 21:33:24.851930 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.851827 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:33:24.852463 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.852439 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hh8fq\"" Jun 03 21:33:24.852561 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.852487 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 21:33:24.852625 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.852587 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-njxb4"] Jun 03 21:33:24.853023 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.852834 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 21:33:24.853423 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.853407 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4jd9" Jun 03 21:33:24.856782 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.856763 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9rvgk\"" Jun 03 21:33:24.857256 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.857232 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:33:24.857467 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.857450 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 21:33:24.858473 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.858450 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6dc9b8464f-bvbd4"] Jun 03 21:33:24.858580 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.858525 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" Jun 03 21:33:24.861157 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.860979 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 21:33:24.861780 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.861442 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 21:33:24.861780 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.861699 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-22j4n\"" Jun 03 21:33:24.862015 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.861924 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wspxj"] Jun 03 21:33:24.862015 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.861982 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5"] Jun 03 21:33:24.862015 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.862013 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:24.862386 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.862365 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4jd9"] Jun 03 21:33:24.864054 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.864038 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 21:33:24.864195 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.864057 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b5b2w\"" Jun 03 21:33:24.864300 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.864058 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 21:33:24.864365 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.864062 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 21:33:24.864418 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.864082 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 21:33:24.864602 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.864581 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 21:33:24.864782 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.864767 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 21:33:24.867606 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.867556 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-njxb4"] Jun 03 21:33:24.868783 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.868763 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dc9b8464f-bvbd4"] Jun 03 21:33:24.910830 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.910802 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:24.910830 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.910831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:24.911092 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.910860 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b318bdcc-3c11-4345-be3a-1deff77e2627-nginx-conf\") pod \"networking-console-plugin-68d6b54856-njxb4\" (UID: \"b318bdcc-3c11-4345-be3a-1deff77e2627\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" Jun 03 21:33:24.911092 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.910877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4061535b-e4c4-4966-ac4b-a2e841d5ee2f-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5\" (UID: \"4061535b-e4c4-4966-ac4b-a2e841d5ee2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" Jun 03 21:33:24.911092 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.910942 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-default-certificate\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:24.911092 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.910994 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-stats-auth\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:24.911092 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.911021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8fvg\" (UniqueName: \"kubernetes.io/projected/7905342a-e33d-4b1a-a037-e3a37b0c0b08-kube-api-access-q8fvg\") pod \"volume-data-source-validator-78dd696465-m4jd9\" (UID: \"7905342a-e33d-4b1a-a037-e3a37b0c0b08\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4jd9" Jun 03 21:33:24.911092 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.911053 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-njxb4\" (UID: \"b318bdcc-3c11-4345-be3a-1deff77e2627\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" Jun 03 21:33:24.911092 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.911087 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pndr\" (UniqueName: \"kubernetes.io/projected/c0c695be-005c-4abe-bd89-9c3d7d580144-kube-api-access-2pndr\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:24.911356 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.911121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg2bn\" (UniqueName: \"kubernetes.io/projected/aee9e5ce-b78a-4bc2-9017-41041a6e29ab-kube-api-access-kg2bn\") pod \"network-check-source-dbd9cf844-wspxj\" (UID: \"aee9e5ce-b78a-4bc2-9017-41041a6e29ab\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wspxj" Jun 03 21:33:24.911356 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.911147 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4061535b-e4c4-4966-ac4b-a2e841d5ee2f-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5\" (UID: \"4061535b-e4c4-4966-ac4b-a2e841d5ee2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" Jun 03 21:33:24.911356 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.911169 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hvz4\" (UniqueName: \"kubernetes.io/projected/4061535b-e4c4-4966-ac4b-a2e841d5ee2f-kube-api-access-8hvz4\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5\" (UID: \"4061535b-e4c4-4966-ac4b-a2e841d5ee2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" Jun 03 21:33:24.942325 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.942295 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-69684796bc-fzcfw"] Jun 03 21:33:24.945230 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.945215 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:24.951177 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.951159 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 21:33:24.953719 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.953703 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 21:33:24.953819 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.953724 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8dknr\"" Jun 03 21:33:24.953819 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.953727 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 21:33:24.954419 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.954400 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 21:33:24.959404 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.959381 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 21:33:24.960436 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:24.960419 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-fzcfw"] Jun 03 21:33:25.012523 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.012486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b318bdcc-3c11-4345-be3a-1deff77e2627-nginx-conf\") pod \"networking-console-plugin-68d6b54856-njxb4\" (UID: \"b318bdcc-3c11-4345-be3a-1deff77e2627\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" Jun 03 21:33:25.012523 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.012525 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pndr\" (UniqueName: \"kubernetes.io/projected/c0c695be-005c-4abe-bd89-9c3d7d580144-kube-api-access-2pndr\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:25.012749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.012549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-tmp\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.012749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.012581 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4061535b-e4c4-4966-ac4b-a2e841d5ee2f-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5\" (UID: \"4061535b-e4c4-4966-ac4b-a2e841d5ee2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" Jun 03 21:33:25.012749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.012605 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-default-certificate\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:25.012749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.012626 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-stats-auth\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:25.012749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.012648 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8fvg\" (UniqueName: \"kubernetes.io/projected/7905342a-e33d-4b1a-a037-e3a37b0c0b08-kube-api-access-q8fvg\") pod \"volume-data-source-validator-78dd696465-m4jd9\" (UID: \"7905342a-e33d-4b1a-a037-e3a37b0c0b08\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4jd9" Jun 03 21:33:25.013030 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.012747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:25.013030 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.012795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-njxb4\" (UID: \"b318bdcc-3c11-4345-be3a-1deff77e2627\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" Jun 03 21:33:25.013030 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.012840 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg2bn\" (UniqueName: \"kubernetes.io/projected/aee9e5ce-b78a-4bc2-9017-41041a6e29ab-kube-api-access-kg2bn\") pod \"network-check-source-dbd9cf844-wspxj\" (UID: \"aee9e5ce-b78a-4bc2-9017-41041a6e29ab\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wspxj" Jun 03 21:33:25.013030 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.012870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hvz4\" (UniqueName: \"kubernetes.io/projected/4061535b-e4c4-4966-ac4b-a2e841d5ee2f-kube-api-access-8hvz4\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5\" (UID: \"4061535b-e4c4-4966-ac4b-a2e841d5ee2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" Jun 03 21:33:25.013030 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.012899 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-snapshots\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.013030 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:25.012978 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle podName:c0c695be-005c-4abe-bd89-9c3d7d580144 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:25.51293022 +0000 UTC m=+204.673423111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle") pod "router-default-6dc9b8464f-bvbd4" (UID: "c0c695be-005c-4abe-bd89-9c3d7d580144") : configmap references non-existent config key: service-ca.crt Jun 03 21:33:25.013030 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.013027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-trusted-ca-bundle\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.013412 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.013068 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-serving-cert\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.013412 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.013110 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4061535b-e4c4-4966-ac4b-a2e841d5ee2f-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5\" (UID: \"4061535b-e4c4-4966-ac4b-a2e841d5ee2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" Jun 03 21:33:25.013412 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.013141 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccmnr\" (UniqueName: \"kubernetes.io/projected/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-kube-api-access-ccmnr\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.013412 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.013169 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:25.013412 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.013193 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-service-ca-bundle\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.013412 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:25.013228 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 21:33:25.013412 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.013319 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b318bdcc-3c11-4345-be3a-1deff77e2627-nginx-conf\") pod \"networking-console-plugin-68d6b54856-njxb4\" (UID: \"b318bdcc-3c11-4345-be3a-1deff77e2627\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" Jun 03 21:33:25.013412 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:25.013336 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert podName:b318bdcc-3c11-4345-be3a-1deff77e2627 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:25.51331491 +0000 UTC m=+204.673807782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-njxb4" (UID: "b318bdcc-3c11-4345-be3a-1deff77e2627") : secret "networking-console-plugin-cert" not found Jun 03 21:33:25.013704 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:25.013437 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 21:33:25.013704 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:25.013507 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs podName:c0c695be-005c-4abe-bd89-9c3d7d580144 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:25.513487287 +0000 UTC m=+204.673980159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs") pod "router-default-6dc9b8464f-bvbd4" (UID: "c0c695be-005c-4abe-bd89-9c3d7d580144") : secret "router-metrics-certs-default" not found Jun 03 21:33:25.013783 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.013763 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4061535b-e4c4-4966-ac4b-a2e841d5ee2f-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5\" (UID: \"4061535b-e4c4-4966-ac4b-a2e841d5ee2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" Jun 03 21:33:25.015109 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.015087 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4061535b-e4c4-4966-ac4b-a2e841d5ee2f-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5\" (UID: \"4061535b-e4c4-4966-ac4b-a2e841d5ee2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" Jun 03 21:33:25.015217 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.015196 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-default-certificate\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:25.015275 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.015221 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-stats-auth\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:25.026957 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.026909 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8fvg\" (UniqueName: \"kubernetes.io/projected/7905342a-e33d-4b1a-a037-e3a37b0c0b08-kube-api-access-q8fvg\") pod \"volume-data-source-validator-78dd696465-m4jd9\" (UID: \"7905342a-e33d-4b1a-a037-e3a37b0c0b08\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4jd9" Jun 03 21:33:25.027170 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.027150 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg2bn\" (UniqueName: \"kubernetes.io/projected/aee9e5ce-b78a-4bc2-9017-41041a6e29ab-kube-api-access-kg2bn\") pod \"network-check-source-dbd9cf844-wspxj\" (UID: \"aee9e5ce-b78a-4bc2-9017-41041a6e29ab\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wspxj" Jun 03 21:33:25.027343 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.027325 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hvz4\" (UniqueName: \"kubernetes.io/projected/4061535b-e4c4-4966-ac4b-a2e841d5ee2f-kube-api-access-8hvz4\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5\" (UID: \"4061535b-e4c4-4966-ac4b-a2e841d5ee2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" Jun 03 21:33:25.027413 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.027354 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pndr\" (UniqueName: \"kubernetes.io/projected/c0c695be-005c-4abe-bd89-9c3d7d580144-kube-api-access-2pndr\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:25.033547 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.033524 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr"] Jun 03 21:33:25.037502 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.037487 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" Jun 03 21:33:25.039686 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.039665 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 21:33:25.039988 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.039972 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 21:33:25.040071 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.040056 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 21:33:25.040180 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.040154 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vhk9p\"" Jun 03 21:33:25.040675 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.040661 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:33:25.046796 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.046775 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr"] Jun 03 21:33:25.113928 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.113843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bedf9a36-437f-4f62-b901-a02d09fbf196-serving-cert\") pod \"service-ca-operator-5bc4cf794b-zlqdr\" (UID: \"bedf9a36-437f-4f62-b901-a02d09fbf196\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" Jun 03 21:33:25.113928 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.113896 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-snapshots\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.113928 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.113925 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-trusted-ca-bundle\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.114235 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.113965 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-serving-cert\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.114235 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.113985 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4wkl\" (UniqueName: \"kubernetes.io/projected/bedf9a36-437f-4f62-b901-a02d09fbf196-kube-api-access-v4wkl\") pod \"service-ca-operator-5bc4cf794b-zlqdr\" (UID: \"bedf9a36-437f-4f62-b901-a02d09fbf196\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" Jun 03 21:33:25.114235 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.114017 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bedf9a36-437f-4f62-b901-a02d09fbf196-config\") pod \"service-ca-operator-5bc4cf794b-zlqdr\" (UID: \"bedf9a36-437f-4f62-b901-a02d09fbf196\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" Jun 03 21:33:25.114235 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.114063 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccmnr\" (UniqueName: \"kubernetes.io/projected/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-kube-api-access-ccmnr\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.114235 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.114116 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-service-ca-bundle\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.114235 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.114155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-tmp\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.114562 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.114541 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-tmp\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.114562 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.114556 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-snapshots\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.114714 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.114696 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-trusted-ca-bundle\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.114766 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.114701 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-service-ca-bundle\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.116326 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.116304 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-serving-cert\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.121161 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.121143 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccmnr\" (UniqueName: \"kubernetes.io/projected/6d2b3d46-d831-4aa4-8828-8f630a2dcd22-kube-api-access-ccmnr\") pod \"insights-operator-69684796bc-fzcfw\" (UID: \"6d2b3d46-d831-4aa4-8828-8f630a2dcd22\") " pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.126614 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.126592 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:25.156320 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.156283 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wspxj" Jun 03 21:33:25.165515 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.165488 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" Jun 03 21:33:25.173530 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.173506 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4jd9" Jun 03 21:33:25.215393 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.215342 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bedf9a36-437f-4f62-b901-a02d09fbf196-serving-cert\") pod \"service-ca-operator-5bc4cf794b-zlqdr\" (UID: \"bedf9a36-437f-4f62-b901-a02d09fbf196\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" Jun 03 21:33:25.215540 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.215446 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4wkl\" (UniqueName: \"kubernetes.io/projected/bedf9a36-437f-4f62-b901-a02d09fbf196-kube-api-access-v4wkl\") pod \"service-ca-operator-5bc4cf794b-zlqdr\" (UID: \"bedf9a36-437f-4f62-b901-a02d09fbf196\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" Jun 03 21:33:25.215540 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.215484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bedf9a36-437f-4f62-b901-a02d09fbf196-config\") pod \"service-ca-operator-5bc4cf794b-zlqdr\" (UID: \"bedf9a36-437f-4f62-b901-a02d09fbf196\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" Jun 03 21:33:25.216264 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.216237 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bedf9a36-437f-4f62-b901-a02d09fbf196-config\") pod \"service-ca-operator-5bc4cf794b-zlqdr\" (UID: \"bedf9a36-437f-4f62-b901-a02d09fbf196\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" Jun 03 21:33:25.221906 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.221816 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bedf9a36-437f-4f62-b901-a02d09fbf196-serving-cert\") pod \"service-ca-operator-5bc4cf794b-zlqdr\" (UID: \"bedf9a36-437f-4f62-b901-a02d09fbf196\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" Jun 03 21:33:25.228993 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.225482 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:25.228993 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.225664 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4wkl\" (UniqueName: \"kubernetes.io/projected/bedf9a36-437f-4f62-b901-a02d09fbf196-kube-api-access-v4wkl\") pod \"service-ca-operator-5bc4cf794b-zlqdr\" (UID: \"bedf9a36-437f-4f62-b901-a02d09fbf196\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" Jun 03 21:33:25.253792 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.253531 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-fzcfw" Jun 03 21:33:25.310630 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.310566 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wspxj"] Jun 03 21:33:25.312402 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:33:25.312115 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee9e5ce_b78a_4bc2_9017_41041a6e29ab.slice/crio-97c59c320c1c29c089a92fae8334b23a7cb8bcacdb1fe6d7686cee2f22e303e6 WatchSource:0}: Error finding container 97c59c320c1c29c089a92fae8334b23a7cb8bcacdb1fe6d7686cee2f22e303e6: Status 404 returned error can't find the container with id 97c59c320c1c29c089a92fae8334b23a7cb8bcacdb1fe6d7686cee2f22e303e6 Jun 03 21:33:25.328722 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.328645 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5"] Jun 03 21:33:25.329470 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:33:25.329440 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4061535b_e4c4_4966_ac4b_a2e841d5ee2f.slice/crio-30f4b8596b2b6b4c8f0bd1c744f27d65b4347fe9e1696bde7348013684c4bd45 WatchSource:0}: Error finding container 30f4b8596b2b6b4c8f0bd1c744f27d65b4347fe9e1696bde7348013684c4bd45: Status 404 returned error can't find the container with id 30f4b8596b2b6b4c8f0bd1c744f27d65b4347fe9e1696bde7348013684c4bd45 Jun 03 21:33:25.343907 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.343778 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4jd9"] Jun 03 21:33:25.346757 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.346726 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" Jun 03 21:33:25.348076 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:33:25.348046 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7905342a_e33d_4b1a_a037_e3a37b0c0b08.slice/crio-7bd9d526259b790dbe71509a7eb55a5ecead00a37b6a24e5c1e1616ef06309c2 WatchSource:0}: Error finding container 7bd9d526259b790dbe71509a7eb55a5ecead00a37b6a24e5c1e1616ef06309c2: Status 404 returned error can't find the container with id 7bd9d526259b790dbe71509a7eb55a5ecead00a37b6a24e5c1e1616ef06309c2 Jun 03 21:33:25.404099 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.404068 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-fzcfw"] Jun 03 21:33:25.407669 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:33:25.407638 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d2b3d46_d831_4aa4_8828_8f630a2dcd22.slice/crio-739791e4151fc123eb86391f04ed79b9d90c8454fbc3ce949710c41d47068419 WatchSource:0}: Error finding container 739791e4151fc123eb86391f04ed79b9d90c8454fbc3ce949710c41d47068419: Status 404 returned error can't find the container with id 739791e4151fc123eb86391f04ed79b9d90c8454fbc3ce949710c41d47068419 Jun 03 21:33:25.476128 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.476093 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr"] Jun 03 21:33:25.478482 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:33:25.478461 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbedf9a36_437f_4f62_b901_a02d09fbf196.slice/crio-26633187811e6655a689c6d582711f4608c0f5abb35815a0b06cff3481408aa9 WatchSource:0}: Error finding container 26633187811e6655a689c6d582711f4608c0f5abb35815a0b06cff3481408aa9: Status 404 returned error can't find the container with id 26633187811e6655a689c6d582711f4608c0f5abb35815a0b06cff3481408aa9 Jun 03 21:33:25.518586 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.518551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:25.518728 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.518591 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-njxb4\" (UID: \"b318bdcc-3c11-4345-be3a-1deff77e2627\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" Jun 03 21:33:25.518728 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.518641 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:25.518845 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:25.518727 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 21:33:25.518845 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:25.518755 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle podName:c0c695be-005c-4abe-bd89-9c3d7d580144 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:26.518732406 +0000 UTC m=+205.679225308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle") pod "router-default-6dc9b8464f-bvbd4" (UID: "c0c695be-005c-4abe-bd89-9c3d7d580144") : configmap references non-existent config key: service-ca.crt Jun 03 21:33:25.518845 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:25.518736 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 21:33:25.518845 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:25.518782 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert podName:b318bdcc-3c11-4345-be3a-1deff77e2627 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:26.518771613 +0000 UTC m=+205.679264498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-njxb4" (UID: "b318bdcc-3c11-4345-be3a-1deff77e2627") : secret "networking-console-plugin-cert" not found Jun 03 21:33:25.518845 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:25.518800 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs podName:c0c695be-005c-4abe-bd89-9c3d7d580144 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:26.518789033 +0000 UTC m=+205.679281909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs") pod "router-default-6dc9b8464f-bvbd4" (UID: "c0c695be-005c-4abe-bd89-9c3d7d580144") : secret "router-metrics-certs-default" not found Jun 03 21:33:25.915024 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.914988 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" event={"ID":"bedf9a36-437f-4f62-b901-a02d09fbf196","Type":"ContainerStarted","Data":"26633187811e6655a689c6d582711f4608c0f5abb35815a0b06cff3481408aa9"} Jun 03 21:33:25.917539 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.917514 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wspxj" event={"ID":"aee9e5ce-b78a-4bc2-9017-41041a6e29ab","Type":"ContainerStarted","Data":"a343ea3b849f9ff27eb5baf68ff4e747de286f8fd55f1638d40641fab931d877"} Jun 03 21:33:25.917729 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.917710 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wspxj" event={"ID":"aee9e5ce-b78a-4bc2-9017-41041a6e29ab","Type":"ContainerStarted","Data":"97c59c320c1c29c089a92fae8334b23a7cb8bcacdb1fe6d7686cee2f22e303e6"} Jun 03 21:33:25.919090 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.919063 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-fzcfw" event={"ID":"6d2b3d46-d831-4aa4-8828-8f630a2dcd22","Type":"ContainerStarted","Data":"739791e4151fc123eb86391f04ed79b9d90c8454fbc3ce949710c41d47068419"} Jun 03 21:33:25.920431 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.920408 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" event={"ID":"4061535b-e4c4-4966-ac4b-a2e841d5ee2f","Type":"ContainerStarted","Data":"30f4b8596b2b6b4c8f0bd1c744f27d65b4347fe9e1696bde7348013684c4bd45"} Jun 03 21:33:25.921574 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.921550 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4jd9" event={"ID":"7905342a-e33d-4b1a-a037-e3a37b0c0b08","Type":"ContainerStarted","Data":"7bd9d526259b790dbe71509a7eb55a5ecead00a37b6a24e5c1e1616ef06309c2"} Jun 03 21:33:25.936275 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:25.935876 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wspxj" podStartSLOduration=1.9358583710000001 podStartE2EDuration="1.935858371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:33:25.934893046 +0000 UTC m=+205.095385938" watchObservedRunningTime="2026-06-03 21:33:25.935858371 +0000 UTC m=+205.096351243" Jun 03 21:33:26.528455 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:26.527510 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-njxb4\" (UID: \"b318bdcc-3c11-4345-be3a-1deff77e2627\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" Jun 03 21:33:26.528455 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:26.527605 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:26.528455 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:26.527677 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:26.528455 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:26.527829 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle podName:c0c695be-005c-4abe-bd89-9c3d7d580144 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:28.527810051 +0000 UTC m=+207.688302923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle") pod "router-default-6dc9b8464f-bvbd4" (UID: "c0c695be-005c-4abe-bd89-9c3d7d580144") : configmap references non-existent config key: service-ca.crt Jun 03 21:33:26.528455 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:26.528254 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 21:33:26.528455 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:26.528305 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert podName:b318bdcc-3c11-4345-be3a-1deff77e2627 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:28.528288929 +0000 UTC m=+207.688781801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-njxb4" (UID: "b318bdcc-3c11-4345-be3a-1deff77e2627") : secret "networking-console-plugin-cert" not found Jun 03 21:33:26.528455 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:26.528361 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 21:33:26.528455 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:26.528391 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs podName:c0c695be-005c-4abe-bd89-9c3d7d580144 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:28.52838172 +0000 UTC m=+207.688874591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs") pod "router-default-6dc9b8464f-bvbd4" (UID: "c0c695be-005c-4abe-bd89-9c3d7d580144") : secret "router-metrics-certs-default" not found Jun 03 21:33:27.929695 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:27.929658 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4jd9" event={"ID":"7905342a-e33d-4b1a-a037-e3a37b0c0b08","Type":"ContainerStarted","Data":"87c366f8e1a467bc1353a6d738e7f1f59096ff02e3ae771cfbb1bfd53338abfa"} Jun 03 21:33:27.946487 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:27.946442 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4jd9" podStartSLOduration=2.386471188 podStartE2EDuration="3.946425169s" totalImagesPullingTime="1.559953981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:33:27.945806637 +0000 UTC m=+207.106299530" watchObservedRunningTime="2026-06-03 21:33:27.946425169 +0000 UTC m=+207.106918074" Jun 03 21:33:28.020765 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:28.020731 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:28.545677 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:28.545642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-njxb4\" (UID: \"b318bdcc-3c11-4345-be3a-1deff77e2627\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" Jun 03 21:33:28.545834 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:28.545733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:28.545834 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:28.545805 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 21:33:28.545940 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:28.545857 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 21:33:28.545940 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:28.545813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:28.545940 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:28.545885 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert podName:b318bdcc-3c11-4345-be3a-1deff77e2627 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:32.545862472 +0000 UTC m=+211.706355343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-njxb4" (UID: "b318bdcc-3c11-4345-be3a-1deff77e2627") : secret "networking-console-plugin-cert" not found Jun 03 21:33:28.545940 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:28.545907 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs podName:c0c695be-005c-4abe-bd89-9c3d7d580144 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:32.54589954 +0000 UTC m=+211.706392410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs") pod "router-default-6dc9b8464f-bvbd4" (UID: "c0c695be-005c-4abe-bd89-9c3d7d580144") : secret "router-metrics-certs-default" not found Jun 03 21:33:28.545940 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:28.545920 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle podName:c0c695be-005c-4abe-bd89-9c3d7d580144 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:32.545915136 +0000 UTC m=+211.706408006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle") pod "router-default-6dc9b8464f-bvbd4" (UID: "c0c695be-005c-4abe-bd89-9c3d7d580144") : configmap references non-existent config key: service-ca.crt Jun 03 21:33:28.940430 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:28.940391 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" event={"ID":"bedf9a36-437f-4f62-b901-a02d09fbf196","Type":"ContainerStarted","Data":"e40a4139b8be6c3357280a7893be1907fd88efa69dc3a6da91c474b2048d0186"} Jun 03 21:33:28.941937 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:28.941916 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-fzcfw" event={"ID":"6d2b3d46-d831-4aa4-8828-8f630a2dcd22","Type":"ContainerStarted","Data":"08a59d55360c99cb2c2436d7398188487f0179caa7c4c05f8524540336175cd9"} Jun 03 21:33:28.943388 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:28.943363 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" event={"ID":"4061535b-e4c4-4966-ac4b-a2e841d5ee2f","Type":"ContainerStarted","Data":"d9e1de06941dffdcb2bcb849a74726a7b64343d8143f1465a73d3ef8d31f8598"} Jun 03 21:33:28.956539 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:28.956494 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" podStartSLOduration=0.926736406 podStartE2EDuration="3.95647795s" totalImagesPullingTime="3.029741544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:33:28.956365582 +0000 UTC m=+208.116858476" watchObservedRunningTime="2026-06-03 21:33:28.95647795 +0000 UTC m=+208.116970841" Jun 03 21:33:28.971725 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:28.971683 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" podStartSLOduration=1.801773067 podStartE2EDuration="4.971669815s" totalImagesPullingTime="3.169896748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:33:28.970098783 +0000 UTC m=+208.130591675" watchObservedRunningTime="2026-06-03 21:33:28.971669815 +0000 UTC m=+208.132162705" Jun 03 21:33:28.985965 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:28.985896 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-69684796bc-fzcfw" podStartSLOduration=1.892570162 podStartE2EDuration="4.985877217s" totalImagesPullingTime="3.093307055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:33:28.985478338 +0000 UTC m=+208.145971231" watchObservedRunningTime="2026-06-03 21:33:28.985877217 +0000 UTC m=+208.146370111" Jun 03 21:33:29.476150 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:29.476095 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:29.538560 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:29.538516 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:30.146578 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:30.146545 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:30.246726 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:30.246693 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:30.347750 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:30.347717 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:30.875849 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:30.875821 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:30.961242 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:30.961209 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:31.420907 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:31.420879 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qjn6_8084eecf-3233-41e7-a360-b2ad82fc8899/dns-node-resolver/0.log" Jun 03 21:33:32.221418 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.221388 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2q9p5_9ff19efc-23e1-46a6-bb9d-0a7c58155f5d/node-ca/0.log" Jun 03 21:33:32.477067 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.476987 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-5jpzf"] Jun 03 21:33:32.481197 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.481176 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-5jpzf" Jun 03 21:33:32.483255 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.483234 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 21:33:32.483347 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.483234 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 21:33:32.483936 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.483918 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tw62w\"" Jun 03 21:33:32.484034 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.483964 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 21:33:32.484034 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.484018 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 21:33:32.489036 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.489015 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-5jpzf"] Jun 03 21:33:32.510288 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.510258 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:32.574249 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.574209 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:32.582143 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.582121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0c8c7e04-62c7-4293-98ee-2872277748c6-signing-key\") pod \"service-ca-7d74d578b8-5jpzf\" (UID: \"0c8c7e04-62c7-4293-98ee-2872277748c6\") " pod="openshift-service-ca/service-ca-7d74d578b8-5jpzf" Jun 03 21:33:32.582272 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.582156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0c8c7e04-62c7-4293-98ee-2872277748c6-signing-cabundle\") pod \"service-ca-7d74d578b8-5jpzf\" (UID: \"0c8c7e04-62c7-4293-98ee-2872277748c6\") " pod="openshift-service-ca/service-ca-7d74d578b8-5jpzf" Jun 03 21:33:32.582272 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.582195 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:32.582272 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.582241 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-njxb4\" (UID: \"b318bdcc-3c11-4345-be3a-1deff77e2627\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" Jun 03 21:33:32.582425 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.582304 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2j8h\" (UniqueName: \"kubernetes.io/projected/0c8c7e04-62c7-4293-98ee-2872277748c6-kube-api-access-g2j8h\") pod \"service-ca-7d74d578b8-5jpzf\" (UID: \"0c8c7e04-62c7-4293-98ee-2872277748c6\") " pod="openshift-service-ca/service-ca-7d74d578b8-5jpzf" Jun 03 21:33:32.582425 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:32.582335 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle podName:c0c695be-005c-4abe-bd89-9c3d7d580144 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:40.58231417 +0000 UTC m=+219.742807052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle") pod "router-default-6dc9b8464f-bvbd4" (UID: "c0c695be-005c-4abe-bd89-9c3d7d580144") : configmap references non-existent config key: service-ca.crt Jun 03 21:33:32.582425 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:32.582372 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 21:33:32.582425 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:32.582412 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert podName:b318bdcc-3c11-4345-be3a-1deff77e2627 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:40.582401212 +0000 UTC m=+219.742894081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-njxb4" (UID: "b318bdcc-3c11-4345-be3a-1deff77e2627") : secret "networking-console-plugin-cert" not found Jun 03 21:33:32.582625 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.582444 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:32.582625 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:32.582507 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 21:33:32.582625 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:32.582529 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs podName:c0c695be-005c-4abe-bd89-9c3d7d580144 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:40.582522491 +0000 UTC m=+219.743015360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs") pod "router-default-6dc9b8464f-bvbd4" (UID: "c0c695be-005c-4abe-bd89-9c3d7d580144") : secret "router-metrics-certs-default" not found Jun 03 21:33:32.683024 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.682986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0c8c7e04-62c7-4293-98ee-2872277748c6-signing-key\") pod \"service-ca-7d74d578b8-5jpzf\" (UID: \"0c8c7e04-62c7-4293-98ee-2872277748c6\") " pod="openshift-service-ca/service-ca-7d74d578b8-5jpzf" Jun 03 21:33:32.683189 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.683035 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0c8c7e04-62c7-4293-98ee-2872277748c6-signing-cabundle\") pod \"service-ca-7d74d578b8-5jpzf\" (UID: \"0c8c7e04-62c7-4293-98ee-2872277748c6\") " pod="openshift-service-ca/service-ca-7d74d578b8-5jpzf" Jun 03 21:33:32.683189 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.683108 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2j8h\" (UniqueName: \"kubernetes.io/projected/0c8c7e04-62c7-4293-98ee-2872277748c6-kube-api-access-g2j8h\") pod \"service-ca-7d74d578b8-5jpzf\" (UID: \"0c8c7e04-62c7-4293-98ee-2872277748c6\") " pod="openshift-service-ca/service-ca-7d74d578b8-5jpzf" Jun 03 21:33:32.683747 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.683723 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0c8c7e04-62c7-4293-98ee-2872277748c6-signing-cabundle\") pod \"service-ca-7d74d578b8-5jpzf\" (UID: \"0c8c7e04-62c7-4293-98ee-2872277748c6\") " pod="openshift-service-ca/service-ca-7d74d578b8-5jpzf" Jun 03 21:33:32.685374 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.685357 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0c8c7e04-62c7-4293-98ee-2872277748c6-signing-key\") pod \"service-ca-7d74d578b8-5jpzf\" (UID: \"0c8c7e04-62c7-4293-98ee-2872277748c6\") " pod="openshift-service-ca/service-ca-7d74d578b8-5jpzf" Jun 03 21:33:32.690367 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.690345 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2j8h\" (UniqueName: \"kubernetes.io/projected/0c8c7e04-62c7-4293-98ee-2872277748c6-kube-api-access-g2j8h\") pod \"service-ca-7d74d578b8-5jpzf\" (UID: \"0c8c7e04-62c7-4293-98ee-2872277748c6\") " pod="openshift-service-ca/service-ca-7d74d578b8-5jpzf" Jun 03 21:33:32.790418 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.790339 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-5jpzf" Jun 03 21:33:32.912881 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.912848 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-5jpzf"] Jun 03 21:33:32.915678 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:33:32.915647 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8c7e04_62c7_4293_98ee_2872277748c6.slice/crio-b71255797e52d9534272b4e4853436ce89972cb6fd045a0c0b4ef9f2fbf6d089 WatchSource:0}: Error finding container b71255797e52d9534272b4e4853436ce89972cb6fd045a0c0b4ef9f2fbf6d089: Status 404 returned error can't find the container with id b71255797e52d9534272b4e4853436ce89972cb6fd045a0c0b4ef9f2fbf6d089 Jun 03 21:33:32.957346 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:32.957312 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-5jpzf" event={"ID":"0c8c7e04-62c7-4293-98ee-2872277748c6","Type":"ContainerStarted","Data":"b71255797e52d9534272b4e4853436ce89972cb6fd045a0c0b4ef9f2fbf6d089"} Jun 03 21:33:33.021833 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:33.021803 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jsbh9_75d06df5-a8a1-4f2c-8564-7c46da054383/serve-healthcheck-canary/0.log" Jun 03 21:33:33.031996 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:33.031962 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:33.121187 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:33.121152 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:33.455087 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:33.455013 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:33.961357 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:33.961327 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-5jpzf" event={"ID":"0c8c7e04-62c7-4293-98ee-2872277748c6","Type":"ContainerStarted","Data":"b0bf4b5cc23873d2895086fd6b487e18406df6926bd078dcf200b8703abeb88d"} Jun 03 21:33:34.956424 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:34.956385 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:35.223220 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:35.223131 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:35.326818 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:35.326767 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:35.384897 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:35.384855 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:35.443715 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:35.443687 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:35.664439 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:35.664399 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:36.677638 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:36.677602 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:37.060282 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:37.060190 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:37.151325 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:37.151274 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:37.270511 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:37.270475 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:37.471064 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:37.471034 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:37.861068 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:37.861036 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:38.462340 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:38.462309 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:38.854875 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:38.854843 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:38.955834 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:38.955804 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:39.305851 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:39.305764 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:39.659798 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:39.659756 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:39.862498 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:39.862450 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:40.464543 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:40.464514 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:40.650870 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:40.650833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:40.651043 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:40.650886 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-njxb4\" (UID: \"b318bdcc-3c11-4345-be3a-1deff77e2627\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" Jun 03 21:33:40.651043 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:40.650974 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:40.651043 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:40.651018 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle podName:c0c695be-005c-4abe-bd89-9c3d7d580144 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:56.650992121 +0000 UTC m=+235.811484993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle") pod "router-default-6dc9b8464f-bvbd4" (UID: "c0c695be-005c-4abe-bd89-9c3d7d580144") : configmap references non-existent config key: service-ca.crt Jun 03 21:33:40.651204 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:40.651045 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 21:33:40.651204 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:33:40.651121 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert podName:b318bdcc-3c11-4345-be3a-1deff77e2627 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:56.651104379 +0000 UTC m=+235.811597252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-njxb4" (UID: "b318bdcc-3c11-4345-be3a-1deff77e2627") : secret "networking-console-plugin-cert" not found Jun 03 21:33:40.653290 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:40.653261 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0c695be-005c-4abe-bd89-9c3d7d580144-metrics-certs\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:40.669909 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:40.669882 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:41.062243 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:41.062187 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:41.490453 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:41.490421 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:41.663038 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:41.663004 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:42.262722 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:42.262692 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:42.474709 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:42.474671 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:42.576249 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:42.576166 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:42.677176 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:42.677143 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:43.056499 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:43.056467 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:43.858867 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:43.858830 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:44.268894 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:44.268802 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:44.461959 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:44.461911 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:44.576423 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:44.576336 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:44.660432 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:44.660402 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:45.064650 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:45.064620 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:45.461198 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:45.461146 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:45.660434 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:45.660403 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:49.166690 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:49.166654 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:49.234129 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:49.234086 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:49.810804 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:49.810764 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:49.873705 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:49.873672 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:52.303996 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:52.303939 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:52.407411 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:52.407382 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:52.559055 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:52.558973 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:52.747677 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:52.747645 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:52.820635 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:52.820561 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:52.949631 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:52.949596 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:53.018791 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:53.018756 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:53.364738 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:53.364706 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:53.753061 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:53.752982 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:53.958546 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:53.958510 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:54.263099 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:54.263069 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:54.967443 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:54.967406 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:55.023050 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.023013 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:55.882478 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.882430 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-5jpzf" podStartSLOduration=23.882411227 podStartE2EDuration="23.882411227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:33:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:33:33.977454538 +0000 UTC m=+213.137947429" watchObservedRunningTime="2026-06-03 21:33:55.882411227 +0000 UTC m=+235.042904124" Jun 03 21:33:55.882729 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.882714 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vtbwv"] Jun 03 21:33:55.885916 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.885900 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:55.888706 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.888684 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 21:33:55.888825 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.888736 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 21:33:55.888825 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.888748 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5cgd6\"" Jun 03 21:33:55.904170 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.904144 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vtbwv"] Jun 03 21:33:55.971207 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.971174 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-56b467f5ff-x84jn"] Jun 03 21:33:55.974199 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.974178 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-x84jn" Jun 03 21:33:55.974413 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.974383 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvmpl\" (UniqueName: \"kubernetes.io/projected/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-kube-api-access-xvmpl\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:55.974525 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.974436 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:55.974525 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.974468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:55.974525 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.974496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-data-volume\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:55.974663 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.974641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-crio-socket\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:55.976172 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.976151 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 21:33:55.976268 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.976256 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 21:33:55.979374 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.979356 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-whm64\"" Jun 03 21:33:55.997171 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:55.997151 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-x84jn"] Jun 03 21:33:56.066461 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.066430 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:56.075551 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.075528 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-crio-socket\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:56.075663 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.075566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhqjw\" (UniqueName: \"kubernetes.io/projected/41898007-584b-4811-8c40-7d71206ba8bc-kube-api-access-bhqjw\") pod \"downloads-56b467f5ff-x84jn\" (UID: \"41898007-584b-4811-8c40-7d71206ba8bc\") " pod="openshift-console/downloads-56b467f5ff-x84jn" Jun 03 21:33:56.075663 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.075597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvmpl\" (UniqueName: \"kubernetes.io/projected/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-kube-api-access-xvmpl\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:56.075663 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.075648 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-crio-socket\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:56.075770 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.075676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:56.075770 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.075702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:56.075770 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.075733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-data-volume\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:56.076144 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.076123 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-data-volume\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:56.076284 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.076268 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:56.078055 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.078038 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:56.083243 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.083221 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvmpl\" (UniqueName: \"kubernetes.io/projected/4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d-kube-api-access-xvmpl\") pod \"insights-runtime-extractor-vtbwv\" (UID: \"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d\") " pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:56.171765 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.171685 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:56.176757 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.176737 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhqjw\" (UniqueName: \"kubernetes.io/projected/41898007-584b-4811-8c40-7d71206ba8bc-kube-api-access-bhqjw\") pod \"downloads-56b467f5ff-x84jn\" (UID: \"41898007-584b-4811-8c40-7d71206ba8bc\") " pod="openshift-console/downloads-56b467f5ff-x84jn" Jun 03 21:33:56.187396 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.187373 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhqjw\" (UniqueName: \"kubernetes.io/projected/41898007-584b-4811-8c40-7d71206ba8bc-kube-api-access-bhqjw\") pod \"downloads-56b467f5ff-x84jn\" (UID: \"41898007-584b-4811-8c40-7d71206ba8bc\") " pod="openshift-console/downloads-56b467f5ff-x84jn" Jun 03 21:33:56.198838 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.198820 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vtbwv" Jun 03 21:33:56.283273 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.283246 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-x84jn" Jun 03 21:33:56.325897 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.325871 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vtbwv"] Jun 03 21:33:56.328261 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:33:56.328234 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ccc2af5_33d2_406c_ab3e_8bf9b687cd0d.slice/crio-a29770fe8c8371a0351797e069051d725e02a27148e392a613d1e207123e2a58 WatchSource:0}: Error finding container a29770fe8c8371a0351797e069051d725e02a27148e392a613d1e207123e2a58: Status 404 returned error can't find the container with id a29770fe8c8371a0351797e069051d725e02a27148e392a613d1e207123e2a58 Jun 03 21:33:56.420775 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.420685 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-x84jn"] Jun 03 21:33:56.423497 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:33:56.423428 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41898007_584b_4811_8c40_7d71206ba8bc.slice/crio-b7a6b0942eddc1bb795ffcbf46a9b829fdeea9dc3c7b5cf1253f7abfd4f77289 WatchSource:0}: Error finding container b7a6b0942eddc1bb795ffcbf46a9b829fdeea9dc3c7b5cf1253f7abfd4f77289: Status 404 returned error can't find the container with id b7a6b0942eddc1bb795ffcbf46a9b829fdeea9dc3c7b5cf1253f7abfd4f77289 Jun 03 21:33:56.680831 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.680748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:56.680831 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.680786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-njxb4\" (UID: \"b318bdcc-3c11-4345-be3a-1deff77e2627\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" Jun 03 21:33:56.681368 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.681349 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c695be-005c-4abe-bd89-9c3d7d580144-service-ca-bundle\") pod \"router-default-6dc9b8464f-bvbd4\" (UID: \"c0c695be-005c-4abe-bd89-9c3d7d580144\") " pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:56.683069 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.683050 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b318bdcc-3c11-4345-be3a-1deff77e2627-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-njxb4\" (UID: \"b318bdcc-3c11-4345-be3a-1deff77e2627\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" Jun 03 21:33:56.684954 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.684930 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:56.806699 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.806674 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dc9b8464f-bvbd4"] Jun 03 21:33:56.808982 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:33:56.808924 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c695be_005c_4abe_bd89_9c3d7d580144.slice/crio-b0383e52339bd45ca7d92f3da5c9bffe5fc1597d6e75d30cd8e6d2c5bb3c13a7 WatchSource:0}: Error finding container b0383e52339bd45ca7d92f3da5c9bffe5fc1597d6e75d30cd8e6d2c5bb3c13a7: Status 404 returned error can't find the container with id b0383e52339bd45ca7d92f3da5c9bffe5fc1597d6e75d30cd8e6d2c5bb3c13a7 Jun 03 21:33:56.980359 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:56.980264 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" Jun 03 21:33:57.049527 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:57.048899 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" event={"ID":"c0c695be-005c-4abe-bd89-9c3d7d580144","Type":"ContainerStarted","Data":"e80238cd94eacb12a7ffb37d17f34998db5485cd084f8d8da581920052ab9516"} Jun 03 21:33:57.049527 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:57.049042 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" event={"ID":"c0c695be-005c-4abe-bd89-9c3d7d580144","Type":"ContainerStarted","Data":"b0383e52339bd45ca7d92f3da5c9bffe5fc1597d6e75d30cd8e6d2c5bb3c13a7"} Jun 03 21:33:57.052059 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:57.052013 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vtbwv" event={"ID":"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d","Type":"ContainerStarted","Data":"e9fffc2764d2d324d9b599fb11d9724f8f31774c9a1dcaa08084c2c8a4e098cc"} Jun 03 21:33:57.052193 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:57.052071 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vtbwv" event={"ID":"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d","Type":"ContainerStarted","Data":"a29770fe8c8371a0351797e069051d725e02a27148e392a613d1e207123e2a58"} Jun 03 21:33:57.054511 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:57.054486 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-x84jn" event={"ID":"41898007-584b-4811-8c40-7d71206ba8bc","Type":"ContainerStarted","Data":"b7a6b0942eddc1bb795ffcbf46a9b829fdeea9dc3c7b5cf1253f7abfd4f77289"} Jun 03 21:33:57.068463 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:57.068410 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" podStartSLOduration=33.068391648 podStartE2EDuration="33.068391648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:33:57.066708273 +0000 UTC m=+236.227201255" watchObservedRunningTime="2026-06-03 21:33:57.068391648 +0000 UTC m=+236.228884540" Jun 03 21:33:57.156063 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:57.155730 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-njxb4"] Jun 03 21:33:57.158638 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:33:57.158608 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb318bdcc_3c11_4345_be3a_1deff77e2627.slice/crio-ded1bac0d8441859bbed00084def549ae662e8df4ee16ff0cf42835008d9ba0c WatchSource:0}: Error finding container ded1bac0d8441859bbed00084def549ae662e8df4ee16ff0cf42835008d9ba0c: Status 404 returned error can't find the container with id ded1bac0d8441859bbed00084def549ae662e8df4ee16ff0cf42835008d9ba0c Jun 03 21:33:57.685562 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:57.685527 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:57.688941 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:57.688754 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:58.061272 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:58.061188 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vtbwv" event={"ID":"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d","Type":"ContainerStarted","Data":"c6ebd935b95498dc26cd67d38e5d51b9971db34aa3b15f45f63d9441b9b7fa0a"} Jun 03 21:33:58.062873 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:58.062826 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" event={"ID":"b318bdcc-3c11-4345-be3a-1deff77e2627","Type":"ContainerStarted","Data":"ded1bac0d8441859bbed00084def549ae662e8df4ee16ff0cf42835008d9ba0c"} Jun 03 21:33:58.063270 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:58.063235 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:58.064709 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:58.064688 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6dc9b8464f-bvbd4" Jun 03 21:33:59.568189 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:59.568096 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:59.671106 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:59.671061 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:33:59.764044 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:33:59.764004 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:00.073807 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:00.073766 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vtbwv" event={"ID":"4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d","Type":"ContainerStarted","Data":"25ec023cacb5d23fc37ef539cf647eac074cd92b94d9a2e804a419740f448aea"} Jun 03 21:34:00.075491 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:00.075463 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" event={"ID":"b318bdcc-3c11-4345-be3a-1deff77e2627","Type":"ContainerStarted","Data":"8c9ffd681d3ec6d61d358610bf2985d70eb828ab54c7ba02e29ced49b9855e1a"} Jun 03 21:34:00.093528 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:00.093481 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vtbwv" podStartSLOduration=2.411097239 podStartE2EDuration="5.093465588s" totalImagesPullingTime="2.682368349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:33:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:00.093017446 +0000 UTC m=+239.253510384" watchObservedRunningTime="2026-06-03 21:34:00.093465588 +0000 UTC m=+239.253958480" Jun 03 21:34:00.109731 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:00.109686 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-68d6b54856-njxb4" podStartSLOduration=34.10867981 podStartE2EDuration="36.109672574s" totalImagesPullingTime="2.000992764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:00.108726531 +0000 UTC m=+239.269219423" watchObservedRunningTime="2026-06-03 21:34:00.109672574 +0000 UTC m=+239.270165464" Jun 03 21:34:00.133524 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:00.133488 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:00.234940 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:00.234902 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:00.301815 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:00.301773 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:02.390999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.390968 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55fb85b865-xvmdb"] Jun 03 21:34:02.425185 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.425152 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55fb85b865-xvmdb"] Jun 03 21:34:02.425348 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.425303 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.429379 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.429112 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 21:34:02.429379 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.429356 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mww5z\"" Jun 03 21:34:02.429966 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.429692 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-service-ca\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.429966 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.429739 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-console-config\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.429966 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.429745 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 21:34:02.429966 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.429755 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 21:34:02.429966 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.429802 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 21:34:02.429966 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.429813 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8fzl\" (UniqueName: \"kubernetes.io/projected/da115fc4-b23a-4db3-93ca-771357931f70-kube-api-access-q8fzl\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.429966 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.429890 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da115fc4-b23a-4db3-93ca-771357931f70-console-serving-cert\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.429966 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.429903 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 21:34:02.430431 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.429976 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da115fc4-b23a-4db3-93ca-771357931f70-console-oauth-config\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.430431 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.430009 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-oauth-serving-cert\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.530585 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.530547 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8fzl\" (UniqueName: \"kubernetes.io/projected/da115fc4-b23a-4db3-93ca-771357931f70-kube-api-access-q8fzl\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.530749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.530607 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da115fc4-b23a-4db3-93ca-771357931f70-console-serving-cert\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.530749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.530630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da115fc4-b23a-4db3-93ca-771357931f70-console-oauth-config\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.530749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.530656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-oauth-serving-cert\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.530749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.530711 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-service-ca\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.530749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.530741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-console-config\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.531620 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.531566 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-console-config\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.531620 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.531602 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-oauth-serving-cert\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.531818 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.531698 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-service-ca\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.533770 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.533746 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da115fc4-b23a-4db3-93ca-771357931f70-console-oauth-config\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.533897 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.533864 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da115fc4-b23a-4db3-93ca-771357931f70-console-serving-cert\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.542569 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.542520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8fzl\" (UniqueName: \"kubernetes.io/projected/da115fc4-b23a-4db3-93ca-771357931f70-kube-api-access-q8fzl\") pod \"console-55fb85b865-xvmdb\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.572730 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.572685 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:02.664782 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.664646 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:02.736217 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.736184 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:02.907584 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:02.907558 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55fb85b865-xvmdb"] Jun 03 21:34:02.910557 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:34:02.910530 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda115fc4_b23a_4db3_93ca_771357931f70.slice/crio-cb2cfdc65c951d3e729de6566afaf0dd0a620fedbeb3afaf84a75a869730edd4 WatchSource:0}: Error finding container cb2cfdc65c951d3e729de6566afaf0dd0a620fedbeb3afaf84a75a869730edd4: Status 404 returned error can't find the container with id cb2cfdc65c951d3e729de6566afaf0dd0a620fedbeb3afaf84a75a869730edd4 Jun 03 21:34:03.090486 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:03.090448 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55fb85b865-xvmdb" event={"ID":"da115fc4-b23a-4db3-93ca-771357931f70","Type":"ContainerStarted","Data":"cb2cfdc65c951d3e729de6566afaf0dd0a620fedbeb3afaf84a75a869730edd4"} Jun 03 21:34:03.767350 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:03.767310 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:03.842784 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:03.842727 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:03.903638 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:03.903602 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:05.370979 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:05.370933 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:05.428610 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:05.428571 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:05.771195 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:05.771079 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:07.907687 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:07.907630 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:08.130352 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.130307 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:08.151438 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.151408 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx"] Jun 03 21:34:08.155207 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.155186 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" Jun 03 21:34:08.158193 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.158137 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 21:34:08.158622 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.158600 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sphfq\"" Jun 03 21:34:08.158756 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.158669 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 21:34:08.158819 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.158776 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 21:34:08.158819 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.158813 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 21:34:08.159183 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.159033 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 21:34:08.169017 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.168996 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx"] Jun 03 21:34:08.173105 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.173079 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf"] Jun 03 21:34:08.176556 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.176536 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.179911 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.179888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2aaa4235-a810-4098-b4ce-56d0be84e3b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-bf7gx\" (UID: \"2aaa4235-a810-4098-b4ce-56d0be84e3b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" Jun 03 21:34:08.180037 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.180007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2aaa4235-a810-4098-b4ce-56d0be84e3b5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-bf7gx\" (UID: \"2aaa4235-a810-4098-b4ce-56d0be84e3b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" Jun 03 21:34:08.180106 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.180039 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2aaa4235-a810-4098-b4ce-56d0be84e3b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-bf7gx\" (UID: \"2aaa4235-a810-4098-b4ce-56d0be84e3b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" Jun 03 21:34:08.180106 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.180082 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2phv8\" (UniqueName: \"kubernetes.io/projected/2aaa4235-a810-4098-b4ce-56d0be84e3b5-kube-api-access-2phv8\") pod \"openshift-state-metrics-65f78d5c66-bf7gx\" (UID: \"2aaa4235-a810-4098-b4ce-56d0be84e3b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" Jun 03 21:34:08.180419 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.180399 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 21:34:08.180838 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.180811 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 21:34:08.180995 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.180976 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 21:34:08.181080 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.181067 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lb879\"" Jun 03 21:34:08.196078 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.196053 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rtn4n"] Jun 03 21:34:08.199615 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.199590 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf"] Jun 03 21:34:08.199732 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.199717 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.202847 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.202825 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 21:34:08.202847 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.202844 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 21:34:08.203476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.203456 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6mf74\"" Jun 03 21:34:08.203994 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.203977 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 21:34:08.223136 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.223106 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:08.281083 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281050 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b447e02b-3c42-464a-a5df-6dbad584f70e-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.281259 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281092 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c83fa458-8d6d-41d7-96fa-7d52e37678f2-sys\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.281259 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5zb2\" (UniqueName: \"kubernetes.io/projected/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-api-access-t5zb2\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.281259 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-textfile\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.281259 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281239 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c83fa458-8d6d-41d7-96fa-7d52e37678f2-metrics-client-ca\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.281464 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281279 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2aaa4235-a810-4098-b4ce-56d0be84e3b5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-bf7gx\" (UID: \"2aaa4235-a810-4098-b4ce-56d0be84e3b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" Jun 03 21:34:08.281464 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281301 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.281464 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281323 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2aaa4235-a810-4098-b4ce-56d0be84e3b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-bf7gx\" (UID: \"2aaa4235-a810-4098-b4ce-56d0be84e3b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" Jun 03 21:34:08.281464 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281341 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-wtmp\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.281464 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281387 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2phv8\" (UniqueName: \"kubernetes.io/projected/2aaa4235-a810-4098-b4ce-56d0be84e3b5-kube-api-access-2phv8\") pod \"openshift-state-metrics-65f78d5c66-bf7gx\" (UID: \"2aaa4235-a810-4098-b4ce-56d0be84e3b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" Jun 03 21:34:08.281464 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281417 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b447e02b-3c42-464a-a5df-6dbad584f70e-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.281744 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281462 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.281744 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dj9p\" (UniqueName: \"kubernetes.io/projected/c83fa458-8d6d-41d7-96fa-7d52e37678f2-kube-api-access-6dj9p\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.281744 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281536 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.281744 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2aaa4235-a810-4098-b4ce-56d0be84e3b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-bf7gx\" (UID: \"2aaa4235-a810-4098-b4ce-56d0be84e3b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" Jun 03 21:34:08.281744 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281594 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.281744 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.281744 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-tls\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.281744 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c83fa458-8d6d-41d7-96fa-7d52e37678f2-root\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.282122 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.281923 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2aaa4235-a810-4098-b4ce-56d0be84e3b5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-bf7gx\" (UID: \"2aaa4235-a810-4098-b4ce-56d0be84e3b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" Jun 03 21:34:08.289015 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.284379 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2aaa4235-a810-4098-b4ce-56d0be84e3b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-bf7gx\" (UID: \"2aaa4235-a810-4098-b4ce-56d0be84e3b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" Jun 03 21:34:08.289332 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.289308 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2aaa4235-a810-4098-b4ce-56d0be84e3b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-bf7gx\" (UID: \"2aaa4235-a810-4098-b4ce-56d0be84e3b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" Jun 03 21:34:08.290247 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.290205 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2phv8\" (UniqueName: \"kubernetes.io/projected/2aaa4235-a810-4098-b4ce-56d0be84e3b5-kube-api-access-2phv8\") pod \"openshift-state-metrics-65f78d5c66-bf7gx\" (UID: \"2aaa4235-a810-4098-b4ce-56d0be84e3b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" Jun 03 21:34:08.290649 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.290624 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:08.382741 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.382710 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b447e02b-3c42-464a-a5df-6dbad584f70e-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.382922 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.382751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.382922 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.382780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dj9p\" (UniqueName: \"kubernetes.io/projected/c83fa458-8d6d-41d7-96fa-7d52e37678f2-kube-api-access-6dj9p\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.382922 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.382807 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.382922 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.382836 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.382922 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.382859 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.382922 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.382915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-tls\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.383297 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.382975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c83fa458-8d6d-41d7-96fa-7d52e37678f2-root\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.383297 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.383032 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b447e02b-3c42-464a-a5df-6dbad584f70e-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.383297 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.383060 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c83fa458-8d6d-41d7-96fa-7d52e37678f2-sys\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.383297 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.383104 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5zb2\" (UniqueName: \"kubernetes.io/projected/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-api-access-t5zb2\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.383297 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.383129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-textfile\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.383297 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.383155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c83fa458-8d6d-41d7-96fa-7d52e37678f2-metrics-client-ca\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.383297 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.383191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.383297 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.383222 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-wtmp\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.383632 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.383445 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-wtmp\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.384366 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.383752 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c83fa458-8d6d-41d7-96fa-7d52e37678f2-root\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.384366 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.383819 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b447e02b-3c42-464a-a5df-6dbad584f70e-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.384536 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.384469 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b447e02b-3c42-464a-a5df-6dbad584f70e-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.384536 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.384495 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-textfile\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.384643 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.384552 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c83fa458-8d6d-41d7-96fa-7d52e37678f2-sys\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.385844 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:34:08.384921 2574 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 03 21:34:08.385844 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:34:08.385014 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-state-metrics-tls podName:b447e02b-3c42-464a-a5df-6dbad584f70e nodeName:}" failed. No retries permitted until 2026-06-03 21:34:08.884994458 +0000 UTC m=+248.045487340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-state-metrics-tls") pod "kube-state-metrics-79fb7d47d4-2skcf" (UID: "b447e02b-3c42-464a-a5df-6dbad584f70e") : secret "kube-state-metrics-tls" not found Jun 03 21:34:08.385844 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.385498 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.385844 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.384918 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c83fa458-8d6d-41d7-96fa-7d52e37678f2-metrics-client-ca\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.385844 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:34:08.385809 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 21:34:08.386174 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:34:08.385882 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-tls podName:c83fa458-8d6d-41d7-96fa-7d52e37678f2 nodeName:}" failed. No retries permitted until 2026-06-03 21:34:08.88586763 +0000 UTC m=+248.046360498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-tls") pod "node-exporter-rtn4n" (UID: "c83fa458-8d6d-41d7-96fa-7d52e37678f2") : secret "node-exporter-tls" not found Jun 03 21:34:08.386174 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.385804 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.388175 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.388134 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.388304 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.388278 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.398901 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.398797 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:08.400985 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.400933 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dj9p\" (UniqueName: \"kubernetes.io/projected/c83fa458-8d6d-41d7-96fa-7d52e37678f2-kube-api-access-6dj9p\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.401907 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.401851 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5zb2\" (UniqueName: \"kubernetes.io/projected/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-api-access-t5zb2\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.467159 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.467076 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" Jun 03 21:34:08.491938 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.491868 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:08.592223 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.592148 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:08.650933 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.650898 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:08.888754 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.888724 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-tls\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.888940 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.888856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.891268 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.891243 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c83fa458-8d6d-41d7-96fa-7d52e37678f2-node-exporter-tls\") pod \"node-exporter-rtn4n\" (UID: \"c83fa458-8d6d-41d7-96fa-7d52e37678f2\") " pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:08.891479 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.891458 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b447e02b-3c42-464a-a5df-6dbad584f70e-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-2skcf\" (UID: \"b447e02b-3c42-464a-a5df-6dbad584f70e\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:08.895400 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:08.895359 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:09.089085 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.089051 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" Jun 03 21:34:09.111313 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.111284 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rtn4n" Jun 03 21:34:09.175112 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.175021 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:09.267868 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.267832 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:09.272128 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.272106 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:34:09.276006 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.275986 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.278419 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.278398 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 21:34:09.278539 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.278452 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 21:34:09.279011 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.278702 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 21:34:09.279011 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.278720 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 21:34:09.279011 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.278757 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 21:34:09.279011 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.278763 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 21:34:09.279011 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.278801 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 21:34:09.279011 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.278757 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r4zqb\"" Jun 03 21:34:09.279011 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.278711 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 21:34:09.279011 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.278724 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 21:34:09.290735 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.290713 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:34:09.292726 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.292704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.292834 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.292742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.292834 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.292764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3db03da2-7544-4a09-a53c-0b509866c585-config-out\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.292834 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.292782 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3db03da2-7544-4a09-a53c-0b509866c585-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.292834 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.292814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.292834 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.292834 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.293116 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.292862 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-web-config\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.293116 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.292888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.293116 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.292986 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-config-volume\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.293116 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.293025 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.293116 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.293046 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.293116 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.293080 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vf7w\" (UniqueName: \"kubernetes.io/projected/3db03da2-7544-4a09-a53c-0b509866c585-kube-api-access-6vf7w\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.293116 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.293111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394066 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394021 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394240 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394086 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394240 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394119 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394392 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394260 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3db03da2-7544-4a09-a53c-0b509866c585-config-out\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394392 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:34:09.394312 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-trusted-ca-bundle podName:3db03da2-7544-4a09-a53c-0b509866c585 nodeName:}" failed. No retries permitted until 2026-06-03 21:34:09.894290678 +0000 UTC m=+249.054783560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "3db03da2-7544-4a09-a53c-0b509866c585") : configmap references non-existent config key: ca-bundle.crt Jun 03 21:34:09.394392 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394340 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3db03da2-7544-4a09-a53c-0b509866c585-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394392 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394384 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394583 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394583 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-web-config\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394583 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394493 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394733 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-config-volume\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394733 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394643 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394733 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394674 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394733 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vf7w\" (UniqueName: \"kubernetes.io/projected/3db03da2-7544-4a09-a53c-0b509866c585-kube-api-access-6vf7w\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394920 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394824 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.394920 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.394892 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.395651 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:34:09.395493 2574 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 03 21:34:09.395651 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:34:09.395623 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-main-tls podName:3db03da2-7544-4a09-a53c-0b509866c585 nodeName:}" failed. No retries permitted until 2026-06-03 21:34:09.895604122 +0000 UTC m=+249.056097017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "3db03da2-7544-4a09-a53c-0b509866c585") : secret "alertmanager-main-tls" not found Jun 03 21:34:09.397609 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.397567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-web-config\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.397896 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.397862 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3db03da2-7544-4a09-a53c-0b509866c585-config-out\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.398491 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.398465 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.398653 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.398634 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.398791 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.398769 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.399309 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.399287 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.399628 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.399608 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3db03da2-7544-4a09-a53c-0b509866c585-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.400051 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.400027 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-config-volume\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.403287 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.403264 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vf7w\" (UniqueName: \"kubernetes.io/projected/3db03da2-7544-4a09-a53c-0b509866c585-kube-api-access-6vf7w\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.587307 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.587275 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:09.899468 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.899372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.899647 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.899501 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.900402 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.900354 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:09.902264 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:09.902241 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:10.147720 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.147688 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-584b745c5d-q2b6j"] Jun 03 21:34:10.154437 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.153309 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.156544 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.156436 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-76k9odp8q2ibt\"" Jun 03 21:34:10.156544 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.156455 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 21:34:10.156544 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.156436 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 21:34:10.156743 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.156611 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 21:34:10.156743 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.156735 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-68h8c\"" Jun 03 21:34:10.156888 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.156866 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 21:34:10.157010 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.156975 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 21:34:10.162424 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.162403 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-584b745c5d-q2b6j"] Jun 03 21:34:10.197380 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.197354 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:34:10.202579 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.202553 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.202698 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.202593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jj4n\" (UniqueName: \"kubernetes.io/projected/201e86a8-9f9f-4f17-97c7-9babdfe2de77-kube-api-access-2jj4n\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.202698 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.202641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-tls\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.202698 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.202666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.202837 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.202704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/201e86a8-9f9f-4f17-97c7-9babdfe2de77-metrics-client-ca\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.202837 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.202729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.202837 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.202761 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-grpc-tls\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.202973 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.202863 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.304181 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.304146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jj4n\" (UniqueName: \"kubernetes.io/projected/201e86a8-9f9f-4f17-97c7-9babdfe2de77-kube-api-access-2jj4n\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.304348 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.304202 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-tls\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.304348 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.304232 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.304348 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.304257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/201e86a8-9f9f-4f17-97c7-9babdfe2de77-metrics-client-ca\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.304348 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.304282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.304348 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.304314 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-grpc-tls\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.304617 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.304378 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.304617 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.304442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.305310 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.305259 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/201e86a8-9f9f-4f17-97c7-9babdfe2de77-metrics-client-ca\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.307711 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.307523 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-grpc-tls\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.307711 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.307589 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.307711 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.307669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.307925 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.307742 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.307925 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.307852 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-tls\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.308219 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.308198 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/201e86a8-9f9f-4f17-97c7-9babdfe2de77-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.313059 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.313038 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jj4n\" (UniqueName: \"kubernetes.io/projected/201e86a8-9f9f-4f17-97c7-9babdfe2de77-kube-api-access-2jj4n\") pod \"thanos-querier-584b745c5d-q2b6j\" (UID: \"201e86a8-9f9f-4f17-97c7-9babdfe2de77\") " pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.465737 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.465649 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:10.772785 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.772675 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:10.872602 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:10.872558 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:11.081756 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:11.081667 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:11.143487 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:11.143454 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:11.539876 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:11.539837 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:11.934314 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:11.934279 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:12.926737 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:12.926698 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:12.990079 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:12.990008 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:13.132908 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:13.132872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:34:13.135715 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:13.135688 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de8b995-a02a-4656-9d2e-ac20d31fb96c-metrics-certs\") pod \"network-metrics-daemon-rcbhk\" (UID: \"5de8b995-a02a-4656-9d2e-ac20d31fb96c\") " pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:34:13.235478 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:13.235394 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvgnm\"" Jun 03 21:34:13.243373 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:13.243346 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rcbhk" Jun 03 21:34:13.277543 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:13.277513 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:13.588603 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:13.588511 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx"] Jun 03 21:34:13.590378 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:34:13.590257 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aaa4235_a810_4098_b4ce_56d0be84e3b5.slice/crio-8e795d1a5acbf43ecaee94cab85de16c004c526de2f984014c50162f192c4de4 WatchSource:0}: Error finding container 8e795d1a5acbf43ecaee94cab85de16c004c526de2f984014c50162f192c4de4: Status 404 returned error can't find the container with id 8e795d1a5acbf43ecaee94cab85de16c004c526de2f984014c50162f192c4de4 Jun 03 21:34:13.606637 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:13.606609 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf"] Jun 03 21:34:13.609280 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:34:13.609252 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb447e02b_3c42_464a_a5df_6dbad584f70e.slice/crio-266b7e041236908c88cda2a236ebb1c58983ae1686f85d671c5d9b0ad0f97b2a WatchSource:0}: Error finding container 266b7e041236908c88cda2a236ebb1c58983ae1686f85d671c5d9b0ad0f97b2a: Status 404 returned error can't find the container with id 266b7e041236908c88cda2a236ebb1c58983ae1686f85d671c5d9b0ad0f97b2a Jun 03 21:34:13.614870 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:13.614781 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rcbhk"] Jun 03 21:34:13.617304 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:34:13.617274 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de8b995_a02a_4656_9d2e_ac20d31fb96c.slice/crio-805e21ba645d0e2194a5afb863972fa35c12239ab2492bcfaf6c8508ebd89a40 WatchSource:0}: Error finding container 805e21ba645d0e2194a5afb863972fa35c12239ab2492bcfaf6c8508ebd89a40: Status 404 returned error can't find the container with id 805e21ba645d0e2194a5afb863972fa35c12239ab2492bcfaf6c8508ebd89a40 Jun 03 21:34:13.861823 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:13.861512 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-584b745c5d-q2b6j"] Jun 03 21:34:13.865060 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:13.864623 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:34:13.867019 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:34:13.866929 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201e86a8_9f9f_4f17_97c7_9babdfe2de77.slice/crio-2010e44c73d41a4d47378b4656264799ab6badd1c3b49c208c5bf037097143fe WatchSource:0}: Error finding container 2010e44c73d41a4d47378b4656264799ab6badd1c3b49c208c5bf037097143fe: Status 404 returned error can't find the container with id 2010e44c73d41a4d47378b4656264799ab6badd1c3b49c208c5bf037097143fe Jun 03 21:34:13.868964 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:34:13.868916 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db03da2_7544_4a09_a53c_0b509866c585.slice/crio-0be517901876d5c52b342e09dcae2562b7c6181575906baf973e2f8bcc51832e WatchSource:0}: Error finding container 0be517901876d5c52b342e09dcae2562b7c6181575906baf973e2f8bcc51832e: Status 404 returned error can't find the container with id 0be517901876d5c52b342e09dcae2562b7c6181575906baf973e2f8bcc51832e Jun 03 21:34:14.143785 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.143685 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rcbhk" event={"ID":"5de8b995-a02a-4656-9d2e-ac20d31fb96c","Type":"ContainerStarted","Data":"805e21ba645d0e2194a5afb863972fa35c12239ab2492bcfaf6c8508ebd89a40"} Jun 03 21:34:14.145244 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.145162 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" event={"ID":"b447e02b-3c42-464a-a5df-6dbad584f70e","Type":"ContainerStarted","Data":"266b7e041236908c88cda2a236ebb1c58983ae1686f85d671c5d9b0ad0f97b2a"} Jun 03 21:34:14.148443 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.148314 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" event={"ID":"2aaa4235-a810-4098-b4ce-56d0be84e3b5","Type":"ContainerStarted","Data":"9c8ba359c40545cda788a6575de862842db9b82efd66ba5761e7d817bc30db8a"} Jun 03 21:34:14.148443 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.148370 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" event={"ID":"2aaa4235-a810-4098-b4ce-56d0be84e3b5","Type":"ContainerStarted","Data":"97722b65dc0333847f11601682fa1e6b4f2c083394abb005f81e8b7eb0966907"} Jun 03 21:34:14.148443 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.148401 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" event={"ID":"2aaa4235-a810-4098-b4ce-56d0be84e3b5","Type":"ContainerStarted","Data":"8e795d1a5acbf43ecaee94cab85de16c004c526de2f984014c50162f192c4de4"} Jun 03 21:34:14.154524 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.152010 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-x84jn" event={"ID":"41898007-584b-4811-8c40-7d71206ba8bc","Type":"ContainerStarted","Data":"89c4afc26b20ebea5977cfee9fce9f6cb851956bff7878ab13a27b1e53423b3b"} Jun 03 21:34:14.154524 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.153127 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-56b467f5ff-x84jn" Jun 03 21:34:14.157376 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.157314 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55fb85b865-xvmdb" event={"ID":"da115fc4-b23a-4db3-93ca-771357931f70","Type":"ContainerStarted","Data":"499d7618d0f5154b98878e947ebf3f974ced1b3255ddf9be5cfdc43091905d54"} Jun 03 21:34:14.159526 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.159279 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerStarted","Data":"0be517901876d5c52b342e09dcae2562b7c6181575906baf973e2f8bcc51832e"} Jun 03 21:34:14.160887 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.160858 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" event={"ID":"201e86a8-9f9f-4f17-97c7-9babdfe2de77","Type":"ContainerStarted","Data":"2010e44c73d41a4d47378b4656264799ab6badd1c3b49c208c5bf037097143fe"} Jun 03 21:34:14.163385 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.163011 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rtn4n" event={"ID":"c83fa458-8d6d-41d7-96fa-7d52e37678f2","Type":"ContainerStarted","Data":"edf419da567d3baf8332b10bc5bc84f30a5c3a3401f629346d1595159b1456c0"} Jun 03 21:34:14.165878 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.165855 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-56b467f5ff-x84jn" Jun 03 21:34:14.171445 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.171380 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-56b467f5ff-x84jn" podStartSLOduration=2.121109257 podStartE2EDuration="19.171363444s" totalImagesPullingTime="17.050254187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:33:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:14.17024959 +0000 UTC m=+253.330742483" watchObservedRunningTime="2026-06-03 21:34:14.171363444 +0000 UTC m=+253.331856337" Jun 03 21:34:14.212994 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.211418 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55fb85b865-xvmdb" podStartSLOduration=1.729093958 podStartE2EDuration="12.211396009s" totalImagesPullingTime="10.482302051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:14.210654848 +0000 UTC m=+253.371147739" watchObservedRunningTime="2026-06-03 21:34:14.211396009 +0000 UTC m=+253.371888901" Jun 03 21:34:14.379509 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:14.379469 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:15.178125 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:15.177399 2574 generic.go:356] "Generic (PLEG): container finished" podID="c83fa458-8d6d-41d7-96fa-7d52e37678f2" containerID="3c6242a28ce4569b7a9840ba682e337071a1efcb58ef86eeebf152de0dba67e5" exitCode=0 Jun 03 21:34:15.178125 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:15.177501 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rtn4n" event={"ID":"c83fa458-8d6d-41d7-96fa-7d52e37678f2","Type":"ContainerDied","Data":"3c6242a28ce4569b7a9840ba682e337071a1efcb58ef86eeebf152de0dba67e5"} Jun 03 21:34:15.185463 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:15.184822 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rcbhk" event={"ID":"5de8b995-a02a-4656-9d2e-ac20d31fb96c","Type":"ContainerStarted","Data":"908b808c0fe1b79db6ddb17d49ff1690866beef446d46fbec8c5d1df6123ada0"} Jun 03 21:34:16.194675 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:16.194564 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rtn4n" event={"ID":"c83fa458-8d6d-41d7-96fa-7d52e37678f2","Type":"ContainerStarted","Data":"0ff788319f14bed3b84f285d693dafbe300fea1dcfc110f7bfa40e9a5d9cce87"} Jun 03 21:34:16.197153 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:16.197122 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rcbhk" event={"ID":"5de8b995-a02a-4656-9d2e-ac20d31fb96c","Type":"ContainerStarted","Data":"7e2f377e56f811d33d2e602cd7eb379ee6218df9c7cabcd3bf2b6adc41da6f37"} Jun 03 21:34:16.215025 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:16.214756 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rcbhk" podStartSLOduration=254.026373989 podStartE2EDuration="4m15.214735525s" totalImagesPullingTime="1.188361536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:16.214409151 +0000 UTC m=+255.374902069" watchObservedRunningTime="2026-06-03 21:34:16.214735525 +0000 UTC m=+255.375228419" Jun 03 21:34:16.299988 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:16.299930 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:16.354037 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:16.354003 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:16.408740 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:16.408703 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:19.212119 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:19.212087 2574 generic.go:356] "Generic (PLEG): container finished" podID="3db03da2-7544-4a09-a53c-0b509866c585" containerID="993f8bc65573a61178bb187713fcfab03887d3e959ebcacb2c780a386826eb81" exitCode=0 Jun 03 21:34:19.212595 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:19.212184 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerDied","Data":"993f8bc65573a61178bb187713fcfab03887d3e959ebcacb2c780a386826eb81"} Jun 03 21:34:19.214713 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:19.214688 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" event={"ID":"201e86a8-9f9f-4f17-97c7-9babdfe2de77","Type":"ContainerStarted","Data":"8ed8c96a93b9df9c65d0932b77e42e330ddacf62c1e5869cf31fcd0c7b131683"} Jun 03 21:34:19.214801 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:19.214752 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" event={"ID":"201e86a8-9f9f-4f17-97c7-9babdfe2de77","Type":"ContainerStarted","Data":"842c2a3c3d4d24c7533671548feba40b5c76df6c15083246f014bfc57bb2cf52"} Jun 03 21:34:19.214801 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:19.214789 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" event={"ID":"201e86a8-9f9f-4f17-97c7-9babdfe2de77","Type":"ContainerStarted","Data":"2f8820ec7d1669c5c098dba5e8d2117feee12fa9bd702c2faf00953f7aba74b3"} Jun 03 21:34:19.217390 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:19.217367 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rtn4n" event={"ID":"c83fa458-8d6d-41d7-96fa-7d52e37678f2","Type":"ContainerStarted","Data":"330a0796ba401a9cb8074a1d1f3c13483cdd3749db7ec8d49f94be09abb1846b"} Jun 03 21:34:19.219662 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:19.219637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" event={"ID":"b447e02b-3c42-464a-a5df-6dbad584f70e","Type":"ContainerStarted","Data":"6a535f5e86b649220c75ab74ac05234bf4a09d96a75df3516f209d0ded9e0004"} Jun 03 21:34:19.219759 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:19.219693 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" event={"ID":"b447e02b-3c42-464a-a5df-6dbad584f70e","Type":"ContainerStarted","Data":"dc490da99b8cfc46796f4a4b5ab27463b909499cf0e407740e67a8cd6a71c4b8"} Jun 03 21:34:19.219759 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:19.219724 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" event={"ID":"b447e02b-3c42-464a-a5df-6dbad584f70e","Type":"ContainerStarted","Data":"b4178920993b003c215fc8665e966a26876aa0a7cb77a6597a10ef7ccacd9819"} Jun 03 21:34:19.221889 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:19.221865 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" event={"ID":"2aaa4235-a810-4098-b4ce-56d0be84e3b5","Type":"ContainerStarted","Data":"98bcfabbc8d4cc9af26b7c02a68b374f1021b3739ac5f977eb39d8a5bbf0496d"} Jun 03 21:34:19.265190 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:19.265146 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-2skcf" podStartSLOduration=6.65002642 podStartE2EDuration="11.265126901s" totalImagesPullingTime="4.615100481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:19.263732916 +0000 UTC m=+258.424225809" watchObservedRunningTime="2026-06-03 21:34:19.265126901 +0000 UTC m=+258.425619793" Jun 03 21:34:19.281088 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:19.281037 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bf7gx" podStartSLOduration=6.777619219 podStartE2EDuration="11.281024822s" totalImagesPullingTime="4.503405603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:19.280054283 +0000 UTC m=+258.440547178" watchObservedRunningTime="2026-06-03 21:34:19.281024822 +0000 UTC m=+258.441517713" Jun 03 21:34:19.297740 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:19.297700 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rtn4n" podStartSLOduration=9.73898819 podStartE2EDuration="11.297687624s" totalImagesPullingTime="1.396286479s" totalInitContainerRuntime="162.412955ms" isStatefulPod=true podCreationTimestamp="2026-06-03 21:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:19.296840862 +0000 UTC m=+258.457333756" watchObservedRunningTime="2026-06-03 21:34:19.297687624 +0000 UTC m=+258.458180514" Jun 03 21:34:20.185029 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.184975 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:20.216598 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.215895 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55fb85b865-xvmdb"] Jun 03 21:34:20.254074 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.253713 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67c8956b58-sb47f"] Jun 03 21:34:20.257665 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.257629 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:20.270236 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.270081 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67c8956b58-sb47f"] Jun 03 21:34:20.270332 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.270189 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.285921 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.285888 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 21:34:20.416563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.416366 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-service-ca\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.416563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.416406 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-trusted-ca-bundle\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.416563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.416435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-oauth-serving-cert\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.416563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.416498 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-console-config\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.416563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.416546 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ece17bb4-b68a-4799-b21f-85801381cc8d-console-serving-cert\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.416563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.416571 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ece17bb4-b68a-4799-b21f-85801381cc8d-console-oauth-config\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.416967 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.416639 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4h2z\" (UniqueName: \"kubernetes.io/projected/ece17bb4-b68a-4799-b21f-85801381cc8d-kube-api-access-b4h2z\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.517869 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.517830 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ece17bb4-b68a-4799-b21f-85801381cc8d-console-serving-cert\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.518057 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.517880 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ece17bb4-b68a-4799-b21f-85801381cc8d-console-oauth-config\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.518057 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.517975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4h2z\" (UniqueName: \"kubernetes.io/projected/ece17bb4-b68a-4799-b21f-85801381cc8d-kube-api-access-b4h2z\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.518057 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.518054 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-service-ca\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.518213 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.518080 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-trusted-ca-bundle\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.518213 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.518103 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-oauth-serving-cert\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.518213 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.518157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-console-config\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.520414 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.518918 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-console-config\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.520414 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.519478 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-service-ca\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.520972 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.520655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-oauth-serving-cert\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.520972 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.520916 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-trusted-ca-bundle\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.527082 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.527057 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4h2z\" (UniqueName: \"kubernetes.io/projected/ece17bb4-b68a-4799-b21f-85801381cc8d-kube-api-access-b4h2z\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.527962 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.527928 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ece17bb4-b68a-4799-b21f-85801381cc8d-console-serving-cert\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.529516 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.529468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ece17bb4-b68a-4799-b21f-85801381cc8d-console-oauth-config\") pod \"console-67c8956b58-sb47f\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.590119 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.589858 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:20.766710 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:20.766584 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67c8956b58-sb47f"] Jun 03 21:34:20.769266 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:34:20.769238 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece17bb4_b68a_4799_b21f_85801381cc8d.slice/crio-62ceedc8a411c18de02e84c105f231cb401a57e0855f6980f01d000cae8a7a8c WatchSource:0}: Error finding container 62ceedc8a411c18de02e84c105f231cb401a57e0855f6980f01d000cae8a7a8c: Status 404 returned error can't find the container with id 62ceedc8a411c18de02e84c105f231cb401a57e0855f6980f01d000cae8a7a8c Jun 03 21:34:21.238449 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:21.238392 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" event={"ID":"201e86a8-9f9f-4f17-97c7-9babdfe2de77","Type":"ContainerStarted","Data":"e245310b3210c09e3bc991a8813e171d496e3f884f4dc44e03bb2874f43f8a0a"} Jun 03 21:34:21.238802 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:21.238472 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" event={"ID":"201e86a8-9f9f-4f17-97c7-9babdfe2de77","Type":"ContainerStarted","Data":"853c598fa8a73a8c8af99999c5256eb32f291354f4bd86413488876ca2f9c233"} Jun 03 21:34:21.238802 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:21.238518 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" event={"ID":"201e86a8-9f9f-4f17-97c7-9babdfe2de77","Type":"ContainerStarted","Data":"272aa645febe4480db3c2e9c5f2475518ad0cec0fe5b16113afc1910cd92348c"} Jun 03 21:34:21.239281 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:21.239255 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:21.240023 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:21.240000 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c8956b58-sb47f" event={"ID":"ece17bb4-b68a-4799-b21f-85801381cc8d","Type":"ContainerStarted","Data":"62ceedc8a411c18de02e84c105f231cb401a57e0855f6980f01d000cae8a7a8c"} Jun 03 21:34:21.261981 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:21.261639 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" podStartSLOduration=5.550895226 podStartE2EDuration="11.261618995s" totalImagesPullingTime="5.710723769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:34:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:21.260783455 +0000 UTC m=+260.421276532" watchObservedRunningTime="2026-06-03 21:34:21.261618995 +0000 UTC m=+260.422111888" Jun 03 21:34:22.248245 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:22.248210 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerStarted","Data":"781db64dd48be1a3fbb92dde050b6e9047b1045c36f1cfaffbd2248edd46a5f6"} Jun 03 21:34:22.248590 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:22.248310 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerStarted","Data":"3c5570e570ffdafdffe23ae5034834211330e99f658866074696d5818660d454"} Jun 03 21:34:22.248590 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:22.248357 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerStarted","Data":"77c36849004a5967d82b51f32a47113de80478d8f582631b476e27ca911505ef"} Jun 03 21:34:22.248590 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:22.248386 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerStarted","Data":"f5c8cf31fa6d20677c8238bcd25b7423d235543110d73af5c167adda3c1382ac"} Jun 03 21:34:22.250014 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:22.249979 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c8956b58-sb47f" event={"ID":"ece17bb4-b68a-4799-b21f-85801381cc8d","Type":"ContainerStarted","Data":"8ecdbfc9f4dcf20ade6da8a176f53fc9b51c5741ecf692830450115512119a4e"} Jun 03 21:34:22.268365 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:22.268305 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67c8956b58-sb47f" podStartSLOduration=2.268285135 podStartE2EDuration="2.268285135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:34:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:22.265936554 +0000 UTC m=+261.426429447" watchObservedRunningTime="2026-06-03 21:34:22.268285135 +0000 UTC m=+261.428778029" Jun 03 21:34:22.737115 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:22.737031 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:34:23.256865 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:23.256826 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerStarted","Data":"b7005d86f9813d02519209776f86cdcb41c42d4cb147b1b9b8f8b3673fb6522a"} Jun 03 21:34:23.257240 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:23.256894 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerStarted","Data":"a29d542478da709e2c81ade88791f274b1c4786eff2c013fc3561a9ad9cc7345"} Jun 03 21:34:23.283013 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:23.282917 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.506414862 podStartE2EDuration="14.282900516s" totalImagesPullingTime="6.732384951s" totalInitContainerRuntime="44.100703ms" isStatefulPod=false podCreationTimestamp="2026-06-03 21:34:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:23.282280159 +0000 UTC m=+262.442773051" watchObservedRunningTime="2026-06-03 21:34:23.282900516 +0000 UTC m=+262.443393401" Jun 03 21:34:27.256218 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:27.256188 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-584b745c5d-q2b6j" Jun 03 21:34:27.907716 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:27.907680 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:28.008652 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:28.008615 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:28.109168 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:28.109129 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:28.210893 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:28.210790 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:29.181684 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:29.181650 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:29.282470 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:29.282434 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:30.590828 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:30.590791 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:30.591334 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:30.590859 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:34:30.592256 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:30.592232 2574 patch_prober.go:28] interesting pod/console-67c8956b58-sb47f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 03 21:34:30.592352 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:30.592275 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67c8956b58-sb47f" podUID="ece17bb4-b68a-4799-b21f-85801381cc8d" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 03 21:34:34.813085 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:34.813047 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:35.053386 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:35.053355 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:38.793889 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:38.793857 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:40.329330 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:40.329298 2574 generic.go:356] "Generic (PLEG): container finished" podID="bedf9a36-437f-4f62-b901-a02d09fbf196" containerID="e40a4139b8be6c3357280a7893be1907fd88efa69dc3a6da91c474b2048d0186" exitCode=0 Jun 03 21:34:40.329692 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:40.329371 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" event={"ID":"bedf9a36-437f-4f62-b901-a02d09fbf196","Type":"ContainerDied","Data":"e40a4139b8be6c3357280a7893be1907fd88efa69dc3a6da91c474b2048d0186"} Jun 03 21:34:40.329692 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:40.329674 2574 scope.go:117] "RemoveContainer" containerID="e40a4139b8be6c3357280a7893be1907fd88efa69dc3a6da91c474b2048d0186" Jun 03 21:34:40.591063 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:40.591037 2574 patch_prober.go:28] interesting pod/console-67c8956b58-sb47f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 03 21:34:40.591208 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:40.591092 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67c8956b58-sb47f" podUID="ece17bb4-b68a-4799-b21f-85801381cc8d" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 03 21:34:41.337141 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:41.337106 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-zlqdr" event={"ID":"bedf9a36-437f-4f62-b901-a02d09fbf196","Type":"ContainerStarted","Data":"b6e78fb5dbf94f14afaf79a8fe72ef96c0a9c13249dc4ca56a6c2d93d0be6f0a"} Jun 03 21:34:42.808539 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:34:42.808501 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" podUID="02da8b3c-0c85-415e-8c2e-bbda6e77a851" Jun 03 21:34:42.808539 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:34:42.808501 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8dcpk" podUID="50dd4927-55d7-4ac2-b9fc-34cf27a08b7f" Jun 03 21:34:43.346498 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:43.346466 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8dcpk" Jun 03 21:34:43.346701 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:43.346467 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:34:43.371671 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:43.371635 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:43.449510 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:43.449475 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:45.245962 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:45.245922 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55fb85b865-xvmdb" podUID="da115fc4-b23a-4db3-93ca-771357931f70" containerName="console" containerID="cri-o://499d7618d0f5154b98878e947ebf3f974ced1b3255ddf9be5cfdc43091905d54" gracePeriod=15 Jun 03 21:34:45.355927 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:45.355896 2574 generic.go:356] "Generic (PLEG): container finished" podID="4061535b-e4c4-4966-ac4b-a2e841d5ee2f" containerID="d9e1de06941dffdcb2bcb849a74726a7b64343d8143f1465a73d3ef8d31f8598" exitCode=0 Jun 03 21:34:45.356090 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:45.355931 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" event={"ID":"4061535b-e4c4-4966-ac4b-a2e841d5ee2f","Type":"ContainerDied","Data":"d9e1de06941dffdcb2bcb849a74726a7b64343d8143f1465a73d3ef8d31f8598"} Jun 03 21:34:45.356229 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:45.356215 2574 scope.go:117] "RemoveContainer" containerID="d9e1de06941dffdcb2bcb849a74726a7b64343d8143f1465a73d3ef8d31f8598" Jun 03 21:34:46.361958 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:46.361924 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5" event={"ID":"4061535b-e4c4-4966-ac4b-a2e841d5ee2f","Type":"ContainerStarted","Data":"1fe32b8256cc36ab78d173b42f0fb55264530459d27c894ddf0edacb16144a7d"} Jun 03 21:34:46.655245 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:46.655155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:34:46.655245 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:46.655213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:34:46.657621 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:46.657597 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls\") pod \"image-registry-7d6577f7f-hl892\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:34:46.657621 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:46.657613 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50dd4927-55d7-4ac2-b9fc-34cf27a08b7f-metrics-tls\") pod \"dns-default-8dcpk\" (UID: \"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f\") " pod="openshift-dns/dns-default-8dcpk" Jun 03 21:34:46.950994 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:46.950892 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x7hbm\"" Jun 03 21:34:46.950994 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:46.950892 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6m9lg\"" Jun 03 21:34:46.958052 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:46.958026 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:34:46.958120 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:46.958072 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8dcpk" Jun 03 21:34:47.141224 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:47.141199 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d6577f7f-hl892"] Jun 03 21:34:47.142308 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:34:47.142286 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02da8b3c_0c85_415e_8c2e_bbda6e77a851.slice/crio-89f6dcf1982f0b2369a383e492f38525a3428a94464cf64c34fd20385961ae2a WatchSource:0}: Error finding container 89f6dcf1982f0b2369a383e492f38525a3428a94464cf64c34fd20385961ae2a: Status 404 returned error can't find the container with id 89f6dcf1982f0b2369a383e492f38525a3428a94464cf64c34fd20385961ae2a Jun 03 21:34:47.161912 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:47.161888 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8dcpk"] Jun 03 21:34:47.164481 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:34:47.164459 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50dd4927_55d7_4ac2_b9fc_34cf27a08b7f.slice/crio-ac4ad7a5486f2e1cfbe3ae2ff5b19aab4219c8793c13e078a011be9888625025 WatchSource:0}: Error finding container ac4ad7a5486f2e1cfbe3ae2ff5b19aab4219c8793c13e078a011be9888625025: Status 404 returned error can't find the container with id ac4ad7a5486f2e1cfbe3ae2ff5b19aab4219c8793c13e078a011be9888625025 Jun 03 21:34:47.366681 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:47.366646 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8dcpk" event={"ID":"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f","Type":"ContainerStarted","Data":"ac4ad7a5486f2e1cfbe3ae2ff5b19aab4219c8793c13e078a011be9888625025"} Jun 03 21:34:47.368256 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:47.368233 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" event={"ID":"02da8b3c-0c85-415e-8c2e-bbda6e77a851","Type":"ContainerStarted","Data":"f8054490a472fb4ac3fa473741fbbc08e90f8df0022612639ce3d8ad7dbe1efa"} Jun 03 21:34:47.368375 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:47.368274 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" event={"ID":"02da8b3c-0c85-415e-8c2e-bbda6e77a851","Type":"ContainerStarted","Data":"89f6dcf1982f0b2369a383e492f38525a3428a94464cf64c34fd20385961ae2a"} Jun 03 21:34:47.368375 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:47.368303 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:34:47.394392 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:47.394343 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" podStartSLOduration=286.394325883 podStartE2EDuration="4m46.394325883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:30:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:47.393303918 +0000 UTC m=+286.553796810" watchObservedRunningTime="2026-06-03 21:34:47.394325883 +0000 UTC m=+286.554818814" Jun 03 21:34:48.306456 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:48.306405 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:48.372851 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:48.372783 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:50.382512 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:50.382476 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8dcpk" event={"ID":"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f","Type":"ContainerStarted","Data":"3db3519942a7704b3374e854f141a48db01e6a039339bd4fda690772878effab"} Jun 03 21:34:50.382965 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:50.382525 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8dcpk" event={"ID":"50dd4927-55d7-4ac2-b9fc-34cf27a08b7f","Type":"ContainerStarted","Data":"12e69829cd7271ba0214af1d5e15fa8476097a57894c6b1b656c69b653b9872e"} Jun 03 21:34:50.382965 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:50.382563 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8dcpk" Jun 03 21:34:50.401834 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:50.401781 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8dcpk" podStartSLOduration=252.027775644 podStartE2EDuration="4m14.401766594s" totalImagesPullingTime="2.37399095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:50.400395941 +0000 UTC m=+289.560888834" watchObservedRunningTime="2026-06-03 21:34:50.401766594 +0000 UTC m=+289.562259484" Jun 03 21:34:50.590784 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:50.590744 2574 patch_prober.go:28] interesting pod/console-67c8956b58-sb47f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 03 21:34:50.590934 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:50.590799 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67c8956b58-sb47f" podUID="ece17bb4-b68a-4799-b21f-85801381cc8d" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 03 21:34:54.399023 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:54.398992 2574 generic.go:356] "Generic (PLEG): container finished" podID="6d2b3d46-d831-4aa4-8828-8f630a2dcd22" containerID="08a59d55360c99cb2c2436d7398188487f0179caa7c4c05f8524540336175cd9" exitCode=0 Jun 03 21:34:54.399430 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:54.399034 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-fzcfw" event={"ID":"6d2b3d46-d831-4aa4-8828-8f630a2dcd22","Type":"ContainerDied","Data":"08a59d55360c99cb2c2436d7398188487f0179caa7c4c05f8524540336175cd9"} Jun 03 21:34:54.399430 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:54.399337 2574 scope.go:117] "RemoveContainer" containerID="08a59d55360c99cb2c2436d7398188487f0179caa7c4c05f8524540336175cd9" Jun 03 21:34:55.405283 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:55.405250 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-fzcfw" event={"ID":"6d2b3d46-d831-4aa4-8828-8f630a2dcd22","Type":"ContainerStarted","Data":"8c5d825647d0e0bf6fe1c1770bdc17cd4ac7bcdf53b12d6c65bd7c4acbe17a79"} Jun 03 21:34:57.188231 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:57.188206 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3db03da2-7544-4a09-a53c-0b509866c585/init-config-reloader/0.log" Jun 03 21:34:57.386196 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:57.386160 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3db03da2-7544-4a09-a53c-0b509866c585/alertmanager/0.log" Jun 03 21:34:57.586250 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:57.586225 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3db03da2-7544-4a09-a53c-0b509866c585/config-reloader/0.log" Jun 03 21:34:57.788185 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:57.788157 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3db03da2-7544-4a09-a53c-0b509866c585/kube-rbac-proxy-web/0.log" Jun 03 21:34:57.925335 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:57.925264 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:57.986982 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:57.986940 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3db03da2-7544-4a09-a53c-0b509866c585/kube-rbac-proxy/0.log" Jun 03 21:34:57.996594 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:57.996572 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:34:58.186503 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:58.186428 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3db03da2-7544-4a09-a53c-0b509866c585/kube-rbac-proxy-metric/0.log" Jun 03 21:34:58.386511 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:58.386481 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3db03da2-7544-4a09-a53c-0b509866c585/prom-label-proxy/0.log" Jun 03 21:34:58.786325 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:58.786295 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-2skcf_b447e02b-3c42-464a-a5df-6dbad584f70e/kube-state-metrics/0.log" Jun 03 21:34:58.986412 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:58.986376 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-2skcf_b447e02b-3c42-464a-a5df-6dbad584f70e/kube-rbac-proxy-main/0.log" Jun 03 21:34:59.187395 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:34:59.187368 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-2skcf_b447e02b-3c42-464a-a5df-6dbad584f70e/kube-rbac-proxy-self/0.log" Jun 03 21:35:00.387542 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.387517 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8dcpk" Jun 03 21:35:00.422311 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.422292 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55fb85b865-xvmdb_da115fc4-b23a-4db3-93ca-771357931f70/console/0.log" Jun 03 21:35:00.432287 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.432267 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55fb85b865-xvmdb_da115fc4-b23a-4db3-93ca-771357931f70/console/0.log" Jun 03 21:35:00.432390 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.432304 2574 generic.go:356] "Generic (PLEG): container finished" podID="da115fc4-b23a-4db3-93ca-771357931f70" containerID="499d7618d0f5154b98878e947ebf3f974ced1b3255ddf9be5cfdc43091905d54" exitCode=137 Jun 03 21:35:00.432390 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.432344 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55fb85b865-xvmdb" event={"ID":"da115fc4-b23a-4db3-93ca-771357931f70","Type":"ContainerDied","Data":"499d7618d0f5154b98878e947ebf3f974ced1b3255ddf9be5cfdc43091905d54"} Jun 03 21:35:00.432390 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.432381 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55fb85b865-xvmdb" event={"ID":"da115fc4-b23a-4db3-93ca-771357931f70","Type":"ContainerDied","Data":"cb2cfdc65c951d3e729de6566afaf0dd0a620fedbeb3afaf84a75a869730edd4"} Jun 03 21:35:00.432487 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.432395 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb2cfdc65c951d3e729de6566afaf0dd0a620fedbeb3afaf84a75a869730edd4" Jun 03 21:35:00.444218 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.444198 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:35:00.587225 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.587201 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-service-ca\") pod \"da115fc4-b23a-4db3-93ca-771357931f70\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " Jun 03 21:35:00.587348 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.587244 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-console-config\") pod \"da115fc4-b23a-4db3-93ca-771357931f70\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " Jun 03 21:35:00.587348 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.587271 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-oauth-serving-cert\") pod \"da115fc4-b23a-4db3-93ca-771357931f70\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " Jun 03 21:35:00.587348 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.587313 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da115fc4-b23a-4db3-93ca-771357931f70-console-serving-cert\") pod \"da115fc4-b23a-4db3-93ca-771357931f70\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " Jun 03 21:35:00.587509 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.587388 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da115fc4-b23a-4db3-93ca-771357931f70-console-oauth-config\") pod \"da115fc4-b23a-4db3-93ca-771357931f70\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " Jun 03 21:35:00.587509 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.587446 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8fzl\" (UniqueName: \"kubernetes.io/projected/da115fc4-b23a-4db3-93ca-771357931f70-kube-api-access-q8fzl\") pod \"da115fc4-b23a-4db3-93ca-771357931f70\" (UID: \"da115fc4-b23a-4db3-93ca-771357931f70\") " Jun 03 21:35:00.587655 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.587631 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-service-ca" (OuterVolumeSpecName: "service-ca") pod "da115fc4-b23a-4db3-93ca-771357931f70" (UID: "da115fc4-b23a-4db3-93ca-771357931f70"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:35:00.587655 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.587641 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-console-config" (OuterVolumeSpecName: "console-config") pod "da115fc4-b23a-4db3-93ca-771357931f70" (UID: "da115fc4-b23a-4db3-93ca-771357931f70"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:35:00.587763 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.587695 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da115fc4-b23a-4db3-93ca-771357931f70" (UID: "da115fc4-b23a-4db3-93ca-771357931f70"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:35:00.587763 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.587707 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-service-ca\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:00.587763 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.587725 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-console-config\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:00.589632 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.589596 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da115fc4-b23a-4db3-93ca-771357931f70-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da115fc4-b23a-4db3-93ca-771357931f70" (UID: "da115fc4-b23a-4db3-93ca-771357931f70"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:35:00.589724 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.589641 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da115fc4-b23a-4db3-93ca-771357931f70-kube-api-access-q8fzl" (OuterVolumeSpecName: "kube-api-access-q8fzl") pod "da115fc4-b23a-4db3-93ca-771357931f70" (UID: "da115fc4-b23a-4db3-93ca-771357931f70"). InnerVolumeSpecName "kube-api-access-q8fzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:35:00.589724 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.589683 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da115fc4-b23a-4db3-93ca-771357931f70-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da115fc4-b23a-4db3-93ca-771357931f70" (UID: "da115fc4-b23a-4db3-93ca-771357931f70"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:35:00.591063 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.591046 2574 patch_prober.go:28] interesting pod/console-67c8956b58-sb47f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 03 21:35:00.591121 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.591102 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67c8956b58-sb47f" podUID="ece17bb4-b68a-4799-b21f-85801381cc8d" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 03 21:35:00.688906 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.688882 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da115fc4-b23a-4db3-93ca-771357931f70-console-oauth-config\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:00.688906 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.688902 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8fzl\" (UniqueName: \"kubernetes.io/projected/da115fc4-b23a-4db3-93ca-771357931f70-kube-api-access-q8fzl\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:00.689051 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.688912 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da115fc4-b23a-4db3-93ca-771357931f70-oauth-serving-cert\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:00.689051 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.688922 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da115fc4-b23a-4db3-93ca-771357931f70-console-serving-cert\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:00.985618 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:00.985548 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rtn4n_c83fa458-8d6d-41d7-96fa-7d52e37678f2/init-textfile/0.log" Jun 03 21:35:01.187125 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:01.187099 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rtn4n_c83fa458-8d6d-41d7-96fa-7d52e37678f2/node-exporter/0.log" Jun 03 21:35:01.288880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:01.288823 2574 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 21:35:01.537930 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:01.389280 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rtn4n_c83fa458-8d6d-41d7-96fa-7d52e37678f2/kube-rbac-proxy/0.log" Jun 03 21:35:01.537930 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:01.436291 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55fb85b865-xvmdb" Jun 03 21:35:01.537930 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:01.464893 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55fb85b865-xvmdb"] Jun 03 21:35:01.537930 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:01.474517 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55fb85b865-xvmdb"] Jun 03 21:35:01.586294 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:01.586270 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-bf7gx_2aaa4235-a810-4098-b4ce-56d0be84e3b5/kube-rbac-proxy-main/0.log" Jun 03 21:35:01.786540 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:01.786506 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-bf7gx_2aaa4235-a810-4098-b4ce-56d0be84e3b5/kube-rbac-proxy-self/0.log" Jun 03 21:35:01.986650 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:01.986575 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-bf7gx_2aaa4235-a810-4098-b4ce-56d0be84e3b5/openshift-state-metrics/0.log" Jun 03 21:35:03.337113 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:03.337080 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da115fc4-b23a-4db3-93ca-771357931f70" path="/var/lib/kubelet/pods/da115fc4-b23a-4db3-93ca-771357931f70/volumes" Jun 03 21:35:03.874226 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:03.874190 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:04.786573 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:04.786546 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584b745c5d-q2b6j_201e86a8-9f9f-4f17-97c7-9babdfe2de77/thanos-query/0.log" Jun 03 21:35:04.965900 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:04.965864 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:04.985695 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:04.985668 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584b745c5d-q2b6j_201e86a8-9f9f-4f17-97c7-9babdfe2de77/kube-rbac-proxy-web/0.log" Jun 03 21:35:05.188353 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:05.188326 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584b745c5d-q2b6j_201e86a8-9f9f-4f17-97c7-9babdfe2de77/kube-rbac-proxy/0.log" Jun 03 21:35:05.386347 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:05.386318 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584b745c5d-q2b6j_201e86a8-9f9f-4f17-97c7-9babdfe2de77/prom-label-proxy/0.log" Jun 03 21:35:05.586684 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:05.586658 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584b745c5d-q2b6j_201e86a8-9f9f-4f17-97c7-9babdfe2de77/kube-rbac-proxy-rules/0.log" Jun 03 21:35:05.786683 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:05.786645 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584b745c5d-q2b6j_201e86a8-9f9f-4f17-97c7-9babdfe2de77/kube-rbac-proxy-metrics/0.log" Jun 03 21:35:05.986327 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:05.986244 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-68d6b54856-njxb4_b318bdcc-3c11-4345-be3a-1deff77e2627/networking-console-plugin/0.log" Jun 03 21:35:06.189087 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:06.189057 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:06.258399 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:06.258323 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:06.962203 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:06.962173 2574 patch_prober.go:28] interesting pod/image-registry-7d6577f7f-hl892 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 21:35:06.962634 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:06.962221 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" podUID="02da8b3c-0c85-415e-8c2e-bbda6e77a851" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 21:35:06.986705 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:06.986686 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67c8956b58-sb47f_ece17bb4-b68a-4799-b21f-85801381cc8d/console/0.log" Jun 03 21:35:07.189188 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:07.189154 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-56b467f5ff-x84jn_41898007-584b-4811-8c40-7d71206ba8bc/download-server/0.log" Jun 03 21:35:07.386243 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:07.386215 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8dcpk_50dd4927-55d7-4ac2-b9fc-34cf27a08b7f/dns/0.log" Jun 03 21:35:07.586467 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:07.586442 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8dcpk_50dd4927-55d7-4ac2-b9fc-34cf27a08b7f/kube-rbac-proxy/0.log" Jun 03 21:35:08.377710 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:08.377682 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:35:08.717658 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:08.717570 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:08.781386 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:08.781350 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:08.785385 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:08.785369 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qjn6_8084eecf-3233-41e7-a360-b2ad82fc8899/dns-node-resolver/0.log" Jun 03 21:35:09.386381 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:09.386345 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d6577f7f-hl892_02da8b3c-0c85-415e-8c2e-bbda6e77a851/registry/0.log" Jun 03 21:35:09.538457 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:09.538419 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:09.590567 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:09.590539 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2q9p5_9ff19efc-23e1-46a6-bb9d-0a7c58155f5d/node-ca/0.log" Jun 03 21:35:09.638112 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:09.638034 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:10.187181 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:10.187151 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc9b8464f-bvbd4_c0c695be-005c-4abe-bd89-9c3d7d580144/router/0.log" Jun 03 21:35:10.391075 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:10.391045 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jsbh9_75d06df5-a8a1-4f2c-8564-7c46da054383/serve-healthcheck-canary/0.log" Jun 03 21:35:10.594974 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:10.594928 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:35:10.598764 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:10.598736 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:35:10.816874 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:10.816837 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:10.915818 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:10.915693 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:11.084145 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:11.084110 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:15.269412 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:15.269377 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:15.370537 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:15.370502 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:19.830528 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:19.830494 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:19.927573 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:19.927537 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:20.094418 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:20.094386 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:21.952830 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:21.952796 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:22.120114 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:22.120064 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:22.217074 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:22.216985 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:24.312312 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:24.312269 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:24.382619 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:24.382587 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d6577f7f-hl892"] Jun 03 21:35:24.413961 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:24.413918 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:24.513717 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:24.513687 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:24.577108 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:24.577032 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:24.646296 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:24.646263 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:24.714844 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:24.714798 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:25.337484 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:25.337453 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:25.410235 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:25.410200 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:28.615810 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:28.615771 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:35:28.616342 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:28.616121 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="alertmanager" containerID="cri-o://f5c8cf31fa6d20677c8238bcd25b7423d235543110d73af5c167adda3c1382ac" gracePeriod=120 Jun 03 21:35:28.616342 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:28.616187 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="kube-rbac-proxy-metric" containerID="cri-o://a29d542478da709e2c81ade88791f274b1c4786eff2c013fc3561a9ad9cc7345" gracePeriod=120 Jun 03 21:35:28.616342 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:28.616220 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="kube-rbac-proxy-web" containerID="cri-o://3c5570e570ffdafdffe23ae5034834211330e99f658866074696d5818660d454" gracePeriod=120 Jun 03 21:35:28.616342 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:28.616241 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="config-reloader" containerID="cri-o://77c36849004a5967d82b51f32a47113de80478d8f582631b476e27ca911505ef" gracePeriod=120 Jun 03 21:35:28.616342 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:28.616217 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="kube-rbac-proxy" containerID="cri-o://781db64dd48be1a3fbb92dde050b6e9047b1045c36f1cfaffbd2248edd46a5f6" gracePeriod=120 Jun 03 21:35:28.616342 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:28.616252 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="prom-label-proxy" containerID="cri-o://b7005d86f9813d02519209776f86cdcb41c42d4cb147b1b9b8f8b3673fb6522a" gracePeriod=120 Jun 03 21:35:29.557083 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.557053 2574 generic.go:356] "Generic (PLEG): container finished" podID="3db03da2-7544-4a09-a53c-0b509866c585" containerID="b7005d86f9813d02519209776f86cdcb41c42d4cb147b1b9b8f8b3673fb6522a" exitCode=0 Jun 03 21:35:29.557083 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.557077 2574 generic.go:356] "Generic (PLEG): container finished" podID="3db03da2-7544-4a09-a53c-0b509866c585" containerID="a29d542478da709e2c81ade88791f274b1c4786eff2c013fc3561a9ad9cc7345" exitCode=0 Jun 03 21:35:29.557083 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.557084 2574 generic.go:356] "Generic (PLEG): container finished" podID="3db03da2-7544-4a09-a53c-0b509866c585" containerID="781db64dd48be1a3fbb92dde050b6e9047b1045c36f1cfaffbd2248edd46a5f6" exitCode=0 Jun 03 21:35:29.557083 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.557090 2574 generic.go:356] "Generic (PLEG): container finished" podID="3db03da2-7544-4a09-a53c-0b509866c585" containerID="77c36849004a5967d82b51f32a47113de80478d8f582631b476e27ca911505ef" exitCode=0 Jun 03 21:35:29.557342 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.557095 2574 generic.go:356] "Generic (PLEG): container finished" podID="3db03da2-7544-4a09-a53c-0b509866c585" containerID="f5c8cf31fa6d20677c8238bcd25b7423d235543110d73af5c167adda3c1382ac" exitCode=0 Jun 03 21:35:29.557342 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.557135 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerDied","Data":"b7005d86f9813d02519209776f86cdcb41c42d4cb147b1b9b8f8b3673fb6522a"} Jun 03 21:35:29.557342 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.557202 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerDied","Data":"a29d542478da709e2c81ade88791f274b1c4786eff2c013fc3561a9ad9cc7345"} Jun 03 21:35:29.557342 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.557230 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerDied","Data":"781db64dd48be1a3fbb92dde050b6e9047b1045c36f1cfaffbd2248edd46a5f6"} Jun 03 21:35:29.557342 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.557257 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerDied","Data":"77c36849004a5967d82b51f32a47113de80478d8f582631b476e27ca911505ef"} Jun 03 21:35:29.557342 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.557281 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerDied","Data":"f5c8cf31fa6d20677c8238bcd25b7423d235543110d73af5c167adda3c1382ac"} Jun 03 21:35:29.863101 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.863077 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:29.940568 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.940532 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy\") pod \"3db03da2-7544-4a09-a53c-0b509866c585\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " Jun 03 21:35:29.940749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.940603 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-cluster-tls-config\") pod \"3db03da2-7544-4a09-a53c-0b509866c585\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " Jun 03 21:35:29.940749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.940673 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy-web\") pod \"3db03da2-7544-4a09-a53c-0b509866c585\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " Jun 03 21:35:29.940749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.940698 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-web-config\") pod \"3db03da2-7544-4a09-a53c-0b509866c585\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " Jun 03 21:35:29.940749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.940722 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-metrics-client-ca\") pod \"3db03da2-7544-4a09-a53c-0b509866c585\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " Jun 03 21:35:29.940749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.940749 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vf7w\" (UniqueName: \"kubernetes.io/projected/3db03da2-7544-4a09-a53c-0b509866c585-kube-api-access-6vf7w\") pod \"3db03da2-7544-4a09-a53c-0b509866c585\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " Jun 03 21:35:29.941059 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.940778 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-trusted-ca-bundle\") pod \"3db03da2-7544-4a09-a53c-0b509866c585\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " Jun 03 21:35:29.941059 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.940803 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3db03da2-7544-4a09-a53c-0b509866c585-config-out\") pod \"3db03da2-7544-4a09-a53c-0b509866c585\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " Jun 03 21:35:29.941059 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.940828 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3db03da2-7544-4a09-a53c-0b509866c585-tls-assets\") pod \"3db03da2-7544-4a09-a53c-0b509866c585\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " Jun 03 21:35:29.941059 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.940854 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3db03da2-7544-4a09-a53c-0b509866c585\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " Jun 03 21:35:29.941059 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.940907 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-main-tls\") pod \"3db03da2-7544-4a09-a53c-0b509866c585\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " Jun 03 21:35:29.946554 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.942054 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-config-volume\") pod \"3db03da2-7544-4a09-a53c-0b509866c585\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " Jun 03 21:35:29.946554 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.942140 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-main-db\") pod \"3db03da2-7544-4a09-a53c-0b509866c585\" (UID: \"3db03da2-7544-4a09-a53c-0b509866c585\") " Jun 03 21:35:29.946554 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.942261 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3db03da2-7544-4a09-a53c-0b509866c585" (UID: "3db03da2-7544-4a09-a53c-0b509866c585"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:35:29.946554 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.942680 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:29.946554 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.944243 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3db03da2-7544-4a09-a53c-0b509866c585" (UID: "3db03da2-7544-4a09-a53c-0b509866c585"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:35:29.949683 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.947285 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3db03da2-7544-4a09-a53c-0b509866c585" (UID: "3db03da2-7544-4a09-a53c-0b509866c585"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:35:29.949683 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.949039 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3db03da2-7544-4a09-a53c-0b509866c585-kube-api-access-6vf7w" (OuterVolumeSpecName: "kube-api-access-6vf7w") pod "3db03da2-7544-4a09-a53c-0b509866c585" (UID: "3db03da2-7544-4a09-a53c-0b509866c585"). InnerVolumeSpecName "kube-api-access-6vf7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:35:29.956872 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.956528 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-config-volume" (OuterVolumeSpecName: "config-volume") pod "3db03da2-7544-4a09-a53c-0b509866c585" (UID: "3db03da2-7544-4a09-a53c-0b509866c585"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:35:29.956872 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.956769 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3db03da2-7544-4a09-a53c-0b509866c585" (UID: "3db03da2-7544-4a09-a53c-0b509866c585"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:35:29.957318 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.957006 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3db03da2-7544-4a09-a53c-0b509866c585" (UID: "3db03da2-7544-4a09-a53c-0b509866c585"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:35:29.958152 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.958112 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3db03da2-7544-4a09-a53c-0b509866c585-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3db03da2-7544-4a09-a53c-0b509866c585" (UID: "3db03da2-7544-4a09-a53c-0b509866c585"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:35:29.958423 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.958385 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db03da2-7544-4a09-a53c-0b509866c585-config-out" (OuterVolumeSpecName: "config-out") pod "3db03da2-7544-4a09-a53c-0b509866c585" (UID: "3db03da2-7544-4a09-a53c-0b509866c585"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:35:29.958423 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.958396 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3db03da2-7544-4a09-a53c-0b509866c585" (UID: "3db03da2-7544-4a09-a53c-0b509866c585"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:35:29.958760 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.958742 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3db03da2-7544-4a09-a53c-0b509866c585" (UID: "3db03da2-7544-4a09-a53c-0b509866c585"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:35:29.959203 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.959180 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3db03da2-7544-4a09-a53c-0b509866c585" (UID: "3db03da2-7544-4a09-a53c-0b509866c585"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:35:29.968207 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:29.968182 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-web-config" (OuterVolumeSpecName: "web-config") pod "3db03da2-7544-4a09-a53c-0b509866c585" (UID: "3db03da2-7544-4a09-a53c-0b509866c585"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:35:30.043937 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.043897 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-main-tls\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:30.043937 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.043930 2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-config-volume\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:30.043937 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.043939 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3db03da2-7544-4a09-a53c-0b509866c585-alertmanager-main-db\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:30.044189 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.043969 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:30.044189 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.043978 2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-cluster-tls-config\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:30.044189 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.043987 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:30.044189 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.044016 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-web-config\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:30.044189 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.044025 2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3db03da2-7544-4a09-a53c-0b509866c585-metrics-client-ca\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:30.044189 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.044034 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vf7w\" (UniqueName: \"kubernetes.io/projected/3db03da2-7544-4a09-a53c-0b509866c585-kube-api-access-6vf7w\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:30.044189 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.044043 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3db03da2-7544-4a09-a53c-0b509866c585-config-out\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:30.044189 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.044050 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3db03da2-7544-4a09-a53c-0b509866c585-tls-assets\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:30.044189 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.044058 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3db03da2-7544-4a09-a53c-0b509866c585-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:30.564357 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.564324 2574 generic.go:356] "Generic (PLEG): container finished" podID="3db03da2-7544-4a09-a53c-0b509866c585" containerID="3c5570e570ffdafdffe23ae5034834211330e99f658866074696d5818660d454" exitCode=0 Jun 03 21:35:30.564552 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.564413 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerDied","Data":"3c5570e570ffdafdffe23ae5034834211330e99f658866074696d5818660d454"} Jun 03 21:35:30.564552 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.564500 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3db03da2-7544-4a09-a53c-0b509866c585","Type":"ContainerDied","Data":"0be517901876d5c52b342e09dcae2562b7c6181575906baf973e2f8bcc51832e"} Jun 03 21:35:30.564552 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.564518 2574 scope.go:117] "RemoveContainer" containerID="b7005d86f9813d02519209776f86cdcb41c42d4cb147b1b9b8f8b3673fb6522a" Jun 03 21:35:30.564552 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.564419 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.572657 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.572639 2574 scope.go:117] "RemoveContainer" containerID="a29d542478da709e2c81ade88791f274b1c4786eff2c013fc3561a9ad9cc7345" Jun 03 21:35:30.580120 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.580104 2574 scope.go:117] "RemoveContainer" containerID="781db64dd48be1a3fbb92dde050b6e9047b1045c36f1cfaffbd2248edd46a5f6" Jun 03 21:35:30.587188 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.587171 2574 scope.go:117] "RemoveContainer" containerID="3c5570e570ffdafdffe23ae5034834211330e99f658866074696d5818660d454" Jun 03 21:35:30.590148 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.590124 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:35:30.594681 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.594659 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:35:30.595065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.595047 2574 scope.go:117] "RemoveContainer" containerID="77c36849004a5967d82b51f32a47113de80478d8f582631b476e27ca911505ef" Jun 03 21:35:30.602029 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.602013 2574 scope.go:117] "RemoveContainer" containerID="f5c8cf31fa6d20677c8238bcd25b7423d235543110d73af5c167adda3c1382ac" Jun 03 21:35:30.609070 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.609041 2574 scope.go:117] "RemoveContainer" containerID="993f8bc65573a61178bb187713fcfab03887d3e959ebcacb2c780a386826eb81" Jun 03 21:35:30.616061 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.616046 2574 scope.go:117] "RemoveContainer" containerID="b7005d86f9813d02519209776f86cdcb41c42d4cb147b1b9b8f8b3673fb6522a" Jun 03 21:35:30.616329 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:35:30.616301 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7005d86f9813d02519209776f86cdcb41c42d4cb147b1b9b8f8b3673fb6522a\": container with ID starting with b7005d86f9813d02519209776f86cdcb41c42d4cb147b1b9b8f8b3673fb6522a not found: ID does not exist" containerID="b7005d86f9813d02519209776f86cdcb41c42d4cb147b1b9b8f8b3673fb6522a" Jun 03 21:35:30.616383 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.616338 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7005d86f9813d02519209776f86cdcb41c42d4cb147b1b9b8f8b3673fb6522a"} err="failed to get container status \"b7005d86f9813d02519209776f86cdcb41c42d4cb147b1b9b8f8b3673fb6522a\": rpc error: code = NotFound desc = could not find container \"b7005d86f9813d02519209776f86cdcb41c42d4cb147b1b9b8f8b3673fb6522a\": container with ID starting with b7005d86f9813d02519209776f86cdcb41c42d4cb147b1b9b8f8b3673fb6522a not found: ID does not exist" Jun 03 21:35:30.616383 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.616371 2574 scope.go:117] "RemoveContainer" containerID="a29d542478da709e2c81ade88791f274b1c4786eff2c013fc3561a9ad9cc7345" Jun 03 21:35:30.616631 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:35:30.616612 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a29d542478da709e2c81ade88791f274b1c4786eff2c013fc3561a9ad9cc7345\": container with ID starting with a29d542478da709e2c81ade88791f274b1c4786eff2c013fc3561a9ad9cc7345 not found: ID does not exist" containerID="a29d542478da709e2c81ade88791f274b1c4786eff2c013fc3561a9ad9cc7345" Jun 03 21:35:30.616689 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.616640 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a29d542478da709e2c81ade88791f274b1c4786eff2c013fc3561a9ad9cc7345"} err="failed to get container status \"a29d542478da709e2c81ade88791f274b1c4786eff2c013fc3561a9ad9cc7345\": rpc error: code = NotFound desc = could not find container \"a29d542478da709e2c81ade88791f274b1c4786eff2c013fc3561a9ad9cc7345\": container with ID starting with a29d542478da709e2c81ade88791f274b1c4786eff2c013fc3561a9ad9cc7345 not found: ID does not exist" Jun 03 21:35:30.616689 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.616664 2574 scope.go:117] "RemoveContainer" containerID="781db64dd48be1a3fbb92dde050b6e9047b1045c36f1cfaffbd2248edd46a5f6" Jun 03 21:35:30.616896 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:35:30.616879 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"781db64dd48be1a3fbb92dde050b6e9047b1045c36f1cfaffbd2248edd46a5f6\": container with ID starting with 781db64dd48be1a3fbb92dde050b6e9047b1045c36f1cfaffbd2248edd46a5f6 not found: ID does not exist" containerID="781db64dd48be1a3fbb92dde050b6e9047b1045c36f1cfaffbd2248edd46a5f6" Jun 03 21:35:30.616936 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.616902 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"781db64dd48be1a3fbb92dde050b6e9047b1045c36f1cfaffbd2248edd46a5f6"} err="failed to get container status \"781db64dd48be1a3fbb92dde050b6e9047b1045c36f1cfaffbd2248edd46a5f6\": rpc error: code = NotFound desc = could not find container \"781db64dd48be1a3fbb92dde050b6e9047b1045c36f1cfaffbd2248edd46a5f6\": container with ID starting with 781db64dd48be1a3fbb92dde050b6e9047b1045c36f1cfaffbd2248edd46a5f6 not found: ID does not exist" Jun 03 21:35:30.616936 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.616917 2574 scope.go:117] "RemoveContainer" containerID="3c5570e570ffdafdffe23ae5034834211330e99f658866074696d5818660d454" Jun 03 21:35:30.617171 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:35:30.617157 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c5570e570ffdafdffe23ae5034834211330e99f658866074696d5818660d454\": container with ID starting with 3c5570e570ffdafdffe23ae5034834211330e99f658866074696d5818660d454 not found: ID does not exist" containerID="3c5570e570ffdafdffe23ae5034834211330e99f658866074696d5818660d454" Jun 03 21:35:30.617223 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.617174 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c5570e570ffdafdffe23ae5034834211330e99f658866074696d5818660d454"} err="failed to get container status \"3c5570e570ffdafdffe23ae5034834211330e99f658866074696d5818660d454\": rpc error: code = NotFound desc = could not find container \"3c5570e570ffdafdffe23ae5034834211330e99f658866074696d5818660d454\": container with ID starting with 3c5570e570ffdafdffe23ae5034834211330e99f658866074696d5818660d454 not found: ID does not exist" Jun 03 21:35:30.617223 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.617186 2574 scope.go:117] "RemoveContainer" containerID="77c36849004a5967d82b51f32a47113de80478d8f582631b476e27ca911505ef" Jun 03 21:35:30.617401 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:35:30.617385 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77c36849004a5967d82b51f32a47113de80478d8f582631b476e27ca911505ef\": container with ID starting with 77c36849004a5967d82b51f32a47113de80478d8f582631b476e27ca911505ef not found: ID does not exist" containerID="77c36849004a5967d82b51f32a47113de80478d8f582631b476e27ca911505ef" Jun 03 21:35:30.617461 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.617408 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77c36849004a5967d82b51f32a47113de80478d8f582631b476e27ca911505ef"} err="failed to get container status \"77c36849004a5967d82b51f32a47113de80478d8f582631b476e27ca911505ef\": rpc error: code = NotFound desc = could not find container \"77c36849004a5967d82b51f32a47113de80478d8f582631b476e27ca911505ef\": container with ID starting with 77c36849004a5967d82b51f32a47113de80478d8f582631b476e27ca911505ef not found: ID does not exist" Jun 03 21:35:30.617461 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.617428 2574 scope.go:117] "RemoveContainer" containerID="f5c8cf31fa6d20677c8238bcd25b7423d235543110d73af5c167adda3c1382ac" Jun 03 21:35:30.617655 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:35:30.617640 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5c8cf31fa6d20677c8238bcd25b7423d235543110d73af5c167adda3c1382ac\": container with ID starting with f5c8cf31fa6d20677c8238bcd25b7423d235543110d73af5c167adda3c1382ac not found: ID does not exist" containerID="f5c8cf31fa6d20677c8238bcd25b7423d235543110d73af5c167adda3c1382ac" Jun 03 21:35:30.617689 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.617659 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5c8cf31fa6d20677c8238bcd25b7423d235543110d73af5c167adda3c1382ac"} err="failed to get container status \"f5c8cf31fa6d20677c8238bcd25b7423d235543110d73af5c167adda3c1382ac\": rpc error: code = NotFound desc = could not find container \"f5c8cf31fa6d20677c8238bcd25b7423d235543110d73af5c167adda3c1382ac\": container with ID starting with f5c8cf31fa6d20677c8238bcd25b7423d235543110d73af5c167adda3c1382ac not found: ID does not exist" Jun 03 21:35:30.617689 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.617672 2574 scope.go:117] "RemoveContainer" containerID="993f8bc65573a61178bb187713fcfab03887d3e959ebcacb2c780a386826eb81" Jun 03 21:35:30.617873 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:35:30.617856 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"993f8bc65573a61178bb187713fcfab03887d3e959ebcacb2c780a386826eb81\": container with ID starting with 993f8bc65573a61178bb187713fcfab03887d3e959ebcacb2c780a386826eb81 not found: ID does not exist" containerID="993f8bc65573a61178bb187713fcfab03887d3e959ebcacb2c780a386826eb81" Jun 03 21:35:30.617922 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.617877 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"993f8bc65573a61178bb187713fcfab03887d3e959ebcacb2c780a386826eb81"} err="failed to get container status \"993f8bc65573a61178bb187713fcfab03887d3e959ebcacb2c780a386826eb81\": rpc error: code = NotFound desc = could not find container \"993f8bc65573a61178bb187713fcfab03887d3e959ebcacb2c780a386826eb81\": container with ID starting with 993f8bc65573a61178bb187713fcfab03887d3e959ebcacb2c780a386826eb81 not found: ID does not exist" Jun 03 21:35:30.627832 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.627808 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:35:30.628207 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628190 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="config-reloader" Jun 03 21:35:30.628278 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628210 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="config-reloader" Jun 03 21:35:30.628278 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628231 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="kube-rbac-proxy-metric" Jun 03 21:35:30.628278 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628239 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="kube-rbac-proxy-metric" Jun 03 21:35:30.628278 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628258 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="alertmanager" Jun 03 21:35:30.628278 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628267 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="alertmanager" Jun 03 21:35:30.628278 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628276 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="prom-label-proxy" Jun 03 21:35:30.628476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628284 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="prom-label-proxy" Jun 03 21:35:30.628476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628297 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="init-config-reloader" Jun 03 21:35:30.628476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628304 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="init-config-reloader" Jun 03 21:35:30.628476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628320 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da115fc4-b23a-4db3-93ca-771357931f70" containerName="console" Jun 03 21:35:30.628476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628328 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="da115fc4-b23a-4db3-93ca-771357931f70" containerName="console" Jun 03 21:35:30.628476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628346 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="kube-rbac-proxy-web" Jun 03 21:35:30.628476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628354 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="kube-rbac-proxy-web" Jun 03 21:35:30.628476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628362 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="kube-rbac-proxy" Jun 03 21:35:30.628476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628369 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="kube-rbac-proxy" Jun 03 21:35:30.628476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628457 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="kube-rbac-proxy-web" Jun 03 21:35:30.628476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628470 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="da115fc4-b23a-4db3-93ca-771357931f70" containerName="console" Jun 03 21:35:30.628476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628480 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="config-reloader" Jun 03 21:35:30.628848 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628490 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="kube-rbac-proxy" Jun 03 21:35:30.628848 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628500 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="alertmanager" Jun 03 21:35:30.628848 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628508 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="prom-label-proxy" Jun 03 21:35:30.628848 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.628517 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db03da2-7544-4a09-a53c-0b509866c585" containerName="kube-rbac-proxy-metric" Jun 03 21:35:30.631820 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.631803 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.634856 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.634834 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 21:35:30.634939 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.634859 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r4zqb\"" Jun 03 21:35:30.635192 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.635175 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 21:35:30.635675 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.635658 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 21:35:30.635756 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.635737 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 21:35:30.635968 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.635933 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 21:35:30.636053 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.635982 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 21:35:30.636053 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.636007 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 21:35:30.636053 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.636012 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 21:35:30.642991 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.642964 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 21:35:30.648777 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.648757 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47ed2b92-cd7f-4203-aa2b-c38daf13b620-tls-assets\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.648875 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.648798 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.648875 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.648833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.648875 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.648858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47ed2b92-cd7f-4203-aa2b-c38daf13b620-config-out\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.649045 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.648880 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-web-config\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.649045 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.648973 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.649045 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.649004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-config-volume\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.649045 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.649026 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.649191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.649073 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.649191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.649089 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/47ed2b92-cd7f-4203-aa2b-c38daf13b620-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.649191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.649124 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ed2b92-cd7f-4203-aa2b-c38daf13b620-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.649191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.649147 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47ed2b92-cd7f-4203-aa2b-c38daf13b620-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.649191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.649161 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkwkw\" (UniqueName: \"kubernetes.io/projected/47ed2b92-cd7f-4203-aa2b-c38daf13b620-kube-api-access-hkwkw\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.656723 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.656701 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:35:30.750387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.750348 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.750387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.750393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.750630 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.750413 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47ed2b92-cd7f-4203-aa2b-c38daf13b620-config-out\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.750630 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.750445 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-web-config\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.750630 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.750466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.750630 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.750485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-config-volume\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.750630 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.750504 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.750630 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.750532 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.750630 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.750549 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/47ed2b92-cd7f-4203-aa2b-c38daf13b620-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.750630 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.750589 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ed2b92-cd7f-4203-aa2b-c38daf13b620-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.750630 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.750616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47ed2b92-cd7f-4203-aa2b-c38daf13b620-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.751097 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.750637 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkwkw\" (UniqueName: \"kubernetes.io/projected/47ed2b92-cd7f-4203-aa2b-c38daf13b620-kube-api-access-hkwkw\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.751097 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.750671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47ed2b92-cd7f-4203-aa2b-c38daf13b620-tls-assets\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.752229 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.751623 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/47ed2b92-cd7f-4203-aa2b-c38daf13b620-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.752229 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.752159 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47ed2b92-cd7f-4203-aa2b-c38daf13b620-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.752692 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.752662 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ed2b92-cd7f-4203-aa2b-c38daf13b620-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.753791 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.753757 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-config-volume\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.754359 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.754256 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.754359 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.754269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.754359 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.754317 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47ed2b92-cd7f-4203-aa2b-c38daf13b620-tls-assets\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.754540 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.754449 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.754540 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.754465 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.754612 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.754601 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47ed2b92-cd7f-4203-aa2b-c38daf13b620-config-out\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.754859 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.754838 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-web-config\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.755338 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.755311 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/47ed2b92-cd7f-4203-aa2b-c38daf13b620-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.767215 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.767193 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkwkw\" (UniqueName: \"kubernetes.io/projected/47ed2b92-cd7f-4203-aa2b-c38daf13b620-kube-api-access-hkwkw\") pod \"alertmanager-main-0\" (UID: \"47ed2b92-cd7f-4203-aa2b-c38daf13b620\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:30.941147 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:30.941107 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:35:31.081278 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:31.081253 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:35:31.082740 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:35:31.082715 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ed2b92_cd7f_4203_aa2b_c38daf13b620.slice/crio-a826607e1584dd19d85cf069681e4e44d55363ad2fa4e9ac5493bb1f8cb4ae1f WatchSource:0}: Error finding container a826607e1584dd19d85cf069681e4e44d55363ad2fa4e9ac5493bb1f8cb4ae1f: Status 404 returned error can't find the container with id a826607e1584dd19d85cf069681e4e44d55363ad2fa4e9ac5493bb1f8cb4ae1f Jun 03 21:35:31.336966 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:31.336906 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3db03da2-7544-4a09-a53c-0b509866c585" path="/var/lib/kubelet/pods/3db03da2-7544-4a09-a53c-0b509866c585/volumes" Jun 03 21:35:31.571483 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:31.571451 2574 generic.go:356] "Generic (PLEG): container finished" podID="47ed2b92-cd7f-4203-aa2b-c38daf13b620" containerID="737d444252e20f86f9422c0e083e76f943fada2e4bb0297ab0be665d174366bb" exitCode=0 Jun 03 21:35:31.571710 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:31.571542 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47ed2b92-cd7f-4203-aa2b-c38daf13b620","Type":"ContainerDied","Data":"737d444252e20f86f9422c0e083e76f943fada2e4bb0297ab0be665d174366bb"} Jun 03 21:35:31.571710 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:31.571622 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47ed2b92-cd7f-4203-aa2b-c38daf13b620","Type":"ContainerStarted","Data":"a826607e1584dd19d85cf069681e4e44d55363ad2fa4e9ac5493bb1f8cb4ae1f"} Jun 03 21:35:32.580939 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:32.580903 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47ed2b92-cd7f-4203-aa2b-c38daf13b620","Type":"ContainerStarted","Data":"d48440ded10aae74c059d8a050e3a2eda50b4e7619f39c6f46b50c15eca58b05"} Jun 03 21:35:32.581327 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:32.580984 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47ed2b92-cd7f-4203-aa2b-c38daf13b620","Type":"ContainerStarted","Data":"402f39ed9289681789edfd78cafe8c6d12526f1b7f626ff4f03897ea7dace185"} Jun 03 21:35:32.581327 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:32.581019 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47ed2b92-cd7f-4203-aa2b-c38daf13b620","Type":"ContainerStarted","Data":"2ebebae797774528da5a4d3ffd026610a198b6278789d602c01161f90cad7fc6"} Jun 03 21:35:32.581327 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:32.581044 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47ed2b92-cd7f-4203-aa2b-c38daf13b620","Type":"ContainerStarted","Data":"4a35934167590702cadb9b210f6ee7b93edc184448aa71845b9f8695d29ccea3"} Jun 03 21:35:32.581327 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:32.581068 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47ed2b92-cd7f-4203-aa2b-c38daf13b620","Type":"ContainerStarted","Data":"290638a563f5b4581a640fbcdb82f9496f8a8843d9c106dd98cadedcedbc9b8b"} Jun 03 21:35:32.581327 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:32.581092 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47ed2b92-cd7f-4203-aa2b-c38daf13b620","Type":"ContainerStarted","Data":"cd270673d3a6bdf3d9f5a349d3a1e4c79572f619dfb839d4ebef5435f4cb977d"} Jun 03 21:35:32.618762 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:32.618710 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.603449791 podStartE2EDuration="2.618695131s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.24534ms" isStatefulPod=false podCreationTimestamp="2026-06-03 21:35:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:35:32.616107615 +0000 UTC m=+331.776600517" watchObservedRunningTime="2026-06-03 21:35:32.618695131 +0000 UTC m=+331.779188049" Jun 03 21:35:33.163733 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:33.163699 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:33.261432 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:33.261399 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:35.595051 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:35.595014 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:35.694423 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:35.694378 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:36.106324 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:36.106297 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67c8956b58-sb47f"] Jun 03 21:35:36.238015 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:36.237986 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:36.338231 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:36.338189 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:36.417859 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:36.417785 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:49.402857 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.402790 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" podUID="02da8b3c-0c85-415e-8c2e-bbda6e77a851" containerName="registry" containerID="cri-o://f8054490a472fb4ac3fa473741fbbc08e90f8df0022612639ce3d8ad7dbe1efa" gracePeriod=30 Jun 03 21:35:49.669624 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.669248 2574 generic.go:356] "Generic (PLEG): container finished" podID="02da8b3c-0c85-415e-8c2e-bbda6e77a851" containerID="f8054490a472fb4ac3fa473741fbbc08e90f8df0022612639ce3d8ad7dbe1efa" exitCode=0 Jun 03 21:35:49.669624 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.669399 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" event={"ID":"02da8b3c-0c85-415e-8c2e-bbda6e77a851","Type":"ContainerDied","Data":"f8054490a472fb4ac3fa473741fbbc08e90f8df0022612639ce3d8ad7dbe1efa"} Jun 03 21:35:49.669624 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.669444 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" event={"ID":"02da8b3c-0c85-415e-8c2e-bbda6e77a851","Type":"ContainerDied","Data":"89f6dcf1982f0b2369a383e492f38525a3428a94464cf64c34fd20385961ae2a"} Jun 03 21:35:49.669624 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.669462 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89f6dcf1982f0b2369a383e492f38525a3428a94464cf64c34fd20385961ae2a" Jun 03 21:35:49.672765 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.672738 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:35:49.806912 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.806878 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02da8b3c-0c85-415e-8c2e-bbda6e77a851-ca-trust-extracted\") pod \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " Jun 03 21:35:49.807116 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.806923 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-bound-sa-token\") pod \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " Jun 03 21:35:49.807116 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.806941 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzkp7\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-kube-api-access-lzkp7\") pod \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " Jun 03 21:35:49.807116 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.807012 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02da8b3c-0c85-415e-8c2e-bbda6e77a851-image-registry-private-configuration\") pod \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " Jun 03 21:35:49.807116 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.807050 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02da8b3c-0c85-415e-8c2e-bbda6e77a851-trusted-ca\") pod \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " Jun 03 21:35:49.807116 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.807116 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls\") pod \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " Jun 03 21:35:49.807381 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.807171 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-certificates\") pod \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " Jun 03 21:35:49.807381 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.807211 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02da8b3c-0c85-415e-8c2e-bbda6e77a851-installation-pull-secrets\") pod \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\" (UID: \"02da8b3c-0c85-415e-8c2e-bbda6e77a851\") " Jun 03 21:35:49.807645 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.807592 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "02da8b3c-0c85-415e-8c2e-bbda6e77a851" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:35:49.807781 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.807651 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02da8b3c-0c85-415e-8c2e-bbda6e77a851-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "02da8b3c-0c85-415e-8c2e-bbda6e77a851" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:35:49.809847 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.809805 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-kube-api-access-lzkp7" (OuterVolumeSpecName: "kube-api-access-lzkp7") pod "02da8b3c-0c85-415e-8c2e-bbda6e77a851" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851"). InnerVolumeSpecName "kube-api-access-lzkp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:35:49.809940 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.809862 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "02da8b3c-0c85-415e-8c2e-bbda6e77a851" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:35:49.809940 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.809888 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "02da8b3c-0c85-415e-8c2e-bbda6e77a851" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:35:49.810061 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.809961 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02da8b3c-0c85-415e-8c2e-bbda6e77a851-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "02da8b3c-0c85-415e-8c2e-bbda6e77a851" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:35:49.810061 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.810051 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02da8b3c-0c85-415e-8c2e-bbda6e77a851-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "02da8b3c-0c85-415e-8c2e-bbda6e77a851" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:35:49.816832 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.816810 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02da8b3c-0c85-415e-8c2e-bbda6e77a851-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "02da8b3c-0c85-415e-8c2e-bbda6e77a851" (UID: "02da8b3c-0c85-415e-8c2e-bbda6e77a851"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:35:49.846936 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.846898 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:49.908259 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.908222 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-certificates\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:49.908259 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.908254 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02da8b3c-0c85-415e-8c2e-bbda6e77a851-installation-pull-secrets\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:49.908259 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.908263 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02da8b3c-0c85-415e-8c2e-bbda6e77a851-ca-trust-extracted\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:49.908456 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.908274 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-bound-sa-token\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:49.908456 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.908283 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzkp7\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-kube-api-access-lzkp7\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:49.908456 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.908292 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02da8b3c-0c85-415e-8c2e-bbda6e77a851-image-registry-private-configuration\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:49.908456 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.908302 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02da8b3c-0c85-415e-8c2e-bbda6e77a851-trusted-ca\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:49.908456 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.908309 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02da8b3c-0c85-415e-8c2e-bbda6e77a851-registry-tls\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:35:49.940491 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:49.940409 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:35:50.673741 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:50.673713 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d6577f7f-hl892" Jun 03 21:35:50.694936 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:50.694902 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d6577f7f-hl892"] Jun 03 21:35:50.699196 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:50.699172 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d6577f7f-hl892"] Jun 03 21:35:51.339656 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:51.339621 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02da8b3c-0c85-415e-8c2e-bbda6e77a851" path="/var/lib/kubelet/pods/02da8b3c-0c85-415e-8c2e-bbda6e77a851/volumes" Jun 03 21:35:56.006309 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:35:56.006272 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:36:01.125730 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.125664 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-67c8956b58-sb47f" podUID="ece17bb4-b68a-4799-b21f-85801381cc8d" containerName="console" containerID="cri-o://8ecdbfc9f4dcf20ade6da8a176f53fc9b51c5741ecf692830450115512119a4e" gracePeriod=15 Jun 03 21:36:01.387828 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.387770 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:36:01.513588 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.513558 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-oauth-serving-cert\") pod \"ece17bb4-b68a-4799-b21f-85801381cc8d\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " Jun 03 21:36:01.513762 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.513604 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ece17bb4-b68a-4799-b21f-85801381cc8d-console-oauth-config\") pod \"ece17bb4-b68a-4799-b21f-85801381cc8d\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " Jun 03 21:36:01.513762 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.513640 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ece17bb4-b68a-4799-b21f-85801381cc8d-console-serving-cert\") pod \"ece17bb4-b68a-4799-b21f-85801381cc8d\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " Jun 03 21:36:01.513762 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.513662 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-trusted-ca-bundle\") pod \"ece17bb4-b68a-4799-b21f-85801381cc8d\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " Jun 03 21:36:01.513762 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.513685 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-console-config\") pod \"ece17bb4-b68a-4799-b21f-85801381cc8d\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " Jun 03 21:36:01.513762 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.513709 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4h2z\" (UniqueName: \"kubernetes.io/projected/ece17bb4-b68a-4799-b21f-85801381cc8d-kube-api-access-b4h2z\") pod \"ece17bb4-b68a-4799-b21f-85801381cc8d\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " Jun 03 21:36:01.514035 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.513767 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-service-ca\") pod \"ece17bb4-b68a-4799-b21f-85801381cc8d\" (UID: \"ece17bb4-b68a-4799-b21f-85801381cc8d\") " Jun 03 21:36:01.514197 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.514157 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ece17bb4-b68a-4799-b21f-85801381cc8d" (UID: "ece17bb4-b68a-4799-b21f-85801381cc8d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:36:01.514325 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.514200 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-console-config" (OuterVolumeSpecName: "console-config") pod "ece17bb4-b68a-4799-b21f-85801381cc8d" (UID: "ece17bb4-b68a-4799-b21f-85801381cc8d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:36:01.514325 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.514209 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ece17bb4-b68a-4799-b21f-85801381cc8d" (UID: "ece17bb4-b68a-4799-b21f-85801381cc8d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:36:01.514325 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.514279 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-service-ca" (OuterVolumeSpecName: "service-ca") pod "ece17bb4-b68a-4799-b21f-85801381cc8d" (UID: "ece17bb4-b68a-4799-b21f-85801381cc8d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:36:01.515791 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.515762 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ece17bb4-b68a-4799-b21f-85801381cc8d-kube-api-access-b4h2z" (OuterVolumeSpecName: "kube-api-access-b4h2z") pod "ece17bb4-b68a-4799-b21f-85801381cc8d" (UID: "ece17bb4-b68a-4799-b21f-85801381cc8d"). InnerVolumeSpecName "kube-api-access-b4h2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:36:01.515877 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.515786 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ece17bb4-b68a-4799-b21f-85801381cc8d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ece17bb4-b68a-4799-b21f-85801381cc8d" (UID: "ece17bb4-b68a-4799-b21f-85801381cc8d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:36:01.515877 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.515856 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ece17bb4-b68a-4799-b21f-85801381cc8d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ece17bb4-b68a-4799-b21f-85801381cc8d" (UID: "ece17bb4-b68a-4799-b21f-85801381cc8d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:36:01.614708 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.614661 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-service-ca\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:36:01.614708 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.614701 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-oauth-serving-cert\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:36:01.614708 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.614711 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ece17bb4-b68a-4799-b21f-85801381cc8d-console-oauth-config\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:36:01.614708 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.614721 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ece17bb4-b68a-4799-b21f-85801381cc8d-console-serving-cert\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:36:01.614982 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.614730 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-trusted-ca-bundle\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:36:01.614982 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.614739 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ece17bb4-b68a-4799-b21f-85801381cc8d-console-config\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:36:01.614982 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.614747 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4h2z\" (UniqueName: \"kubernetes.io/projected/ece17bb4-b68a-4799-b21f-85801381cc8d-kube-api-access-b4h2z\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:36:01.722433 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.722356 2574 generic.go:356] "Generic (PLEG): container finished" podID="ece17bb4-b68a-4799-b21f-85801381cc8d" containerID="8ecdbfc9f4dcf20ade6da8a176f53fc9b51c5741ecf692830450115512119a4e" exitCode=0 Jun 03 21:36:01.722433 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.722403 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c8956b58-sb47f" Jun 03 21:36:01.722433 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.722423 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c8956b58-sb47f" event={"ID":"ece17bb4-b68a-4799-b21f-85801381cc8d","Type":"ContainerDied","Data":"8ecdbfc9f4dcf20ade6da8a176f53fc9b51c5741ecf692830450115512119a4e"} Jun 03 21:36:01.722644 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.722462 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c8956b58-sb47f" event={"ID":"ece17bb4-b68a-4799-b21f-85801381cc8d","Type":"ContainerDied","Data":"62ceedc8a411c18de02e84c105f231cb401a57e0855f6980f01d000cae8a7a8c"} Jun 03 21:36:01.722644 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.722480 2574 scope.go:117] "RemoveContainer" containerID="8ecdbfc9f4dcf20ade6da8a176f53fc9b51c5741ecf692830450115512119a4e" Jun 03 21:36:01.730881 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.730865 2574 scope.go:117] "RemoveContainer" containerID="8ecdbfc9f4dcf20ade6da8a176f53fc9b51c5741ecf692830450115512119a4e" Jun 03 21:36:01.731144 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:36:01.731125 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ecdbfc9f4dcf20ade6da8a176f53fc9b51c5741ecf692830450115512119a4e\": container with ID starting with 8ecdbfc9f4dcf20ade6da8a176f53fc9b51c5741ecf692830450115512119a4e not found: ID does not exist" containerID="8ecdbfc9f4dcf20ade6da8a176f53fc9b51c5741ecf692830450115512119a4e" Jun 03 21:36:01.731208 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.731151 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ecdbfc9f4dcf20ade6da8a176f53fc9b51c5741ecf692830450115512119a4e"} err="failed to get container status \"8ecdbfc9f4dcf20ade6da8a176f53fc9b51c5741ecf692830450115512119a4e\": rpc error: code = NotFound desc = could not find container \"8ecdbfc9f4dcf20ade6da8a176f53fc9b51c5741ecf692830450115512119a4e\": container with ID starting with 8ecdbfc9f4dcf20ade6da8a176f53fc9b51c5741ecf692830450115512119a4e not found: ID does not exist" Jun 03 21:36:01.742617 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.742591 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67c8956b58-sb47f"] Jun 03 21:36:01.750433 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:01.750405 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67c8956b58-sb47f"] Jun 03 21:36:03.338046 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:03.338015 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ece17bb4-b68a-4799-b21f-85801381cc8d" path="/var/lib/kubelet/pods/ece17bb4-b68a-4799-b21f-85801381cc8d/volumes" Jun 03 21:36:25.245724 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:25.245687 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:36:27.213701 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:27.213661 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:36:27.322076 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:27.322039 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:36:59.196164 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:36:59.196129 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:00.028285 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:00.028250 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:03.007379 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:03.007340 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:03.109548 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:03.109509 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:04.807319 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:04.807282 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:04.949241 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:04.949207 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:05.163161 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:05.163108 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:07.432679 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.432644 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:07.649246 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.649217 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:07.768371 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.768299 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-vhtc7"] Jun 03 21:37:07.768617 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.768606 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02da8b3c-0c85-415e-8c2e-bbda6e77a851" containerName="registry" Jun 03 21:37:07.768657 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.768619 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="02da8b3c-0c85-415e-8c2e-bbda6e77a851" containerName="registry" Jun 03 21:37:07.768657 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.768639 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ece17bb4-b68a-4799-b21f-85801381cc8d" containerName="console" Jun 03 21:37:07.768657 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.768645 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ece17bb4-b68a-4799-b21f-85801381cc8d" containerName="console" Jun 03 21:37:07.768749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.768689 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="02da8b3c-0c85-415e-8c2e-bbda6e77a851" containerName="registry" Jun 03 21:37:07.768749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.768699 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ece17bb4-b68a-4799-b21f-85801381cc8d" containerName="console" Jun 03 21:37:07.772202 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.772181 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vhtc7" Jun 03 21:37:07.775152 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.775136 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fxjgt\"" Jun 03 21:37:07.775416 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.775401 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 21:37:07.775786 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.775775 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 21:37:07.788963 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.788922 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-vhtc7"] Jun 03 21:37:07.962829 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.962787 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05c53449-6d56-4a62-94de-7ac89225519a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-vhtc7\" (UID: \"05c53449-6d56-4a62-94de-7ac89225519a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vhtc7" Jun 03 21:37:07.962829 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:07.962835 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgb5k\" (UniqueName: \"kubernetes.io/projected/05c53449-6d56-4a62-94de-7ac89225519a-kube-api-access-xgb5k\") pod \"cert-manager-cainjector-5d99449ffd-vhtc7\" (UID: \"05c53449-6d56-4a62-94de-7ac89225519a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vhtc7" Jun 03 21:37:08.064040 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:08.063921 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05c53449-6d56-4a62-94de-7ac89225519a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-vhtc7\" (UID: \"05c53449-6d56-4a62-94de-7ac89225519a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vhtc7" Jun 03 21:37:08.064040 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:08.064005 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgb5k\" (UniqueName: \"kubernetes.io/projected/05c53449-6d56-4a62-94de-7ac89225519a-kube-api-access-xgb5k\") pod \"cert-manager-cainjector-5d99449ffd-vhtc7\" (UID: \"05c53449-6d56-4a62-94de-7ac89225519a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vhtc7" Jun 03 21:37:08.075616 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:08.075590 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05c53449-6d56-4a62-94de-7ac89225519a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-vhtc7\" (UID: \"05c53449-6d56-4a62-94de-7ac89225519a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vhtc7" Jun 03 21:37:08.075770 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:08.075680 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgb5k\" (UniqueName: \"kubernetes.io/projected/05c53449-6d56-4a62-94de-7ac89225519a-kube-api-access-xgb5k\") pod \"cert-manager-cainjector-5d99449ffd-vhtc7\" (UID: \"05c53449-6d56-4a62-94de-7ac89225519a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vhtc7" Jun 03 21:37:08.096020 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:08.095987 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vhtc7" Jun 03 21:37:08.224151 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:08.223914 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-vhtc7"] Jun 03 21:37:08.226328 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:37:08.226298 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05c53449_6d56_4a62_94de_7ac89225519a.slice/crio-5e729d110ad60a2a382fac90010c605bc7d39e54cd46fa667816eb82f1f8e73d WatchSource:0}: Error finding container 5e729d110ad60a2a382fac90010c605bc7d39e54cd46fa667816eb82f1f8e73d: Status 404 returned error can't find the container with id 5e729d110ad60a2a382fac90010c605bc7d39e54cd46fa667816eb82f1f8e73d Jun 03 21:37:08.228331 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:08.228317 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:37:08.995706 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:08.995645 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vhtc7" event={"ID":"05c53449-6d56-4a62-94de-7ac89225519a","Type":"ContainerStarted","Data":"5e729d110ad60a2a382fac90010c605bc7d39e54cd46fa667816eb82f1f8e73d"} Jun 03 21:37:09.009710 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:09.009645 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl"] Jun 03 21:37:09.013440 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:09.013414 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl" Jun 03 21:37:09.018569 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:09.018544 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zprjt\"" Jun 03 21:37:09.032427 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:09.032407 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl"] Jun 03 21:37:09.173624 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:09.173590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7656c065-4b4d-4811-aed9-8833413de4f6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-lb6dl\" (UID: \"7656c065-4b4d-4811-aed9-8833413de4f6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl" Jun 03 21:37:09.173813 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:09.173680 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c788f\" (UniqueName: \"kubernetes.io/projected/7656c065-4b4d-4811-aed9-8833413de4f6-kube-api-access-c788f\") pod \"cert-manager-webhook-7dc76cbb94-lb6dl\" (UID: \"7656c065-4b4d-4811-aed9-8833413de4f6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl" Jun 03 21:37:09.274401 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:09.274321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c788f\" (UniqueName: \"kubernetes.io/projected/7656c065-4b4d-4811-aed9-8833413de4f6-kube-api-access-c788f\") pod \"cert-manager-webhook-7dc76cbb94-lb6dl\" (UID: \"7656c065-4b4d-4811-aed9-8833413de4f6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl" Jun 03 21:37:09.274401 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:09.274393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7656c065-4b4d-4811-aed9-8833413de4f6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-lb6dl\" (UID: \"7656c065-4b4d-4811-aed9-8833413de4f6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl" Jun 03 21:37:09.284989 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:09.284904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7656c065-4b4d-4811-aed9-8833413de4f6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-lb6dl\" (UID: \"7656c065-4b4d-4811-aed9-8833413de4f6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl" Jun 03 21:37:09.284989 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:09.284969 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c788f\" (UniqueName: \"kubernetes.io/projected/7656c065-4b4d-4811-aed9-8833413de4f6-kube-api-access-c788f\") pod \"cert-manager-webhook-7dc76cbb94-lb6dl\" (UID: \"7656c065-4b4d-4811-aed9-8833413de4f6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl" Jun 03 21:37:09.326961 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:09.326921 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl" Jun 03 21:37:09.496305 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:09.496066 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl"] Jun 03 21:37:09.500783 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:37:09.500538 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7656c065_4b4d_4811_aed9_8833413de4f6.slice/crio-bcff9d1af1b37f058fc497b5ba045354bd03847483ed49ad22e65e706ff12dc6 WatchSource:0}: Error finding container bcff9d1af1b37f058fc497b5ba045354bd03847483ed49ad22e65e706ff12dc6: Status 404 returned error can't find the container with id bcff9d1af1b37f058fc497b5ba045354bd03847483ed49ad22e65e706ff12dc6 Jun 03 21:37:09.998464 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:09.998419 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:10.003257 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:10.003226 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl" event={"ID":"7656c065-4b4d-4811-aed9-8833413de4f6","Type":"ContainerStarted","Data":"bcff9d1af1b37f058fc497b5ba045354bd03847483ed49ad22e65e706ff12dc6"} Jun 03 21:37:10.100004 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:10.099934 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:12.013986 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:12.013936 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vhtc7" event={"ID":"05c53449-6d56-4a62-94de-7ac89225519a","Type":"ContainerStarted","Data":"6010f6444b0b60918afb5d8f819875da89aa66189630d2c0d691d4fc52663d23"} Jun 03 21:37:12.015431 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:12.015407 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl" event={"ID":"7656c065-4b4d-4811-aed9-8833413de4f6","Type":"ContainerStarted","Data":"124b78fe448ba8ee59f3d977e4cc37db9c8564e14f0ecd5542d9e5eabc6a6c7c"} Jun 03 21:37:12.015560 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:12.015516 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl" Jun 03 21:37:12.030212 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:12.030157 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vhtc7" podStartSLOduration=2.018369499 podStartE2EDuration="5.030140673s" totalImagesPullingTime="3.011771174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:37:12.028494991 +0000 UTC m=+431.188987881" watchObservedRunningTime="2026-06-03 21:37:12.030140673 +0000 UTC m=+431.190633565" Jun 03 21:37:12.047762 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:12.047714 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl" podStartSLOduration=2.310292926 podStartE2EDuration="4.047701332s" totalImagesPullingTime="1.737408406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:37:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:37:12.046593304 +0000 UTC m=+431.207086199" watchObservedRunningTime="2026-06-03 21:37:12.047701332 +0000 UTC m=+431.208194222" Jun 03 21:37:15.813668 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:15.813627 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:17.119533 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:17.119498 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:17.215171 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:17.215143 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:18.021619 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:18.021593 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lb6dl" Jun 03 21:37:23.196872 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:23.196788 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:23.299568 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:23.299524 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:25.087596 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:25.087559 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:28.489177 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:28.489139 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:28.550915 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:28.550878 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:35.838162 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:35.838120 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:41.357854 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.357815 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:41.414938 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.414911 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k"] Jun 03 21:37:41.421822 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.421800 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:41.426569 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.426548 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 21:37:41.426681 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.426578 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 21:37:41.426681 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.426588 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 21:37:41.426681 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.426605 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:37:41.426849 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.426680 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-27ths\"" Jun 03 21:37:41.426906 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.426850 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 21:37:41.443735 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.443715 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k"] Jun 03 21:37:41.527558 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.527520 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:41.546003 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.545980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/50b48046-366d-455d-bc8a-1c29c9a6a95a-metrics-cert\") pod \"lws-controller-manager-66f8bf9848-r549k\" (UID: \"50b48046-366d-455d-bc8a-1c29c9a6a95a\") " pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:41.546144 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.546018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50b48046-366d-455d-bc8a-1c29c9a6a95a-cert\") pod \"lws-controller-manager-66f8bf9848-r549k\" (UID: \"50b48046-366d-455d-bc8a-1c29c9a6a95a\") " pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:41.546144 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.546041 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/50b48046-366d-455d-bc8a-1c29c9a6a95a-manager-config\") pod \"lws-controller-manager-66f8bf9848-r549k\" (UID: \"50b48046-366d-455d-bc8a-1c29c9a6a95a\") " pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:41.546144 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.546089 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wzkl\" (UniqueName: \"kubernetes.io/projected/50b48046-366d-455d-bc8a-1c29c9a6a95a-kube-api-access-5wzkl\") pod \"lws-controller-manager-66f8bf9848-r549k\" (UID: \"50b48046-366d-455d-bc8a-1c29c9a6a95a\") " pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:41.647319 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.647246 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/50b48046-366d-455d-bc8a-1c29c9a6a95a-metrics-cert\") pod \"lws-controller-manager-66f8bf9848-r549k\" (UID: \"50b48046-366d-455d-bc8a-1c29c9a6a95a\") " pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:41.647319 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.647284 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50b48046-366d-455d-bc8a-1c29c9a6a95a-cert\") pod \"lws-controller-manager-66f8bf9848-r549k\" (UID: \"50b48046-366d-455d-bc8a-1c29c9a6a95a\") " pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:41.647319 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.647302 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/50b48046-366d-455d-bc8a-1c29c9a6a95a-manager-config\") pod \"lws-controller-manager-66f8bf9848-r549k\" (UID: \"50b48046-366d-455d-bc8a-1c29c9a6a95a\") " pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:41.647571 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.647327 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzkl\" (UniqueName: \"kubernetes.io/projected/50b48046-366d-455d-bc8a-1c29c9a6a95a-kube-api-access-5wzkl\") pod \"lws-controller-manager-66f8bf9848-r549k\" (UID: \"50b48046-366d-455d-bc8a-1c29c9a6a95a\") " pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:41.647884 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.647863 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/50b48046-366d-455d-bc8a-1c29c9a6a95a-manager-config\") pod \"lws-controller-manager-66f8bf9848-r549k\" (UID: \"50b48046-366d-455d-bc8a-1c29c9a6a95a\") " pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:41.649732 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.649709 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/50b48046-366d-455d-bc8a-1c29c9a6a95a-metrics-cert\") pod \"lws-controller-manager-66f8bf9848-r549k\" (UID: \"50b48046-366d-455d-bc8a-1c29c9a6a95a\") " pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:41.649858 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.649840 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50b48046-366d-455d-bc8a-1c29c9a6a95a-cert\") pod \"lws-controller-manager-66f8bf9848-r549k\" (UID: \"50b48046-366d-455d-bc8a-1c29c9a6a95a\") " pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:41.657524 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.657502 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wzkl\" (UniqueName: \"kubernetes.io/projected/50b48046-366d-455d-bc8a-1c29c9a6a95a-kube-api-access-5wzkl\") pod \"lws-controller-manager-66f8bf9848-r549k\" (UID: \"50b48046-366d-455d-bc8a-1c29c9a6a95a\") " pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:41.733281 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.733250 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:41.874839 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:37:41.874697 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b48046_366d_455d_bc8a_1c29c9a6a95a.slice/crio-c59849569f7b4632d976ae4c7b6fa259038f23753e1b6065d211077461807812 WatchSource:0}: Error finding container c59849569f7b4632d976ae4c7b6fa259038f23753e1b6065d211077461807812: Status 404 returned error can't find the container with id c59849569f7b4632d976ae4c7b6fa259038f23753e1b6065d211077461807812 Jun 03 21:37:41.876993 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:41.876969 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k"] Jun 03 21:37:42.145227 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:42.145190 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" event={"ID":"50b48046-366d-455d-bc8a-1c29c9a6a95a","Type":"ContainerStarted","Data":"c59849569f7b4632d976ae4c7b6fa259038f23753e1b6065d211077461807812"} Jun 03 21:37:45.163536 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:45.163495 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" event={"ID":"50b48046-366d-455d-bc8a-1c29c9a6a95a","Type":"ContainerStarted","Data":"b19c47a296f08231bac2e7d077049e8f43100efbdbcc860a354381d9be5d967f"} Jun 03 21:37:45.163966 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:45.163601 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:45.182213 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:45.182163 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" podStartSLOduration=1.79511524 podStartE2EDuration="4.182149164s" totalImagesPullingTime="2.387033924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:37:45.180524008 +0000 UTC m=+464.341016910" watchObservedRunningTime="2026-06-03 21:37:45.182149164 +0000 UTC m=+464.342642054" Jun 03 21:37:48.905308 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:48.905277 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:49.002018 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:49.001982 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:49.467667 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:49.467624 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:49.856508 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:49.856458 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:49.958873 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:49.958842 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:50.054453 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.052072 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv"] Jun 03 21:37:50.057140 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.057118 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.059717 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.059697 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 21:37:50.059899 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.059879 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 21:37:50.059899 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.059893 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nqwwb\"" Jun 03 21:37:50.060051 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.059958 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 21:37:50.060051 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.060015 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 21:37:50.072507 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.072489 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv"] Jun 03 21:37:50.218507 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.218402 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:50.227961 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.227920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5587c2d2-1f99-48cb-a182-8afe8dfa7924-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.228056 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.228006 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5587c2d2-1f99-48cb-a182-8afe8dfa7924-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.228112 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.228092 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5587c2d2-1f99-48cb-a182-8afe8dfa7924-tmp\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.228167 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.228150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5587c2d2-1f99-48cb-a182-8afe8dfa7924-manifests\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.228206 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.228183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79gcc\" (UniqueName: \"kubernetes.io/projected/5587c2d2-1f99-48cb-a182-8afe8dfa7924-kube-api-access-79gcc\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.323365 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.323327 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:50.329383 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.329359 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5587c2d2-1f99-48cb-a182-8afe8dfa7924-manifests\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.329462 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.329390 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79gcc\" (UniqueName: \"kubernetes.io/projected/5587c2d2-1f99-48cb-a182-8afe8dfa7924-kube-api-access-79gcc\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.329462 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.329421 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5587c2d2-1f99-48cb-a182-8afe8dfa7924-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.329542 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.329474 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5587c2d2-1f99-48cb-a182-8afe8dfa7924-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.329542 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.329518 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5587c2d2-1f99-48cb-a182-8afe8dfa7924-tmp\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.329778 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.329759 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5587c2d2-1f99-48cb-a182-8afe8dfa7924-manifests\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.331868 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.331843 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5587c2d2-1f99-48cb-a182-8afe8dfa7924-tmp\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.332025 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.332004 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5587c2d2-1f99-48cb-a182-8afe8dfa7924-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.332080 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.332066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5587c2d2-1f99-48cb-a182-8afe8dfa7924-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.347214 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.347194 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79gcc\" (UniqueName: \"kubernetes.io/projected/5587c2d2-1f99-48cb-a182-8afe8dfa7924-kube-api-access-79gcc\") pod \"opendatahub-operator-controller-manager-64f56cf757-jjpnv\" (UID: \"5587c2d2-1f99-48cb-a182-8afe8dfa7924\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.368166 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.368143 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:50.419986 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.419924 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:50.491901 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.491814 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:50.509402 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.509376 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv"] Jun 03 21:37:50.511388 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:37:50.511358 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5587c2d2_1f99_48cb_a182_8afe8dfa7924.slice/crio-fcc94c7548a9541e011eb828fe6a0784f7639fb954d058b5a7303395453aba70 WatchSource:0}: Error finding container fcc94c7548a9541e011eb828fe6a0784f7639fb954d058b5a7303395453aba70: Status 404 returned error can't find the container with id fcc94c7548a9541e011eb828fe6a0784f7639fb954d058b5a7303395453aba70 Jun 03 21:37:50.559760 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.559722 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:50.667739 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.667691 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:50.778460 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:50.778364 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:37:51.197708 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:51.197655 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" event={"ID":"5587c2d2-1f99-48cb-a182-8afe8dfa7924","Type":"ContainerStarted","Data":"fcc94c7548a9541e011eb828fe6a0784f7639fb954d058b5a7303395453aba70"} Jun 03 21:37:54.220674 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:54.220642 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" event={"ID":"5587c2d2-1f99-48cb-a182-8afe8dfa7924","Type":"ContainerStarted","Data":"b0f2b18c2572872780acd73e3fa60ec3dcf866cdd85228db2ef7cd097cd762a6"} Jun 03 21:37:55.226777 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:55.226745 2574 generic.go:356] "Generic (PLEG): container finished" podID="5587c2d2-1f99-48cb-a182-8afe8dfa7924" containerID="b0f2b18c2572872780acd73e3fa60ec3dcf866cdd85228db2ef7cd097cd762a6" exitCode=0 Jun 03 21:37:55.227181 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:55.226812 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" event={"ID":"5587c2d2-1f99-48cb-a182-8afe8dfa7924","Type":"ContainerDied","Data":"b0f2b18c2572872780acd73e3fa60ec3dcf866cdd85228db2ef7cd097cd762a6"} Jun 03 21:37:56.171645 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:56.171614 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66f8bf9848-r549k" Jun 03 21:37:56.233536 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:56.233496 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" event={"ID":"5587c2d2-1f99-48cb-a182-8afe8dfa7924","Type":"ContainerStarted","Data":"618f0855ed951fa501a429e00b108e40fea78ffe27c0318c28eec1c2d12987f5"} Jun 03 21:37:56.233999 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:56.233574 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:37:56.254009 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:37:56.253930 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" podStartSLOduration=2.09888508 podStartE2EDuration="6.253907799s" totalImagesPullingTime="3.158971955s" totalInitContainerRuntime="996.050764ms" isStatefulPod=false podCreationTimestamp="2026-06-03 21:37:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:37:56.252547905 +0000 UTC m=+475.413040796" watchObservedRunningTime="2026-06-03 21:37:56.253907799 +0000 UTC m=+475.414400691" Jun 03 21:38:07.240500 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:07.240466 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-jjpnv" Jun 03 21:38:08.884710 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:08.884673 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:09.034886 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:09.034852 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:09.295425 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:09.295322 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:09.554795 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:09.554685 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:09.772783 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:09.772739 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:09.926401 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:09.926366 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:10.038025 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:10.037988 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:10.153956 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:10.153922 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:10.267744 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:10.267651 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:10.360139 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:10.360098 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:10.832367 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:10.832332 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:11.290161 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:11.290125 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:20.799651 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:20.799610 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:20.915604 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:20.915568 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:21.177520 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:21.177463 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:21.508828 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:21.508730 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:22.079712 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:22.079676 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:22.175504 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:22.175470 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:26.928691 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:26.928657 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:27.049116 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:27.049081 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:27.164974 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:27.164920 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:27.336760 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:27.336711 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:28.454773 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:28.454729 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:28.570669 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:28.570637 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:28.708436 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:28.708353 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:29.126991 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:29.126937 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:29.323376 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:29.323339 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:34.532963 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:34.532916 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:36.728898 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:36.728861 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:36.822681 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:36.822615 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:37.322792 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:37.322749 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:39.824733 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:39.824662 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:39.924490 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:39.924458 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:40.838402 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:40.838369 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:40.937649 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:40.937613 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:41.126994 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.126896 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9"] Jun 03 21:38:41.130185 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.130162 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.132567 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.132546 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kvgtw\"" Jun 03 21:38:41.132783 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.132768 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 21:38:41.148336 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.148312 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9"] Jun 03 21:38:41.156513 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.156489 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:41.290068 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.290032 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebb2ce15-b04a-4865-9fef-310303316fdd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.290266 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.290095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.290266 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.290180 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.290266 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.290216 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebb2ce15-b04a-4865-9fef-310303316fdd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.290266 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.290245 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.290266 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.290264 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebb2ce15-b04a-4865-9fef-310303316fdd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.290448 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.290339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.290448 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.290370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.290448 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.290396 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x455m\" (UniqueName: \"kubernetes.io/projected/ebb2ce15-b04a-4865-9fef-310303316fdd-kube-api-access-x455m\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.390811 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.390719 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:41.390983 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.390805 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.390983 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.390842 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.390983 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.390874 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x455m\" (UniqueName: \"kubernetes.io/projected/ebb2ce15-b04a-4865-9fef-310303316fdd-kube-api-access-x455m\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.390983 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.390913 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebb2ce15-b04a-4865-9fef-310303316fdd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.390983 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.390970 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.391322 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.391015 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.391322 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.391045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebb2ce15-b04a-4865-9fef-310303316fdd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.391322 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.391072 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.391322 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.391093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebb2ce15-b04a-4865-9fef-310303316fdd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.391322 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.391241 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.391584 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.391419 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.391584 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.391483 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.391791 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.391770 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.391859 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.391801 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebb2ce15-b04a-4865-9fef-310303316fdd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.393405 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.393379 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebb2ce15-b04a-4865-9fef-310303316fdd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.393606 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.393589 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebb2ce15-b04a-4865-9fef-310303316fdd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.403895 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.403869 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x455m\" (UniqueName: \"kubernetes.io/projected/ebb2ce15-b04a-4865-9fef-310303316fdd-kube-api-access-x455m\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.405088 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.405067 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebb2ce15-b04a-4865-9fef-310303316fdd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kt4b9\" (UID: \"ebb2ce15-b04a-4865-9fef-310303316fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.441714 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.441659 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:41.580916 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.580886 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9"] Jun 03 21:38:41.582273 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:38:41.582243 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb2ce15_b04a_4865_9fef_310303316fdd.slice/crio-5362cd5ad5e84dcb719fc0a16da4854eb370b5361c0a6d0b138c2a456fa98069 WatchSource:0}: Error finding container 5362cd5ad5e84dcb719fc0a16da4854eb370b5361c0a6d0b138c2a456fa98069: Status 404 returned error can't find the container with id 5362cd5ad5e84dcb719fc0a16da4854eb370b5361c0a6d0b138c2a456fa98069 Jun 03 21:38:41.832610 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:41.832524 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:42.448200 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:42.448160 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" event={"ID":"ebb2ce15-b04a-4865-9fef-310303316fdd","Type":"ContainerStarted","Data":"5362cd5ad5e84dcb719fc0a16da4854eb370b5361c0a6d0b138c2a456fa98069"} Jun 03 21:38:44.765220 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:44.765176 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 21:38:44.765486 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:44.765271 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 21:38:44.765486 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:44.765304 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 21:38:45.466270 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:45.466238 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" event={"ID":"ebb2ce15-b04a-4865-9fef-310303316fdd","Type":"ContainerStarted","Data":"7763b4e010e8ad29d1743071df5dc46af7b81fad8b496efa3fd41cf64194656d"} Jun 03 21:38:45.500832 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:45.500781 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" podStartSLOduration=1.320056669 podStartE2EDuration="4.500765798s" totalImagesPullingTime="3.180709129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:45.500640825 +0000 UTC m=+524.661133751" watchObservedRunningTime="2026-06-03 21:38:45.500765798 +0000 UTC m=+524.661258692" Jun 03 21:38:46.139588 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.139552 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5cc66d9bff-9tbjh"] Jun 03 21:38:46.143040 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.143023 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5cc66d9bff-9tbjh" Jun 03 21:38:46.146843 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.146821 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mtgvp\"" Jun 03 21:38:46.147195 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.147174 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 21:38:46.226929 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.226899 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx89x\" (UniqueName: \"kubernetes.io/projected/dab631d0-5bd7-423b-a486-c8c0b32553cd-kube-api-access-tx89x\") pod \"dashboard-redirect-5cc66d9bff-9tbjh\" (UID: \"dab631d0-5bd7-423b-a486-c8c0b32553cd\") " pod="opendatahub/dashboard-redirect-5cc66d9bff-9tbjh" Jun 03 21:38:46.227087 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.226970 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/dab631d0-5bd7-423b-a486-c8c0b32553cd-redirect-config\") pod \"dashboard-redirect-5cc66d9bff-9tbjh\" (UID: \"dab631d0-5bd7-423b-a486-c8c0b32553cd\") " pod="opendatahub/dashboard-redirect-5cc66d9bff-9tbjh" Jun 03 21:38:46.229434 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.229407 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5cc66d9bff-9tbjh"] Jun 03 21:38:46.249142 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.249115 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:38:46.328184 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.328150 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx89x\" (UniqueName: \"kubernetes.io/projected/dab631d0-5bd7-423b-a486-c8c0b32553cd-kube-api-access-tx89x\") pod \"dashboard-redirect-5cc66d9bff-9tbjh\" (UID: \"dab631d0-5bd7-423b-a486-c8c0b32553cd\") " pod="opendatahub/dashboard-redirect-5cc66d9bff-9tbjh" Jun 03 21:38:46.328358 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.328211 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/dab631d0-5bd7-423b-a486-c8c0b32553cd-redirect-config\") pod \"dashboard-redirect-5cc66d9bff-9tbjh\" (UID: \"dab631d0-5bd7-423b-a486-c8c0b32553cd\") " pod="opendatahub/dashboard-redirect-5cc66d9bff-9tbjh" Jun 03 21:38:46.328983 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.328942 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/dab631d0-5bd7-423b-a486-c8c0b32553cd-redirect-config\") pod \"dashboard-redirect-5cc66d9bff-9tbjh\" (UID: \"dab631d0-5bd7-423b-a486-c8c0b32553cd\") " pod="opendatahub/dashboard-redirect-5cc66d9bff-9tbjh" Jun 03 21:38:46.347167 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.347140 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx89x\" (UniqueName: \"kubernetes.io/projected/dab631d0-5bd7-423b-a486-c8c0b32553cd-kube-api-access-tx89x\") pod \"dashboard-redirect-5cc66d9bff-9tbjh\" (UID: \"dab631d0-5bd7-423b-a486-c8c0b32553cd\") " pod="opendatahub/dashboard-redirect-5cc66d9bff-9tbjh" Jun 03 21:38:46.445912 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.445841 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:46.451055 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.451030 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:46.453109 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.453092 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5cc66d9bff-9tbjh" Jun 03 21:38:46.471092 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.471067 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:46.471938 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.471912 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kt4b9" Jun 03 21:38:46.609196 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:46.609157 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5cc66d9bff-9tbjh"] Jun 03 21:38:46.613287 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:38:46.613256 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab631d0_5bd7_423b_a486_c8c0b32553cd.slice/crio-c9498a0e528b2d507309cb0f46cf62403d1a01c89a6020df43906b0961d355e7 WatchSource:0}: Error finding container c9498a0e528b2d507309cb0f46cf62403d1a01c89a6020df43906b0961d355e7: Status 404 returned error can't find the container with id c9498a0e528b2d507309cb0f46cf62403d1a01c89a6020df43906b0961d355e7 Jun 03 21:38:47.480994 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:47.480932 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5cc66d9bff-9tbjh" event={"ID":"dab631d0-5bd7-423b-a486-c8c0b32553cd","Type":"ContainerStarted","Data":"c9498a0e528b2d507309cb0f46cf62403d1a01c89a6020df43906b0961d355e7"} Jun 03 21:38:51.503624 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:51.503589 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5cc66d9bff-9tbjh" event={"ID":"dab631d0-5bd7-423b-a486-c8c0b32553cd","Type":"ContainerStarted","Data":"331acbd6ed5665a08c26d178042e444ce52f19facbba689e202de4f2cb08ab71"} Jun 03 21:38:51.520719 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:38:51.520678 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5cc66d9bff-9tbjh" podStartSLOduration=1.224447794 podStartE2EDuration="5.52066319s" totalImagesPullingTime="4.296215396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:51.518810475 +0000 UTC m=+530.679303369" watchObservedRunningTime="2026-06-03 21:38:51.52066319 +0000 UTC m=+530.681156081" Jun 03 21:39:10.499788 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:10.499747 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:10.605914 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:10.605882 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:10.660210 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:10.660179 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bt5tc"] Jun 03 21:39:10.663843 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:10.663816 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bt5tc" Jun 03 21:39:10.666142 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:10.666124 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 21:39:10.666807 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:10.666782 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-j56dp\"" Jun 03 21:39:10.666807 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:10.666802 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 21:39:10.674537 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:10.674513 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bt5tc"] Jun 03 21:39:10.720109 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:10.720075 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:10.729770 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:10.729746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xbxk\" (UniqueName: \"kubernetes.io/projected/37f988a5-85f4-4501-8180-6bad5bb215ca-kube-api-access-4xbxk\") pod \"kuadrant-operator-catalog-bt5tc\" (UID: \"37f988a5-85f4-4501-8180-6bad5bb215ca\") " pod="kuadrant-system/kuadrant-operator-catalog-bt5tc" Jun 03 21:39:10.830868 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:10.830786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xbxk\" (UniqueName: \"kubernetes.io/projected/37f988a5-85f4-4501-8180-6bad5bb215ca-kube-api-access-4xbxk\") pod \"kuadrant-operator-catalog-bt5tc\" (UID: \"37f988a5-85f4-4501-8180-6bad5bb215ca\") " pod="kuadrant-system/kuadrant-operator-catalog-bt5tc" Jun 03 21:39:10.844269 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:10.844250 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xbxk\" (UniqueName: \"kubernetes.io/projected/37f988a5-85f4-4501-8180-6bad5bb215ca-kube-api-access-4xbxk\") pod \"kuadrant-operator-catalog-bt5tc\" (UID: \"37f988a5-85f4-4501-8180-6bad5bb215ca\") " pod="kuadrant-system/kuadrant-operator-catalog-bt5tc" Jun 03 21:39:10.976020 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:10.975975 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bt5tc" Jun 03 21:39:11.102754 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:11.102726 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bt5tc"] Jun 03 21:39:11.105228 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:39:11.105200 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f988a5_85f4_4501_8180_6bad5bb215ca.slice/crio-4da9634a4fc11509e6e206a0f41fcd4e7b7399df3e9ae77e5eff5f9d9c786f99 WatchSource:0}: Error finding container 4da9634a4fc11509e6e206a0f41fcd4e7b7399df3e9ae77e5eff5f9d9c786f99: Status 404 returned error can't find the container with id 4da9634a4fc11509e6e206a0f41fcd4e7b7399df3e9ae77e5eff5f9d9c786f99 Jun 03 21:39:11.596214 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:11.596180 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bt5tc" event={"ID":"37f988a5-85f4-4501-8180-6bad5bb215ca","Type":"ContainerStarted","Data":"4da9634a4fc11509e6e206a0f41fcd4e7b7399df3e9ae77e5eff5f9d9c786f99"} Jun 03 21:39:13.607217 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:13.607181 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bt5tc" event={"ID":"37f988a5-85f4-4501-8180-6bad5bb215ca","Type":"ContainerStarted","Data":"5846d8028f67a28cb5a70805400779c4f64e603b6593f4075eef2967fae3628d"} Jun 03 21:39:13.625193 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:13.625150 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bt5tc" podStartSLOduration=1.532779393 podStartE2EDuration="3.625136916s" totalImagesPullingTime="2.092357523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:39:13.624573938 +0000 UTC m=+552.785066830" watchObservedRunningTime="2026-06-03 21:39:13.625136916 +0000 UTC m=+552.785629806" Jun 03 21:39:15.550045 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:15.550010 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:15.650409 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:15.650377 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:20.977107 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:20.977073 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-bt5tc" Jun 03 21:39:20.977501 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:20.977148 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-bt5tc" Jun 03 21:39:20.999465 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:20.999436 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-bt5tc" Jun 03 21:39:21.666299 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:21.666273 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-bt5tc" Jun 03 21:39:33.170738 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:33.170698 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:34.072757 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.072718 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86b6cc475d-h22pl"] Jun 03 21:39:34.096424 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.096398 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.097317 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.097291 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b6cc475d-h22pl"] Jun 03 21:39:34.098628 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.098606 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 21:39:34.098749 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.098729 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mww5z\"" Jun 03 21:39:34.099156 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.099137 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 21:39:34.099253 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.099187 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 21:39:34.099253 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.099236 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 21:39:34.100834 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.100811 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 21:39:34.105307 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.105288 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 21:39:34.156694 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.156660 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:34.224338 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.224294 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3550094b-2fbb-4c38-8aa4-8b766fdcab92-oauth-serving-cert\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.224338 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.224340 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3550094b-2fbb-4c38-8aa4-8b766fdcab92-console-config\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.224785 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.224362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3550094b-2fbb-4c38-8aa4-8b766fdcab92-trusted-ca-bundle\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.224785 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.224446 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3550094b-2fbb-4c38-8aa4-8b766fdcab92-console-serving-cert\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.224785 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.224489 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3550094b-2fbb-4c38-8aa4-8b766fdcab92-console-oauth-config\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.224785 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.224601 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r48g\" (UniqueName: \"kubernetes.io/projected/3550094b-2fbb-4c38-8aa4-8b766fdcab92-kube-api-access-8r48g\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.224785 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.224633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3550094b-2fbb-4c38-8aa4-8b766fdcab92-service-ca\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.256965 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.256884 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:34.326091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.326026 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r48g\" (UniqueName: \"kubernetes.io/projected/3550094b-2fbb-4c38-8aa4-8b766fdcab92-kube-api-access-8r48g\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.326091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.326062 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3550094b-2fbb-4c38-8aa4-8b766fdcab92-service-ca\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.326246 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.326092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3550094b-2fbb-4c38-8aa4-8b766fdcab92-oauth-serving-cert\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.326246 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.326111 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3550094b-2fbb-4c38-8aa4-8b766fdcab92-console-config\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.326246 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.326130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3550094b-2fbb-4c38-8aa4-8b766fdcab92-trusted-ca-bundle\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.326391 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.326254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3550094b-2fbb-4c38-8aa4-8b766fdcab92-console-serving-cert\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.326391 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.326293 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3550094b-2fbb-4c38-8aa4-8b766fdcab92-console-oauth-config\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.326839 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.326807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3550094b-2fbb-4c38-8aa4-8b766fdcab92-service-ca\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.326942 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.326841 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3550094b-2fbb-4c38-8aa4-8b766fdcab92-console-config\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.327059 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.327040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3550094b-2fbb-4c38-8aa4-8b766fdcab92-oauth-serving-cert\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.327059 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.327050 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3550094b-2fbb-4c38-8aa4-8b766fdcab92-trusted-ca-bundle\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.328899 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.328877 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3550094b-2fbb-4c38-8aa4-8b766fdcab92-console-oauth-config\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.328995 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.328981 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3550094b-2fbb-4c38-8aa4-8b766fdcab92-console-serving-cert\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.336674 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.336654 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r48g\" (UniqueName: \"kubernetes.io/projected/3550094b-2fbb-4c38-8aa4-8b766fdcab92-kube-api-access-8r48g\") pod \"console-86b6cc475d-h22pl\" (UID: \"3550094b-2fbb-4c38-8aa4-8b766fdcab92\") " pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.406685 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.406648 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:34.540342 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.540271 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b6cc475d-h22pl"] Jun 03 21:39:34.542726 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:39:34.542703 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3550094b_2fbb_4c38_8aa4_8b766fdcab92.slice/crio-2f2a121d68b3632612f7e91857eda70c0114a822d94117b44ca81f4b73aea541 WatchSource:0}: Error finding container 2f2a121d68b3632612f7e91857eda70c0114a822d94117b44ca81f4b73aea541: Status 404 returned error can't find the container with id 2f2a121d68b3632612f7e91857eda70c0114a822d94117b44ca81f4b73aea541 Jun 03 21:39:34.707458 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.707425 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b6cc475d-h22pl" event={"ID":"3550094b-2fbb-4c38-8aa4-8b766fdcab92","Type":"ContainerStarted","Data":"fe1dcb1ed632b41237a499f732d3166aec66d5b08520ecace3f9a82a81083c6c"} Jun 03 21:39:34.707608 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.707478 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b6cc475d-h22pl" event={"ID":"3550094b-2fbb-4c38-8aa4-8b766fdcab92","Type":"ContainerStarted","Data":"2f2a121d68b3632612f7e91857eda70c0114a822d94117b44ca81f4b73aea541"} Jun 03 21:39:34.734860 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:34.734813 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86b6cc475d-h22pl" podStartSLOduration=0.734796682 podStartE2EDuration="734.796682ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:39:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:39:34.733238773 +0000 UTC m=+573.893731664" watchObservedRunningTime="2026-06-03 21:39:34.734796682 +0000 UTC m=+573.895289572" Jun 03 21:39:35.788666 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:35.788633 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cbd28"] Jun 03 21:39:35.792258 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:35.792242 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cbd28" Jun 03 21:39:35.798375 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:35.798355 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lrmss\"" Jun 03 21:39:35.798502 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:35.798479 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 21:39:35.809424 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:35.809401 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cbd28"] Jun 03 21:39:35.940080 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:35.940043 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twts6\" (UniqueName: \"kubernetes.io/projected/8be278f6-1e84-4f1c-82ae-e8ecd070b98f-kube-api-access-twts6\") pod \"dns-operator-controller-manager-864dd78c4c-cbd28\" (UID: \"8be278f6-1e84-4f1c-82ae-e8ecd070b98f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cbd28" Jun 03 21:39:36.041186 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:36.041107 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twts6\" (UniqueName: \"kubernetes.io/projected/8be278f6-1e84-4f1c-82ae-e8ecd070b98f-kube-api-access-twts6\") pod \"dns-operator-controller-manager-864dd78c4c-cbd28\" (UID: \"8be278f6-1e84-4f1c-82ae-e8ecd070b98f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cbd28" Jun 03 21:39:36.053167 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:36.053143 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twts6\" (UniqueName: \"kubernetes.io/projected/8be278f6-1e84-4f1c-82ae-e8ecd070b98f-kube-api-access-twts6\") pod \"dns-operator-controller-manager-864dd78c4c-cbd28\" (UID: \"8be278f6-1e84-4f1c-82ae-e8ecd070b98f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cbd28" Jun 03 21:39:36.103091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:36.103064 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cbd28" Jun 03 21:39:36.234935 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:36.234906 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cbd28"] Jun 03 21:39:36.236254 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:39:36.236223 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be278f6_1e84_4f1c_82ae_e8ecd070b98f.slice/crio-1e916611fe55ddd159b9372e8734ee4be30302ebec0c91d9d5e1f58d3aa635ea WatchSource:0}: Error finding container 1e916611fe55ddd159b9372e8734ee4be30302ebec0c91d9d5e1f58d3aa635ea: Status 404 returned error can't find the container with id 1e916611fe55ddd159b9372e8734ee4be30302ebec0c91d9d5e1f58d3aa635ea Jun 03 21:39:36.718474 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:36.718442 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cbd28" event={"ID":"8be278f6-1e84-4f1c-82ae-e8ecd070b98f","Type":"ContainerStarted","Data":"1e916611fe55ddd159b9372e8734ee4be30302ebec0c91d9d5e1f58d3aa635ea"} Jun 03 21:39:37.356996 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:37.356962 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:38.729428 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:38.729346 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cbd28" event={"ID":"8be278f6-1e84-4f1c-82ae-e8ecd070b98f","Type":"ContainerStarted","Data":"28cb96e15c4a7df05aef90604ffa8708e7fb3f6e188092a5a3db40198462345d"} Jun 03 21:39:38.729757 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:38.729482 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cbd28" Jun 03 21:39:38.748827 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:38.748783 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cbd28" podStartSLOduration=1.645221615 podStartE2EDuration="3.748768104s" totalImagesPullingTime="2.103546489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:39:38.748072689 +0000 UTC m=+577.908565581" watchObservedRunningTime="2026-06-03 21:39:38.748768104 +0000 UTC m=+577.909260992" Jun 03 21:39:39.181307 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:39.181273 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j"] Jun 03 21:39:39.184775 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:39.184756 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" Jun 03 21:39:39.188248 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:39.188229 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fpr86\"" Jun 03 21:39:39.207662 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:39.207634 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j"] Jun 03 21:39:39.375787 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:39.375754 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjmw8\" (UniqueName: \"kubernetes.io/projected/d0b7e270-bb3a-446b-8f53-f6a182eecda7-kube-api-access-hjmw8\") pod \"limitador-operator-controller-manager-859d7b78bd-rxn9j\" (UID: \"d0b7e270-bb3a-446b-8f53-f6a182eecda7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" Jun 03 21:39:39.476539 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:39.476507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjmw8\" (UniqueName: \"kubernetes.io/projected/d0b7e270-bb3a-446b-8f53-f6a182eecda7-kube-api-access-hjmw8\") pod \"limitador-operator-controller-manager-859d7b78bd-rxn9j\" (UID: \"d0b7e270-bb3a-446b-8f53-f6a182eecda7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" Jun 03 21:39:39.504445 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:39.504414 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjmw8\" (UniqueName: \"kubernetes.io/projected/d0b7e270-bb3a-446b-8f53-f6a182eecda7-kube-api-access-hjmw8\") pod \"limitador-operator-controller-manager-859d7b78bd-rxn9j\" (UID: \"d0b7e270-bb3a-446b-8f53-f6a182eecda7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" Jun 03 21:39:39.736785 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:39.736701 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:39.794579 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:39.794548 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" Jun 03 21:39:39.959734 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:39.959610 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j"] Jun 03 21:39:39.962533 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:39:39.962508 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b7e270_bb3a_446b_8f53_f6a182eecda7.slice/crio-022bb7ee6ffebeb48a6c3a9f2a10ce08be3b1a82cac7f0e014ae3a19b2665988 WatchSource:0}: Error finding container 022bb7ee6ffebeb48a6c3a9f2a10ce08be3b1a82cac7f0e014ae3a19b2665988: Status 404 returned error can't find the container with id 022bb7ee6ffebeb48a6c3a9f2a10ce08be3b1a82cac7f0e014ae3a19b2665988 Jun 03 21:39:39.992277 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:39.992221 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:40.364167 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:40.364134 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:40.741312 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:40.741229 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" event={"ID":"d0b7e270-bb3a-446b-8f53-f6a182eecda7","Type":"ContainerStarted","Data":"022bb7ee6ffebeb48a6c3a9f2a10ce08be3b1a82cac7f0e014ae3a19b2665988"} Jun 03 21:39:41.747611 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:41.747575 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" event={"ID":"d0b7e270-bb3a-446b-8f53-f6a182eecda7","Type":"ContainerStarted","Data":"b4b9b3b9a1e8e19227db03753af37d09b5ef380a68144007c211fe04de9b9584"} Jun 03 21:39:41.747991 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:41.747721 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" Jun 03 21:39:41.772528 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:41.772480 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" podStartSLOduration=1.150698623 podStartE2EDuration="2.772466047s" totalImagesPullingTime="1.621767424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:39:41.772073489 +0000 UTC m=+580.932566392" watchObservedRunningTime="2026-06-03 21:39:41.772466047 +0000 UTC m=+580.932958937" Jun 03 21:39:43.762430 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:43.762394 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:44.407064 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:44.407024 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:44.407234 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:44.407089 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:44.411702 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:44.411684 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:44.765522 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:44.765439 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86b6cc475d-h22pl" Jun 03 21:39:44.905391 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:44.905358 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:45.036366 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:45.036270 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:45.238113 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:45.238048 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:45.350936 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:45.350912 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:45.456995 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:45.456935 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:46.943323 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:46.943286 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:48.326238 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:48.326207 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2"] Jun 03 21:39:48.334732 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:48.334711 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:39:48.338131 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:48.338111 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qfwh4\"" Jun 03 21:39:48.346942 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:48.346921 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2"] Jun 03 21:39:48.352630 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:48.352609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf216088-07d6-4aa7-85e7-4402813f94b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hdsx2\" (UID: \"cf216088-07d6-4aa7-85e7-4402813f94b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:39:48.352751 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:48.352713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlb8l\" (UniqueName: \"kubernetes.io/projected/cf216088-07d6-4aa7-85e7-4402813f94b2-kube-api-access-jlb8l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hdsx2\" (UID: \"cf216088-07d6-4aa7-85e7-4402813f94b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:39:48.454088 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:48.454064 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf216088-07d6-4aa7-85e7-4402813f94b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hdsx2\" (UID: \"cf216088-07d6-4aa7-85e7-4402813f94b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:39:48.454204 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:48.454127 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlb8l\" (UniqueName: \"kubernetes.io/projected/cf216088-07d6-4aa7-85e7-4402813f94b2-kube-api-access-jlb8l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hdsx2\" (UID: \"cf216088-07d6-4aa7-85e7-4402813f94b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:39:48.454425 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:48.454408 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf216088-07d6-4aa7-85e7-4402813f94b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hdsx2\" (UID: \"cf216088-07d6-4aa7-85e7-4402813f94b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:39:48.468168 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:48.468146 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlb8l\" (UniqueName: \"kubernetes.io/projected/cf216088-07d6-4aa7-85e7-4402813f94b2-kube-api-access-jlb8l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hdsx2\" (UID: \"cf216088-07d6-4aa7-85e7-4402813f94b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:39:48.619230 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:48.619191 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:48.645168 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:48.645143 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:39:48.804784 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:48.804761 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2"] Jun 03 21:39:48.807301 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:39:48.807274 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf216088_07d6_4aa7_85e7_4402813f94b2.slice/crio-ce63a1848514b25b3b54eabb1760e3d27125a646ba23dff0f4584632203db3d4 WatchSource:0}: Error finding container ce63a1848514b25b3b54eabb1760e3d27125a646ba23dff0f4584632203db3d4: Status 404 returned error can't find the container with id ce63a1848514b25b3b54eabb1760e3d27125a646ba23dff0f4584632203db3d4 Jun 03 21:39:49.737643 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:49.737612 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cbd28" Jun 03 21:39:49.787965 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:49.787909 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" event={"ID":"cf216088-07d6-4aa7-85e7-4402813f94b2","Type":"ContainerStarted","Data":"ce63a1848514b25b3b54eabb1760e3d27125a646ba23dff0f4584632203db3d4"} Jun 03 21:39:50.014384 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:50.014293 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:50.109357 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:50.109319 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:52.755038 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:52.755004 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" Jun 03 21:39:53.794758 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:53.794727 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:53.816526 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:53.816452 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" event={"ID":"cf216088-07d6-4aa7-85e7-4402813f94b2","Type":"ContainerStarted","Data":"6dccbafc45e29335e04dc041d55b7b7ef3215ad36c737452bb9074edd2bab26e"} Jun 03 21:39:53.816654 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:53.816639 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:39:53.873170 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:53.873124 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" podStartSLOduration=1.117589894 podStartE2EDuration="5.873110251s" totalImagesPullingTime="4.755520357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:39:53.871670496 +0000 UTC m=+593.032163387" watchObservedRunningTime="2026-06-03 21:39:53.873110251 +0000 UTC m=+593.033603207" Jun 03 21:39:53.972548 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:53.972518 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:56.227387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:56.227351 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:56.296342 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:56.296307 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:58.008329 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:58.008289 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:58.123412 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:58.123381 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:58.352354 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:58.352321 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:39:58.451326 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:39:58.451297 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:02.190476 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:02.190441 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:02.318191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:02.318163 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:04.823507 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:04.823480 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:40:06.397822 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.397794 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m"] Jun 03 21:40:06.401283 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.401265 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m" Jun 03 21:40:06.413254 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.413231 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m"] Jun 03 21:40:06.518967 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.518920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sfc4\" (UniqueName: \"kubernetes.io/projected/1be5d703-8a37-468b-bb55-9b79d87016cf-kube-api-access-4sfc4\") pod \"kuadrant-operator-controller-manager-55467d9f7-4gt6m\" (UID: \"1be5d703-8a37-468b-bb55-9b79d87016cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m" Jun 03 21:40:06.519091 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.518991 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1be5d703-8a37-468b-bb55-9b79d87016cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4gt6m\" (UID: \"1be5d703-8a37-468b-bb55-9b79d87016cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m" Jun 03 21:40:06.526645 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.526621 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m"] Jun 03 21:40:06.526857 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.526838 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-4sfc4], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m" podUID="1be5d703-8a37-468b-bb55-9b79d87016cf" Jun 03 21:40:06.569161 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.569133 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb"] Jun 03 21:40:06.572586 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.572567 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" Jun 03 21:40:06.577728 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.577705 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m"] Jun 03 21:40:06.584858 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.584838 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m"] Jun 03 21:40:06.592907 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.592882 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb"] Jun 03 21:40:06.610025 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.610006 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2"] Jun 03 21:40:06.610158 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.610140 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" podUID="cf216088-07d6-4aa7-85e7-4402813f94b2" containerName="manager" containerID="cri-o://6dccbafc45e29335e04dc041d55b7b7ef3215ad36c737452bb9074edd2bab26e" gracePeriod=2 Jun 03 21:40:06.619624 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.619601 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2"] Jun 03 21:40:06.620034 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.620007 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1be5d703-8a37-468b-bb55-9b79d87016cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4gt6m\" (UID: \"1be5d703-8a37-468b-bb55-9b79d87016cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m" Jun 03 21:40:06.620161 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.620146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sfc4\" (UniqueName: \"kubernetes.io/projected/1be5d703-8a37-468b-bb55-9b79d87016cf-kube-api-access-4sfc4\") pod \"kuadrant-operator-controller-manager-55467d9f7-4gt6m\" (UID: \"1be5d703-8a37-468b-bb55-9b79d87016cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m" Jun 03 21:40:06.620377 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.620359 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1be5d703-8a37-468b-bb55-9b79d87016cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4gt6m\" (UID: \"1be5d703-8a37-468b-bb55-9b79d87016cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m" Jun 03 21:40:06.624545 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.624513 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hdsx2\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="cf216088-07d6-4aa7-85e7-4402813f94b2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:40:06.624646 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.624630 2574 projected.go:196] Error preparing data for projected volume kube-api-access-4sfc4 for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-4gt6m" not found Jun 03 21:40:06.624715 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.624684 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1be5d703-8a37-468b-bb55-9b79d87016cf-kube-api-access-4sfc4 podName:1be5d703-8a37-468b-bb55-9b79d87016cf nodeName:}" failed. No retries permitted until 2026-06-03 21:40:07.12466878 +0000 UTC m=+606.285161652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4sfc4" (UniqueName: "kubernetes.io/projected/1be5d703-8a37-468b-bb55-9b79d87016cf-kube-api-access-4sfc4") pod "kuadrant-operator-controller-manager-55467d9f7-4gt6m" (UID: "1be5d703-8a37-468b-bb55-9b79d87016cf") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-4gt6m" not found Jun 03 21:40:06.636073 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.636051 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j"] Jun 03 21:40:06.636293 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.636267 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" podUID="d0b7e270-bb3a-446b-8f53-f6a182eecda7" containerName="manager" containerID="cri-o://b4b9b3b9a1e8e19227db03753af37d09b5ef380a68144007c211fe04de9b9584" gracePeriod=2 Jun 03 21:40:06.638176 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.638150 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hdsx2\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="cf216088-07d6-4aa7-85e7-4402813f94b2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:40:06.646897 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.646871 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j"] Jun 03 21:40:06.648751 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.648692 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg"] Jun 03 21:40:06.649085 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.649072 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b7e270-bb3a-446b-8f53-f6a182eecda7" containerName="manager" Jun 03 21:40:06.649085 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.649086 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b7e270-bb3a-446b-8f53-f6a182eecda7" containerName="manager" Jun 03 21:40:06.649281 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.649106 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf216088-07d6-4aa7-85e7-4402813f94b2" containerName="manager" Jun 03 21:40:06.649281 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.649113 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf216088-07d6-4aa7-85e7-4402813f94b2" containerName="manager" Jun 03 21:40:06.649281 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.649168 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b7e270-bb3a-446b-8f53-f6a182eecda7" containerName="manager" Jun 03 21:40:06.649281 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.649179 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf216088-07d6-4aa7-85e7-4402813f94b2" containerName="manager" Jun 03 21:40:06.652007 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.651988 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" Jun 03 21:40:06.654353 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.654330 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hdsx2\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="cf216088-07d6-4aa7-85e7-4402813f94b2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:40:06.656122 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.656096 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rxn9j\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="d0b7e270-bb3a-446b-8f53-f6a182eecda7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" Jun 03 21:40:06.664469 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.664446 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg"] Jun 03 21:40:06.721419 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.721394 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7qqx\" (UniqueName: \"kubernetes.io/projected/7632d92f-a212-4e31-b1be-e0112158472b-kube-api-access-v7qqx\") pod \"kuadrant-operator-controller-manager-86878c769f-x2lpb\" (UID: \"7632d92f-a212-4e31-b1be-e0112158472b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" Jun 03 21:40:06.721536 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.721428 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cf5a1a5-d802-4c84-82e3-5011dc217ed3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mlxdg\" (UID: \"6cf5a1a5-d802-4c84-82e3-5011dc217ed3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" Jun 03 21:40:06.721536 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.721450 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2nx2\" (UniqueName: \"kubernetes.io/projected/6cf5a1a5-d802-4c84-82e3-5011dc217ed3-kube-api-access-q2nx2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mlxdg\" (UID: \"6cf5a1a5-d802-4c84-82e3-5011dc217ed3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" Jun 03 21:40:06.721536 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.721508 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7632d92f-a212-4e31-b1be-e0112158472b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x2lpb\" (UID: \"7632d92f-a212-4e31-b1be-e0112158472b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" Jun 03 21:40:06.822207 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.822175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7qqx\" (UniqueName: \"kubernetes.io/projected/7632d92f-a212-4e31-b1be-e0112158472b-kube-api-access-v7qqx\") pod \"kuadrant-operator-controller-manager-86878c769f-x2lpb\" (UID: \"7632d92f-a212-4e31-b1be-e0112158472b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" Jun 03 21:40:06.822332 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.822316 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cf5a1a5-d802-4c84-82e3-5011dc217ed3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mlxdg\" (UID: \"6cf5a1a5-d802-4c84-82e3-5011dc217ed3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" Jun 03 21:40:06.822393 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.822355 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2nx2\" (UniqueName: \"kubernetes.io/projected/6cf5a1a5-d802-4c84-82e3-5011dc217ed3-kube-api-access-q2nx2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mlxdg\" (UID: \"6cf5a1a5-d802-4c84-82e3-5011dc217ed3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" Jun 03 21:40:06.822446 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.822415 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7632d92f-a212-4e31-b1be-e0112158472b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x2lpb\" (UID: \"7632d92f-a212-4e31-b1be-e0112158472b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" Jun 03 21:40:06.822744 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.822718 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cf5a1a5-d802-4c84-82e3-5011dc217ed3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mlxdg\" (UID: \"6cf5a1a5-d802-4c84-82e3-5011dc217ed3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" Jun 03 21:40:06.822850 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.822808 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7632d92f-a212-4e31-b1be-e0112158472b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x2lpb\" (UID: \"7632d92f-a212-4e31-b1be-e0112158472b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" Jun 03 21:40:06.832501 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.832479 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2nx2\" (UniqueName: \"kubernetes.io/projected/6cf5a1a5-d802-4c84-82e3-5011dc217ed3-kube-api-access-q2nx2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mlxdg\" (UID: \"6cf5a1a5-d802-4c84-82e3-5011dc217ed3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" Jun 03 21:40:06.832725 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.832704 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7qqx\" (UniqueName: \"kubernetes.io/projected/7632d92f-a212-4e31-b1be-e0112158472b-kube-api-access-v7qqx\") pod \"kuadrant-operator-controller-manager-86878c769f-x2lpb\" (UID: \"7632d92f-a212-4e31-b1be-e0112158472b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" Jun 03 21:40:06.878247 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.878226 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:40:06.880409 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.880380 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hdsx2\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="cf216088-07d6-4aa7-85e7-4402813f94b2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:40:06.880515 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.880456 2574 generic.go:356] "Generic (PLEG): container finished" podID="d0b7e270-bb3a-446b-8f53-f6a182eecda7" containerID="b4b9b3b9a1e8e19227db03753af37d09b5ef380a68144007c211fe04de9b9584" exitCode=0 Jun 03 21:40:06.880564 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.880529 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="022bb7ee6ffebeb48a6c3a9f2a10ce08be3b1a82cac7f0e014ae3a19b2665988" Jun 03 21:40:06.881874 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.881854 2574 generic.go:356] "Generic (PLEG): container finished" podID="cf216088-07d6-4aa7-85e7-4402813f94b2" containerID="6dccbafc45e29335e04dc041d55b7b7ef3215ad36c737452bb9074edd2bab26e" exitCode=0 Jun 03 21:40:06.881979 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.881884 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:40:06.881979 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.881890 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" Jun 03 21:40:06.881979 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.881932 2574 scope.go:117] "RemoveContainer" containerID="6dccbafc45e29335e04dc041d55b7b7ef3215ad36c737452bb9074edd2bab26e" Jun 03 21:40:06.882095 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.882039 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m" Jun 03 21:40:06.882464 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.882447 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" Jun 03 21:40:06.883014 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.882992 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rxn9j\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="d0b7e270-bb3a-446b-8f53-f6a182eecda7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" Jun 03 21:40:06.884964 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.884922 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4gt6m\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="1be5d703-8a37-468b-bb55-9b79d87016cf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m" Jun 03 21:40:06.886712 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.886689 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hdsx2\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="cf216088-07d6-4aa7-85e7-4402813f94b2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:40:06.888306 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.888289 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m" Jun 03 21:40:06.888473 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.888453 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rxn9j\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="d0b7e270-bb3a-446b-8f53-f6a182eecda7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" Jun 03 21:40:06.890873 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.890853 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rxn9j\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="d0b7e270-bb3a-446b-8f53-f6a182eecda7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" Jun 03 21:40:06.892528 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.892510 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4gt6m\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="1be5d703-8a37-468b-bb55-9b79d87016cf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m" Jun 03 21:40:06.894099 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.894078 2574 scope.go:117] "RemoveContainer" containerID="6dccbafc45e29335e04dc041d55b7b7ef3215ad36c737452bb9074edd2bab26e" Jun 03 21:40:06.894403 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.894386 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dccbafc45e29335e04dc041d55b7b7ef3215ad36c737452bb9074edd2bab26e\": container with ID starting with 6dccbafc45e29335e04dc041d55b7b7ef3215ad36c737452bb9074edd2bab26e not found: ID does not exist" containerID="6dccbafc45e29335e04dc041d55b7b7ef3215ad36c737452bb9074edd2bab26e" Jun 03 21:40:06.894458 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:06.894412 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dccbafc45e29335e04dc041d55b7b7ef3215ad36c737452bb9074edd2bab26e"} err="failed to get container status \"6dccbafc45e29335e04dc041d55b7b7ef3215ad36c737452bb9074edd2bab26e\": rpc error: code = NotFound desc = could not find container \"6dccbafc45e29335e04dc041d55b7b7ef3215ad36c737452bb9074edd2bab26e\": container with ID starting with 6dccbafc45e29335e04dc041d55b7b7ef3215ad36c737452bb9074edd2bab26e not found: ID does not exist" Jun 03 21:40:06.895172 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:06.895151 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hdsx2\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="cf216088-07d6-4aa7-85e7-4402813f94b2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:40:07.024055 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.024027 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjmw8\" (UniqueName: \"kubernetes.io/projected/d0b7e270-bb3a-446b-8f53-f6a182eecda7-kube-api-access-hjmw8\") pod \"d0b7e270-bb3a-446b-8f53-f6a182eecda7\" (UID: \"d0b7e270-bb3a-446b-8f53-f6a182eecda7\") " Jun 03 21:40:07.024728 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.024138 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1be5d703-8a37-468b-bb55-9b79d87016cf-extensions-socket-volume\") pod \"1be5d703-8a37-468b-bb55-9b79d87016cf\" (UID: \"1be5d703-8a37-468b-bb55-9b79d87016cf\") " Jun 03 21:40:07.024728 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.024194 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf216088-07d6-4aa7-85e7-4402813f94b2-extensions-socket-volume\") pod \"cf216088-07d6-4aa7-85e7-4402813f94b2\" (UID: \"cf216088-07d6-4aa7-85e7-4402813f94b2\") " Jun 03 21:40:07.024728 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.024222 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlb8l\" (UniqueName: \"kubernetes.io/projected/cf216088-07d6-4aa7-85e7-4402813f94b2-kube-api-access-jlb8l\") pod \"cf216088-07d6-4aa7-85e7-4402813f94b2\" (UID: \"cf216088-07d6-4aa7-85e7-4402813f94b2\") " Jun 03 21:40:07.024728 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.024390 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1be5d703-8a37-468b-bb55-9b79d87016cf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1be5d703-8a37-468b-bb55-9b79d87016cf" (UID: "1be5d703-8a37-468b-bb55-9b79d87016cf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:40:07.024728 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.024551 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sfc4\" (UniqueName: \"kubernetes.io/projected/1be5d703-8a37-468b-bb55-9b79d87016cf-kube-api-access-4sfc4\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:40:07.024728 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.024570 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1be5d703-8a37-468b-bb55-9b79d87016cf-extensions-socket-volume\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:40:07.025126 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.025077 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf216088-07d6-4aa7-85e7-4402813f94b2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cf216088-07d6-4aa7-85e7-4402813f94b2" (UID: "cf216088-07d6-4aa7-85e7-4402813f94b2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:40:07.026724 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.026704 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b7e270-bb3a-446b-8f53-f6a182eecda7-kube-api-access-hjmw8" (OuterVolumeSpecName: "kube-api-access-hjmw8") pod "d0b7e270-bb3a-446b-8f53-f6a182eecda7" (UID: "d0b7e270-bb3a-446b-8f53-f6a182eecda7"). InnerVolumeSpecName "kube-api-access-hjmw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:40:07.027006 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.026976 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf216088-07d6-4aa7-85e7-4402813f94b2-kube-api-access-jlb8l" (OuterVolumeSpecName: "kube-api-access-jlb8l") pod "cf216088-07d6-4aa7-85e7-4402813f94b2" (UID: "cf216088-07d6-4aa7-85e7-4402813f94b2"). InnerVolumeSpecName "kube-api-access-jlb8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:40:07.027617 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.027597 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb"] Jun 03 21:40:07.030030 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:40:07.030000 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7632d92f_a212_4e31_b1be_e0112158472b.slice/crio-51ba2a2291536ca7e8d4d5f5eb18bfafa352f2cf0d6e518170b181aad971da8d WatchSource:0}: Error finding container 51ba2a2291536ca7e8d4d5f5eb18bfafa352f2cf0d6e518170b181aad971da8d: Status 404 returned error can't find the container with id 51ba2a2291536ca7e8d4d5f5eb18bfafa352f2cf0d6e518170b181aad971da8d Jun 03 21:40:07.048490 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.048469 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" Jun 03 21:40:07.126039 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.126014 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjmw8\" (UniqueName: \"kubernetes.io/projected/d0b7e270-bb3a-446b-8f53-f6a182eecda7-kube-api-access-hjmw8\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:40:07.126039 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.126039 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf216088-07d6-4aa7-85e7-4402813f94b2-extensions-socket-volume\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:40:07.126215 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.126050 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlb8l\" (UniqueName: \"kubernetes.io/projected/cf216088-07d6-4aa7-85e7-4402813f94b2-kube-api-access-jlb8l\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:40:07.186492 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.186469 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg"] Jun 03 21:40:07.187988 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:40:07.187962 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf5a1a5_d802_4c84_82e3_5011dc217ed3.slice/crio-1aa898b7852309fc32fa2eaaa4d33def698b0902d49b73738a7ba70ac8393d9e WatchSource:0}: Error finding container 1aa898b7852309fc32fa2eaaa4d33def698b0902d49b73738a7ba70ac8393d9e: Status 404 returned error can't find the container with id 1aa898b7852309fc32fa2eaaa4d33def698b0902d49b73738a7ba70ac8393d9e Jun 03 21:40:07.196064 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:07.196037 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rxn9j\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="d0b7e270-bb3a-446b-8f53-f6a182eecda7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" Jun 03 21:40:07.198034 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:07.198008 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4gt6m\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="1be5d703-8a37-468b-bb55-9b79d87016cf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m" Jun 03 21:40:07.199703 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:07.199681 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hdsx2\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="cf216088-07d6-4aa7-85e7-4402813f94b2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdsx2" Jun 03 21:40:07.338063 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.338034 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1be5d703-8a37-468b-bb55-9b79d87016cf" path="/var/lib/kubelet/pods/1be5d703-8a37-468b-bb55-9b79d87016cf/volumes" Jun 03 21:40:07.338287 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.338275 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf216088-07d6-4aa7-85e7-4402813f94b2" path="/var/lib/kubelet/pods/cf216088-07d6-4aa7-85e7-4402813f94b2/volumes" Jun 03 21:40:07.338564 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.338553 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0b7e270-bb3a-446b-8f53-f6a182eecda7" path="/var/lib/kubelet/pods/d0b7e270-bb3a-446b-8f53-f6a182eecda7/volumes" Jun 03 21:40:07.888187 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.888097 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" event={"ID":"7632d92f-a212-4e31-b1be-e0112158472b","Type":"ContainerStarted","Data":"209c986c5638daa8cc7393964d83bc293adf3a7b358821ab28c9254f43c92b55"} Jun 03 21:40:07.888187 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.888154 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" event={"ID":"7632d92f-a212-4e31-b1be-e0112158472b","Type":"ContainerStarted","Data":"51ba2a2291536ca7e8d4d5f5eb18bfafa352f2cf0d6e518170b181aad971da8d"} Jun 03 21:40:07.888604 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.888271 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" Jun 03 21:40:07.890498 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.890469 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" event={"ID":"6cf5a1a5-d802-4c84-82e3-5011dc217ed3","Type":"ContainerStarted","Data":"a6bb1f934a929cd64d84102506b05c5c4249ce4dac11b5827bf44b96b4491e7a"} Jun 03 21:40:07.890644 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.890515 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" event={"ID":"6cf5a1a5-d802-4c84-82e3-5011dc217ed3","Type":"ContainerStarted","Data":"1aa898b7852309fc32fa2eaaa4d33def698b0902d49b73738a7ba70ac8393d9e"} Jun 03 21:40:07.890644 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.890478 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m" Jun 03 21:40:07.890644 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.890636 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" Jun 03 21:40:07.890819 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.890668 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxn9j" Jun 03 21:40:07.921030 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.920978 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" podStartSLOduration=1.920959965 podStartE2EDuration="1.920959965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:40:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:40:07.919586041 +0000 UTC m=+607.080078933" watchObservedRunningTime="2026-06-03 21:40:07.920959965 +0000 UTC m=+607.081452855" Jun 03 21:40:07.948700 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:07.948660 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" podStartSLOduration=1.948649718 podStartE2EDuration="1.948649718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:40:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:40:07.947608463 +0000 UTC m=+607.108101354" watchObservedRunningTime="2026-06-03 21:40:07.948649718 +0000 UTC m=+607.109142648" Jun 03 21:40:07.950804 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:07.950774 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4gt6m\" is forbidden: User \"system:node:ip-10-0-141-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-134.ec2.internal' and this object" podUID="1be5d703-8a37-468b-bb55-9b79d87016cf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gt6m" Jun 03 21:40:08.897214 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:08.897175 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:10.221315 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:10.221243 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:11.704853 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:11.704823 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:11.806837 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:11.806791 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:16.497567 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:16.497529 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:16.608280 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:16.608248 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:18.898519 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:18.898487 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" Jun 03 21:40:18.898885 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:18.898553 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" Jun 03 21:40:18.995672 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:18.995640 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg"] Jun 03 21:40:18.995914 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:18.995889 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" podUID="6cf5a1a5-d802-4c84-82e3-5011dc217ed3" containerName="manager" containerID="cri-o://a6bb1f934a929cd64d84102506b05c5c4249ce4dac11b5827bf44b96b4491e7a" gracePeriod=10 Jun 03 21:40:19.252663 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.252641 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" Jun 03 21:40:19.434485 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.434338 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2nx2\" (UniqueName: \"kubernetes.io/projected/6cf5a1a5-d802-4c84-82e3-5011dc217ed3-kube-api-access-q2nx2\") pod \"6cf5a1a5-d802-4c84-82e3-5011dc217ed3\" (UID: \"6cf5a1a5-d802-4c84-82e3-5011dc217ed3\") " Jun 03 21:40:19.434485 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.434379 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cf5a1a5-d802-4c84-82e3-5011dc217ed3-extensions-socket-volume\") pod \"6cf5a1a5-d802-4c84-82e3-5011dc217ed3\" (UID: \"6cf5a1a5-d802-4c84-82e3-5011dc217ed3\") " Jun 03 21:40:19.434780 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.434757 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cf5a1a5-d802-4c84-82e3-5011dc217ed3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6cf5a1a5-d802-4c84-82e3-5011dc217ed3" (UID: "6cf5a1a5-d802-4c84-82e3-5011dc217ed3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:40:19.436717 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.436687 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cf5a1a5-d802-4c84-82e3-5011dc217ed3-kube-api-access-q2nx2" (OuterVolumeSpecName: "kube-api-access-q2nx2") pod "6cf5a1a5-d802-4c84-82e3-5011dc217ed3" (UID: "6cf5a1a5-d802-4c84-82e3-5011dc217ed3"). InnerVolumeSpecName "kube-api-access-q2nx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:40:19.535830 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.535795 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2nx2\" (UniqueName: \"kubernetes.io/projected/6cf5a1a5-d802-4c84-82e3-5011dc217ed3-kube-api-access-q2nx2\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:40:19.535830 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.535825 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cf5a1a5-d802-4c84-82e3-5011dc217ed3-extensions-socket-volume\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:40:19.900146 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.900113 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:19.953470 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.953436 2574 generic.go:356] "Generic (PLEG): container finished" podID="6cf5a1a5-d802-4c84-82e3-5011dc217ed3" containerID="a6bb1f934a929cd64d84102506b05c5c4249ce4dac11b5827bf44b96b4491e7a" exitCode=0 Jun 03 21:40:19.953650 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.953473 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" Jun 03 21:40:19.953650 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.953508 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" event={"ID":"6cf5a1a5-d802-4c84-82e3-5011dc217ed3","Type":"ContainerDied","Data":"a6bb1f934a929cd64d84102506b05c5c4249ce4dac11b5827bf44b96b4491e7a"} Jun 03 21:40:19.953650 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.953569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg" event={"ID":"6cf5a1a5-d802-4c84-82e3-5011dc217ed3","Type":"ContainerDied","Data":"1aa898b7852309fc32fa2eaaa4d33def698b0902d49b73738a7ba70ac8393d9e"} Jun 03 21:40:19.953650 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.953600 2574 scope.go:117] "RemoveContainer" containerID="a6bb1f934a929cd64d84102506b05c5c4249ce4dac11b5827bf44b96b4491e7a" Jun 03 21:40:19.962740 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.962725 2574 scope.go:117] "RemoveContainer" containerID="a6bb1f934a929cd64d84102506b05c5c4249ce4dac11b5827bf44b96b4491e7a" Jun 03 21:40:19.963129 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:19.963106 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6bb1f934a929cd64d84102506b05c5c4249ce4dac11b5827bf44b96b4491e7a\": container with ID starting with a6bb1f934a929cd64d84102506b05c5c4249ce4dac11b5827bf44b96b4491e7a not found: ID does not exist" containerID="a6bb1f934a929cd64d84102506b05c5c4249ce4dac11b5827bf44b96b4491e7a" Jun 03 21:40:19.963191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.963139 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6bb1f934a929cd64d84102506b05c5c4249ce4dac11b5827bf44b96b4491e7a"} err="failed to get container status \"a6bb1f934a929cd64d84102506b05c5c4249ce4dac11b5827bf44b96b4491e7a\": rpc error: code = NotFound desc = could not find container \"a6bb1f934a929cd64d84102506b05c5c4249ce4dac11b5827bf44b96b4491e7a\": container with ID starting with a6bb1f934a929cd64d84102506b05c5c4249ce4dac11b5827bf44b96b4491e7a not found: ID does not exist" Jun 03 21:40:19.981478 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.981450 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg"] Jun 03 21:40:19.984914 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.984891 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mlxdg"] Jun 03 21:40:19.986997 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:19.986969 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:20.131733 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:20.131692 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:20.234984 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:20.234884 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:21.338622 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:21.338528 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cf5a1a5-d802-4c84-82e3-5011dc217ed3" path="/var/lib/kubelet/pods/6cf5a1a5-d802-4c84-82e3-5011dc217ed3/volumes" Jun 03 21:40:26.766717 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:26.766671 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:26.865391 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:26.865355 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:29.963423 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:29.963389 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:30.073239 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:30.073198 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:34.392464 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:34.392423 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:34.491639 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:34.491604 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:34.591823 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:34.591788 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:34.692212 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:34.692125 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:35.338936 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.338907 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n"] Jun 03 21:40:35.339296 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.339282 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cf5a1a5-d802-4c84-82e3-5011dc217ed3" containerName="manager" Jun 03 21:40:35.339341 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.339297 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cf5a1a5-d802-4c84-82e3-5011dc217ed3" containerName="manager" Jun 03 21:40:35.339376 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.339366 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cf5a1a5-d802-4c84-82e3-5011dc217ed3" containerName="manager" Jun 03 21:40:35.342794 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.342542 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.345332 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.345311 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pbdwj\"" Jun 03 21:40:35.353236 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.353216 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n"] Jun 03 21:40:35.373194 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.373164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.373311 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.373218 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw82f\" (UniqueName: \"kubernetes.io/projected/13978d02-1df7-4bab-b4bb-1ab7048ab86c-kube-api-access-dw82f\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.373311 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.373238 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.373311 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.373299 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.373432 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.373325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.373432 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.373343 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.373432 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.373366 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.373543 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.373426 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.373543 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.373454 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.378648 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.378621 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:35.459376 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.459344 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:35.474431 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.474404 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw82f\" (UniqueName: \"kubernetes.io/projected/13978d02-1df7-4bab-b4bb-1ab7048ab86c-kube-api-access-dw82f\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.474552 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.474439 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.474552 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.474467 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.474552 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.474486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.474704 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.474599 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.474704 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.474632 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.474704 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.474669 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.474855 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.474702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.474855 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.474795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.475004 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.474984 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.475084 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.475021 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.475247 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.475225 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.475488 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.475463 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.475601 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.475583 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.476913 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.476886 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.476913 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.476912 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.482823 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.482800 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw82f\" (UniqueName: \"kubernetes.io/projected/13978d02-1df7-4bab-b4bb-1ab7048ab86c-kube-api-access-dw82f\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.482923 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.482907 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13978d02-1df7-4bab-b4bb-1ab7048ab86c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-ntz5n\" (UID: \"13978d02-1df7-4bab-b4bb-1ab7048ab86c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.654435 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.654332 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:35.799984 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.799937 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n"] Jun 03 21:40:35.807331 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.807286 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 21:40:35.807442 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.807362 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 21:40:35.807442 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:35.807391 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 21:40:36.036086 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:36.035994 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" event={"ID":"13978d02-1df7-4bab-b4bb-1ab7048ab86c","Type":"ContainerStarted","Data":"1d03c000d7f944e2b8b88d51656bb74aed4d14174ace41473c422a2d55eb47e0"} Jun 03 21:40:36.036086 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:36.036063 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" event={"ID":"13978d02-1df7-4bab-b4bb-1ab7048ab86c","Type":"ContainerStarted","Data":"5293209f3451fff3fea9046ef48cd99ed01cd42de5740dbacd2cfd63d9b1b3f7"} Jun 03 21:40:36.068555 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:36.068503 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" podStartSLOduration=1.068483041 podStartE2EDuration="1.068483041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:40:36.065874191 +0000 UTC m=+635.226367104" watchObservedRunningTime="2026-06-03 21:40:36.068483041 +0000 UTC m=+635.228975934" Jun 03 21:40:36.655398 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:36.655366 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:36.656443 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:36.656420 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-ntz5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jun 03 21:40:36.656551 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:36.656475 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" podUID="13978d02-1df7-4bab-b4bb-1ab7048ab86c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jun 03 21:40:37.658870 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:37.658840 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:38.046409 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:38.046320 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:38.047238 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:38.047221 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:40:38.419734 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:38.419698 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:38.522286 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:38.522234 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:39.686266 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:39.686232 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:40.051773 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.051690 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:40.064492 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.064471 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gngnd"] Jun 03 21:40:40.068014 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.067998 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" Jun 03 21:40:40.071100 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.071072 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 21:40:40.071230 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.071214 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5mts4\"" Jun 03 21:40:40.079971 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.079935 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gngnd"] Jun 03 21:40:40.119794 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.119769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd9jk\" (UniqueName: \"kubernetes.io/projected/4a264cf4-cea1-4356-a66a-4810660eda60-kube-api-access-kd9jk\") pod \"limitador-limitador-64c94fd64f-gngnd\" (UID: \"4a264cf4-cea1-4356-a66a-4810660eda60\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" Jun 03 21:40:40.119935 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.119845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4a264cf4-cea1-4356-a66a-4810660eda60-config-file\") pod \"limitador-limitador-64c94fd64f-gngnd\" (UID: \"4a264cf4-cea1-4356-a66a-4810660eda60\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" Jun 03 21:40:40.162527 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.162496 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gngnd"] Jun 03 21:40:40.176284 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.176258 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:40.220622 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.220600 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd9jk\" (UniqueName: \"kubernetes.io/projected/4a264cf4-cea1-4356-a66a-4810660eda60-kube-api-access-kd9jk\") pod \"limitador-limitador-64c94fd64f-gngnd\" (UID: \"4a264cf4-cea1-4356-a66a-4810660eda60\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" Jun 03 21:40:40.220733 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.220630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4a264cf4-cea1-4356-a66a-4810660eda60-config-file\") pod \"limitador-limitador-64c94fd64f-gngnd\" (UID: \"4a264cf4-cea1-4356-a66a-4810660eda60\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" Jun 03 21:40:40.221285 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.221267 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4a264cf4-cea1-4356-a66a-4810660eda60-config-file\") pod \"limitador-limitador-64c94fd64f-gngnd\" (UID: \"4a264cf4-cea1-4356-a66a-4810660eda60\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" Jun 03 21:40:40.231843 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.231787 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd9jk\" (UniqueName: \"kubernetes.io/projected/4a264cf4-cea1-4356-a66a-4810660eda60-kube-api-access-kd9jk\") pod \"limitador-limitador-64c94fd64f-gngnd\" (UID: \"4a264cf4-cea1-4356-a66a-4810660eda60\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" Jun 03 21:40:40.277488 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.277461 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:40.378986 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.378942 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" Jun 03 21:40:40.525712 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.525687 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gngnd"] Jun 03 21:40:40.526735 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:40:40.526708 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a264cf4_cea1_4356_a66a_4810660eda60.slice/crio-36e96078db9cc0ad74e21b7a1321f946c2a29e47543f554477ccc26d5b8b0cf8 WatchSource:0}: Error finding container 36e96078db9cc0ad74e21b7a1321f946c2a29e47543f554477ccc26d5b8b0cf8: Status 404 returned error can't find the container with id 36e96078db9cc0ad74e21b7a1321f946c2a29e47543f554477ccc26d5b8b0cf8 Jun 03 21:40:40.906689 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.906658 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mhglb"] Jun 03 21:40:40.911709 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.911691 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mhglb" Jun 03 21:40:40.914183 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.914162 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-x62bd\"" Jun 03 21:40:40.924074 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.924050 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mhglb"] Jun 03 21:40:40.959305 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:40.959277 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:41.028156 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:41.028121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnvn4\" (UniqueName: \"kubernetes.io/projected/2568dc41-2fb6-4c07-8810-df968a78a25d-kube-api-access-tnvn4\") pod \"authorino-58cd955675-mhglb\" (UID: \"2568dc41-2fb6-4c07-8810-df968a78a25d\") " pod="kuadrant-system/authorino-58cd955675-mhglb" Jun 03 21:40:41.041722 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:41.041692 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:41.062277 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:41.062251 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" event={"ID":"4a264cf4-cea1-4356-a66a-4810660eda60","Type":"ContainerStarted","Data":"36e96078db9cc0ad74e21b7a1321f946c2a29e47543f554477ccc26d5b8b0cf8"} Jun 03 21:40:41.129459 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:41.129431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnvn4\" (UniqueName: \"kubernetes.io/projected/2568dc41-2fb6-4c07-8810-df968a78a25d-kube-api-access-tnvn4\") pod \"authorino-58cd955675-mhglb\" (UID: \"2568dc41-2fb6-4c07-8810-df968a78a25d\") " pod="kuadrant-system/authorino-58cd955675-mhglb" Jun 03 21:40:41.138237 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:41.138211 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnvn4\" (UniqueName: \"kubernetes.io/projected/2568dc41-2fb6-4c07-8810-df968a78a25d-kube-api-access-tnvn4\") pod \"authorino-58cd955675-mhglb\" (UID: \"2568dc41-2fb6-4c07-8810-df968a78a25d\") " pod="kuadrant-system/authorino-58cd955675-mhglb" Jun 03 21:40:41.220883 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:41.220809 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mhglb" Jun 03 21:40:41.414022 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:41.413990 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mhglb"] Jun 03 21:40:41.415720 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:40:41.415687 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2568dc41_2fb6_4c07_8810_df968a78a25d.slice/crio-ce25f57b4e51ca2d73188cbb78278adae7bb4d5cd1d321a226bf0d05ef97886f WatchSource:0}: Error finding container ce25f57b4e51ca2d73188cbb78278adae7bb4d5cd1d321a226bf0d05ef97886f: Status 404 returned error can't find the container with id ce25f57b4e51ca2d73188cbb78278adae7bb4d5cd1d321a226bf0d05ef97886f Jun 03 21:40:42.069396 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:42.069358 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mhglb" event={"ID":"2568dc41-2fb6-4c07-8810-df968a78a25d","Type":"ContainerStarted","Data":"ce25f57b4e51ca2d73188cbb78278adae7bb4d5cd1d321a226bf0d05ef97886f"} Jun 03 21:40:44.085519 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:44.085477 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" event={"ID":"4a264cf4-cea1-4356-a66a-4810660eda60","Type":"ContainerStarted","Data":"bf16a0b1a72f232635e04c17209e8ececb369224b7dba35c0e3c6db7aef559a2"} Jun 03 21:40:44.085914 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:44.085596 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" Jun 03 21:40:44.113259 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:44.113202 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" podStartSLOduration=1.180554978 podStartE2EDuration="4.11318452s" totalImagesPullingTime="2.932629542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:40:44.111362816 +0000 UTC m=+643.271855709" watchObservedRunningTime="2026-06-03 21:40:44.11318452 +0000 UTC m=+643.273677464" Jun 03 21:40:45.549655 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:45.549580 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mhglb"] Jun 03 21:40:46.098327 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:46.098294 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mhglb" event={"ID":"2568dc41-2fb6-4c07-8810-df968a78a25d","Type":"ContainerStarted","Data":"062ed2180c8a795e515880f8db407b7ba43dbd94b34160152b78fc732ef26999"} Jun 03 21:40:46.117004 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:46.116932 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mhglb" podStartSLOduration=2.251283009 podStartE2EDuration="6.116918421s" totalImagesPullingTime="3.865635412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:40:46.115459896 +0000 UTC m=+645.275952787" watchObservedRunningTime="2026-06-03 21:40:46.116918421 +0000 UTC m=+645.277411312" Jun 03 21:40:47.103501 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:47.103443 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mhglb" podUID="2568dc41-2fb6-4c07-8810-df968a78a25d" containerName="authorino" containerID="cri-o://062ed2180c8a795e515880f8db407b7ba43dbd94b34160152b78fc732ef26999" gracePeriod=30 Jun 03 21:40:47.364020 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:47.363936 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mhglb" Jun 03 21:40:47.494051 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:47.494014 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnvn4\" (UniqueName: \"kubernetes.io/projected/2568dc41-2fb6-4c07-8810-df968a78a25d-kube-api-access-tnvn4\") pod \"2568dc41-2fb6-4c07-8810-df968a78a25d\" (UID: \"2568dc41-2fb6-4c07-8810-df968a78a25d\") " Jun 03 21:40:47.496044 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:47.496020 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2568dc41-2fb6-4c07-8810-df968a78a25d-kube-api-access-tnvn4" (OuterVolumeSpecName: "kube-api-access-tnvn4") pod "2568dc41-2fb6-4c07-8810-df968a78a25d" (UID: "2568dc41-2fb6-4c07-8810-df968a78a25d"). InnerVolumeSpecName "kube-api-access-tnvn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:40:47.595601 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:47.595570 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnvn4\" (UniqueName: \"kubernetes.io/projected/2568dc41-2fb6-4c07-8810-df968a78a25d-kube-api-access-tnvn4\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:40:48.109390 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:48.109354 2574 generic.go:356] "Generic (PLEG): container finished" podID="2568dc41-2fb6-4c07-8810-df968a78a25d" containerID="062ed2180c8a795e515880f8db407b7ba43dbd94b34160152b78fc732ef26999" exitCode=0 Jun 03 21:40:48.109824 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:48.109402 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mhglb" Jun 03 21:40:48.109824 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:48.109405 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mhglb" event={"ID":"2568dc41-2fb6-4c07-8810-df968a78a25d","Type":"ContainerDied","Data":"062ed2180c8a795e515880f8db407b7ba43dbd94b34160152b78fc732ef26999"} Jun 03 21:40:48.109824 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:48.109495 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mhglb" event={"ID":"2568dc41-2fb6-4c07-8810-df968a78a25d","Type":"ContainerDied","Data":"ce25f57b4e51ca2d73188cbb78278adae7bb4d5cd1d321a226bf0d05ef97886f"} Jun 03 21:40:48.109824 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:48.109511 2574 scope.go:117] "RemoveContainer" containerID="062ed2180c8a795e515880f8db407b7ba43dbd94b34160152b78fc732ef26999" Jun 03 21:40:48.118259 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:48.118240 2574 scope.go:117] "RemoveContainer" containerID="062ed2180c8a795e515880f8db407b7ba43dbd94b34160152b78fc732ef26999" Jun 03 21:40:48.118530 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:48.118510 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"062ed2180c8a795e515880f8db407b7ba43dbd94b34160152b78fc732ef26999\": container with ID starting with 062ed2180c8a795e515880f8db407b7ba43dbd94b34160152b78fc732ef26999 not found: ID does not exist" containerID="062ed2180c8a795e515880f8db407b7ba43dbd94b34160152b78fc732ef26999" Jun 03 21:40:48.118601 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:48.118543 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"062ed2180c8a795e515880f8db407b7ba43dbd94b34160152b78fc732ef26999"} err="failed to get container status \"062ed2180c8a795e515880f8db407b7ba43dbd94b34160152b78fc732ef26999\": rpc error: code = NotFound desc = could not find container \"062ed2180c8a795e515880f8db407b7ba43dbd94b34160152b78fc732ef26999\": container with ID starting with 062ed2180c8a795e515880f8db407b7ba43dbd94b34160152b78fc732ef26999 not found: ID does not exist" Jun 03 21:40:48.136307 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:48.136285 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mhglb"] Jun 03 21:40:48.143439 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:48.143419 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mhglb"] Jun 03 21:40:49.337865 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:49.337831 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2568dc41-2fb6-4c07-8810-df968a78a25d" path="/var/lib/kubelet/pods/2568dc41-2fb6-4c07-8810-df968a78a25d/volumes" Jun 03 21:40:52.302638 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:52.302605 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:52.388673 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:52.388643 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:40:55.092854 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:55.092822 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" Jun 03 21:40:56.563309 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:56.563276 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gngnd"] Jun 03 21:40:56.563693 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:56.563445 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" podUID="4a264cf4-cea1-4356-a66a-4810660eda60" containerName="limitador" containerID="cri-o://bf16a0b1a72f232635e04c17209e8ececb369224b7dba35c0e3c6db7aef559a2" gracePeriod=30 Jun 03 21:40:57.125778 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.125725 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" Jun 03 21:40:57.162043 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.162007 2574 generic.go:356] "Generic (PLEG): container finished" podID="4a264cf4-cea1-4356-a66a-4810660eda60" containerID="bf16a0b1a72f232635e04c17209e8ececb369224b7dba35c0e3c6db7aef559a2" exitCode=0 Jun 03 21:40:57.162167 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.162049 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" Jun 03 21:40:57.162167 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.162090 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" event={"ID":"4a264cf4-cea1-4356-a66a-4810660eda60","Type":"ContainerDied","Data":"bf16a0b1a72f232635e04c17209e8ececb369224b7dba35c0e3c6db7aef559a2"} Jun 03 21:40:57.162167 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.162141 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gngnd" event={"ID":"4a264cf4-cea1-4356-a66a-4810660eda60","Type":"ContainerDied","Data":"36e96078db9cc0ad74e21b7a1321f946c2a29e47543f554477ccc26d5b8b0cf8"} Jun 03 21:40:57.162287 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.162170 2574 scope.go:117] "RemoveContainer" containerID="bf16a0b1a72f232635e04c17209e8ececb369224b7dba35c0e3c6db7aef559a2" Jun 03 21:40:57.170363 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.170347 2574 scope.go:117] "RemoveContainer" containerID="bf16a0b1a72f232635e04c17209e8ececb369224b7dba35c0e3c6db7aef559a2" Jun 03 21:40:57.170614 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:40:57.170596 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf16a0b1a72f232635e04c17209e8ececb369224b7dba35c0e3c6db7aef559a2\": container with ID starting with bf16a0b1a72f232635e04c17209e8ececb369224b7dba35c0e3c6db7aef559a2 not found: ID does not exist" containerID="bf16a0b1a72f232635e04c17209e8ececb369224b7dba35c0e3c6db7aef559a2" Jun 03 21:40:57.170670 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.170623 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf16a0b1a72f232635e04c17209e8ececb369224b7dba35c0e3c6db7aef559a2"} err="failed to get container status \"bf16a0b1a72f232635e04c17209e8ececb369224b7dba35c0e3c6db7aef559a2\": rpc error: code = NotFound desc = could not find container \"bf16a0b1a72f232635e04c17209e8ececb369224b7dba35c0e3c6db7aef559a2\": container with ID starting with bf16a0b1a72f232635e04c17209e8ececb369224b7dba35c0e3c6db7aef559a2 not found: ID does not exist" Jun 03 21:40:57.277087 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.277058 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4a264cf4-cea1-4356-a66a-4810660eda60-config-file\") pod \"4a264cf4-cea1-4356-a66a-4810660eda60\" (UID: \"4a264cf4-cea1-4356-a66a-4810660eda60\") " Jun 03 21:40:57.277218 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.277206 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd9jk\" (UniqueName: \"kubernetes.io/projected/4a264cf4-cea1-4356-a66a-4810660eda60-kube-api-access-kd9jk\") pod \"4a264cf4-cea1-4356-a66a-4810660eda60\" (UID: \"4a264cf4-cea1-4356-a66a-4810660eda60\") " Jun 03 21:40:57.277462 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.277439 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a264cf4-cea1-4356-a66a-4810660eda60-config-file" (OuterVolumeSpecName: "config-file") pod "4a264cf4-cea1-4356-a66a-4810660eda60" (UID: "4a264cf4-cea1-4356-a66a-4810660eda60"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:40:57.279138 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.279107 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a264cf4-cea1-4356-a66a-4810660eda60-kube-api-access-kd9jk" (OuterVolumeSpecName: "kube-api-access-kd9jk") pod "4a264cf4-cea1-4356-a66a-4810660eda60" (UID: "4a264cf4-cea1-4356-a66a-4810660eda60"). InnerVolumeSpecName "kube-api-access-kd9jk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:40:57.378416 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.378352 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd9jk\" (UniqueName: \"kubernetes.io/projected/4a264cf4-cea1-4356-a66a-4810660eda60-kube-api-access-kd9jk\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:40:57.378416 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.378377 2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4a264cf4-cea1-4356-a66a-4810660eda60-config-file\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:40:57.480471 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.480443 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gngnd"] Jun 03 21:40:57.485227 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:57.485203 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gngnd"] Jun 03 21:40:59.343516 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:40:59.343480 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a264cf4-cea1-4356-a66a-4810660eda60" path="/var/lib/kubelet/pods/4a264cf4-cea1-4356-a66a-4810660eda60/volumes" Jun 03 21:41:01.246115 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.246083 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-5t7ch"] Jun 03 21:41:01.246489 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.246441 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a264cf4-cea1-4356-a66a-4810660eda60" containerName="limitador" Jun 03 21:41:01.246489 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.246452 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a264cf4-cea1-4356-a66a-4810660eda60" containerName="limitador" Jun 03 21:41:01.246489 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.246478 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2568dc41-2fb6-4c07-8810-df968a78a25d" containerName="authorino" Jun 03 21:41:01.246489 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.246484 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2568dc41-2fb6-4c07-8810-df968a78a25d" containerName="authorino" Jun 03 21:41:01.246667 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.246541 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2568dc41-2fb6-4c07-8810-df968a78a25d" containerName="authorino" Jun 03 21:41:01.246667 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.246554 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a264cf4-cea1-4356-a66a-4810660eda60" containerName="limitador" Jun 03 21:41:01.250998 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.250979 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-5t7ch" Jun 03 21:41:01.253494 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.253475 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 21:41:01.261791 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.261761 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-5t7ch"] Jun 03 21:41:01.283581 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.283548 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:41:01.325088 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.325064 2574 scope.go:117] "RemoveContainer" containerID="f8054490a472fb4ac3fa473741fbbc08e90f8df0022612639ce3d8ad7dbe1efa" Jun 03 21:41:01.333253 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.333234 2574 scope.go:117] "RemoveContainer" containerID="499d7618d0f5154b98878e947ebf3f974ced1b3255ddf9be5cfdc43091905d54" Jun 03 21:41:01.412517 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.412493 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ebd3804a-451b-49e0-8f33-de64478f815b-data\") pod \"postgres-69fb4594cf-5t7ch\" (UID: \"ebd3804a-451b-49e0-8f33-de64478f815b\") " pod="opendatahub/postgres-69fb4594cf-5t7ch" Jun 03 21:41:01.412670 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.412646 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkkvg\" (UniqueName: \"kubernetes.io/projected/ebd3804a-451b-49e0-8f33-de64478f815b-kube-api-access-mkkvg\") pod \"postgres-69fb4594cf-5t7ch\" (UID: \"ebd3804a-451b-49e0-8f33-de64478f815b\") " pod="opendatahub/postgres-69fb4594cf-5t7ch" Jun 03 21:41:01.513373 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.513298 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkkvg\" (UniqueName: \"kubernetes.io/projected/ebd3804a-451b-49e0-8f33-de64478f815b-kube-api-access-mkkvg\") pod \"postgres-69fb4594cf-5t7ch\" (UID: \"ebd3804a-451b-49e0-8f33-de64478f815b\") " pod="opendatahub/postgres-69fb4594cf-5t7ch" Jun 03 21:41:01.513373 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.513335 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ebd3804a-451b-49e0-8f33-de64478f815b-data\") pod \"postgres-69fb4594cf-5t7ch\" (UID: \"ebd3804a-451b-49e0-8f33-de64478f815b\") " pod="opendatahub/postgres-69fb4594cf-5t7ch" Jun 03 21:41:01.513724 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.513701 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ebd3804a-451b-49e0-8f33-de64478f815b-data\") pod \"postgres-69fb4594cf-5t7ch\" (UID: \"ebd3804a-451b-49e0-8f33-de64478f815b\") " pod="opendatahub/postgres-69fb4594cf-5t7ch" Jun 03 21:41:01.521835 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.521812 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkkvg\" (UniqueName: \"kubernetes.io/projected/ebd3804a-451b-49e0-8f33-de64478f815b-kube-api-access-mkkvg\") pod \"postgres-69fb4594cf-5t7ch\" (UID: \"ebd3804a-451b-49e0-8f33-de64478f815b\") " pod="opendatahub/postgres-69fb4594cf-5t7ch" Jun 03 21:41:01.562343 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.562316 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-5t7ch" Jun 03 21:41:01.700246 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:01.700222 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-5t7ch"] Jun 03 21:41:01.701902 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:41:01.701863 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd3804a_451b_49e0_8f33_de64478f815b.slice/crio-c98edeb71726ffcf6472c388e470a8ef09b8de86c380ec160731cb4e3906dc60 WatchSource:0}: Error finding container c98edeb71726ffcf6472c388e470a8ef09b8de86c380ec160731cb4e3906dc60: Status 404 returned error can't find the container with id c98edeb71726ffcf6472c388e470a8ef09b8de86c380ec160731cb4e3906dc60 Jun 03 21:41:02.189485 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:02.189440 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-5t7ch" event={"ID":"ebd3804a-451b-49e0-8f33-de64478f815b","Type":"ContainerStarted","Data":"c98edeb71726ffcf6472c388e470a8ef09b8de86c380ec160731cb4e3906dc60"} Jun 03 21:41:06.211907 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:06.211873 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-5t7ch" event={"ID":"ebd3804a-451b-49e0-8f33-de64478f815b","Type":"ContainerStarted","Data":"1904bd0ef5862bc749f4432ea7cc5bccafb6d04b8ae2576c77197e8af2c4321e"} Jun 03 21:41:06.212359 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:06.212031 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-5t7ch" Jun 03 21:41:12.246603 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:12.246566 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-5t7ch" Jun 03 21:41:12.264295 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:12.264246 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-5t7ch" podStartSLOduration=7.603865888 podStartE2EDuration="11.264230841s" totalImagesPullingTime="3.660364953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:41:06.2301388 +0000 UTC m=+665.390631692" watchObservedRunningTime="2026-06-03 21:41:12.264230841 +0000 UTC m=+671.424723733" Jun 03 21:41:12.592068 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:12.592036 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:41:12.688937 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:12.688906 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:41:12.842889 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:12.842806 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:41:22.297310 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:22.297280 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-kt6hz"] Jun 03 21:41:22.310113 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:22.310087 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-kt6hz"] Jun 03 21:41:22.310113 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:22.310110 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-kt6hz" Jun 03 21:41:22.313140 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:22.313119 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 21:41:22.314172 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:22.314151 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 21:41:22.314280 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:22.314198 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-4bv52\"" Jun 03 21:41:22.402101 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:22.402069 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9vbx\" (UniqueName: \"kubernetes.io/projected/324123e4-cdba-4c3a-a2f3-2284265eea6c-kube-api-access-t9vbx\") pod \"keycloak-operator-dd84cbf46-kt6hz\" (UID: \"324123e4-cdba-4c3a-a2f3-2284265eea6c\") " pod="keycloak-system/keycloak-operator-dd84cbf46-kt6hz" Jun 03 21:41:22.503567 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:22.503532 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9vbx\" (UniqueName: \"kubernetes.io/projected/324123e4-cdba-4c3a-a2f3-2284265eea6c-kube-api-access-t9vbx\") pod \"keycloak-operator-dd84cbf46-kt6hz\" (UID: \"324123e4-cdba-4c3a-a2f3-2284265eea6c\") " pod="keycloak-system/keycloak-operator-dd84cbf46-kt6hz" Jun 03 21:41:22.515021 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:22.514991 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9vbx\" (UniqueName: \"kubernetes.io/projected/324123e4-cdba-4c3a-a2f3-2284265eea6c-kube-api-access-t9vbx\") pod \"keycloak-operator-dd84cbf46-kt6hz\" (UID: \"324123e4-cdba-4c3a-a2f3-2284265eea6c\") " pod="keycloak-system/keycloak-operator-dd84cbf46-kt6hz" Jun 03 21:41:22.620563 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:22.620533 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-kt6hz" Jun 03 21:41:22.779494 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:22.779470 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-kt6hz"] Jun 03 21:41:22.780542 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:41:22.780515 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324123e4_cdba_4c3a_a2f3_2284265eea6c.slice/crio-2173cf497090d2659d8a69e8d243453a06f6c32527ea43f8154de7ef37469292 WatchSource:0}: Error finding container 2173cf497090d2659d8a69e8d243453a06f6c32527ea43f8154de7ef37469292: Status 404 returned error can't find the container with id 2173cf497090d2659d8a69e8d243453a06f6c32527ea43f8154de7ef37469292 Jun 03 21:41:23.297966 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:23.297906 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-kt6hz" event={"ID":"324123e4-cdba-4c3a-a2f3-2284265eea6c","Type":"ContainerStarted","Data":"2173cf497090d2659d8a69e8d243453a06f6c32527ea43f8154de7ef37469292"} Jun 03 21:41:28.333169 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:28.333079 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-kt6hz" event={"ID":"324123e4-cdba-4c3a-a2f3-2284265eea6c","Type":"ContainerStarted","Data":"29fb71dd197885af79f3a2ce5fd69792cae6f9687d9c0a2b8cefb7b86e33abf3"} Jun 03 21:41:28.356169 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:28.356115 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-kt6hz" podStartSLOduration=1.1814444179999999 podStartE2EDuration="6.356099408s" totalImagesPullingTime="5.17465499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:41:28.354592447 +0000 UTC m=+687.515085360" watchObservedRunningTime="2026-06-03 21:41:28.356099408 +0000 UTC m=+687.516592357" Jun 03 21:41:30.390497 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:30.390462 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:41:36.564963 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:36.564909 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:41:36.683280 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:36.683240 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:41:36.977617 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:36.977581 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:41:36.981331 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:36.981314 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 21:41:36.984407 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:36.984384 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-qzc9p\"" Jun 03 21:41:36.984407 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:36.984400 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 21:41:36.992183 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:36.992159 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:41:37.143688 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:37.143651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cchh\" (UniqueName: \"kubernetes.io/projected/7c668d17-b2dc-4b05-afb4-1dfe8d52eca9-kube-api-access-5cchh\") pod \"maas-keycloak-0\" (UID: \"7c668d17-b2dc-4b05-afb4-1dfe8d52eca9\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:41:37.244365 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:37.244287 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cchh\" (UniqueName: \"kubernetes.io/projected/7c668d17-b2dc-4b05-afb4-1dfe8d52eca9-kube-api-access-5cchh\") pod \"maas-keycloak-0\" (UID: \"7c668d17-b2dc-4b05-afb4-1dfe8d52eca9\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:41:37.254047 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:37.254018 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cchh\" (UniqueName: \"kubernetes.io/projected/7c668d17-b2dc-4b05-afb4-1dfe8d52eca9-kube-api-access-5cchh\") pod \"maas-keycloak-0\" (UID: \"7c668d17-b2dc-4b05-afb4-1dfe8d52eca9\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:41:37.292083 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:37.292047 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 21:41:37.433096 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:37.433063 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:41:37.434083 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:41:37.434058 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c668d17_b2dc_4b05_afb4_1dfe8d52eca9.slice/crio-b7512e90677f7ea55811db057804e2f2d6e92ae7af97821abf7e7886ef0bc731 WatchSource:0}: Error finding container b7512e90677f7ea55811db057804e2f2d6e92ae7af97821abf7e7886ef0bc731: Status 404 returned error can't find the container with id b7512e90677f7ea55811db057804e2f2d6e92ae7af97821abf7e7886ef0bc731 Jun 03 21:41:38.392708 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:38.392677 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7c668d17-b2dc-4b05-afb4-1dfe8d52eca9","Type":"ContainerStarted","Data":"b7512e90677f7ea55811db057804e2f2d6e92ae7af97821abf7e7886ef0bc731"} Jun 03 21:41:42.428775 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:42.428680 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7c668d17-b2dc-4b05-afb4-1dfe8d52eca9","Type":"ContainerStarted","Data":"2dd68f8300d2581fb0f6947d1c42d338ee53fac41dba84f9bcdb840388f49afa"} Jun 03 21:41:42.455877 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:42.455820 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.781798911 podStartE2EDuration="6.455800924s" totalImagesPullingTime="4.674002013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:41:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:41:42.448499453 +0000 UTC m=+701.608992357" watchObservedRunningTime="2026-06-03 21:41:42.455800924 +0000 UTC m=+701.616293817" Jun 03 21:41:43.293015 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:43.292973 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 21:41:43.294714 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:43.294677 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 03 21:41:44.293508 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:44.293453 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 03 21:41:45.293337 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:45.293291 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 03 21:41:46.293702 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:46.293291 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 03 21:41:47.293474 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:47.293417 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 03 21:41:47.294067 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:47.294008 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 21:41:48.293387 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:48.293330 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 03 21:41:49.292614 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:49.292563 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 03 21:41:50.293182 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:50.293133 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 03 21:41:51.292990 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:51.292859 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 03 21:41:52.293295 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:52.293244 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 03 21:41:53.292840 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:53.292791 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 03 21:41:54.292794 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:54.292742 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 03 21:41:55.382492 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:55.382454 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 21:41:55.397147 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:41:55.397098 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 21:42:05.388939 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:05.388896 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 21:42:06.079579 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:06.079537 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:42:06.274106 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:06.274066 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:42:14.446807 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:14.446751 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:42:14.549912 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:14.549879 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:42:26.425010 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:26.424977 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:42:45.443794 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:45.443755 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:42:45.742903 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:45.742782 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:42:45.875095 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:45.875063 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:42:53.622936 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:53.621940 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-ntz5n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:53200->10.132.0.40:15021: read: connection reset by peer" start-of-body= Jun 03 21:42:53.622936 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:53.622049 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" podUID="13978d02-1df7-4bab-b4bb-1ab7048ab86c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:53200->10.132.0.40:15021: read: connection reset by peer" Jun 03 21:42:53.643814 ip-10-0-141-134 kubenswrapper[2574]: E0603 21:42:53.643788 2574 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@0-16482-0.service\": RecentStats: unable to find data in memory cache]" Jun 03 21:42:53.835903 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:53.835875 2574 generic.go:356] "Generic (PLEG): container finished" podID="13978d02-1df7-4bab-b4bb-1ab7048ab86c" containerID="1d03c000d7f944e2b8b88d51656bb74aed4d14174ace41473c422a2d55eb47e0" exitCode=0 Jun 03 21:42:53.836065 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:53.835935 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" event={"ID":"13978d02-1df7-4bab-b4bb-1ab7048ab86c","Type":"ContainerDied","Data":"1d03c000d7f944e2b8b88d51656bb74aed4d14174ace41473c422a2d55eb47e0"} Jun 03 21:42:53.836355 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:53.836341 2574 scope.go:117] "RemoveContainer" containerID="1d03c000d7f944e2b8b88d51656bb74aed4d14174ace41473c422a2d55eb47e0" Jun 03 21:42:53.837298 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:53.837270 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 21:42:53.837356 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:53.837336 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 21:42:53.837392 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:53.837370 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 21:42:54.842795 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:54.842762 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" event={"ID":"13978d02-1df7-4bab-b4bb-1ab7048ab86c","Type":"ContainerStarted","Data":"8d339061def6722fc4cd1d21d4b7d783dfaabb60b4f3c3fedc9c3551354a6b28"} Jun 03 21:42:55.655440 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:55.655413 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:42:55.655602 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:55.655581 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-ntz5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jun 03 21:42:55.655665 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:55.655630 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" podUID="13978d02-1df7-4bab-b4bb-1ab7048ab86c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jun 03 21:42:56.231347 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:56.231297 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:42:56.231879 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:56.231549 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" containerID="cri-o://2dd68f8300d2581fb0f6947d1c42d338ee53fac41dba84f9bcdb840388f49afa" gracePeriod=30 Jun 03 21:42:56.655748 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:56.655706 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-ntz5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jun 03 21:42:56.655989 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:56.655785 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" podUID="13978d02-1df7-4bab-b4bb-1ab7048ab86c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jun 03 21:42:57.654810 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:57.654772 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-ntz5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jun 03 21:42:57.655398 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:57.654847 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" podUID="13978d02-1df7-4bab-b4bb-1ab7048ab86c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jun 03 21:42:57.860913 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:57.860875 2574 generic.go:356] "Generic (PLEG): container finished" podID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerID="2dd68f8300d2581fb0f6947d1c42d338ee53fac41dba84f9bcdb840388f49afa" exitCode=143 Jun 03 21:42:57.861087 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:57.860960 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7c668d17-b2dc-4b05-afb4-1dfe8d52eca9","Type":"ContainerDied","Data":"2dd68f8300d2581fb0f6947d1c42d338ee53fac41dba84f9bcdb840388f49afa"} Jun 03 21:42:57.896593 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:57.896570 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 21:42:58.023393 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.023289 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cchh\" (UniqueName: \"kubernetes.io/projected/7c668d17-b2dc-4b05-afb4-1dfe8d52eca9-kube-api-access-5cchh\") pod \"7c668d17-b2dc-4b05-afb4-1dfe8d52eca9\" (UID: \"7c668d17-b2dc-4b05-afb4-1dfe8d52eca9\") " Jun 03 21:42:58.027439 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.027406 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c668d17-b2dc-4b05-afb4-1dfe8d52eca9-kube-api-access-5cchh" (OuterVolumeSpecName: "kube-api-access-5cchh") pod "7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" (UID: "7c668d17-b2dc-4b05-afb4-1dfe8d52eca9"). InnerVolumeSpecName "kube-api-access-5cchh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:42:58.124932 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.124880 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cchh\" (UniqueName: \"kubernetes.io/projected/7c668d17-b2dc-4b05-afb4-1dfe8d52eca9-kube-api-access-5cchh\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:42:58.659251 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.659222 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:42:58.659635 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.659557 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:42:58.660173 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.660156 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ntz5n" Jun 03 21:42:58.867981 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.867939 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 21:42:58.867981 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.867977 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7c668d17-b2dc-4b05-afb4-1dfe8d52eca9","Type":"ContainerDied","Data":"b7512e90677f7ea55811db057804e2f2d6e92ae7af97821abf7e7886ef0bc731"} Jun 03 21:42:58.868228 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.868036 2574 scope.go:117] "RemoveContainer" containerID="2dd68f8300d2581fb0f6947d1c42d338ee53fac41dba84f9bcdb840388f49afa" Jun 03 21:42:58.889990 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.889962 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:42:58.894257 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.894235 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:42:58.920676 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.920611 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:42:58.921063 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.921048 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" Jun 03 21:42:58.921112 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.921065 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" Jun 03 21:42:58.921151 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.921140 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" containerName="keycloak" Jun 03 21:42:58.925542 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.925523 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 21:42:58.928057 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.928032 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 21:42:58.928179 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.928150 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 21:42:58.928249 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.928198 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-qzc9p\"" Jun 03 21:42:58.937323 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:58.937296 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:42:59.033580 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:59.033538 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e4c5638a-f94b-4c3e-b527-3b7446b8ea1f-test-realms\") pod \"maas-keycloak-0\" (UID: \"e4c5638a-f94b-4c3e-b527-3b7446b8ea1f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:42:59.033832 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:59.033813 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmt6p\" (UniqueName: \"kubernetes.io/projected/e4c5638a-f94b-4c3e-b527-3b7446b8ea1f-kube-api-access-kmt6p\") pod \"maas-keycloak-0\" (UID: \"e4c5638a-f94b-4c3e-b527-3b7446b8ea1f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:42:59.134500 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:59.134465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmt6p\" (UniqueName: \"kubernetes.io/projected/e4c5638a-f94b-4c3e-b527-3b7446b8ea1f-kube-api-access-kmt6p\") pod \"maas-keycloak-0\" (UID: \"e4c5638a-f94b-4c3e-b527-3b7446b8ea1f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:42:59.134672 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:59.134583 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e4c5638a-f94b-4c3e-b527-3b7446b8ea1f-test-realms\") pod \"maas-keycloak-0\" (UID: \"e4c5638a-f94b-4c3e-b527-3b7446b8ea1f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:42:59.135317 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:59.135295 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e4c5638a-f94b-4c3e-b527-3b7446b8ea1f-test-realms\") pod \"maas-keycloak-0\" (UID: \"e4c5638a-f94b-4c3e-b527-3b7446b8ea1f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:42:59.144671 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:59.144646 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmt6p\" (UniqueName: \"kubernetes.io/projected/e4c5638a-f94b-4c3e-b527-3b7446b8ea1f-kube-api-access-kmt6p\") pod \"maas-keycloak-0\" (UID: \"e4c5638a-f94b-4c3e-b527-3b7446b8ea1f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:42:59.236325 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:59.236237 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 21:42:59.338391 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:59.338360 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c668d17-b2dc-4b05-afb4-1dfe8d52eca9" path="/var/lib/kubelet/pods/7c668d17-b2dc-4b05-afb4-1dfe8d52eca9/volumes" Jun 03 21:42:59.372377 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:59.372352 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:42:59.373914 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:42:59.373888 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c5638a_f94b_4c3e_b527_3b7446b8ea1f.slice/crio-81e00c4a825b4ae7615c6b3c02c601e30048564336b06324df54b8ba6a3907fa WatchSource:0}: Error finding container 81e00c4a825b4ae7615c6b3c02c601e30048564336b06324df54b8ba6a3907fa: Status 404 returned error can't find the container with id 81e00c4a825b4ae7615c6b3c02c601e30048564336b06324df54b8ba6a3907fa Jun 03 21:42:59.375397 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:59.375377 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:42:59.875236 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:59.875198 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e4c5638a-f94b-4c3e-b527-3b7446b8ea1f","Type":"ContainerStarted","Data":"f136b7e436567ea3e3729bbcd8a08e5da271719c59380e7031871aeddbe3d762"} Jun 03 21:42:59.875689 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:59.875258 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e4c5638a-f94b-4c3e-b527-3b7446b8ea1f","Type":"ContainerStarted","Data":"81e00c4a825b4ae7615c6b3c02c601e30048564336b06324df54b8ba6a3907fa"} Jun 03 21:42:59.897836 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:42:59.897789 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.510971192 podStartE2EDuration="1.897774355s" totalImagesPullingTime="386.803163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:59.89491367 +0000 UTC m=+779.055406560" watchObservedRunningTime="2026-06-03 21:42:59.897774355 +0000 UTC m=+779.058267246" Jun 03 21:43:00.237272 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:00.237235 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 21:43:00.238868 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:00.238835 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e4c5638a-f94b-4c3e-b527-3b7446b8ea1f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 03 21:43:01.237521 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:01.237464 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e4c5638a-f94b-4c3e-b527-3b7446b8ea1f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 03 21:43:02.237791 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:02.237741 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e4c5638a-f94b-4c3e-b527-3b7446b8ea1f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 03 21:43:03.237014 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:03.236964 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e4c5638a-f94b-4c3e-b527-3b7446b8ea1f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 03 21:43:04.237570 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:04.237517 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e4c5638a-f94b-4c3e-b527-3b7446b8ea1f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 03 21:43:05.237638 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:05.237569 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e4c5638a-f94b-4c3e-b527-3b7446b8ea1f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 03 21:43:06.237465 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:06.237414 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e4c5638a-f94b-4c3e-b527-3b7446b8ea1f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 03 21:43:07.237605 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:07.237553 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e4c5638a-f94b-4c3e-b527-3b7446b8ea1f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 03 21:43:08.237198 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:08.237157 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e4c5638a-f94b-4c3e-b527-3b7446b8ea1f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 03 21:43:09.236437 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:09.236394 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 21:43:09.237014 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:09.236759 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e4c5638a-f94b-4c3e-b527-3b7446b8ea1f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 03 21:43:10.237042 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:10.236977 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e4c5638a-f94b-4c3e-b527-3b7446b8ea1f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 03 21:43:10.964493 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:10.964456 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:43:11.033848 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:11.033800 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:43:11.237151 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:11.237051 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e4c5638a-f94b-4c3e-b527-3b7446b8ea1f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 03 21:43:12.237773 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:12.237728 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e4c5638a-f94b-4c3e-b527-3b7446b8ea1f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 03 21:43:13.367492 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:13.367455 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 21:43:13.386270 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:13.386227 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="e4c5638a-f94b-4c3e-b527-3b7446b8ea1f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 21:43:23.373481 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:23.373393 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 21:43:35.993371 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:35.993330 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:43:36.161006 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:36.160939 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:43:43.835647 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:43.835618 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:43:51.287048 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:51.287009 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:43:53.559607 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:53.559563 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:43:53.661754 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:43:53.661718 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:44:13.551516 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:13.551480 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:44:29.915082 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:29.915049 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t"] Jun 03 21:44:29.918278 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:29.918260 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:29.921003 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:29.920974 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 21:44:29.921624 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:29.921605 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 21:44:29.921728 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:29.921691 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 21:44:29.921800 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:29.921744 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zbpp4\"" Jun 03 21:44:29.930668 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:29.930649 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t"] Jun 03 21:44:29.938940 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:29.938918 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:44:30.022007 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.021936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95d7794a-4d4b-4eb9-8943-957ccef8d22f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.022175 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.022084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95d7794a-4d4b-4eb9-8943-957ccef8d22f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.022175 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.022113 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrkgb\" (UniqueName: \"kubernetes.io/projected/95d7794a-4d4b-4eb9-8943-957ccef8d22f-kube-api-access-zrkgb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.022175 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.022140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95d7794a-4d4b-4eb9-8943-957ccef8d22f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.022295 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.022205 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/95d7794a-4d4b-4eb9-8943-957ccef8d22f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.022295 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.022235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95d7794a-4d4b-4eb9-8943-957ccef8d22f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.123185 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.123153 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95d7794a-4d4b-4eb9-8943-957ccef8d22f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.123375 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.123204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/95d7794a-4d4b-4eb9-8943-957ccef8d22f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.123375 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.123233 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95d7794a-4d4b-4eb9-8943-957ccef8d22f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.123375 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.123281 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95d7794a-4d4b-4eb9-8943-957ccef8d22f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.123375 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.123346 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95d7794a-4d4b-4eb9-8943-957ccef8d22f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.123375 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.123371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrkgb\" (UniqueName: \"kubernetes.io/projected/95d7794a-4d4b-4eb9-8943-957ccef8d22f-kube-api-access-zrkgb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.123649 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.123549 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95d7794a-4d4b-4eb9-8943-957ccef8d22f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.123649 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.123625 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/95d7794a-4d4b-4eb9-8943-957ccef8d22f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.123649 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.123641 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95d7794a-4d4b-4eb9-8943-957ccef8d22f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.125544 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.125517 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95d7794a-4d4b-4eb9-8943-957ccef8d22f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.125712 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.125692 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95d7794a-4d4b-4eb9-8943-957ccef8d22f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.135792 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.135771 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrkgb\" (UniqueName: \"kubernetes.io/projected/95d7794a-4d4b-4eb9-8943-957ccef8d22f-kube-api-access-zrkgb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t\" (UID: \"95d7794a-4d4b-4eb9-8943-957ccef8d22f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.229499 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.229439 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:30.373021 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.372998 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t"] Jun 03 21:44:30.375177 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:44:30.375147 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d7794a_4d4b_4eb9_8943_957ccef8d22f.slice/crio-e9706a5400652d305313a6fa39e4caec86dff431bad2a696cbc4eee6ae31f95f WatchSource:0}: Error finding container e9706a5400652d305313a6fa39e4caec86dff431bad2a696cbc4eee6ae31f95f: Status 404 returned error can't find the container with id e9706a5400652d305313a6fa39e4caec86dff431bad2a696cbc4eee6ae31f95f Jun 03 21:44:30.410400 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:30.410371 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" event={"ID":"95d7794a-4d4b-4eb9-8943-957ccef8d22f","Type":"ContainerStarted","Data":"e9706a5400652d305313a6fa39e4caec86dff431bad2a696cbc4eee6ae31f95f"} Jun 03 21:44:34.437982 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:34.437929 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" event={"ID":"95d7794a-4d4b-4eb9-8943-957ccef8d22f","Type":"ContainerStarted","Data":"5e58458347da6636dcc9899eef5856a9965e04c688ebf5ff6060017d583cd925"} Jun 03 21:44:35.444865 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:35.444780 2574 generic.go:356] "Generic (PLEG): container finished" podID="95d7794a-4d4b-4eb9-8943-957ccef8d22f" containerID="5e58458347da6636dcc9899eef5856a9965e04c688ebf5ff6060017d583cd925" exitCode=0 Jun 03 21:44:35.444865 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:35.444826 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" event={"ID":"95d7794a-4d4b-4eb9-8943-957ccef8d22f","Type":"ContainerDied","Data":"5e58458347da6636dcc9899eef5856a9965e04c688ebf5ff6060017d583cd925"} Jun 03 21:44:36.196866 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:36.196821 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:44:37.458322 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:37.458287 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" event={"ID":"95d7794a-4d4b-4eb9-8943-957ccef8d22f","Type":"ContainerStarted","Data":"06817798494fcee61d4036d4dbd5a4cf668b6b4f6bbe275baf27285a3c1f77f1"} Jun 03 21:44:37.489544 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:37.489494 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" podStartSLOduration=2.653855563 podStartE2EDuration="8.489477241s" totalImagesPullingTime="4.617151425s" totalInitContainerRuntime="1.218470253s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:44:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:44:37.487590718 +0000 UTC m=+876.648083612" watchObservedRunningTime="2026-06-03 21:44:37.489477241 +0000 UTC m=+876.649970131" Jun 03 21:44:40.230583 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:40.230543 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:40.231061 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:40.230610 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:40.243207 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:40.243180 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:40.486282 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:40.486201 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t" Jun 03 21:44:53.199251 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:53.199159 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:44:57.502014 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:44:57.501972 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:45:00.137262 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:00.137224 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29675385-2j6qq"] Jun 03 21:45:00.140964 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:00.140929 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675385-2j6qq" Jun 03 21:45:00.143631 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:00.143610 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-n2bc7\"" Jun 03 21:45:00.150704 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:00.150677 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675385-2j6qq"] Jun 03 21:45:00.221168 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:00.221138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd8k8\" (UniqueName: \"kubernetes.io/projected/6c7dc068-0818-405a-bfaf-81b58455419c-kube-api-access-sd8k8\") pod \"maas-api-key-cleanup-29675385-2j6qq\" (UID: \"6c7dc068-0818-405a-bfaf-81b58455419c\") " pod="opendatahub/maas-api-key-cleanup-29675385-2j6qq" Jun 03 21:45:00.322432 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:00.322393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd8k8\" (UniqueName: \"kubernetes.io/projected/6c7dc068-0818-405a-bfaf-81b58455419c-kube-api-access-sd8k8\") pod \"maas-api-key-cleanup-29675385-2j6qq\" (UID: \"6c7dc068-0818-405a-bfaf-81b58455419c\") " pod="opendatahub/maas-api-key-cleanup-29675385-2j6qq" Jun 03 21:45:00.330251 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:00.330218 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd8k8\" (UniqueName: \"kubernetes.io/projected/6c7dc068-0818-405a-bfaf-81b58455419c-kube-api-access-sd8k8\") pod \"maas-api-key-cleanup-29675385-2j6qq\" (UID: \"6c7dc068-0818-405a-bfaf-81b58455419c\") " pod="opendatahub/maas-api-key-cleanup-29675385-2j6qq" Jun 03 21:45:00.452718 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:00.452635 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675385-2j6qq" Jun 03 21:45:00.793571 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:00.793542 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675385-2j6qq"] Jun 03 21:45:00.795137 ip-10-0-141-134 kubenswrapper[2574]: W0603 21:45:00.795112 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7dc068_0818_405a_bfaf_81b58455419c.slice/crio-cf693a7c77ef4857290ad826fbae464202d7b6e4d080eb3f440b17393c0eb011 WatchSource:0}: Error finding container cf693a7c77ef4857290ad826fbae464202d7b6e4d080eb3f440b17393c0eb011: Status 404 returned error can't find the container with id cf693a7c77ef4857290ad826fbae464202d7b6e4d080eb3f440b17393c0eb011 Jun 03 21:45:01.584735 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:01.584694 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675385-2j6qq" event={"ID":"6c7dc068-0818-405a-bfaf-81b58455419c","Type":"ContainerStarted","Data":"cf693a7c77ef4857290ad826fbae464202d7b6e4d080eb3f440b17393c0eb011"} Jun 03 21:45:05.609779 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:05.609738 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675385-2j6qq" event={"ID":"6c7dc068-0818-405a-bfaf-81b58455419c","Type":"ContainerStarted","Data":"9f0e9edfd72cec94c9a5188f1729bc94887717539e4f37f7d471614ae500d4d3"} Jun 03 21:45:05.625845 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:05.625784 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29675385-2j6qq" podStartSLOduration=1.440888162 podStartE2EDuration="5.625769687s" totalImagesPullingTime="4.184881525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:45:05.624089858 +0000 UTC m=+904.784582749" watchObservedRunningTime="2026-06-03 21:45:05.625769687 +0000 UTC m=+904.786262577" Jun 03 21:45:06.617397 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:06.617357 2574 generic.go:356] "Generic (PLEG): container finished" podID="6c7dc068-0818-405a-bfaf-81b58455419c" containerID="9f0e9edfd72cec94c9a5188f1729bc94887717539e4f37f7d471614ae500d4d3" exitCode=0 Jun 03 21:45:06.617880 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:06.617405 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675385-2j6qq" event={"ID":"6c7dc068-0818-405a-bfaf-81b58455419c","Type":"ContainerDied","Data":"9f0e9edfd72cec94c9a5188f1729bc94887717539e4f37f7d471614ae500d4d3"} Jun 03 21:45:07.762923 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:07.762898 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675385-2j6qq" Jun 03 21:45:07.796339 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:07.796306 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd8k8\" (UniqueName: \"kubernetes.io/projected/6c7dc068-0818-405a-bfaf-81b58455419c-kube-api-access-sd8k8\") pod \"6c7dc068-0818-405a-bfaf-81b58455419c\" (UID: \"6c7dc068-0818-405a-bfaf-81b58455419c\") " Jun 03 21:45:07.798576 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:07.798541 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c7dc068-0818-405a-bfaf-81b58455419c-kube-api-access-sd8k8" (OuterVolumeSpecName: "kube-api-access-sd8k8") pod "6c7dc068-0818-405a-bfaf-81b58455419c" (UID: "6c7dc068-0818-405a-bfaf-81b58455419c"). InnerVolumeSpecName "kube-api-access-sd8k8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:45:07.897533 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:07.897443 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd8k8\" (UniqueName: \"kubernetes.io/projected/6c7dc068-0818-405a-bfaf-81b58455419c-kube-api-access-sd8k8\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:45:08.629343 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:08.629305 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675385-2j6qq" event={"ID":"6c7dc068-0818-405a-bfaf-81b58455419c","Type":"ContainerDied","Data":"cf693a7c77ef4857290ad826fbae464202d7b6e4d080eb3f440b17393c0eb011"} Jun 03 21:45:08.629343 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:08.629337 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675385-2j6qq" Jun 03 21:45:08.629571 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:08.629356 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf693a7c77ef4857290ad826fbae464202d7b6e4d080eb3f440b17393c0eb011" Jun 03 21:45:41.565293 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:41.565258 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:45:42.723340 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:45:42.723301 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:46:01.415690 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:46:01.415659 2574 scope.go:117] "RemoveContainer" containerID="b4b9b3b9a1e8e19227db03753af37d09b5ef380a68144007c211fe04de9b9584" Jun 03 21:47:32.077117 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:47:32.077084 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:47:51.152330 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:47:51.152246 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:47:51.251188 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:47:51.251155 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:47:59.505696 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:47:59.505663 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:48:05.410121 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:48:05.410091 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:48:05.509479 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:48:05.509443 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:48:37.506293 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:48:37.506255 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:48:37.605696 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:48:37.605661 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:01.369837 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:01.369805 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:07.072757 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:07.072721 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:07.135657 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:07.135624 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:07.214703 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:07.214668 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:07.309240 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:07.309211 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:07.438779 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:07.438748 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:07.542087 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:07.542060 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:23.929656 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:23.929572 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:24.045136 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:24.045100 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:24.148105 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:24.148070 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:29.176633 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:29.176597 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:29.939454 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:29.939414 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:30.039499 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:30.039459 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:38.097853 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:38.097821 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:38.203410 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:38.203370 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:38.300659 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:38.300632 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:38.396348 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:38.396266 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:40.477481 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:40.477447 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:54.987833 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:54.987799 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:55.123786 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:55.123751 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:49:55.255226 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:49:55.255143 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:50:00.998268 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:50:00.998231 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:50:01.062882 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:50:01.062849 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:53:37.248000 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:53:37.247966 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:55:15.581987 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:55:15.581933 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:55:25.966673 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:55:25.966595 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:55:26.022888 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:55:26.022856 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 21:57:27.979163 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:27.979074 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb"] Jun 03 21:57:27.979754 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:27.979381 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" podUID="7632d92f-a212-4e31-b1be-e0112158472b" containerName="manager" containerID="cri-o://209c986c5638daa8cc7393964d83bc293adf3a7b358821ab28c9254f43c92b55" gracePeriod=10 Jun 03 21:57:28.456779 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:28.456741 2574 generic.go:356] "Generic (PLEG): container finished" podID="7632d92f-a212-4e31-b1be-e0112158472b" containerID="209c986c5638daa8cc7393964d83bc293adf3a7b358821ab28c9254f43c92b55" exitCode=0 Jun 03 21:57:28.456940 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:28.456810 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" event={"ID":"7632d92f-a212-4e31-b1be-e0112158472b","Type":"ContainerDied","Data":"209c986c5638daa8cc7393964d83bc293adf3a7b358821ab28c9254f43c92b55"} Jun 03 21:57:28.531184 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:28.531160 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" Jun 03 21:57:28.683678 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:28.683645 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7632d92f-a212-4e31-b1be-e0112158472b-extensions-socket-volume\") pod \"7632d92f-a212-4e31-b1be-e0112158472b\" (UID: \"7632d92f-a212-4e31-b1be-e0112158472b\") " Jun 03 21:57:28.683872 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:28.683698 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7qqx\" (UniqueName: \"kubernetes.io/projected/7632d92f-a212-4e31-b1be-e0112158472b-kube-api-access-v7qqx\") pod \"7632d92f-a212-4e31-b1be-e0112158472b\" (UID: \"7632d92f-a212-4e31-b1be-e0112158472b\") " Jun 03 21:57:28.684042 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:28.684021 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7632d92f-a212-4e31-b1be-e0112158472b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7632d92f-a212-4e31-b1be-e0112158472b" (UID: "7632d92f-a212-4e31-b1be-e0112158472b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:57:28.685735 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:28.685711 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7632d92f-a212-4e31-b1be-e0112158472b-kube-api-access-v7qqx" (OuterVolumeSpecName: "kube-api-access-v7qqx") pod "7632d92f-a212-4e31-b1be-e0112158472b" (UID: "7632d92f-a212-4e31-b1be-e0112158472b"). InnerVolumeSpecName "kube-api-access-v7qqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:57:28.784468 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:28.784426 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7632d92f-a212-4e31-b1be-e0112158472b-extensions-socket-volume\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:57:28.784468 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:28.784463 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7qqx\" (UniqueName: \"kubernetes.io/projected/7632d92f-a212-4e31-b1be-e0112158472b-kube-api-access-v7qqx\") on node \"ip-10-0-141-134.ec2.internal\" DevicePath \"\"" Jun 03 21:57:29.463453 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:29.463424 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" Jun 03 21:57:29.463834 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:29.463463 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb" event={"ID":"7632d92f-a212-4e31-b1be-e0112158472b","Type":"ContainerDied","Data":"51ba2a2291536ca7e8d4d5f5eb18bfafa352f2cf0d6e518170b181aad971da8d"} Jun 03 21:57:29.463834 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:29.463526 2574 scope.go:117] "RemoveContainer" containerID="209c986c5638daa8cc7393964d83bc293adf3a7b358821ab28c9254f43c92b55" Jun 03 21:57:29.481203 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:29.481176 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb"] Jun 03 21:57:29.485189 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:29.485166 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x2lpb"] Jun 03 21:57:31.338247 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:57:31.338213 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7632d92f-a212-4e31-b1be-e0112158472b" path="/var/lib/kubelet/pods/7632d92f-a212-4e31-b1be-e0112158472b/volumes" Jun 03 21:58:34.071863 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.071828 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk"] Jun 03 21:58:34.072352 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.072274 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7632d92f-a212-4e31-b1be-e0112158472b" containerName="manager" Jun 03 21:58:34.072352 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.072288 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7632d92f-a212-4e31-b1be-e0112158472b" containerName="manager" Jun 03 21:58:34.072352 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.072315 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c7dc068-0818-405a-bfaf-81b58455419c" containerName="cleanup" Jun 03 21:58:34.072352 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.072321 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c7dc068-0818-405a-bfaf-81b58455419c" containerName="cleanup" Jun 03 21:58:34.072505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.072378 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c7dc068-0818-405a-bfaf-81b58455419c" containerName="cleanup" Jun 03 21:58:34.072505 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.072388 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7632d92f-a212-4e31-b1be-e0112158472b" containerName="manager" Jun 03 21:58:34.075393 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.075376 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk" Jun 03 21:58:34.077725 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.077705 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qfwh4\"" Jun 03 21:58:34.086696 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.086662 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk"] Jun 03 21:58:34.178054 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.178025 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqc7m\" (UniqueName: \"kubernetes.io/projected/875bf80c-88f7-4608-90cc-9e0c74e3df21-kube-api-access-fqc7m\") pod \"kuadrant-operator-controller-manager-86878c769f-q8hrk\" (UID: \"875bf80c-88f7-4608-90cc-9e0c74e3df21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk" Jun 03 21:58:34.178167 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.178103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/875bf80c-88f7-4608-90cc-9e0c74e3df21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q8hrk\" (UID: \"875bf80c-88f7-4608-90cc-9e0c74e3df21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk" Jun 03 21:58:34.279106 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.279077 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqc7m\" (UniqueName: \"kubernetes.io/projected/875bf80c-88f7-4608-90cc-9e0c74e3df21-kube-api-access-fqc7m\") pod \"kuadrant-operator-controller-manager-86878c769f-q8hrk\" (UID: \"875bf80c-88f7-4608-90cc-9e0c74e3df21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk" Jun 03 21:58:34.279209 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.279130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/875bf80c-88f7-4608-90cc-9e0c74e3df21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q8hrk\" (UID: \"875bf80c-88f7-4608-90cc-9e0c74e3df21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk" Jun 03 21:58:34.279531 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.279515 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/875bf80c-88f7-4608-90cc-9e0c74e3df21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q8hrk\" (UID: \"875bf80c-88f7-4608-90cc-9e0c74e3df21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk" Jun 03 21:58:34.287595 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.287570 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqc7m\" (UniqueName: \"kubernetes.io/projected/875bf80c-88f7-4608-90cc-9e0c74e3df21-kube-api-access-fqc7m\") pod \"kuadrant-operator-controller-manager-86878c769f-q8hrk\" (UID: \"875bf80c-88f7-4608-90cc-9e0c74e3df21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk" Jun 03 21:58:34.386993 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.386965 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk" Jun 03 21:58:34.528119 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.528092 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk"] Jun 03 21:58:34.798191 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.798113 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk" event={"ID":"875bf80c-88f7-4608-90cc-9e0c74e3df21","Type":"ContainerStarted","Data":"ea49dc25fd78bdcdd5712fe83fe78edda652b1d65dfad64e645765bb3c8ed3c2"} Jun 03 21:58:34.798341 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.798193 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk" event={"ID":"875bf80c-88f7-4608-90cc-9e0c74e3df21","Type":"ContainerStarted","Data":"5d7ba6f3a4d6e87510a6052efcec8e4a1838395faec9b40d8338f87f83d3c453"} Jun 03 21:58:34.798341 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.798262 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk" Jun 03 21:58:34.819382 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:34.819333 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk" podStartSLOduration=0.819317805 podStartE2EDuration="819.317805ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:58:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:58:34.817966023 +0000 UTC m=+1713.978458915" watchObservedRunningTime="2026-06-03 21:58:34.819317805 +0000 UTC m=+1713.979810770" Jun 03 21:58:45.805873 ip-10-0-141-134 kubenswrapper[2574]: I0603 21:58:45.805839 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8hrk" Jun 03 22:00:21.912481 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:00:21.912441 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 22:01:38.054490 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:01:38.054458 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:20.348668 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:05:20.348629 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:46.934021 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:07:46.933983 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:56.530665 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:07:56.530627 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 22:08:20.800036 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:20.800003 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 22:08:33.861485 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:33.861442 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 22:08:44.914490 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:44.914458 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 22:08:45.754502 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:45.754474 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5cc66d9bff-9tbjh_dab631d0-5bd7-423b-a486-c8c0b32553cd/nginx/0.log" Jun 03 22:08:46.337413 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:46.337386 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675385-2j6qq_6c7dc068-0818-405a-bfaf-81b58455419c/cleanup/0.log" Jun 03 22:08:47.041919 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:47.041888 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f56cf757-jjpnv_5587c2d2-1f99-48cb-a182-8afe8dfa7924/copy-manifests/0.log" Jun 03 22:08:47.048264 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:47.048243 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f56cf757-jjpnv_5587c2d2-1f99-48cb-a182-8afe8dfa7924/manager/0.log" Jun 03 22:08:47.273513 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:47.273464 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-5t7ch_ebd3804a-451b-49e0-8f33-de64478f815b/postgres/0.log" Jun 03 22:08:48.764822 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:48.764794 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cbd28_8be278f6-1e84-4f1c-82ae-e8ecd070b98f/manager/0.log" Jun 03 22:08:48.987071 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:48.987041 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bt5tc_37f988a5-85f4-4501-8180-6bad5bb215ca/registry-server/0.log" Jun 03 22:08:49.106532 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:49.106510 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-q8hrk_875bf80c-88f7-4608-90cc-9e0c74e3df21/manager/0.log" Jun 03 22:08:49.675204 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:49.675173 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kt4b9_ebb2ce15-b04a-4865-9fef-310303316fdd/istio-proxy/0.log" Jun 03 22:08:50.147960 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:50.147919 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ntz5n_13978d02-1df7-4bab-b4bb-1ab7048ab86c/istio-proxy/1.log" Jun 03 22:08:50.404659 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:50.404592 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc9b8464f-bvbd4_c0c695be-005c-4abe-bd89-9c3d7d580144/router/0.log" Jun 03 22:08:51.095760 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:51.095737 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t_95d7794a-4d4b-4eb9-8943-957ccef8d22f/storage-initializer/0.log" Jun 03 22:08:51.102599 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:51.102578 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clkk4t_95d7794a-4d4b-4eb9-8943-957ccef8d22f/main/0.log" Jun 03 22:08:55.437915 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:55.437884 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 22:08:55.506467 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:55.506444 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" limit=1024 Jun 03 22:08:58.388461 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:58.388432 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bcm8v_ef9739dc-ca42-4f19-861f-6450aab361b5/global-pull-secret-syncer/0.log" Jun 03 22:08:58.477361 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:58.477326 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9thtn_d234ba0a-d9b7-4c4c-8198-501b74d44672/konnectivity-agent/0.log" Jun 03 22:08:58.606069 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:08:58.606039 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-134.ec2.internal_94f58f1173546d0833b3c3c2dbbc5151/haproxy/0.log" Jun 03 22:09:03.596382 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:03.596347 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cbd28_8be278f6-1e84-4f1c-82ae-e8ecd070b98f/manager/0.log" Jun 03 22:09:03.656410 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:03.656383 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bt5tc_37f988a5-85f4-4501-8180-6bad5bb215ca/registry-server/0.log" Jun 03 22:09:03.715218 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:03.715187 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-q8hrk_875bf80c-88f7-4608-90cc-9e0c74e3df21/manager/0.log" Jun 03 22:09:05.397529 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.397481 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_47ed2b92-cd7f-4203-aa2b-c38daf13b620/alertmanager/0.log" Jun 03 22:09:05.417331 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.417291 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_47ed2b92-cd7f-4203-aa2b-c38daf13b620/config-reloader/0.log" Jun 03 22:09:05.436876 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.436859 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_47ed2b92-cd7f-4203-aa2b-c38daf13b620/kube-rbac-proxy-web/0.log" Jun 03 22:09:05.453448 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.453424 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_47ed2b92-cd7f-4203-aa2b-c38daf13b620/kube-rbac-proxy/0.log" Jun 03 22:09:05.473856 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.473837 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_47ed2b92-cd7f-4203-aa2b-c38daf13b620/kube-rbac-proxy-metric/0.log" Jun 03 22:09:05.493480 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.493459 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_47ed2b92-cd7f-4203-aa2b-c38daf13b620/prom-label-proxy/0.log" Jun 03 22:09:05.510745 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.510727 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_47ed2b92-cd7f-4203-aa2b-c38daf13b620/init-config-reloader/0.log" Jun 03 22:09:05.584071 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.584052 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-2skcf_b447e02b-3c42-464a-a5df-6dbad584f70e/kube-state-metrics/0.log" Jun 03 22:09:05.597696 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.597656 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-2skcf_b447e02b-3c42-464a-a5df-6dbad584f70e/kube-rbac-proxy-main/0.log" Jun 03 22:09:05.615443 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.615413 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-2skcf_b447e02b-3c42-464a-a5df-6dbad584f70e/kube-rbac-proxy-self/0.log" Jun 03 22:09:05.844849 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.844828 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rtn4n_c83fa458-8d6d-41d7-96fa-7d52e37678f2/node-exporter/0.log" Jun 03 22:09:05.862741 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.862721 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rtn4n_c83fa458-8d6d-41d7-96fa-7d52e37678f2/kube-rbac-proxy/0.log" Jun 03 22:09:05.890076 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.890057 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rtn4n_c83fa458-8d6d-41d7-96fa-7d52e37678f2/init-textfile/0.log" Jun 03 22:09:05.912382 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.912361 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-bf7gx_2aaa4235-a810-4098-b4ce-56d0be84e3b5/kube-rbac-proxy-main/0.log" Jun 03 22:09:05.928391 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.928374 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-bf7gx_2aaa4235-a810-4098-b4ce-56d0be84e3b5/kube-rbac-proxy-self/0.log" Jun 03 22:09:05.944874 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:05.944856 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-bf7gx_2aaa4235-a810-4098-b4ce-56d0be84e3b5/openshift-state-metrics/0.log" Jun 03 22:09:06.286245 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:06.286163 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584b745c5d-q2b6j_201e86a8-9f9f-4f17-97c7-9babdfe2de77/thanos-query/0.log" Jun 03 22:09:06.304465 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:06.304392 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584b745c5d-q2b6j_201e86a8-9f9f-4f17-97c7-9babdfe2de77/kube-rbac-proxy-web/0.log" Jun 03 22:09:06.324641 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:06.324587 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584b745c5d-q2b6j_201e86a8-9f9f-4f17-97c7-9babdfe2de77/kube-rbac-proxy/0.log" Jun 03 22:09:06.341850 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:06.341827 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584b745c5d-q2b6j_201e86a8-9f9f-4f17-97c7-9babdfe2de77/prom-label-proxy/0.log" Jun 03 22:09:06.359065 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:06.359049 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584b745c5d-q2b6j_201e86a8-9f9f-4f17-97c7-9babdfe2de77/kube-rbac-proxy-rules/0.log" Jun 03 22:09:06.377520 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:06.377492 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584b745c5d-q2b6j_201e86a8-9f9f-4f17-97c7-9babdfe2de77/kube-rbac-proxy-metrics/0.log" Jun 03 22:09:08.031635 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:08.031608 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-68d6b54856-njxb4_b318bdcc-3c11-4345-be3a-1deff77e2627/networking-console-plugin/0.log" Jun 03 22:09:09.249465 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:09.249436 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86b6cc475d-h22pl_3550094b-2fbb-4c38-8aa4-8b766fdcab92/console/0.log" Jun 03 22:09:09.276324 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:09.276298 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-56b467f5ff-x84jn_41898007-584b-4811-8c40-7d71206ba8bc/download-server/0.log" Jun 03 22:09:10.003139 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:10.003106 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-m4jd9_7905342a-e33d-4b1a-a037-e3a37b0c0b08/volume-data-source-validator/0.log" Jun 03 22:09:11.005836 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.005806 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n"] Jun 03 22:09:11.009600 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.009580 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.012156 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.012134 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8zmnb\"/\"kube-root-ca.crt\"" Jun 03 22:09:11.012256 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.012241 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8zmnb\"/\"default-dockercfg-85wb2\"" Jun 03 22:09:11.012327 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.012285 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8zmnb\"/\"openshift-service-ca.crt\"" Jun 03 22:09:11.017510 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.017489 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n"] Jun 03 22:09:11.155234 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.155200 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ms6h\" (UniqueName: \"kubernetes.io/projected/b12c2d91-884b-47f3-9279-f75c8c8f3df0-kube-api-access-8ms6h\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.155385 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.155238 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b12c2d91-884b-47f3-9279-f75c8c8f3df0-podres\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.155385 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.155304 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b12c2d91-884b-47f3-9279-f75c8c8f3df0-lib-modules\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.155475 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.155387 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b12c2d91-884b-47f3-9279-f75c8c8f3df0-proc\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.155475 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.155436 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b12c2d91-884b-47f3-9279-f75c8c8f3df0-sys\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.229524 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.229504 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8dcpk_50dd4927-55d7-4ac2-b9fc-34cf27a08b7f/dns/0.log" Jun 03 22:09:11.248674 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.248655 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8dcpk_50dd4927-55d7-4ac2-b9fc-34cf27a08b7f/kube-rbac-proxy/0.log" Jun 03 22:09:11.256573 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.256502 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b12c2d91-884b-47f3-9279-f75c8c8f3df0-proc\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.256573 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.256565 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b12c2d91-884b-47f3-9279-f75c8c8f3df0-sys\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.256736 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.256597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ms6h\" (UniqueName: \"kubernetes.io/projected/b12c2d91-884b-47f3-9279-f75c8c8f3df0-kube-api-access-8ms6h\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.256736 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.256617 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b12c2d91-884b-47f3-9279-f75c8c8f3df0-proc\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.256736 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.256619 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b12c2d91-884b-47f3-9279-f75c8c8f3df0-podres\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.256736 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.256679 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b12c2d91-884b-47f3-9279-f75c8c8f3df0-sys\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.256736 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.256697 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b12c2d91-884b-47f3-9279-f75c8c8f3df0-lib-modules\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.256736 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.256721 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b12c2d91-884b-47f3-9279-f75c8c8f3df0-podres\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.256938 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.256807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b12c2d91-884b-47f3-9279-f75c8c8f3df0-lib-modules\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.263790 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.263766 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ms6h\" (UniqueName: \"kubernetes.io/projected/b12c2d91-884b-47f3-9279-f75c8c8f3df0-kube-api-access-8ms6h\") pod \"perf-node-gather-daemonset-pwl8n\" (UID: \"b12c2d91-884b-47f3-9279-f75c8c8f3df0\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.320713 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.320688 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:11.387985 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.387939 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qjn6_8084eecf-3233-41e7-a360-b2ad82fc8899/dns-node-resolver/0.log" Jun 03 22:09:11.659790 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.659759 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n"] Jun 03 22:09:11.660876 ip-10-0-141-134 kubenswrapper[2574]: W0603 22:09:11.660850 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb12c2d91_884b_47f3_9279_f75c8c8f3df0.slice/crio-bcb9a5603459eaf317c605c1d693a5a2b3d7365a5cb30ef3c35bd43203a89666 WatchSource:0}: Error finding container bcb9a5603459eaf317c605c1d693a5a2b3d7365a5cb30ef3c35bd43203a89666: Status 404 returned error can't find the container with id bcb9a5603459eaf317c605c1d693a5a2b3d7365a5cb30ef3c35bd43203a89666 Jun 03 22:09:11.970836 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:11.970771 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2q9p5_9ff19efc-23e1-46a6-bb9d-0a7c58155f5d/node-ca/0.log" Jun 03 22:09:12.074901 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:12.074868 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" event={"ID":"b12c2d91-884b-47f3-9279-f75c8c8f3df0","Type":"ContainerStarted","Data":"5897b108280bf5bf2b02fa7a918e023fb12535b2642c27605adb4b8fecbf5f61"} Jun 03 22:09:12.075253 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:12.075007 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:12.075253 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:12.075043 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" event={"ID":"b12c2d91-884b-47f3-9279-f75c8c8f3df0","Type":"ContainerStarted","Data":"bcb9a5603459eaf317c605c1d693a5a2b3d7365a5cb30ef3c35bd43203a89666"} Jun 03 22:09:12.091773 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:12.091727 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" podStartSLOduration=2.091714299 podStartE2EDuration="2.091714299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:09:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:09:12.090253988 +0000 UTC m=+2351.250746900" watchObservedRunningTime="2026-06-03 22:09:12.091714299 +0000 UTC m=+2351.252207190" Jun 03 22:09:12.931596 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:12.931568 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kt4b9_ebb2ce15-b04a-4865-9fef-310303316fdd/istio-proxy/0.log" Jun 03 22:09:13.145537 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:13.145508 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ntz5n_13978d02-1df7-4bab-b4bb-1ab7048ab86c/istio-proxy/0.log" Jun 03 22:09:13.175558 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:13.175534 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ntz5n_13978d02-1df7-4bab-b4bb-1ab7048ab86c/istio-proxy/1.log" Jun 03 22:09:13.294496 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:13.294427 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc9b8464f-bvbd4_c0c695be-005c-4abe-bd89-9c3d7d580144/router/0.log" Jun 03 22:09:13.891865 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:13.891837 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jsbh9_75d06df5-a8a1-4f2c-8564-7c46da054383/serve-healthcheck-canary/0.log" Jun 03 22:09:14.440617 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:14.440585 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-fzcfw_6d2b3d46-d831-4aa4-8828-8f630a2dcd22/insights-operator/0.log" Jun 03 22:09:14.442682 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:14.442662 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-fzcfw_6d2b3d46-d831-4aa4-8828-8f630a2dcd22/insights-operator/1.log" Jun 03 22:09:14.592329 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:14.592300 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vtbwv_4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d/kube-rbac-proxy/0.log" Jun 03 22:09:14.613404 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:14.613381 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vtbwv_4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d/exporter/0.log" Jun 03 22:09:14.632611 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:14.632587 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vtbwv_4ccc2af5-33d2-406c-ab3e-8bf9b687cd0d/extractor/0.log" Jun 03 22:09:16.830827 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:16.830802 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5cc66d9bff-9tbjh_dab631d0-5bd7-423b-a486-c8c0b32553cd/nginx/0.log" Jun 03 22:09:17.064863 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:17.064834 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675385-2j6qq_6c7dc068-0818-405a-bfaf-81b58455419c/cleanup/0.log" Jun 03 22:09:17.457125 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:17.457098 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f56cf757-jjpnv_5587c2d2-1f99-48cb-a182-8afe8dfa7924/manager/0.log" Jun 03 22:09:17.474612 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:17.474589 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f56cf757-jjpnv_5587c2d2-1f99-48cb-a182-8afe8dfa7924/copy-manifests/0.log" Jun 03 22:09:17.540455 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:17.540436 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-5t7ch_ebd3804a-451b-49e0-8f33-de64478f815b/postgres/0.log" Jun 03 22:09:18.090262 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:18.090234 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-pwl8n" Jun 03 22:09:19.009879 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:19.009850 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66f8bf9848-r549k_50b48046-366d-455d-bc8a-1c29c9a6a95a/manager/0.log" Jun 03 22:09:23.455444 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:23.455396 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kt4b9_ebb2ce15-b04a-4865-9fef-310303316fdd/istio-proxy/0.log" Jun 03 22:09:23.648480 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:23.648449 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ntz5n_13978d02-1df7-4bab-b4bb-1ab7048ab86c/istio-proxy/0.log" Jun 03 22:09:23.683860 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:23.683835 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ntz5n_13978d02-1df7-4bab-b4bb-1ab7048ab86c/istio-proxy/1.log" Jun 03 22:09:23.792816 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:23.792745 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc9b8464f-bvbd4_c0c695be-005c-4abe-bd89-9c3d7d580144/router/0.log" Jun 03 22:09:24.929756 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:24.929722 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kt4b9_ebb2ce15-b04a-4865-9fef-310303316fdd/istio-proxy/0.log" Jun 03 22:09:25.109376 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:25.109329 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5_4061535b-e4c4-4966-ac4b-a2e841d5ee2f/kube-storage-version-migrator-operator/1.log" Jun 03 22:09:25.110195 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:25.110171 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-5k4n5_4061535b-e4c4-4966-ac4b-a2e841d5ee2f/kube-storage-version-migrator-operator/0.log" Jun 03 22:09:25.157342 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:25.157315 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ntz5n_13978d02-1df7-4bab-b4bb-1ab7048ab86c/istio-proxy/0.log" Jun 03 22:09:25.188969 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:25.188882 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ntz5n_13978d02-1df7-4bab-b4bb-1ab7048ab86c/istio-proxy/1.log" Jun 03 22:09:25.297819 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:25.297794 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc9b8464f-bvbd4_c0c695be-005c-4abe-bd89-9c3d7d580144/router/0.log" Jun 03 22:09:26.256446 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:26.256414 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mh6hm_b2536758-10d6-4ebb-8f50-09038d91191b/kube-multus-additional-cni-plugins/0.log" Jun 03 22:09:26.273320 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:26.273297 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mh6hm_b2536758-10d6-4ebb-8f50-09038d91191b/egress-router-binary-copy/0.log" Jun 03 22:09:26.289712 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:26.289694 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mh6hm_b2536758-10d6-4ebb-8f50-09038d91191b/cni-plugins/0.log" Jun 03 22:09:26.306120 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:26.306098 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mh6hm_b2536758-10d6-4ebb-8f50-09038d91191b/bond-cni-plugin/0.log" Jun 03 22:09:26.328272 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:26.328251 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mh6hm_b2536758-10d6-4ebb-8f50-09038d91191b/routeoverride-cni/0.log" Jun 03 22:09:26.345818 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:26.345804 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mh6hm_b2536758-10d6-4ebb-8f50-09038d91191b/whereabouts-cni-bincopy/0.log" Jun 03 22:09:26.362529 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:26.362508 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mh6hm_b2536758-10d6-4ebb-8f50-09038d91191b/whereabouts-cni/0.log" Jun 03 22:09:26.692389 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:26.692366 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dq8xx_aec4f361-86f0-460d-b894-8e60ac0e0c2d/kube-multus/0.log" Jun 03 22:09:26.785168 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:26.785142 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rcbhk_5de8b995-a02a-4656-9d2e-ac20d31fb96c/network-metrics-daemon/0.log" Jun 03 22:09:26.802053 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:26.802023 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rcbhk_5de8b995-a02a-4656-9d2e-ac20d31fb96c/kube-rbac-proxy/0.log" Jun 03 22:09:26.926995 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:26.926967 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kt4b9_ebb2ce15-b04a-4865-9fef-310303316fdd/istio-proxy/0.log" Jun 03 22:09:27.130923 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:27.130890 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ntz5n_13978d02-1df7-4bab-b4bb-1ab7048ab86c/istio-proxy/0.log" Jun 03 22:09:27.169985 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:27.169960 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ntz5n_13978d02-1df7-4bab-b4bb-1ab7048ab86c/istio-proxy/1.log" Jun 03 22:09:27.280007 ip-10-0-141-134 kubenswrapper[2574]: I0603 22:09:27.279934 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc9b8464f-bvbd4_c0c695be-005c-4abe-bd89-9c3d7d580144/router/0.log"