Jun 11 22:49:42.902220 ip-10-0-128-179 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 22:49:42.902232 ip-10-0-128-179 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 22:49:42.902240 ip-10-0-128-179 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 22:49:42.902469 ip-10-0-128-179 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 22:49:53.151538 ip-10-0-128-179 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 22:49:53.151555 ip-10-0-128-179 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a12c89b6f84b40c2b733a9ca2e304c4c -- Jun 11 22:52:01.987936 ip-10-0-128-179 systemd[1]: Starting Kubernetes Kubelet... Jun 11 22:52:02.439221 ip-10-0-128-179 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 22:52:02.439221 ip-10-0-128-179 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 22:52:02.439221 ip-10-0-128-179 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 22:52:02.439221 ip-10-0-128-179 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 22:52:02.439221 ip-10-0-128-179 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 22:52:02.440255 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.440167 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 22:52:02.445172 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445155 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 22:52:02.445172 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445172 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445176 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445179 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445182 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445185 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445188 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445191 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445193 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445196 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445199 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445201 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445204 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445213 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445216 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445219 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445221 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445224 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445226 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445229 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445231 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 22:52:02.445242 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445234 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445236 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445239 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445241 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445244 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445247 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445250 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445252 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445255 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445260 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445263 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445266 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445269 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445272 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445275 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445277 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445280 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445283 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445286 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445288 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 22:52:02.445892 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445291 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445293 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445296 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445299 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445301 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445304 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445307 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445309 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445312 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445314 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445318 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445328 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445331 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445334 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445338 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445340 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445343 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445346 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445348 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 22:52:02.446643 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445351 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445353 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445356 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445358 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445361 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445364 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445366 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445369 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445371 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445373 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445377 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445379 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445382 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445385 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445389 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445392 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445395 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445397 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445400 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 22:52:02.447101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445405 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445408 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445410 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445413 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445415 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445418 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445421 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445423 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445427 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445429 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445432 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445435 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445437 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445440 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445442 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445445 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445447 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445450 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445452 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 22:52:02.447656 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.445455 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 22:52:02.448329 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448312 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 22:52:02.448363 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448331 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 22:52:02.448363 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448337 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 22:52:02.448363 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448340 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 22:52:02.448363 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448343 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 22:52:02.448363 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448346 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 22:52:02.448363 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448348 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 22:52:02.448363 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448351 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 22:52:02.448363 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448353 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 22:52:02.448363 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448356 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 22:52:02.448363 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448358 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 22:52:02.448363 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448361 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 22:52:02.448363 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448363 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 22:52:02.448363 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448366 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 22:52:02.448363 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448369 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448371 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448374 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448376 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448379 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448381 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448384 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448386 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448389 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448391 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448393 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448396 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448398 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448400 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448403 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448406 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448411 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448414 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448417 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 22:52:02.448736 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448419 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448421 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448424 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448426 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448429 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448431 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448433 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448436 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448438 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448441 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448443 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448445 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448448 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448450 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448452 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448456 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448459 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448462 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448465 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 22:52:02.449193 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448468 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448470 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448473 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448475 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448479 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448482 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448485 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448489 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448491 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448494 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448496 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448499 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448502 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448504 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448507 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448509 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448512 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448514 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448517 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448519 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 22:52:02.449683 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448521 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448524 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448526 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448529 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448532 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448535 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448537 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448540 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448543 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448545 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448548 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448551 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448554 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448556 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448559 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448562 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448566 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448569 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448572 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448574 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 22:52:02.450191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448577 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448579 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448582 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448602 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448607 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448611 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.448614 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449012 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449016 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449019 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449022 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449024 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449027 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449029 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449032 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449034 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449037 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449040 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449042 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449045 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 22:52:02.450713 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449048 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449051 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449053 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449056 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449061 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449064 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449068 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449070 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449073 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449076 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449079 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449081 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449084 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449086 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449089 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449092 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449094 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449096 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449099 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 22:52:02.451191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449101 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449104 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449107 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449109 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449111 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449114 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449116 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449119 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449121 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449124 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449127 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449129 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449132 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449135 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449137 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449140 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449142 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449145 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449149 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 22:52:02.451657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449152 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449155 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449158 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449161 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449163 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449166 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449169 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449171 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449173 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449176 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449178 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449181 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449183 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449185 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449188 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449190 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449193 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449195 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449198 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449201 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 22:52:02.452114 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449203 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449206 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449208 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449211 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449213 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449217 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449220 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449222 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449225 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449227 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449230 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449233 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449236 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449238 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449240 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449242 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449245 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449247 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449250 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449252 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 22:52:02.452601 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449254 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449256 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449259 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449261 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449264 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449266 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449269 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449272 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449346 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449353 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449360 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449364 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449368 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449371 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449378 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449382 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449385 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449389 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449392 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449395 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449398 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449401 2578 flags.go:64] FLAG: --cgroup-root="" Jun 11 22:52:02.453122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449403 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449406 2578 flags.go:64] FLAG: --client-ca-file="" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449410 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449413 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449416 2578 flags.go:64] FLAG: --cluster-domain="" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449419 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449422 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449425 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449428 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449432 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449434 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449437 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449440 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449443 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449446 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449449 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449452 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449454 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449458 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449461 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449463 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449466 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449469 2578 flags.go:64] FLAG: --enable-server="true" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449472 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449478 2578 flags.go:64] FLAG: --event-burst="100" Jun 11 22:52:02.453678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449481 2578 flags.go:64] FLAG: --event-qps="50" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449484 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449487 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449490 2578 flags.go:64] FLAG: --eviction-hard="" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449493 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449496 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449499 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449502 2578 flags.go:64] FLAG: --eviction-soft="" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449505 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449508 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449511 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449514 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449517 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449520 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449523 2578 flags.go:64] FLAG: --feature-gates="" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449526 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449529 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449532 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449534 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449537 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449540 2578 flags.go:64] FLAG: --help="false" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449543 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449546 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449548 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 22:52:02.454280 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449551 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449554 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449557 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449560 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449562 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449565 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449568 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449572 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449575 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449578 2578 flags.go:64] FLAG: --kube-reserved="" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449599 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449602 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449605 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449608 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449611 2578 flags.go:64] FLAG: --lock-file="" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449614 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449617 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449620 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449626 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449629 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449632 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449635 2578 flags.go:64] FLAG: --logging-format="text" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449637 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449640 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 22:52:02.454911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449643 2578 flags.go:64] FLAG: --manifest-url="" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449645 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449650 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449652 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449656 2578 flags.go:64] FLAG: --max-pods="110" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449659 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449662 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449665 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449668 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449670 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449673 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449676 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449684 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449687 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449690 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449694 2578 flags.go:64] FLAG: --pod-cidr="" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449697 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449702 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449707 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449710 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449713 2578 flags.go:64] FLAG: --port="10250" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449715 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449718 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07d9a0419087afd36" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449721 2578 flags.go:64] FLAG: --qos-reserved="" Jun 11 22:52:02.455497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449724 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449727 2578 flags.go:64] FLAG: --register-node="true" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449730 2578 flags.go:64] FLAG: --register-with-taints="" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449740 2578 flags.go:64] FLAG: --registry-burst="10" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449743 2578 flags.go:64] FLAG: --registry-qps="5" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449746 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449749 2578 flags.go:64] FLAG: --reserved-memory="" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449752 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449755 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449758 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449761 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449763 2578 flags.go:64] FLAG: --runonce="false" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449766 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449769 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449772 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449774 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449777 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449780 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449783 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449786 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449788 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449791 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449794 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449797 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449801 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 22:52:02.456089 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449804 2578 flags.go:64] FLAG: --system-cgroups="" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449808 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449813 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449815 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449826 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449832 2578 flags.go:64] FLAG: --tls-min-version="" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449835 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449837 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449841 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449844 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449847 2578 flags.go:64] FLAG: --v="2" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449851 2578 flags.go:64] FLAG: --version="false" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449855 2578 flags.go:64] FLAG: --vmodule="" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449859 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.449862 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449978 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449982 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449985 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449987 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449990 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449993 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449995 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 22:52:02.456765 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.449999 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450003 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450006 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450009 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450011 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450014 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450016 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450019 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450021 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450026 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450028 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450033 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450035 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450038 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450040 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450043 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450045 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450048 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450050 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450052 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 22:52:02.457320 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450055 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450057 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450059 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450063 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450065 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450068 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450070 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450073 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450075 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450078 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450082 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450085 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450088 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450091 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450094 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450097 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450099 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450102 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450104 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 22:52:02.457833 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450107 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450109 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450113 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450116 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450120 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450122 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450126 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450130 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450133 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450136 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450139 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450141 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450144 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450146 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450149 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450151 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450154 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450157 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450159 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450162 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 22:52:02.458299 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450165 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450167 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450169 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450172 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450174 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450177 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450179 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450181 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450184 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450186 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450189 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450191 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450194 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450196 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450199 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450202 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450206 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450208 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450211 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450214 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 22:52:02.458805 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450216 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450219 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450221 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450223 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450226 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450228 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450230 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450233 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450235 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450237 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450241 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450243 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.450245 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.451018 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.458219 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 22:52:02.459291 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.458329 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.459239 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.459248 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459313 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459321 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459325 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459328 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459331 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459334 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459337 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459340 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459343 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459346 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459348 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459351 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459354 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459356 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459359 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459361 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 22:52:02.459682 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459364 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459367 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459369 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459372 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459374 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459377 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459379 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459382 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459385 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459390 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459393 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459395 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459398 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459401 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459403 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459406 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459409 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459412 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459414 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459417 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 22:52:02.460151 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459419 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459422 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459424 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459427 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459430 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459432 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459435 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459437 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459439 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459442 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459444 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459447 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459449 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459452 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459454 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459456 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459459 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459461 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459464 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 22:52:02.460657 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459466 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459469 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459471 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459474 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459477 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459479 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459481 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459484 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459487 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459490 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459492 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459495 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459497 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459499 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459502 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459504 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459507 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459509 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459511 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459514 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 22:52:02.461116 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459516 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459519 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459521 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459524 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459526 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459529 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459531 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459535 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459539 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459542 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459544 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459547 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459550 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459553 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459555 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459558 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459561 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459564 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459567 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 22:52:02.461694 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459569 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459573 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459575 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459578 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459580 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.459600 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459717 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459722 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459725 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459728 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459731 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459733 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459736 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459739 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459741 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 22:52:02.462163 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459744 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459747 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459750 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459752 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459755 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459757 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459760 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459762 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459764 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459767 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459769 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459771 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459774 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459776 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459779 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459781 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459785 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459789 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459791 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459794 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 22:52:02.462558 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459797 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459800 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459803 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459806 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459809 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459812 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459815 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459818 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459820 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459823 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459826 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459828 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459831 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459833 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459836 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459838 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459840 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459843 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459845 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459847 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 22:52:02.463101 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459850 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459852 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459854 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459857 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459859 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459862 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459865 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459867 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459870 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459873 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459875 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459878 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459881 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459883 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459886 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459888 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459891 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459893 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459895 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 22:52:02.463576 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459898 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459901 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459903 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459906 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459908 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459911 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459913 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459915 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459918 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459920 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459924 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459927 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459930 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459933 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459935 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459938 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459940 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459942 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459945 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459948 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 22:52:02.464051 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459950 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 22:52:02.464526 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459953 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 22:52:02.464526 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459955 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 22:52:02.464526 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459958 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 22:52:02.464526 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459960 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 22:52:02.464526 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459963 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 22:52:02.464526 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459965 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 22:52:02.464526 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459968 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 22:52:02.464526 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459971 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 22:52:02.464526 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459973 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 22:52:02.464526 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:02.459975 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 22:52:02.464526 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.459980 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 22:52:02.464526 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.460089 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 22:52:02.464526 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.462423 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 22:52:02.464526 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.463940 2578 server.go:1019] "Starting client certificate rotation" Jun 11 22:52:02.464892 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.464041 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 22:52:02.464892 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.464081 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 22:52:02.466697 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.466683 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 22:52:02.469569 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.467860 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 22:52:02.481387 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.481368 2578 log.go:25] "Validated CRI v1 runtime API" Jun 11 22:52:02.484780 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.484763 2578 log.go:25] "Validated CRI v1 image API" Jun 11 22:52:02.485466 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.485452 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 22:52:02.488127 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.488108 2578 fs.go:135] Filesystem UUIDs: map[6f0e4e9c-242c-4c7e-afda-1836998bc554:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 87c66562-2eec-4670-88ec-621ae13cc9c3:/dev/nvme0n1p3] Jun 11 22:52:02.488176 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.488127 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 22:52:02.494878 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.494758 2578 manager.go:216] Machine: {Timestamp:2026-06-11 22:52:02.492618133 +0000 UTC m=+0.375940955 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110972 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25bf36788a1953cef20e047a45df4d SystemUUID:ec25bf36-788a-1953-cef2-0e047a45df4d BootID:a12c89b6-f84b-40c2-b733-a9ca2e304c4c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:34:c6:a9:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:34:c6:a9:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:7e:89:c4:4d:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 22:52:02.494878 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.494873 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 22:52:02.495024 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.495005 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 22:52:02.498975 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.498949 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 22:52:02.499125 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.498979 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-179.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 22:52:02.500353 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.500342 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 22:52:02.500395 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.500356 2578 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 22:52:02.500395 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.500364 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 22:52:02.500395 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.500378 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 22:52:02.501987 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.501975 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 22:52:02.506398 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.506385 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 11 22:52:02.506515 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.506507 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 22:52:02.507309 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.507300 2578 kubelet.go:486] "Attempting to sync node with API server" Jun 11 22:52:02.507349 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.507313 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 22:52:02.507349 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.507328 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 22:52:02.507349 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.507337 2578 kubelet.go:398] "Adding apiserver pod source" Jun 11 22:52:02.507349 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.507346 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 22:52:02.507708 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.507696 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 22:52:02.507761 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.507715 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 22:52:02.510377 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.510351 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 22:52:02.512034 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.512019 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 22:52:02.512101 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.512050 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 22:52:02.512210 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.512200 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 22:52:02.512241 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.512216 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 22:52:02.512241 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.512222 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 22:52:02.512241 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.512227 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 22:52:02.512241 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.512236 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 22:52:02.512349 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.512244 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 22:52:02.512867 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.512857 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 22:52:02.512867 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.512868 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 22:52:02.512931 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.512875 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 22:52:02.512931 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.512881 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 22:52:02.512931 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.512891 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 22:52:02.512931 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.512899 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 22:52:02.514175 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.514158 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 22:52:02.514727 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.514716 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 22:52:02.514781 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.514728 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 22:52:02.517982 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.517966 2578 server.go:1268] "Started kubelet" Jun 11 22:52:02.518075 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.518046 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 22:52:02.518938 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.518882 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 22:52:02.519036 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.518985 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 22:52:02.519061 ip-10-0-128-179 systemd[1]: Started Kubernetes Kubelet. Jun 11 22:52:02.523838 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.523722 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 22:52:02.524090 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.524063 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 22:52:02.524205 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.524175 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-179.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 22:52:02.525078 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.525048 2578 server.go:310] "Adding debug handlers to kubelet server" Jun 11 22:52:02.525485 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.525463 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-179.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 22:52:02.526267 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.526224 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 22:52:02.529396 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.527491 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-179.ec2.internal.18b828a08519463d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-179.ec2.internal,UID:ip-10-0-128-179.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-179.ec2.internal,},FirstTimestamp:2026-06-11 22:52:02.517935677 +0000 UTC m=+0.401258500,LastTimestamp:2026-06-11 22:52:02.517935677 +0000 UTC m=+0.401258500,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-179.ec2.internal,}" Jun 11 22:52:02.530350 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.530335 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 22:52:02.530408 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.530351 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 22:52:02.530752 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.530474 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-179.ec2.internal\" not found" Jun 11 22:52:02.531063 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.531038 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 22:52:02.531150 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.531089 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 22:52:02.531150 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.531103 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 22:52:02.531266 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.531245 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 11 22:52:02.531266 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.531263 2578 reconciler.go:29] "Reconciler: start to sync state" Jun 11 22:52:02.531541 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.531473 2578 factory.go:55] Registering systemd factory Jun 11 22:52:02.531541 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.531514 2578 factory.go:223] Registration of the systemd container factory successfully Jun 11 22:52:02.531783 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.531770 2578 factory.go:153] Registering CRI-O factory Jun 11 22:52:02.531833 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.531786 2578 factory.go:223] Registration of the crio container factory successfully Jun 11 22:52:02.531833 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.531831 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 22:52:02.531916 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.531860 2578 factory.go:103] Registering Raw factory Jun 11 22:52:02.531916 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.531879 2578 manager.go:1196] Started watching for new ooms in manager Jun 11 22:52:02.532296 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.532283 2578 manager.go:349] Starting recovery of all containers Jun 11 22:52:02.542047 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.542024 2578 manager.go:354] Recovery completed Jun 11 22:52:02.542336 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.542312 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-179.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 22:52:02.542336 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.542306 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 22:52:02.546107 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.546093 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 22:52:02.547919 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.547895 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasSufficientMemory" Jun 11 22:52:02.547983 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.547934 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 22:52:02.547983 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.547944 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasSufficientPID" Jun 11 22:52:02.548429 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.548414 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 22:52:02.548429 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.548428 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 22:52:02.548547 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.548431 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 22:52:02.548547 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.548446 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 11 22:52:02.549092 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.549079 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasSufficientMemory" Jun 11 22:52:02.549144 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.549102 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 22:52:02.549144 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.549112 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasSufficientPID" Jun 11 22:52:02.550686 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.550674 2578 policy_none.go:49] "None policy: Start" Jun 11 22:52:02.550729 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.550690 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 22:52:02.550729 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.550701 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 22:52:02.552355 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.552345 2578 policy_none.go:47] "Start" Jun 11 22:52:02.557188 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.557119 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-179.ec2.internal.18b828a086e2ca19 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-179.ec2.internal,UID:ip-10-0-128-179.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-179.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-179.ec2.internal,},FirstTimestamp:2026-06-11 22:52:02.547919385 +0000 UTC m=+0.431242207,LastTimestamp:2026-06-11 22:52:02.547919385 +0000 UTC m=+0.431242207,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-179.ec2.internal,}" Jun 11 22:52:02.568744 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.568669 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-179.ec2.internal.18b828a086e3179d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-179.ec2.internal,UID:ip-10-0-128-179.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-179.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-179.ec2.internal,},FirstTimestamp:2026-06-11 22:52:02.547939229 +0000 UTC m=+0.431262052,LastTimestamp:2026-06-11 22:52:02.547939229 +0000 UTC m=+0.431262052,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-179.ec2.internal,}" Jun 11 22:52:02.571429 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.571410 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pjvp9" Jun 11 22:52:02.579038 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.578965 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-179.ec2.internal.18b828a086e33a4d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-179.ec2.internal,UID:ip-10-0-128-179.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-179.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-179.ec2.internal,},FirstTimestamp:2026-06-11 22:52:02.547948109 +0000 UTC m=+0.431270932,LastTimestamp:2026-06-11 22:52:02.547948109 +0000 UTC m=+0.431270932,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-179.ec2.internal,}" Jun 11 22:52:02.579720 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.579702 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pjvp9" Jun 11 22:52:02.585252 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.585235 2578 manager.go:337] "Starting Device Plugin manager" Jun 11 22:52:02.585362 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.585267 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 22:52:02.585362 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.585277 2578 server.go:87] "Starting device plugin registration server" Jun 11 22:52:02.585516 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.585502 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 22:52:02.585646 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.585516 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 22:52:02.585703 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.585690 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 22:52:02.585788 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.585776 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 22:52:02.585788 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.585787 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 22:52:02.587199 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.587170 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 22:52:02.587278 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.587237 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-179.ec2.internal\" not found" Jun 11 22:52:02.603467 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.603441 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 22:52:02.615925 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.604779 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 22:52:02.615925 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.604816 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 22:52:02.615925 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.604837 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 22:52:02.615925 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.604927 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 22:52:02.615925 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.607914 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 22:52:02.685868 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.685824 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 22:52:02.686861 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.686846 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasSufficientMemory" Jun 11 22:52:02.686928 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.686876 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 22:52:02.686928 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.686887 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasSufficientPID" Jun 11 22:52:02.686928 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.686917 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.696290 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.696241 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.696290 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.696263 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-179.ec2.internal\": node \"ip-10-0-128-179.ec2.internal\" not found" Jun 11 22:52:02.705620 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.705598 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-179.ec2.internal"] Jun 11 22:52:02.705700 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.705664 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 22:52:02.706518 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.706503 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasSufficientMemory" Jun 11 22:52:02.706628 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.706533 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 22:52:02.706628 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.706548 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasSufficientPID" Jun 11 22:52:02.709071 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.709058 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 22:52:02.709202 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.709188 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.709253 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.709215 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 22:52:02.709802 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.709779 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasSufficientMemory" Jun 11 22:52:02.709904 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.709809 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasSufficientMemory" Jun 11 22:52:02.709904 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.709822 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 22:52:02.709904 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.709837 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 22:52:02.709904 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.709851 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasSufficientPID" Jun 11 22:52:02.709904 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.709837 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasSufficientPID" Jun 11 22:52:02.712007 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.711991 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.712100 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.712017 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 22:52:02.712675 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.712659 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasSufficientMemory" Jun 11 22:52:02.712759 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.712681 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 22:52:02.712759 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.712693 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeHasSufficientPID" Jun 11 22:52:02.726305 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.726288 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-179.ec2.internal\" not found" Jun 11 22:52:02.732458 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.732439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65fdfd166c590181556c1b9f71a16a32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal\" (UID: \"65fdfd166c590181556c1b9f71a16a32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.732523 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.732466 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65fdfd166c590181556c1b9f71a16a32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal\" (UID: \"65fdfd166c590181556c1b9f71a16a32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.732523 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.732490 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d4e299e57df85b5072453add22d52c7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-179.ec2.internal\" (UID: \"0d4e299e57df85b5072453add22d52c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.737305 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.737286 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-179.ec2.internal\" not found" node="ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.741694 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.741675 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-179.ec2.internal\" not found" node="ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.827291 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.827255 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-179.ec2.internal\" not found" Jun 11 22:52:02.833472 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.833443 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d4e299e57df85b5072453add22d52c7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-179.ec2.internal\" (UID: \"0d4e299e57df85b5072453add22d52c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.833566 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.833481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65fdfd166c590181556c1b9f71a16a32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal\" (UID: \"65fdfd166c590181556c1b9f71a16a32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.833566 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.833505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65fdfd166c590181556c1b9f71a16a32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal\" (UID: \"65fdfd166c590181556c1b9f71a16a32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.833566 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.833545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d4e299e57df85b5072453add22d52c7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-179.ec2.internal\" (UID: \"0d4e299e57df85b5072453add22d52c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.833697 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.833551 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65fdfd166c590181556c1b9f71a16a32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal\" (UID: \"65fdfd166c590181556c1b9f71a16a32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.833697 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:02.833552 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65fdfd166c590181556c1b9f71a16a32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal\" (UID: \"65fdfd166c590181556c1b9f71a16a32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal" Jun 11 22:52:02.927386 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:02.927339 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-179.ec2.internal\" not found" Jun 11 22:52:03.028111 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:03.028033 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-179.ec2.internal\" not found" Jun 11 22:52:03.040499 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.040475 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal" Jun 11 22:52:03.047548 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.047528 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-179.ec2.internal" Jun 11 22:52:03.128441 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:03.128403 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-179.ec2.internal\" not found" Jun 11 22:52:03.228950 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:03.228923 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-179.ec2.internal\" not found" Jun 11 22:52:03.329517 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:03.329438 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-179.ec2.internal\" not found" Jun 11 22:52:03.368643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.368620 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 22:52:03.426732 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.426704 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 22:52:03.429741 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:03.429723 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-179.ec2.internal\" not found" Jun 11 22:52:03.463230 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.463196 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 22:52:03.463906 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.463353 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 22:52:03.463906 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.463387 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 22:52:03.463906 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.463389 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 22:52:03.529932 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:03.529899 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-179.ec2.internal\" not found" Jun 11 22:52:03.536834 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.536811 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 22:52:03.569684 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:03.569641 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65fdfd166c590181556c1b9f71a16a32.slice/crio-72b5afff9ceec024cb6a9a88918e64b296ea215e414d7999398a58a001affd1f WatchSource:0}: Error finding container 72b5afff9ceec024cb6a9a88918e64b296ea215e414d7999398a58a001affd1f: Status 404 returned error can't find the container with id 72b5afff9ceec024cb6a9a88918e64b296ea215e414d7999398a58a001affd1f Jun 11 22:52:03.570500 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:03.570475 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4e299e57df85b5072453add22d52c7.slice/crio-a402048130d57ed5fdf9c3337ce9bb0e8575898737e834b63fefb50ea4ae6a3c WatchSource:0}: Error finding container a402048130d57ed5fdf9c3337ce9bb0e8575898737e834b63fefb50ea4ae6a3c: Status 404 returned error can't find the container with id a402048130d57ed5fdf9c3337ce9bb0e8575898737e834b63fefb50ea4ae6a3c Jun 11 22:52:03.574646 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.574629 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 22:52:03.585575 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.585500 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 22:47:02 +0000 UTC" deadline="2027-12-01 14:51:44.228569029 +0000 UTC" Jun 11 22:52:03.585575 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.585544 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12903h59m40.643028813s" Jun 11 22:52:03.608264 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.608202 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-179.ec2.internal" event={"ID":"0d4e299e57df85b5072453add22d52c7","Type":"ContainerStarted","Data":"a402048130d57ed5fdf9c3337ce9bb0e8575898737e834b63fefb50ea4ae6a3c"} Jun 11 22:52:03.609225 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.609200 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal" event={"ID":"65fdfd166c590181556c1b9f71a16a32","Type":"ContainerStarted","Data":"72b5afff9ceec024cb6a9a88918e64b296ea215e414d7999398a58a001affd1f"} Jun 11 22:52:03.630545 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.630522 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal" Jun 11 22:52:03.647865 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.647839 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 22:52:03.649070 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.649057 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-179.ec2.internal" Jun 11 22:52:03.658560 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:03.658544 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 22:52:04.369822 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.369796 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 22:52:04.508513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.508470 2578 apiserver.go:52] "Watching apiserver" Jun 11 22:52:04.520375 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.520347 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 22:52:04.522678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.522630 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-hm2rt","kube-system/global-pull-secret-syncer-s452g","kube-system/konnectivity-agent-vxttp","kube-system/kube-apiserver-proxy-ip-10-0-128-179.ec2.internal","openshift-cluster-node-tuning-operator/tuned-m48ng","openshift-dns/node-resolver-gxzlc","openshift-image-registry/node-ca-b5jz4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal","openshift-multus/multus-additional-cni-plugins-t9r8c","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v","openshift-multus/multus-dxc4s","openshift-multus/network-metrics-daemon-5smcr","openshift-network-diagnostics/network-check-target-nvgqg","openshift-network-operator/iptables-alerter-2rj46"] Jun 11 22:52:04.525606 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.525442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.527776 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.527753 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.528217 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.528190 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 22:52:04.528217 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.528196 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 22:52:04.528389 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.528200 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 22:52:04.528460 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.528445 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-855kt\"" Jun 11 22:52:04.529829 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.529807 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vxttp" Jun 11 22:52:04.529994 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.529977 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 22:52:04.530328 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.530305 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bqpvc\"" Jun 11 22:52:04.530428 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.530351 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 22:52:04.530488 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.530455 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 22:52:04.531948 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.531103 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 22:52:04.531948 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.531168 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 22:52:04.531948 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.531862 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 22:52:04.532606 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.532230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2rj46" Jun 11 22:52:04.532606 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.532259 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lnr7q\"" Jun 11 22:52:04.532606 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.532489 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 22:52:04.534113 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.534095 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.535679 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.535656 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 22:52:04.536188 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.535938 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 22:52:04.536746 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.536725 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 22:52:04.536823 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.536772 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4qsxd\"" Jun 11 22:52:04.538073 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.538032 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7xp48\"" Jun 11 22:52:04.538163 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.538126 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 22:52:04.538467 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.538444 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 22:52:04.539389 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.539370 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:04.539481 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:04.539447 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:04.541228 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541198 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-run-k8s-cni-cncf-io\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.541320 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-run-multus-certs\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.541320 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541252 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8994707f-d5de-465f-be7c-61a9c4f7749d-konnectivity-ca\") pod \"konnectivity-agent-vxttp\" (UID: \"8994707f-d5de-465f-be7c-61a9c4f7749d\") " pod="kube-system/konnectivity-agent-vxttp" Jun 11 22:52:04.541320 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.541474 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-cnibin\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.541474 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-multus-conf-dir\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.541474 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj7fj\" (UniqueName: \"kubernetes.io/projected/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-kube-api-access-hj7fj\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.541474 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-etc-selinux\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.541474 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/671edf47-e582-4800-aea5-97d605e173e3-iptables-alerter-script\") pod \"iptables-alerter-2rj46\" (UID: \"671edf47-e582-4800-aea5-97d605e173e3\") " pod="openshift-network-operator/iptables-alerter-2rj46" Jun 11 22:52:04.541474 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-system-cni-dir\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.541818 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-os-release\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.541818 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-multus-daemon-config\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.541818 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541554 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-socket-dir\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.541818 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541576 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-registration-dir\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.541818 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-etc-kubernetes\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.541818 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-cni-binary-copy\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.541818 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541649 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-var-lib-kubelet\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.541818 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541666 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8994707f-d5de-465f-be7c-61a9c4f7749d-agent-certs\") pod \"konnectivity-agent-vxttp\" (UID: \"8994707f-d5de-465f-be7c-61a9c4f7749d\") " pod="kube-system/konnectivity-agent-vxttp" Jun 11 22:52:04.541818 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/671edf47-e582-4800-aea5-97d605e173e3-host-slash\") pod \"iptables-alerter-2rj46\" (UID: \"671edf47-e582-4800-aea5-97d605e173e3\") " pod="openshift-network-operator/iptables-alerter-2rj46" Jun 11 22:52:04.541818 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-sys-fs\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.541818 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541747 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-multus-cni-dir\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.541818 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-multus-socket-dir-parent\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.541818 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-run-netns\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.542520 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-var-lib-cni-bin\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.542520 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541859 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-var-lib-cni-multus\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.542520 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfv79\" (UniqueName: \"kubernetes.io/projected/671edf47-e582-4800-aea5-97d605e173e3-kube-api-access-bfv79\") pod \"iptables-alerter-2rj46\" (UID: \"671edf47-e582-4800-aea5-97d605e173e3\") " pod="openshift-network-operator/iptables-alerter-2rj46" Jun 11 22:52:04.542520 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmb26\" (UniqueName: \"kubernetes.io/projected/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-kube-api-access-bmb26\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.542520 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541947 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b5jz4" Jun 11 22:52:04.542520 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541964 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-hostroot\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.542520 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.541985 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-device-dir\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.543662 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.543644 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 22:52:04.543902 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.543886 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:04.543968 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:04.543936 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:04.544288 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.544274 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 22:52:04.544499 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.544482 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 22:52:04.544714 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.544696 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nxbpc\"" Jun 11 22:52:04.544919 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.544904 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 22:52:04.546364 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.546178 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:04.546364 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:04.546251 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:04.548840 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.548821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.551380 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.551360 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 22:52:04.551811 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.551713 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.552091 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.552061 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 22:52:04.552176 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.552160 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 22:52:04.552701 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.552683 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tqwqf\"" Jun 11 22:52:04.553164 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.553145 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 22:52:04.553250 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.553182 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 22:52:04.553288 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.553262 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 22:52:04.554011 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.553992 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8d6nz\"" Jun 11 22:52:04.554011 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.554007 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 22:52:04.554371 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.554354 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 22:52:04.554714 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.554697 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gxzlc" Jun 11 22:52:04.556875 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.556861 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nvwv5\"" Jun 11 22:52:04.557061 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.557044 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 22:52:04.557141 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.557073 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 22:52:04.569976 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.569950 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q2xwx" Jun 11 22:52:04.575902 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.575884 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q2xwx" Jun 11 22:52:04.634847 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.634457 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 22:52:04.642808 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.642774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-run-k8s-cni-cncf-io\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.642951 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.642837 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-run-multus-certs\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.642951 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.642879 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-var-lib-kubelet\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.642951 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.642907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qskzq\" (UniqueName: \"kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq\") pod \"network-check-target-nvgqg\" (UID: \"035057ba-16c5-4542-87f7-13bce9b448ac\") " pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:04.642951 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.642927 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c752df24-652a-49ad-912b-e760b4a4cad7-kubelet-config\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:04.642951 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.642915 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-run-k8s-cni-cncf-io\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.642951 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.642940 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c752df24-652a-49ad-912b-e760b4a4cad7-dbus\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:04.643162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.642955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-var-lib-openvswitch\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.643162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.642969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f47d704a-2272-485d-992e-0ad29e254298-env-overrides\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.643162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.642987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.643162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.642995 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-run-multus-certs\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.643162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643002 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-multus-conf-dir\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.643162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643026 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-tuned\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.643162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643041 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-multus-conf-dir\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.643162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-kubelet\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.643162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj7fj\" (UniqueName: \"kubernetes.io/projected/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-kube-api-access-hj7fj\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.643162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643099 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.643162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.643162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-sysctl-d\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.643162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f01823b1-ec0f-4636-bb5d-1d25a7e91152-serviceca\") pod \"node-ca-b5jz4\" (UID: \"f01823b1-ec0f-4636-bb5d-1d25a7e91152\") " pod="openshift-image-registry/node-ca-b5jz4" Jun 11 22:52:04.643162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643166 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-run-ovn\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643198 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-node-log\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-run-ovn-kubernetes\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-os-release\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643244 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mfd6\" (UniqueName: \"kubernetes.io/projected/f2093b4d-bc7b-46b4-b79a-032b54a323b6-kube-api-access-2mfd6\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54366c51-87c6-4077-b5f1-b4513f516370-tmp-dir\") pod \"node-resolver-gxzlc\" (UID: \"54366c51-87c6-4077-b5f1-b4513f516370\") " pod="openshift-dns/node-resolver-gxzlc" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-systemd\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-cni-netd\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-socket-dir\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643363 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-os-release\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643376 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-etc-kubernetes\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643415 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-etc-kubernetes\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54366c51-87c6-4077-b5f1-b4513f516370-hosts-file\") pod \"node-resolver-gxzlc\" (UID: \"54366c51-87c6-4077-b5f1-b4513f516370\") " pod="openshift-dns/node-resolver-gxzlc" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-tmp\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643486 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-socket-dir\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-sys-fs\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.643604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643532 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-multus-socket-dir-parent\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-sys-fs\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-var-lib-cni-bin\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643601 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-multus-socket-dir-parent\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643627 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-var-lib-cni-bin\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643665 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-var-lib-cni-multus\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643694 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643716 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-cnibin\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643729 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-var-lib-cni-multus\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643771 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-sys\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmb26\" (UniqueName: \"kubernetes.io/projected/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-kube-api-access-bmb26\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-sysctl-conf\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqrvq\" (UniqueName: \"kubernetes.io/projected/f01823b1-ec0f-4636-bb5d-1d25a7e91152-kube-api-access-dqrvq\") pod \"node-ca-b5jz4\" (UID: \"f01823b1-ec0f-4636-bb5d-1d25a7e91152\") " pod="openshift-image-registry/node-ca-b5jz4" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ggpr\" (UniqueName: \"kubernetes.io/projected/f47d704a-2272-485d-992e-0ad29e254298-kube-api-access-6ggpr\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-device-dir\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8994707f-d5de-465f-be7c-61a9c4f7749d-konnectivity-ca\") pod \"konnectivity-agent-vxttp\" (UID: \"8994707f-d5de-465f-be7c-61a9c4f7749d\") " pod="kube-system/konnectivity-agent-vxttp" Jun 11 22:52:04.644169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643960 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-device-dir\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.643970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-modprobe-d\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644037 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkfjg\" (UniqueName: \"kubernetes.io/projected/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-kube-api-access-dkfjg\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-run-systemd\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-log-socket\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-cnibin\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644132 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-run\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644168 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-cnibin\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-etc-openvswitch\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-etc-selinux\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644227 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/671edf47-e582-4800-aea5-97d605e173e3-iptables-alerter-script\") pod \"iptables-alerter-2rj46\" (UID: \"671edf47-e582-4800-aea5-97d605e173e3\") " pod="openshift-network-operator/iptables-alerter-2rj46" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-sysconfig\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644262 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-system-cni-dir\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-multus-daemon-config\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644297 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-etc-selinux\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-system-cni-dir\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.644851 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644353 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-system-cni-dir\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644423 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8994707f-d5de-465f-be7c-61a9c4f7749d-konnectivity-ca\") pod \"konnectivity-agent-vxttp\" (UID: \"8994707f-d5de-465f-be7c-61a9c4f7749d\") " pod="kube-system/konnectivity-agent-vxttp" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-systemd-units\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f47d704a-2272-485d-992e-0ad29e254298-ovnkube-config\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-registration-dir\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-host\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644552 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-registration-dir\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-run-openvswitch\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644615 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-cni-bin\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644631 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f47d704a-2272-485d-992e-0ad29e254298-ovnkube-script-lib\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-cni-binary-copy\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-var-lib-kubelet\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8994707f-d5de-465f-be7c-61a9c4f7749d-agent-certs\") pod \"konnectivity-agent-vxttp\" (UID: \"8994707f-d5de-465f-be7c-61a9c4f7749d\") " pod="kube-system/konnectivity-agent-vxttp" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/671edf47-e582-4800-aea5-97d605e173e3-host-slash\") pod \"iptables-alerter-2rj46\" (UID: \"671edf47-e582-4800-aea5-97d605e173e3\") " pod="openshift-network-operator/iptables-alerter-2rj46" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644732 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-var-lib-kubelet\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644773 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/671edf47-e582-4800-aea5-97d605e173e3-host-slash\") pod \"iptables-alerter-2rj46\" (UID: \"671edf47-e582-4800-aea5-97d605e173e3\") " pod="openshift-network-operator/iptables-alerter-2rj46" Jun 11 22:52:04.645476 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644796 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/671edf47-e582-4800-aea5-97d605e173e3-iptables-alerter-script\") pod \"iptables-alerter-2rj46\" (UID: \"671edf47-e582-4800-aea5-97d605e173e3\") " pod="openshift-network-operator/iptables-alerter-2rj46" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxnjz\" (UniqueName: \"kubernetes.io/projected/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-kube-api-access-wxnjz\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-lib-modules\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-run-netns\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644879 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f47d704a-2272-485d-992e-0ad29e254298-ovn-node-metrics-cert\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-multus-cni-dir\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644901 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-multus-daemon-config\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-run-netns\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfv79\" (UniqueName: \"kubernetes.io/projected/671edf47-e582-4800-aea5-97d605e173e3-kube-api-access-bfv79\") pod \"iptables-alerter-2rj46\" (UID: \"671edf47-e582-4800-aea5-97d605e173e3\") " pod="openshift-network-operator/iptables-alerter-2rj46" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644954 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644967 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-multus-cni-dir\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9gs7\" (UniqueName: \"kubernetes.io/projected/54366c51-87c6-4077-b5f1-b4513f516370-kube-api-access-m9gs7\") pod \"node-resolver-gxzlc\" (UID: \"54366c51-87c6-4077-b5f1-b4513f516370\") " pod="openshift-dns/node-resolver-gxzlc" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.644988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-kubernetes\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.645002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-slash\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.645018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-hostroot\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.645033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-os-release\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.645048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f01823b1-ec0f-4636-bb5d-1d25a7e91152-host\") pod \"node-ca-b5jz4\" (UID: \"f01823b1-ec0f-4636-bb5d-1d25a7e91152\") " pod="openshift-image-registry/node-ca-b5jz4" Jun 11 22:52:04.646194 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.645092 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-host-run-netns\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.646804 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.645088 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 22:52:04.646804 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.645129 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-hostroot\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.646804 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.645152 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-cni-binary-copy\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.648725 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.648463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8994707f-d5de-465f-be7c-61a9c4f7749d-agent-certs\") pod \"konnectivity-agent-vxttp\" (UID: \"8994707f-d5de-465f-be7c-61a9c4f7749d\") " pod="kube-system/konnectivity-agent-vxttp" Jun 11 22:52:04.652949 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.652928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfv79\" (UniqueName: \"kubernetes.io/projected/671edf47-e582-4800-aea5-97d605e173e3-kube-api-access-bfv79\") pod \"iptables-alerter-2rj46\" (UID: \"671edf47-e582-4800-aea5-97d605e173e3\") " pod="openshift-network-operator/iptables-alerter-2rj46" Jun 11 22:52:04.653070 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.652948 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj7fj\" (UniqueName: \"kubernetes.io/projected/47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d-kube-api-access-hj7fj\") pod \"multus-dxc4s\" (UID: \"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d\") " pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.653289 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.653256 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmb26\" (UniqueName: \"kubernetes.io/projected/5e5d6e42-44e0-4107-b1b0-3f0930a7ab76-kube-api-access-bmb26\") pod \"aws-ebs-csi-driver-node-cqn2v\" (UID: \"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.746123 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:04.746123 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-cnibin\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.746341 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.746341 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-sys\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.746341 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-sysctl-conf\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.746341 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746232 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqrvq\" (UniqueName: \"kubernetes.io/projected/f01823b1-ec0f-4636-bb5d-1d25a7e91152-kube-api-access-dqrvq\") pod \"node-ca-b5jz4\" (UID: \"f01823b1-ec0f-4636-bb5d-1d25a7e91152\") " pod="openshift-image-registry/node-ca-b5jz4" Jun 11 22:52:04.746341 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746247 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ggpr\" (UniqueName: \"kubernetes.io/projected/f47d704a-2272-485d-992e-0ad29e254298-kube-api-access-6ggpr\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.746341 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-modprobe-d\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.746341 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkfjg\" (UniqueName: \"kubernetes.io/projected/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-kube-api-access-dkfjg\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.746341 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-run-systemd\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.746341 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-log-socket\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-run\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-etc-openvswitch\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-sysconfig\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-system-cni-dir\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-systemd-units\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f47d704a-2272-485d-992e-0ad29e254298-ovnkube-config\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-host\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746526 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-run-openvswitch\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746540 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-cni-bin\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f47d704a-2272-485d-992e-0ad29e254298-ovnkube-script-lib\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxnjz\" (UniqueName: \"kubernetes.io/projected/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-kube-api-access-wxnjz\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-lib-modules\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-run-netns\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f47d704a-2272-485d-992e-0ad29e254298-ovn-node-metrics-cert\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.746721 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9gs7\" (UniqueName: \"kubernetes.io/projected/54366c51-87c6-4077-b5f1-b4513f516370-kube-api-access-m9gs7\") pod \"node-resolver-gxzlc\" (UID: \"54366c51-87c6-4077-b5f1-b4513f516370\") " pod="openshift-dns/node-resolver-gxzlc" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-kubernetes\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-slash\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-os-release\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f01823b1-ec0f-4636-bb5d-1d25a7e91152-host\") pod \"node-ca-b5jz4\" (UID: \"f01823b1-ec0f-4636-bb5d-1d25a7e91152\") " pod="openshift-image-registry/node-ca-b5jz4" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-var-lib-kubelet\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qskzq\" (UniqueName: \"kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq\") pod \"network-check-target-nvgqg\" (UID: \"035057ba-16c5-4542-87f7-13bce9b448ac\") " pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c752df24-652a-49ad-912b-e760b4a4cad7-kubelet-config\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c752df24-652a-49ad-912b-e760b4a4cad7-dbus\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-var-lib-openvswitch\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f47d704a-2272-485d-992e-0ad29e254298-env-overrides\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.746983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-tuned\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.747006 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-kubelet\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.747034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.747057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-sysctl-d\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.747082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f01823b1-ec0f-4636-bb5d-1d25a7e91152-serviceca\") pod \"node-ca-b5jz4\" (UID: \"f01823b1-ec0f-4636-bb5d-1d25a7e91152\") " pod="openshift-image-registry/node-ca-b5jz4" Jun 11 22:52:04.747445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.747097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-run-ovn\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.748214 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.747116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-node-log\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.748214 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.747140 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-run-ovn-kubernetes\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.748214 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.747171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mfd6\" (UniqueName: \"kubernetes.io/projected/f2093b4d-bc7b-46b4-b79a-032b54a323b6-kube-api-access-2mfd6\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:04.748214 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.747196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54366c51-87c6-4077-b5f1-b4513f516370-tmp-dir\") pod \"node-resolver-gxzlc\" (UID: \"54366c51-87c6-4077-b5f1-b4513f516370\") " pod="openshift-dns/node-resolver-gxzlc" Jun 11 22:52:04.748214 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.747215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-systemd\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.748214 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.747236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-cni-netd\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.748214 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.747253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.748214 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.747281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54366c51-87c6-4077-b5f1-b4513f516370-hosts-file\") pod \"node-resolver-gxzlc\" (UID: \"54366c51-87c6-4077-b5f1-b4513f516370\") " pod="openshift-dns/node-resolver-gxzlc" Jun 11 22:52:04.748214 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.747303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-tmp\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.748214 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.748016 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-run-ovn-kubernetes\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.748214 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.748082 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-kubelet\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.748742 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.748623 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f01823b1-ec0f-4636-bb5d-1d25a7e91152-serviceca\") pod \"node-ca-b5jz4\" (UID: \"f01823b1-ec0f-4636-bb5d-1d25a7e91152\") " pod="openshift-image-registry/node-ca-b5jz4" Jun 11 22:52:04.748742 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.748654 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.748742 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.748724 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-run-ovn\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.748884 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.748770 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-node-log\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.748884 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.748826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f01823b1-ec0f-4636-bb5d-1d25a7e91152-host\") pod \"node-ca-b5jz4\" (UID: \"f01823b1-ec0f-4636-bb5d-1d25a7e91152\") " pod="openshift-image-registry/node-ca-b5jz4" Jun 11 22:52:04.748980 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.748888 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-sysctl-d\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.748980 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.748947 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-systemd\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.748980 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.748967 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.749236 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-kubernetes\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.749273 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54366c51-87c6-4077-b5f1-b4513f516370-tmp-dir\") pod \"node-resolver-gxzlc\" (UID: \"54366c51-87c6-4077-b5f1-b4513f516370\") " pod="openshift-dns/node-resolver-gxzlc" Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.749289 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-slash\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.749358 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-os-release\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:04.749424 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:04.749492 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret podName:c752df24-652a-49ad-912b-e760b4a4cad7 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:05.249469726 +0000 UTC m=+3.132792558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret") pod "global-pull-secret-syncer-s452g" (UID: "c752df24-652a-49ad-912b-e760b4a4cad7") : object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.749489 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c752df24-652a-49ad-912b-e760b4a4cad7-kubelet-config\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.749533 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-var-lib-kubelet\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.749610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-cnibin\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.749620 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.749669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-cni-netd\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:04.749862 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:04.749915 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs podName:f2093b4d-bc7b-46b4-b79a-032b54a323b6 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:05.249900034 +0000 UTC m=+3.133222847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs") pod "network-metrics-daemon-5smcr" (UID: "f2093b4d-bc7b-46b4-b79a-032b54a323b6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.749974 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-host\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.749976 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.749974 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-var-lib-openvswitch\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.751643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.750030 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-sysconfig\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.750031 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-etc-openvswitch\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.750067 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-system-cni-dir\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.750082 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c752df24-652a-49ad-912b-e760b4a4cad7-dbus\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.750109 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-sys\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.750126 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-sysctl-conf\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.750170 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-systemd-units\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.750663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f47d704a-2272-485d-992e-0ad29e254298-ovnkube-config\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.750687 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-modprobe-d\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.750723 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f47d704a-2272-485d-992e-0ad29e254298-ovnkube-script-lib\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.750740 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-log-socket\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.750744 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-run-systemd\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.750806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-run\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.750830 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-lib-modules\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.751000 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-run-openvswitch\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.751173 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.751227 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-cni-bin\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.751273 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f47d704a-2272-485d-992e-0ad29e254298-host-run-netns\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.752261 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.751277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54366c51-87c6-4077-b5f1-b4513f516370-hosts-file\") pod \"node-resolver-gxzlc\" (UID: \"54366c51-87c6-4077-b5f1-b4513f516370\") " pod="openshift-dns/node-resolver-gxzlc" Jun 11 22:52:04.753041 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.751317 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-etc-tuned\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.753041 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.751337 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f47d704a-2272-485d-992e-0ad29e254298-ovn-node-metrics-cert\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.753041 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.751695 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f47d704a-2272-485d-992e-0ad29e254298-env-overrides\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.755679 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:04.755654 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 22:52:04.755679 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:04.755681 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 22:52:04.756005 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:04.755694 2578 projected.go:196] Error preparing data for projected volume kube-api-access-qskzq for pod openshift-network-diagnostics/network-check-target-nvgqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:04.756005 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:04.755751 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq podName:035057ba-16c5-4542-87f7-13bce9b448ac nodeName:}" failed. No retries permitted until 2026-06-11 22:52:05.255732462 +0000 UTC m=+3.139055291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qskzq" (UniqueName: "kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq") pod "network-check-target-nvgqg" (UID: "035057ba-16c5-4542-87f7-13bce9b448ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:04.757932 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.757899 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mfd6\" (UniqueName: \"kubernetes.io/projected/f2093b4d-bc7b-46b4-b79a-032b54a323b6-kube-api-access-2mfd6\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:04.758023 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.757975 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9gs7\" (UniqueName: \"kubernetes.io/projected/54366c51-87c6-4077-b5f1-b4513f516370-kube-api-access-m9gs7\") pod \"node-resolver-gxzlc\" (UID: \"54366c51-87c6-4077-b5f1-b4513f516370\") " pod="openshift-dns/node-resolver-gxzlc" Jun 11 22:52:04.758804 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.758764 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-tmp\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.759467 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.759448 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqrvq\" (UniqueName: \"kubernetes.io/projected/f01823b1-ec0f-4636-bb5d-1d25a7e91152-kube-api-access-dqrvq\") pod \"node-ca-b5jz4\" (UID: \"f01823b1-ec0f-4636-bb5d-1d25a7e91152\") " pod="openshift-image-registry/node-ca-b5jz4" Jun 11 22:52:04.760465 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.760443 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkfjg\" (UniqueName: \"kubernetes.io/projected/b7b5ec11-3548-4aa0-bb43-5a22074ea5e4-kube-api-access-dkfjg\") pod \"tuned-m48ng\" (UID: \"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4\") " pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.760612 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.760579 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ggpr\" (UniqueName: \"kubernetes.io/projected/f47d704a-2272-485d-992e-0ad29e254298-kube-api-access-6ggpr\") pod \"ovnkube-node-hm2rt\" (UID: \"f47d704a-2272-485d-992e-0ad29e254298\") " pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.761129 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.761107 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxnjz\" (UniqueName: \"kubernetes.io/projected/3ca4a8ca-16e8-4e4f-b62e-b08ef861c251-kube-api-access-wxnjz\") pod \"multus-additional-cni-plugins-t9r8c\" (UID: \"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251\") " pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.838262 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.838225 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" Jun 11 22:52:04.845241 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.845215 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxc4s" Jun 11 22:52:04.853125 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.853103 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vxttp" Jun 11 22:52:04.862631 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.862601 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2rj46" Jun 11 22:52:04.868209 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.868188 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m48ng" Jun 11 22:52:04.874664 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.874645 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b5jz4" Jun 11 22:52:04.881255 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.881237 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:04.887777 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.887728 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t9r8c" Jun 11 22:52:04.892296 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:04.892270 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gxzlc" Jun 11 22:52:05.250861 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.250744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:05.250861 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.250794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:05.251077 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:05.250893 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:05.251077 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:05.250895 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:05.251077 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:05.250953 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs podName:f2093b4d-bc7b-46b4-b79a-032b54a323b6 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:06.250937931 +0000 UTC m=+4.134260742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs") pod "network-metrics-daemon-5smcr" (UID: "f2093b4d-bc7b-46b4-b79a-032b54a323b6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:05.251077 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:05.250967 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret podName:c752df24-652a-49ad-912b-e760b4a4cad7 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:06.25096064 +0000 UTC m=+4.134283450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret") pod "global-pull-secret-syncer-s452g" (UID: "c752df24-652a-49ad-912b-e760b4a4cad7") : object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:05.280210 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.280174 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 22:52:05.351884 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.351851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qskzq\" (UniqueName: \"kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq\") pod \"network-check-target-nvgqg\" (UID: \"035057ba-16c5-4542-87f7-13bce9b448ac\") " pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:05.352043 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:05.351984 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 22:52:05.352043 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:05.352001 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 22:52:05.352043 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:05.352010 2578 projected.go:196] Error preparing data for projected volume kube-api-access-qskzq for pod openshift-network-diagnostics/network-check-target-nvgqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:05.352181 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:05.352062 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq podName:035057ba-16c5-4542-87f7-13bce9b448ac nodeName:}" failed. No retries permitted until 2026-06-11 22:52:06.352048125 +0000 UTC m=+4.235370935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qskzq" (UniqueName: "kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq") pod "network-check-target-nvgqg" (UID: "035057ba-16c5-4542-87f7-13bce9b448ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:05.493513 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:05.493487 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5d6e42_44e0_4107_b1b0_3f0930a7ab76.slice/crio-c984e218522af202d573d26d4ad6a6443fd98251d96ce3466490369126cb9007 WatchSource:0}: Error finding container c984e218522af202d573d26d4ad6a6443fd98251d96ce3466490369126cb9007: Status 404 returned error can't find the container with id c984e218522af202d573d26d4ad6a6443fd98251d96ce3466490369126cb9007 Jun 11 22:52:05.497194 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:05.497174 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf01823b1_ec0f_4636_bb5d_1d25a7e91152.slice/crio-799e60fc6ad4af3612b02d04bd9041a8c0b4ffafa9f74809512c9dddb66be2ec WatchSource:0}: Error finding container 799e60fc6ad4af3612b02d04bd9041a8c0b4ffafa9f74809512c9dddb66be2ec: Status 404 returned error can't find the container with id 799e60fc6ad4af3612b02d04bd9041a8c0b4ffafa9f74809512c9dddb66be2ec Jun 11 22:52:05.498549 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:05.498528 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca4a8ca_16e8_4e4f_b62e_b08ef861c251.slice/crio-53c26f1c92d0d0c1c8c90ef9ad4d0c6729d403ca94437407fdbc6ae59b09f1fe WatchSource:0}: Error finding container 53c26f1c92d0d0c1c8c90ef9ad4d0c6729d403ca94437407fdbc6ae59b09f1fe: Status 404 returned error can't find the container with id 53c26f1c92d0d0c1c8c90ef9ad4d0c6729d403ca94437407fdbc6ae59b09f1fe Jun 11 22:52:05.499408 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:05.499390 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54366c51_87c6_4077_b5f1_b4513f516370.slice/crio-ca722d066dcee8bd9ff7ac13052e7b9ca7a307edf6ad1f1bf67a5b9e29c07241 WatchSource:0}: Error finding container ca722d066dcee8bd9ff7ac13052e7b9ca7a307edf6ad1f1bf67a5b9e29c07241: Status 404 returned error can't find the container with id ca722d066dcee8bd9ff7ac13052e7b9ca7a307edf6ad1f1bf67a5b9e29c07241 Jun 11 22:52:05.500032 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:05.499975 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47d704a_2272_485d_992e_0ad29e254298.slice/crio-35a47dac7d43218acf9d12ce31774aa94129691f7b50f4941a23d59f577f9be7 WatchSource:0}: Error finding container 35a47dac7d43218acf9d12ce31774aa94129691f7b50f4941a23d59f577f9be7: Status 404 returned error can't find the container with id 35a47dac7d43218acf9d12ce31774aa94129691f7b50f4941a23d59f577f9be7 Jun 11 22:52:05.522456 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:05.522415 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8994707f_d5de_465f_be7c_61a9c4f7749d.slice/crio-b05b7699220a27f6cee058fe2fba4545ccccb912cffc5bfffa4f909e9015c3b4 WatchSource:0}: Error finding container b05b7699220a27f6cee058fe2fba4545ccccb912cffc5bfffa4f909e9015c3b4: Status 404 returned error can't find the container with id b05b7699220a27f6cee058fe2fba4545ccccb912cffc5bfffa4f909e9015c3b4 Jun 11 22:52:05.523036 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:05.523014 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod671edf47_e582_4800_aea5_97d605e173e3.slice/crio-2cef28468ed3c84e9fb72bbe000b10d43d15df9e4ea25f192171acb62bfbf8e4 WatchSource:0}: Error finding container 2cef28468ed3c84e9fb72bbe000b10d43d15df9e4ea25f192171acb62bfbf8e4: Status 404 returned error can't find the container with id 2cef28468ed3c84e9fb72bbe000b10d43d15df9e4ea25f192171acb62bfbf8e4 Jun 11 22:52:05.524121 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:05.524054 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47cc7a9a_0bf8_405e_8cd3_c1eecc2f3c2d.slice/crio-312c45deac55809dc23a89328e7e9bc5153df6b482a55e1fee569e303fc459b4 WatchSource:0}: Error finding container 312c45deac55809dc23a89328e7e9bc5153df6b482a55e1fee569e303fc459b4: Status 404 returned error can't find the container with id 312c45deac55809dc23a89328e7e9bc5153df6b482a55e1fee569e303fc459b4 Jun 11 22:52:05.524926 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:05.524846 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b5ec11_3548_4aa0_bb43_5a22074ea5e4.slice/crio-3ae9b9e76960af5ca401600687ab1b4f8034d979ac1fdd3db7a78ff14dc90790 WatchSource:0}: Error finding container 3ae9b9e76960af5ca401600687ab1b4f8034d979ac1fdd3db7a78ff14dc90790: Status 404 returned error can't find the container with id 3ae9b9e76960af5ca401600687ab1b4f8034d979ac1fdd3db7a78ff14dc90790 Jun 11 22:52:05.579321 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.578913 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 22:47:04 +0000 UTC" deadline="2027-11-15 17:37:11.899874499 +0000 UTC" Jun 11 22:52:05.579321 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.578960 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12522h45m6.320917582s" Jun 11 22:52:05.605403 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.605376 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:05.605518 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:05.605484 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:05.609527 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.609508 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 22:52:05.612663 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.612576 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2rj46" event={"ID":"671edf47-e582-4800-aea5-97d605e173e3","Type":"ContainerStarted","Data":"2cef28468ed3c84e9fb72bbe000b10d43d15df9e4ea25f192171acb62bfbf8e4"} Jun 11 22:52:05.613820 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.613795 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b5jz4" event={"ID":"f01823b1-ec0f-4636-bb5d-1d25a7e91152","Type":"ContainerStarted","Data":"799e60fc6ad4af3612b02d04bd9041a8c0b4ffafa9f74809512c9dddb66be2ec"} Jun 11 22:52:05.615053 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.614991 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" event={"ID":"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76","Type":"ContainerStarted","Data":"c984e218522af202d573d26d4ad6a6443fd98251d96ce3466490369126cb9007"} Jun 11 22:52:05.616195 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.616175 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxc4s" event={"ID":"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d","Type":"ContainerStarted","Data":"312c45deac55809dc23a89328e7e9bc5153df6b482a55e1fee569e303fc459b4"} Jun 11 22:52:05.617510 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.617486 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vxttp" event={"ID":"8994707f-d5de-465f-be7c-61a9c4f7749d","Type":"ContainerStarted","Data":"b05b7699220a27f6cee058fe2fba4545ccccb912cffc5bfffa4f909e9015c3b4"} Jun 11 22:52:05.618876 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.618732 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" event={"ID":"f47d704a-2272-485d-992e-0ad29e254298","Type":"ContainerStarted","Data":"35a47dac7d43218acf9d12ce31774aa94129691f7b50f4941a23d59f577f9be7"} Jun 11 22:52:05.619792 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.619757 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gxzlc" event={"ID":"54366c51-87c6-4077-b5f1-b4513f516370","Type":"ContainerStarted","Data":"ca722d066dcee8bd9ff7ac13052e7b9ca7a307edf6ad1f1bf67a5b9e29c07241"} Jun 11 22:52:05.620950 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.620930 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9r8c" event={"ID":"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251","Type":"ContainerStarted","Data":"53c26f1c92d0d0c1c8c90ef9ad4d0c6729d403ca94437407fdbc6ae59b09f1fe"} Jun 11 22:52:05.622180 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:05.622162 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m48ng" event={"ID":"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4","Type":"ContainerStarted","Data":"3ae9b9e76960af5ca401600687ab1b4f8034d979ac1fdd3db7a78ff14dc90790"} Jun 11 22:52:06.260707 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:06.259975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:06.260707 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:06.260028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:06.260707 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:06.260159 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:06.260707 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:06.260218 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret podName:c752df24-652a-49ad-912b-e760b4a4cad7 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:08.260200819 +0000 UTC m=+6.143523633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret") pod "global-pull-secret-syncer-s452g" (UID: "c752df24-652a-49ad-912b-e760b4a4cad7") : object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:06.260707 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:06.260623 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:06.260707 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:06.260672 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs podName:f2093b4d-bc7b-46b4-b79a-032b54a323b6 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:08.260657697 +0000 UTC m=+6.143980511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs") pod "network-metrics-daemon-5smcr" (UID: "f2093b4d-bc7b-46b4-b79a-032b54a323b6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:06.361679 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:06.361464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qskzq\" (UniqueName: \"kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq\") pod \"network-check-target-nvgqg\" (UID: \"035057ba-16c5-4542-87f7-13bce9b448ac\") " pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:06.361679 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:06.361640 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 22:52:06.361679 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:06.361662 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 22:52:06.361679 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:06.361674 2578 projected.go:196] Error preparing data for projected volume kube-api-access-qskzq for pod openshift-network-diagnostics/network-check-target-nvgqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:06.362023 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:06.361732 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq podName:035057ba-16c5-4542-87f7-13bce9b448ac nodeName:}" failed. No retries permitted until 2026-06-11 22:52:08.361714783 +0000 UTC m=+6.245037611 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qskzq" (UniqueName: "kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq") pod "network-check-target-nvgqg" (UID: "035057ba-16c5-4542-87f7-13bce9b448ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:06.579683 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:06.579546 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 22:47:04 +0000 UTC" deadline="2028-01-26 10:34:52.296804779 +0000 UTC" Jun 11 22:52:06.579683 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:06.579608 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14243h42m45.717201748s" Jun 11 22:52:06.608210 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:06.607420 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:06.608210 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:06.607534 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:06.608210 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:06.607971 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:06.608210 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:06.608080 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:06.649707 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:06.649669 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-179.ec2.internal" event={"ID":"0d4e299e57df85b5072453add22d52c7","Type":"ContainerStarted","Data":"d5fe359ab85bcc293a4429c07f9a07a6dc09c1b397897c657c78461bb3244e29"} Jun 11 22:52:06.660082 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:06.659999 2578 generic.go:356] "Generic (PLEG): container finished" podID="65fdfd166c590181556c1b9f71a16a32" containerID="9ed03ec646ea26fc825249af1ee4aadf6cb4b9b5208869c8c57eb3c247405606" exitCode=0 Jun 11 22:52:06.660082 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:06.660040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal" event={"ID":"65fdfd166c590181556c1b9f71a16a32","Type":"ContainerDied","Data":"9ed03ec646ea26fc825249af1ee4aadf6cb4b9b5208869c8c57eb3c247405606"} Jun 11 22:52:06.692678 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:06.692600 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-179.ec2.internal" podStartSLOduration=3.6925570580000002 podStartE2EDuration="3.692557058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:06.666420085 +0000 UTC m=+4.549742918" watchObservedRunningTime="2026-06-11 22:52:06.692557058 +0000 UTC m=+4.575879891" Jun 11 22:52:07.606284 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:07.605671 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:07.606284 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:07.605807 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:07.679499 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:07.679452 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal" event={"ID":"65fdfd166c590181556c1b9f71a16a32","Type":"ContainerStarted","Data":"deabac64e30e637b7a68c34f46fd3ce48c2745c48b4f12b9ba690599d8b7ee2c"} Jun 11 22:52:08.277465 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:08.277423 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:08.277686 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:08.277490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:08.277686 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:08.277633 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:08.277808 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:08.277697 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret podName:c752df24-652a-49ad-912b-e760b4a4cad7 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:12.277679551 +0000 UTC m=+10.161002366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret") pod "global-pull-secret-syncer-s452g" (UID: "c752df24-652a-49ad-912b-e760b4a4cad7") : object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:08.278245 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:08.278215 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:08.278344 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:08.278274 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs podName:f2093b4d-bc7b-46b4-b79a-032b54a323b6 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:12.278256616 +0000 UTC m=+10.161579426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs") pod "network-metrics-daemon-5smcr" (UID: "f2093b4d-bc7b-46b4-b79a-032b54a323b6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:08.378954 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:08.378269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qskzq\" (UniqueName: \"kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq\") pod \"network-check-target-nvgqg\" (UID: \"035057ba-16c5-4542-87f7-13bce9b448ac\") " pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:08.378954 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:08.378490 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 22:52:08.378954 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:08.378509 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 22:52:08.378954 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:08.378521 2578 projected.go:196] Error preparing data for projected volume kube-api-access-qskzq for pod openshift-network-diagnostics/network-check-target-nvgqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:08.378954 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:08.378579 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq podName:035057ba-16c5-4542-87f7-13bce9b448ac nodeName:}" failed. No retries permitted until 2026-06-11 22:52:12.378561849 +0000 UTC m=+10.261884663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qskzq" (UniqueName: "kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq") pod "network-check-target-nvgqg" (UID: "035057ba-16c5-4542-87f7-13bce9b448ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:08.609063 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:08.608342 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:08.609063 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:08.608469 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:08.609063 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:08.608862 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:08.609063 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:08.608959 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:09.605467 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:09.605432 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:09.605681 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:09.605581 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:10.605166 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:10.605134 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:10.605687 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:10.605271 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:10.605687 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:10.605668 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:10.605870 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:10.605738 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:11.605389 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:11.605351 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:11.606003 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:11.605502 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:12.311033 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:12.310993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:12.311225 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:12.311049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:12.311225 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:12.311214 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:12.311341 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:12.311287 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret podName:c752df24-652a-49ad-912b-e760b4a4cad7 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:20.311268559 +0000 UTC m=+18.194591376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret") pod "global-pull-secret-syncer-s452g" (UID: "c752df24-652a-49ad-912b-e760b4a4cad7") : object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:12.311749 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:12.311721 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:12.311867 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:12.311782 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs podName:f2093b4d-bc7b-46b4-b79a-032b54a323b6 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:20.311765442 +0000 UTC m=+18.195088257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs") pod "network-metrics-daemon-5smcr" (UID: "f2093b4d-bc7b-46b4-b79a-032b54a323b6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:12.412470 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:12.412418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qskzq\" (UniqueName: \"kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq\") pod \"network-check-target-nvgqg\" (UID: \"035057ba-16c5-4542-87f7-13bce9b448ac\") " pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:12.412683 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:12.412659 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 22:52:12.412683 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:12.412687 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 22:52:12.412889 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:12.412701 2578 projected.go:196] Error preparing data for projected volume kube-api-access-qskzq for pod openshift-network-diagnostics/network-check-target-nvgqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:12.412889 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:12.412762 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq podName:035057ba-16c5-4542-87f7-13bce9b448ac nodeName:}" failed. No retries permitted until 2026-06-11 22:52:20.412743801 +0000 UTC m=+18.296066616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qskzq" (UniqueName: "kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq") pod "network-check-target-nvgqg" (UID: "035057ba-16c5-4542-87f7-13bce9b448ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:12.606598 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:12.606499 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:12.606598 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:12.606520 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:12.607020 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:12.606643 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:12.607020 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:12.606780 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:13.605508 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:13.605468 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:13.605687 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:13.605626 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:14.605763 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:14.605297 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:14.605763 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:14.605303 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:14.605763 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:14.605439 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:14.605763 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:14.605526 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:15.605724 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:15.605273 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:15.605724 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:15.605404 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:16.606237 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:16.605717 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:16.606237 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:16.605732 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:16.606237 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:16.605849 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:16.606237 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:16.605958 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:17.605560 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:17.605525 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:17.605747 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:17.605670 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:18.605648 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:18.605611 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:18.606112 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:18.605745 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:18.606112 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:18.605814 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:18.606112 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:18.605939 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:19.605708 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:19.605669 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:19.606105 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:19.605820 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:20.372142 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:20.372104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:20.372317 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:20.372178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:20.372317 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:20.372275 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:20.372317 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:20.372276 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:20.372451 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:20.372341 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs podName:f2093b4d-bc7b-46b4-b79a-032b54a323b6 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:36.372324088 +0000 UTC m=+34.255646898 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs") pod "network-metrics-daemon-5smcr" (UID: "f2093b4d-bc7b-46b4-b79a-032b54a323b6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:20.372451 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:20.372357 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret podName:c752df24-652a-49ad-912b-e760b4a4cad7 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:36.372350988 +0000 UTC m=+34.255673798 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret") pod "global-pull-secret-syncer-s452g" (UID: "c752df24-652a-49ad-912b-e760b4a4cad7") : object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:20.472558 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:20.472525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qskzq\" (UniqueName: \"kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq\") pod \"network-check-target-nvgqg\" (UID: \"035057ba-16c5-4542-87f7-13bce9b448ac\") " pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:20.472740 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:20.472685 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 22:52:20.472740 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:20.472708 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 22:52:20.472740 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:20.472721 2578 projected.go:196] Error preparing data for projected volume kube-api-access-qskzq for pod openshift-network-diagnostics/network-check-target-nvgqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:20.472885 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:20.472783 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq podName:035057ba-16c5-4542-87f7-13bce9b448ac nodeName:}" failed. No retries permitted until 2026-06-11 22:52:36.472764908 +0000 UTC m=+34.356087718 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qskzq" (UniqueName: "kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq") pod "network-check-target-nvgqg" (UID: "035057ba-16c5-4542-87f7-13bce9b448ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:20.605894 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:20.605814 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:20.606332 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:20.605938 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:20.606467 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:20.606439 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:20.606607 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:20.606565 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:21.605781 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:21.605739 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:21.605960 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:21.605862 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:22.605732 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:22.605705 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:22.605918 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:22.605805 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:22.605918 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:22.605845 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:22.606243 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:22.605945 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:23.605226 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:23.605193 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:23.605417 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:23.605317 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:24.605502 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.605268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:24.606388 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:24.605605 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:24.606388 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.605669 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:24.606388 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:24.605722 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:24.715997 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.715804 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxc4s" event={"ID":"47cc7a9a-0bf8-405e-8cd3-c1eecc2f3c2d","Type":"ContainerStarted","Data":"887eab5bbe2f681a660c17a64f887bbb704552baf4445cae23a56869634fd427"} Jun 11 22:52:24.717006 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.716982 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vxttp" event={"ID":"8994707f-d5de-465f-be7c-61a9c4f7749d","Type":"ContainerStarted","Data":"be97cd9eb27fabef50dfa40a9cc03009b534de2dd6c8e59a961b849d69580952"} Jun 11 22:52:24.718279 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.718258 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" event={"ID":"f47d704a-2272-485d-992e-0ad29e254298","Type":"ContainerStarted","Data":"af4de36a8998b9f4fd5e9b9df495ba531e5125843b84b05e0cd7648d47df67a3"} Jun 11 22:52:24.719575 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.719539 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gxzlc" event={"ID":"54366c51-87c6-4077-b5f1-b4513f516370","Type":"ContainerStarted","Data":"c24eeca3ae5c02cf722db189b9944bfaecf06bdb193956833bd72aa3b606cf4d"} Jun 11 22:52:24.721214 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.721102 2578 generic.go:356] "Generic (PLEG): container finished" podID="3ca4a8ca-16e8-4e4f-b62e-b08ef861c251" containerID="78ce803f62da19f7d41ca69b54661cabac51ff35e7b0ed98eb2418cacc7b6707" exitCode=0 Jun 11 22:52:24.721214 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.721175 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9r8c" event={"ID":"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251","Type":"ContainerDied","Data":"78ce803f62da19f7d41ca69b54661cabac51ff35e7b0ed98eb2418cacc7b6707"} Jun 11 22:52:24.723713 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.723296 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m48ng" event={"ID":"b7b5ec11-3548-4aa0-bb43-5a22074ea5e4","Type":"ContainerStarted","Data":"53497eb4a1d38b043105e5e279aa434e9050719260935fa6c7e97e38be4dc47a"} Jun 11 22:52:24.724237 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.724179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b5jz4" event={"ID":"f01823b1-ec0f-4636-bb5d-1d25a7e91152","Type":"ContainerStarted","Data":"1b211da5889502b9c2a625659f9527793fca351009fcc46ca067a4cb305d24c9"} Jun 11 22:52:24.725706 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.725687 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" event={"ID":"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76","Type":"ContainerStarted","Data":"e9fa2863947dd671911dc231bf398b25f6e5c75351497a5b9aebd0ccefc11f80"} Jun 11 22:52:24.751514 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.751450 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-179.ec2.internal" podStartSLOduration=21.751429466 podStartE2EDuration="21.751429466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:07.698442949 +0000 UTC m=+5.581765782" watchObservedRunningTime="2026-06-11 22:52:24.751429466 +0000 UTC m=+22.634752301" Jun 11 22:52:24.751833 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.751804 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dxc4s" podStartSLOduration=3.851512734 podStartE2EDuration="22.751788577s" totalImagesPullingTime="18.900275843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:24.751296191 +0000 UTC m=+22.634619022" watchObservedRunningTime="2026-06-11 22:52:24.751788577 +0000 UTC m=+22.635111410" Jun 11 22:52:24.841517 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.839536 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b5jz4" podStartSLOduration=3.938565024 podStartE2EDuration="22.839440897s" totalImagesPullingTime="18.900875873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:24.798423107 +0000 UTC m=+22.681745935" watchObservedRunningTime="2026-06-11 22:52:24.839440897 +0000 UTC m=+22.722763721" Jun 11 22:52:24.887372 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.887315 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gxzlc" podStartSLOduration=3.022762484 podStartE2EDuration="21.887293756s" totalImagesPullingTime="18.864531272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:24.868441343 +0000 UTC m=+22.751764174" watchObservedRunningTime="2026-06-11 22:52:24.887293756 +0000 UTC m=+22.770616588" Jun 11 22:52:24.887912 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.887888 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vxttp" podStartSLOduration=12.512261579 podStartE2EDuration="22.887881548s" totalImagesPullingTime="10.375619969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:24.887444332 +0000 UTC m=+22.770767145" watchObservedRunningTime="2026-06-11 22:52:24.887881548 +0000 UTC m=+22.771204411" Jun 11 22:52:24.904956 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:24.904918 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m48ng" podStartSLOduration=4.031098316 podStartE2EDuration="22.904903948s" totalImagesPullingTime="18.873805632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:24.904838617 +0000 UTC m=+22.788161459" watchObservedRunningTime="2026-06-11 22:52:24.904903948 +0000 UTC m=+22.788226780" Jun 11 22:52:25.605626 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:25.605576 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:25.606011 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:25.605707 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:25.730538 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:25.730502 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" event={"ID":"f47d704a-2272-485d-992e-0ad29e254298","Type":"ContainerStarted","Data":"16545686e6dfd01b9fcb9705a55bc2844f556a63fe1d3b4f378ecce3f5b26a79"} Jun 11 22:52:25.730706 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:25.730576 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" event={"ID":"f47d704a-2272-485d-992e-0ad29e254298","Type":"ContainerStarted","Data":"aefb5fe18f1b34ed2beed78bc4d672476f4a5f44867e22caeabf2dd49180bc8f"} Jun 11 22:52:25.730706 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:25.730657 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" event={"ID":"f47d704a-2272-485d-992e-0ad29e254298","Type":"ContainerStarted","Data":"cd36869cdefce7e3791d54688401980d90824558304ea8c3216784d41b2c5d8c"} Jun 11 22:52:25.730706 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:25.730688 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" event={"ID":"f47d704a-2272-485d-992e-0ad29e254298","Type":"ContainerStarted","Data":"7ecb636e49905b83bcf835fe92ebd82f0ba308a815e2ad73062e28f907d3d12f"} Jun 11 22:52:25.730835 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:25.730716 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" event={"ID":"f47d704a-2272-485d-992e-0ad29e254298","Type":"ContainerStarted","Data":"ce0251c0f2745d2eed195f49a4dd309cf235c14c8e3ea803b147e680105ae19a"} Jun 11 22:52:25.765821 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:25.765657 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 22:52:26.598226 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:26.598125 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T22:52:25.765818252Z","UUID":"2daa32be-74ce-4b32-9813-60287e6acd3c","Handler":null,"Name":"","Endpoint":""} Jun 11 22:52:26.599619 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:26.599581 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 22:52:26.599728 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:26.599634 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 22:52:26.605562 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:26.605538 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:26.605699 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:26.605664 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:26.605959 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:26.605715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:26.605959 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:26.605818 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:26.733628 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:26.733582 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2rj46" event={"ID":"671edf47-e582-4800-aea5-97d605e173e3","Type":"ContainerStarted","Data":"b664375f8c6c6709ff1f67e667f85e7458b2e73682553756b7c97c39e43f2b0e"} Jun 11 22:52:26.735573 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:26.735541 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" event={"ID":"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76","Type":"ContainerStarted","Data":"1babaa58f1e345f548b27e5dbe366eea9e16cd256555d74e97e33c58758cc4df"} Jun 11 22:52:26.735711 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:26.735612 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" event={"ID":"5e5d6e42-44e0-4107-b1b0-3f0930a7ab76","Type":"ContainerStarted","Data":"787e86ff68ca903dd9dafbc2d55a93c49e3630cab088f4eaae66bd10eaade452"} Jun 11 22:52:26.750166 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:26.750124 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2rj46" podStartSLOduration=5.878763298 podStartE2EDuration="24.750111363s" totalImagesPullingTime="18.871348065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:26.749953758 +0000 UTC m=+24.633276591" watchObservedRunningTime="2026-06-11 22:52:26.750111363 +0000 UTC m=+24.633434196" Jun 11 22:52:26.768268 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:26.768222 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cqn2v" podStartSLOduration=4.01799256 podStartE2EDuration="24.768208201s" totalImagesPullingTime="20.750215641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:26.767840651 +0000 UTC m=+24.651163484" watchObservedRunningTime="2026-06-11 22:52:26.768208201 +0000 UTC m=+24.651531032" Jun 11 22:52:26.963626 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:26.963568 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vxttp" Jun 11 22:52:26.964308 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:26.964283 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vxttp" Jun 11 22:52:27.605350 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:27.605319 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:27.605528 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:27.605507 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:27.742840 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:27.742791 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" event={"ID":"f47d704a-2272-485d-992e-0ad29e254298","Type":"ContainerStarted","Data":"be1561d2a3c5f6542094fcace1bd6b2b95eb84f07d33542d94baa49df1a373e7"} Jun 11 22:52:27.743448 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:27.743436 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vxttp" Jun 11 22:52:27.743553 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:27.743536 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vxttp" Jun 11 22:52:28.605414 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:28.605379 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:28.605604 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:28.605384 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:28.605604 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:28.605513 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:28.605692 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:28.605634 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:29.605022 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:29.604994 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:29.605660 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:29.605098 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:30.605856 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:30.605651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:30.606455 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:30.605661 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:30.606455 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:30.605970 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:30.606455 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:30.605983 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:30.753303 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:30.753259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" event={"ID":"f47d704a-2272-485d-992e-0ad29e254298","Type":"ContainerStarted","Data":"3d5110a8941e0825f14760de897bf93f82cf0ce71db72a4563b2b11758082583"} Jun 11 22:52:30.753548 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:30.753531 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:30.755074 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:30.755050 2578 generic.go:356] "Generic (PLEG): container finished" podID="3ca4a8ca-16e8-4e4f-b62e-b08ef861c251" containerID="39571f0d692969726ad193e22219286bcbedc986db87a3b706b8e18566b12564" exitCode=0 Jun 11 22:52:30.755206 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:30.755096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9r8c" event={"ID":"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251","Type":"ContainerDied","Data":"39571f0d692969726ad193e22219286bcbedc986db87a3b706b8e18566b12564"} Jun 11 22:52:30.770271 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:30.770250 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:30.780304 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:30.780263 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" podStartSLOduration=8.840249449 podStartE2EDuration="27.780250685s" totalImagesPullingTime="18.940001236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:30.778277047 +0000 UTC m=+28.661599873" watchObservedRunningTime="2026-06-11 22:52:30.780250685 +0000 UTC m=+28.663573516" Jun 11 22:52:31.605599 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:31.605557 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:31.605738 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:31.605669 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:31.758080 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:31.758053 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:31.758352 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:31.758140 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:31.774014 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:31.773994 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:52:31.925168 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:31.925143 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s452g"] Jun 11 22:52:31.925320 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:31.925305 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:31.925409 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:31.925391 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:31.928306 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:31.928283 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nvgqg"] Jun 11 22:52:31.928424 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:31.928407 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:31.928613 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:31.928562 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:31.929046 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:31.929025 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5smcr"] Jun 11 22:52:31.929124 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:31.929118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:31.929215 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:31.929195 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:32.761804 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:32.761623 2578 generic.go:356] "Generic (PLEG): container finished" podID="3ca4a8ca-16e8-4e4f-b62e-b08ef861c251" containerID="ef3b4996624d81afe32dd68a9238e22fd732a6a41fc7bc755cf99a8eadd3400f" exitCode=0 Jun 11 22:52:32.762157 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:32.761701 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9r8c" event={"ID":"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251","Type":"ContainerDied","Data":"ef3b4996624d81afe32dd68a9238e22fd732a6a41fc7bc755cf99a8eadd3400f"} Jun 11 22:52:33.605873 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:33.605791 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:33.605873 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:33.605815 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:33.606046 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:33.605912 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:33.606046 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:33.605964 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:33.606109 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:33.606064 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:33.606155 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:33.606136 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:34.768808 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:34.768770 2578 generic.go:356] "Generic (PLEG): container finished" podID="3ca4a8ca-16e8-4e4f-b62e-b08ef861c251" containerID="e1b2466c16c0469fab8d9cb969ec163a5d226f90efcdc25c54e52e6842d344d7" exitCode=0 Jun 11 22:52:34.769576 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:34.768849 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9r8c" event={"ID":"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251","Type":"ContainerDied","Data":"e1b2466c16c0469fab8d9cb969ec163a5d226f90efcdc25c54e52e6842d344d7"} Jun 11 22:52:35.605432 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:35.605336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:35.605432 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:35.605364 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:35.605432 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:35.605376 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:35.605675 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:35.605471 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:52:35.605675 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:35.605582 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvgqg" podUID="035057ba-16c5-4542-87f7-13bce9b448ac" Jun 11 22:52:35.605740 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:35.605680 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s452g" podUID="c752df24-652a-49ad-912b-e760b4a4cad7" Jun 11 22:52:36.387489 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:36.387458 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:36.388110 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:36.387505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:36.388110 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:36.387639 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:36.388110 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:36.387658 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:36.388110 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:36.387718 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs podName:f2093b4d-bc7b-46b4-b79a-032b54a323b6 nodeName:}" failed. No retries permitted until 2026-06-11 22:53:08.387698597 +0000 UTC m=+66.271021426 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs") pod "network-metrics-daemon-5smcr" (UID: "f2093b4d-bc7b-46b4-b79a-032b54a323b6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 22:52:36.388110 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:36.387737 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret podName:c752df24-652a-49ad-912b-e760b4a4cad7 nodeName:}" failed. No retries permitted until 2026-06-11 22:53:08.387728158 +0000 UTC m=+66.271050969 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret") pod "global-pull-secret-syncer-s452g" (UID: "c752df24-652a-49ad-912b-e760b4a4cad7") : object "kube-system"/"original-pull-secret" not registered Jun 11 22:52:36.488682 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:36.488648 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qskzq\" (UniqueName: \"kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq\") pod \"network-check-target-nvgqg\" (UID: \"035057ba-16c5-4542-87f7-13bce9b448ac\") " pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:36.488885 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:36.488833 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 22:52:36.488885 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:36.488859 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 22:52:36.488885 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:36.488872 2578 projected.go:196] Error preparing data for projected volume kube-api-access-qskzq for pod openshift-network-diagnostics/network-check-target-nvgqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:36.489051 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:36.488931 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq podName:035057ba-16c5-4542-87f7-13bce9b448ac nodeName:}" failed. No retries permitted until 2026-06-11 22:53:08.488914455 +0000 UTC m=+66.372237264 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qskzq" (UniqueName: "kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq") pod "network-check-target-nvgqg" (UID: "035057ba-16c5-4542-87f7-13bce9b448ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 22:52:37.434312 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.434282 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-179.ec2.internal" event="NodeReady" Jun 11 22:52:37.434794 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.434438 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 22:52:37.483527 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.483483 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-654696cff6-lxh9s"] Jun 11 22:52:37.501310 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.501272 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vnrbb"] Jun 11 22:52:37.501487 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.501410 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.504779 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.504756 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 22:52:37.504929 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.504830 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 22:52:37.505084 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.505058 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 22:52:37.505524 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.505369 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rjskh\"" Jun 11 22:52:37.517896 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.517872 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 22:52:37.525334 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.525309 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r857s"] Jun 11 22:52:37.525481 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.525444 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:37.529898 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.529878 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 22:52:37.530056 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.530023 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 22:52:37.530115 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.530063 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m9z2n\"" Jun 11 22:52:37.541381 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.541314 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-654696cff6-lxh9s"] Jun 11 22:52:37.541677 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.541406 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r857s" Jun 11 22:52:37.541677 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.541424 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vnrbb"] Jun 11 22:52:37.541677 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.541457 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r857s"] Jun 11 22:52:37.554384 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.554362 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 22:52:37.554485 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.554362 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 22:52:37.554485 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.554370 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 22:52:37.554485 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.554448 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wbppm\"" Jun 11 22:52:37.600064 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.600025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c612aab-e5f2-47c2-b34d-59df79068b8f-trusted-ca\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.600064 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.600057 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c612aab-e5f2-47c2-b34d-59df79068b8f-installation-pull-secrets\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.600276 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.600092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-tmp-dir\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:37.600276 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.600143 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pcjl\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-kube-api-access-5pcjl\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.600276 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.600181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrhkk\" (UniqueName: \"kubernetes.io/projected/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-kube-api-access-rrhkk\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:37.600276 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.600218 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c612aab-e5f2-47c2-b34d-59df79068b8f-ca-trust-extracted\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.600276 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.600249 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:37.600276 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.600269 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.600478 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.600308 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-bound-sa-token\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.600478 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.600335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-config-volume\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:37.600478 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.600357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c612aab-e5f2-47c2-b34d-59df79068b8f-image-registry-private-configuration\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.600478 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.600373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-certificates\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.605545 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.605527 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:52:37.605636 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.605621 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:52:37.605681 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.605650 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:52:37.610507 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.610483 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 22:52:37.613417 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.613395 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s94r6\"" Jun 11 22:52:37.613553 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.613533 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4mdrn\"" Jun 11 22:52:37.613883 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.613868 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 22:52:37.614339 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.614326 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 22:52:37.615137 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.615118 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 22:52:37.654810 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.654759 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxttp_8994707f-d5de-465f-be7c-61a9c4f7749d/konnectivity-agent/0.log" limit=1024 Jun 11 22:52:37.700820 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.700727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/669cf1be-fd7f-4d0e-a42a-52f85ed2b337-cert\") pod \"ingress-canary-r857s\" (UID: \"669cf1be-fd7f-4d0e-a42a-52f85ed2b337\") " pod="openshift-ingress-canary/ingress-canary-r857s" Jun 11 22:52:37.700820 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.700780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-bound-sa-token\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.701037 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.700853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-config-volume\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:37.701037 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.700896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c612aab-e5f2-47c2-b34d-59df79068b8f-image-registry-private-configuration\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.701037 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.700923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-certificates\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.701037 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.700948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c612aab-e5f2-47c2-b34d-59df79068b8f-trusted-ca\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.701037 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.700974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c612aab-e5f2-47c2-b34d-59df79068b8f-installation-pull-secrets\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.701037 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.701023 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-tmp-dir\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:37.701345 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.701046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pcjl\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-kube-api-access-5pcjl\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.701345 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.701099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrhkk\" (UniqueName: \"kubernetes.io/projected/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-kube-api-access-rrhkk\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:37.701345 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.701122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c612aab-e5f2-47c2-b34d-59df79068b8f-ca-trust-extracted\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.701345 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.701150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75jlc\" (UniqueName: \"kubernetes.io/projected/669cf1be-fd7f-4d0e-a42a-52f85ed2b337-kube-api-access-75jlc\") pod \"ingress-canary-r857s\" (UID: \"669cf1be-fd7f-4d0e-a42a-52f85ed2b337\") " pod="openshift-ingress-canary/ingress-canary-r857s" Jun 11 22:52:37.701345 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.701197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:37.701345 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.701223 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.701345 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.701304 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-tmp-dir\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:37.701345 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:37.701337 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 22:52:37.701345 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:37.701352 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654696cff6-lxh9s: secret "image-registry-tls" not found Jun 11 22:52:37.701821 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:37.701417 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls podName:9c612aab-e5f2-47c2-b34d-59df79068b8f nodeName:}" failed. No retries permitted until 2026-06-11 22:52:38.201399887 +0000 UTC m=+36.084722697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls") pod "image-registry-654696cff6-lxh9s" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f") : secret "image-registry-tls" not found Jun 11 22:52:37.701821 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.701565 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-certificates\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.701821 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.701617 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-config-volume\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:37.701821 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:37.701749 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:52:37.701821 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:37.701807 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls podName:9d904fc7-7dff-47ab-9ed8-d804c2aa6688 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:38.201789396 +0000 UTC m=+36.085112209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls") pod "dns-default-vnrbb" (UID: "9d904fc7-7dff-47ab-9ed8-d804c2aa6688") : secret "dns-default-metrics-tls" not found Jun 11 22:52:37.702095 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.701893 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c612aab-e5f2-47c2-b34d-59df79068b8f-ca-trust-extracted\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.702095 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.701937 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c612aab-e5f2-47c2-b34d-59df79068b8f-trusted-ca\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.706340 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.706322 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c612aab-e5f2-47c2-b34d-59df79068b8f-installation-pull-secrets\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.706464 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.706413 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c612aab-e5f2-47c2-b34d-59df79068b8f-image-registry-private-configuration\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.722786 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.722758 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-bound-sa-token\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.730225 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.730188 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrhkk\" (UniqueName: \"kubernetes.io/projected/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-kube-api-access-rrhkk\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:37.731794 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.731769 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pcjl\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-kube-api-access-5pcjl\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:37.800698 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.800660 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxttp_8994707f-d5de-465f-be7c-61a9c4f7749d/konnectivity-agent/0.log" limit=1024 Jun 11 22:52:37.802636 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.802601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/669cf1be-fd7f-4d0e-a42a-52f85ed2b337-cert\") pod \"ingress-canary-r857s\" (UID: \"669cf1be-fd7f-4d0e-a42a-52f85ed2b337\") " pod="openshift-ingress-canary/ingress-canary-r857s" Jun 11 22:52:37.802759 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.802706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75jlc\" (UniqueName: \"kubernetes.io/projected/669cf1be-fd7f-4d0e-a42a-52f85ed2b337-kube-api-access-75jlc\") pod \"ingress-canary-r857s\" (UID: \"669cf1be-fd7f-4d0e-a42a-52f85ed2b337\") " pod="openshift-ingress-canary/ingress-canary-r857s" Jun 11 22:52:37.805393 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.805370 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/669cf1be-fd7f-4d0e-a42a-52f85ed2b337-cert\") pod \"ingress-canary-r857s\" (UID: \"669cf1be-fd7f-4d0e-a42a-52f85ed2b337\") " pod="openshift-ingress-canary/ingress-canary-r857s" Jun 11 22:52:37.814417 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.814386 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75jlc\" (UniqueName: \"kubernetes.io/projected/669cf1be-fd7f-4d0e-a42a-52f85ed2b337-kube-api-access-75jlc\") pod \"ingress-canary-r857s\" (UID: \"669cf1be-fd7f-4d0e-a42a-52f85ed2b337\") " pod="openshift-ingress-canary/ingress-canary-r857s" Jun 11 22:52:37.853374 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:37.853341 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r857s" Jun 11 22:52:38.103682 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:38.103455 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r857s"] Jun 11 22:52:38.205869 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:38.205835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:38.205869 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:38.205872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:38.206129 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:38.205997 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:52:38.206129 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:38.206017 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 22:52:38.206129 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:38.206029 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654696cff6-lxh9s: secret "image-registry-tls" not found Jun 11 22:52:38.206129 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:38.206063 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls podName:9d904fc7-7dff-47ab-9ed8-d804c2aa6688 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:39.206047589 +0000 UTC m=+37.089370402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls") pod "dns-default-vnrbb" (UID: "9d904fc7-7dff-47ab-9ed8-d804c2aa6688") : secret "dns-default-metrics-tls" not found Jun 11 22:52:38.206129 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:38.206076 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls podName:9c612aab-e5f2-47c2-b34d-59df79068b8f nodeName:}" failed. No retries permitted until 2026-06-11 22:52:39.206070831 +0000 UTC m=+37.089393641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls") pod "image-registry-654696cff6-lxh9s" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f") : secret "image-registry-tls" not found Jun 11 22:52:39.215156 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:39.215116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:39.215156 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:39.215158 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:39.215735 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:39.215272 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:52:39.215735 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:39.215352 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls podName:9d904fc7-7dff-47ab-9ed8-d804c2aa6688 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:41.215331148 +0000 UTC m=+39.098653966 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls") pod "dns-default-vnrbb" (UID: "9d904fc7-7dff-47ab-9ed8-d804c2aa6688") : secret "dns-default-metrics-tls" not found Jun 11 22:52:39.215735 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:39.215356 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 22:52:39.215735 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:39.215374 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654696cff6-lxh9s: secret "image-registry-tls" not found Jun 11 22:52:39.215735 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:39.215413 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls podName:9c612aab-e5f2-47c2-b34d-59df79068b8f nodeName:}" failed. No retries permitted until 2026-06-11 22:52:41.215401018 +0000 UTC m=+39.098723828 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls") pod "image-registry-654696cff6-lxh9s" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f") : secret "image-registry-tls" not found Jun 11 22:52:39.550747 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:52:39.550676 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669cf1be_fd7f_4d0e_a42a_52f85ed2b337.slice/crio-4ebcc137d38e54b08bc636f1fd040da0c808d26861f6150bdd0e9f1eb47ad1f4 WatchSource:0}: Error finding container 4ebcc137d38e54b08bc636f1fd040da0c808d26861f6150bdd0e9f1eb47ad1f4: Status 404 returned error can't find the container with id 4ebcc137d38e54b08bc636f1fd040da0c808d26861f6150bdd0e9f1eb47ad1f4 Jun 11 22:52:39.786203 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:39.786170 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r857s" event={"ID":"669cf1be-fd7f-4d0e-a42a-52f85ed2b337","Type":"ContainerStarted","Data":"4ebcc137d38e54b08bc636f1fd040da0c808d26861f6150bdd0e9f1eb47ad1f4"} Jun 11 22:52:40.791511 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:40.791335 2578 generic.go:356] "Generic (PLEG): container finished" podID="3ca4a8ca-16e8-4e4f-b62e-b08ef861c251" containerID="7848a0fef2f3eb9697891bedd9b4c109648d38484e1b2c44214fd8dbd2248e2d" exitCode=0 Jun 11 22:52:40.791511 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:40.791421 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9r8c" event={"ID":"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251","Type":"ContainerDied","Data":"7848a0fef2f3eb9697891bedd9b4c109648d38484e1b2c44214fd8dbd2248e2d"} Jun 11 22:52:40.846105 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:40.846077 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxttp_8994707f-d5de-465f-be7c-61a9c4f7749d/konnectivity-agent/0.log" limit=1024 Jun 11 22:52:40.905673 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:40.905643 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxttp_8994707f-d5de-465f-be7c-61a9c4f7749d/konnectivity-agent/0.log" limit=1024 Jun 11 22:52:41.231281 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:41.231237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:41.231478 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:41.231286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:41.231478 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:41.231386 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 22:52:41.231478 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:41.231400 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654696cff6-lxh9s: secret "image-registry-tls" not found Jun 11 22:52:41.231478 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:41.231416 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:52:41.231478 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:41.231458 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls podName:9c612aab-e5f2-47c2-b34d-59df79068b8f nodeName:}" failed. No retries permitted until 2026-06-11 22:52:45.231445467 +0000 UTC m=+43.114768277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls") pod "image-registry-654696cff6-lxh9s" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f") : secret "image-registry-tls" not found Jun 11 22:52:41.231783 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:41.231539 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls podName:9d904fc7-7dff-47ab-9ed8-d804c2aa6688 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:45.231515137 +0000 UTC m=+43.114837956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls") pod "dns-default-vnrbb" (UID: "9d904fc7-7dff-47ab-9ed8-d804c2aa6688") : secret "dns-default-metrics-tls" not found Jun 11 22:52:41.615281 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:41.615244 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxttp_8994707f-d5de-465f-be7c-61a9c4f7749d/konnectivity-agent/0.log" limit=1024 Jun 11 22:52:41.673037 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:41.672999 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxttp_8994707f-d5de-465f-be7c-61a9c4f7749d/konnectivity-agent/0.log" limit=1024 Jun 11 22:52:41.797107 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:41.797021 2578 generic.go:356] "Generic (PLEG): container finished" podID="3ca4a8ca-16e8-4e4f-b62e-b08ef861c251" containerID="e39a76f1096bcc6dd06fb6cde94c7b4bb95e50b07e924dc2a763df27b506380f" exitCode=0 Jun 11 22:52:41.797107 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:41.797088 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9r8c" event={"ID":"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251","Type":"ContainerDied","Data":"e39a76f1096bcc6dd06fb6cde94c7b4bb95e50b07e924dc2a763df27b506380f"} Jun 11 22:52:41.798514 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:41.798491 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r857s" event={"ID":"669cf1be-fd7f-4d0e-a42a-52f85ed2b337","Type":"ContainerStarted","Data":"0f20a3183fb4114f0d52a2d74b1325299ccf0f058fd4e2ce098f699614d0404c"} Jun 11 22:52:41.834401 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:41.834339 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r857s" podStartSLOduration=2.923626452 podStartE2EDuration="4.834316982s" totalImagesPullingTime="1.91069053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:41.833712432 +0000 UTC m=+39.717035266" watchObservedRunningTime="2026-06-11 22:52:41.834316982 +0000 UTC m=+39.717639819" Jun 11 22:52:42.803659 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:42.803616 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9r8c" event={"ID":"3ca4a8ca-16e8-4e4f-b62e-b08ef861c251","Type":"ContainerStarted","Data":"20cf876474482541bbffaa0c6f26e49889d5910922a3e17ac668d89f7a54fb08"} Jun 11 22:52:42.830682 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:42.830632 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t9r8c" podStartSLOduration=8.54816236 podStartE2EDuration="39.830614632s" totalImagesPullingTime="31.282452272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:52:42.828874628 +0000 UTC m=+40.712197459" watchObservedRunningTime="2026-06-11 22:52:42.830614632 +0000 UTC m=+40.713937464" Jun 11 22:52:42.950501 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:42.950470 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxttp_8994707f-d5de-465f-be7c-61a9c4f7749d/konnectivity-agent/0.log" limit=1024 Jun 11 22:52:43.016458 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:43.016431 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxttp_8994707f-d5de-465f-be7c-61a9c4f7749d/konnectivity-agent/0.log" limit=1024 Jun 11 22:52:45.266610 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:45.266553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:45.267023 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:45.266622 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:45.267023 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:45.266710 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:52:45.267023 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:45.266718 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 22:52:45.267023 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:45.266734 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654696cff6-lxh9s: secret "image-registry-tls" not found Jun 11 22:52:45.267023 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:45.266775 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls podName:9d904fc7-7dff-47ab-9ed8-d804c2aa6688 nodeName:}" failed. No retries permitted until 2026-06-11 22:52:53.266760417 +0000 UTC m=+51.150083228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls") pod "dns-default-vnrbb" (UID: "9d904fc7-7dff-47ab-9ed8-d804c2aa6688") : secret "dns-default-metrics-tls" not found Jun 11 22:52:45.267023 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:45.266790 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls podName:9c612aab-e5f2-47c2-b34d-59df79068b8f nodeName:}" failed. No retries permitted until 2026-06-11 22:52:53.266784186 +0000 UTC m=+51.150106996 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls") pod "image-registry-654696cff6-lxh9s" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f") : secret "image-registry-tls" not found Jun 11 22:52:53.323506 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:53.323446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:52:53.323506 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:52:53.323504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:52:53.323942 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:53.323641 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 22:52:53.323942 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:53.323639 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:52:53.323942 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:53.323652 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654696cff6-lxh9s: secret "image-registry-tls" not found Jun 11 22:52:53.323942 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:53.323729 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls podName:9c612aab-e5f2-47c2-b34d-59df79068b8f nodeName:}" failed. No retries permitted until 2026-06-11 22:53:09.32371098 +0000 UTC m=+67.207033836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls") pod "image-registry-654696cff6-lxh9s" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f") : secret "image-registry-tls" not found Jun 11 22:52:53.323942 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:52:53.323747 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls podName:9d904fc7-7dff-47ab-9ed8-d804c2aa6688 nodeName:}" failed. No retries permitted until 2026-06-11 22:53:09.323737923 +0000 UTC m=+67.207060733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls") pod "dns-default-vnrbb" (UID: "9d904fc7-7dff-47ab-9ed8-d804c2aa6688") : secret "dns-default-metrics-tls" not found Jun 11 22:53:03.782169 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:03.782138 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hm2rt" Jun 11 22:53:08.431238 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.431190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:53:08.431722 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.431272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:53:08.433964 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.433942 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 22:53:08.434072 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.434038 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 22:53:08.442206 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:53:08.442186 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 22:53:08.442296 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:53:08.442253 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs podName:f2093b4d-bc7b-46b4-b79a-032b54a323b6 nodeName:}" failed. No retries permitted until 2026-06-11 22:54:12.442236875 +0000 UTC m=+130.325559685 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs") pod "network-metrics-daemon-5smcr" (UID: "f2093b4d-bc7b-46b4-b79a-032b54a323b6") : secret "metrics-daemon-secret" not found Jun 11 22:53:08.446049 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.446029 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c752df24-652a-49ad-912b-e760b4a4cad7-original-pull-secret\") pod \"global-pull-secret-syncer-s452g\" (UID: \"c752df24-652a-49ad-912b-e760b4a4cad7\") " pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:53:08.525846 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.525811 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s452g" Jun 11 22:53:08.531913 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.531889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qskzq\" (UniqueName: \"kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq\") pod \"network-check-target-nvgqg\" (UID: \"035057ba-16c5-4542-87f7-13bce9b448ac\") " pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:53:08.534574 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.534552 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 22:53:08.544885 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.544860 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 22:53:08.555370 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.555338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qskzq\" (UniqueName: \"kubernetes.io/projected/035057ba-16c5-4542-87f7-13bce9b448ac-kube-api-access-qskzq\") pod \"network-check-target-nvgqg\" (UID: \"035057ba-16c5-4542-87f7-13bce9b448ac\") " pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:53:08.660068 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.660038 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s452g"] Jun 11 22:53:08.663156 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:53:08.663125 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc752df24_652a_49ad_912b_e760b4a4cad7.slice/crio-32d548193cf40f956115555a1b10dacd33054ee97e69a3b97f1d19224135a3ee WatchSource:0}: Error finding container 32d548193cf40f956115555a1b10dacd33054ee97e69a3b97f1d19224135a3ee: Status 404 returned error can't find the container with id 32d548193cf40f956115555a1b10dacd33054ee97e69a3b97f1d19224135a3ee Jun 11 22:53:08.818275 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.818203 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4mdrn\"" Jun 11 22:53:08.826430 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.826412 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:53:08.867071 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.867036 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s452g" event={"ID":"c752df24-652a-49ad-912b-e760b4a4cad7","Type":"ContainerStarted","Data":"32d548193cf40f956115555a1b10dacd33054ee97e69a3b97f1d19224135a3ee"} Jun 11 22:53:08.946970 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:08.946936 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nvgqg"] Jun 11 22:53:08.950259 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:53:08.950230 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035057ba_16c5_4542_87f7_13bce9b448ac.slice/crio-41f066527a7463bbc5c2d60779f9fcfce67daec5315479bfa9b2b82726ee9123 WatchSource:0}: Error finding container 41f066527a7463bbc5c2d60779f9fcfce67daec5315479bfa9b2b82726ee9123: Status 404 returned error can't find the container with id 41f066527a7463bbc5c2d60779f9fcfce67daec5315479bfa9b2b82726ee9123 Jun 11 22:53:09.339943 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:09.339909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:53:09.340135 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:09.339953 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:53:09.340135 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:53:09.340083 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 22:53:09.340135 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:53:09.340096 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654696cff6-lxh9s: secret "image-registry-tls" not found Jun 11 22:53:09.340135 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:53:09.340095 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:53:09.340294 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:53:09.340165 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls podName:9c612aab-e5f2-47c2-b34d-59df79068b8f nodeName:}" failed. No retries permitted until 2026-06-11 22:53:41.340147021 +0000 UTC m=+99.223469831 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls") pod "image-registry-654696cff6-lxh9s" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f") : secret "image-registry-tls" not found Jun 11 22:53:09.340294 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:53:09.340179 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls podName:9d904fc7-7dff-47ab-9ed8-d804c2aa6688 nodeName:}" failed. No retries permitted until 2026-06-11 22:53:41.340173331 +0000 UTC m=+99.223496141 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls") pod "dns-default-vnrbb" (UID: "9d904fc7-7dff-47ab-9ed8-d804c2aa6688") : secret "dns-default-metrics-tls" not found Jun 11 22:53:09.871471 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:09.871428 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nvgqg" event={"ID":"035057ba-16c5-4542-87f7-13bce9b448ac","Type":"ContainerStarted","Data":"41f066527a7463bbc5c2d60779f9fcfce67daec5315479bfa9b2b82726ee9123"} Jun 11 22:53:13.884148 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:13.884110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s452g" event={"ID":"c752df24-652a-49ad-912b-e760b4a4cad7","Type":"ContainerStarted","Data":"478dc577da321ff282c689efbab488103813b7b386a42f770305b7bedefbdc8b"} Jun 11 22:53:13.885516 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:13.885486 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nvgqg" event={"ID":"035057ba-16c5-4542-87f7-13bce9b448ac","Type":"ContainerStarted","Data":"ff4561e7ac5737666b2e937a708d0fc5bba4c2466f3369a824a12b5e0b5fe139"} Jun 11 22:53:13.885644 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:13.885629 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:53:13.898775 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:13.898735 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s452g" podStartSLOduration=65.953257258 podStartE2EDuration="1m10.898723853s" totalImagesPullingTime="4.945466595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:52:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:53:13.898102237 +0000 UTC m=+71.781425071" watchObservedRunningTime="2026-06-11 22:53:13.898723853 +0000 UTC m=+71.782046685" Jun 11 22:53:13.912729 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:13.912681 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nvgqg" podStartSLOduration=66.257385539 podStartE2EDuration="1m10.912665461s" totalImagesPullingTime="4.655279922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:52:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:53:13.912141294 +0000 UTC m=+71.795464125" watchObservedRunningTime="2026-06-11 22:53:13.912665461 +0000 UTC m=+71.795988294" Jun 11 22:53:41.372710 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:41.372663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:53:41.372710 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:41.372718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:53:41.373102 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:53:41.372854 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 22:53:41.373102 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:53:41.372845 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:53:41.373102 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:53:41.372869 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654696cff6-lxh9s: secret "image-registry-tls" not found Jun 11 22:53:41.373102 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:53:41.372936 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls podName:9d904fc7-7dff-47ab-9ed8-d804c2aa6688 nodeName:}" failed. No retries permitted until 2026-06-11 22:54:45.372917043 +0000 UTC m=+163.256239853 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls") pod "dns-default-vnrbb" (UID: "9d904fc7-7dff-47ab-9ed8-d804c2aa6688") : secret "dns-default-metrics-tls" not found Jun 11 22:53:41.373102 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:53:41.372950 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls podName:9c612aab-e5f2-47c2-b34d-59df79068b8f nodeName:}" failed. No retries permitted until 2026-06-11 22:54:45.372943994 +0000 UTC m=+163.256266804 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls") pod "image-registry-654696cff6-lxh9s" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f") : secret "image-registry-tls" not found Jun 11 22:53:44.890314 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:53:44.890282 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nvgqg" Jun 11 22:54:12.490218 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:54:12.490162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:54:12.490760 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:54:12.490323 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 22:54:12.490760 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:54:12.490390 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs podName:f2093b4d-bc7b-46b4-b79a-032b54a323b6 nodeName:}" failed. No retries permitted until 2026-06-11 22:56:14.490373399 +0000 UTC m=+252.373696210 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs") pod "network-metrics-daemon-5smcr" (UID: "f2093b4d-bc7b-46b4-b79a-032b54a323b6") : secret "metrics-daemon-secret" not found Jun 11 22:54:40.513473 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:54:40.513426 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" podUID="9c612aab-e5f2-47c2-b34d-59df79068b8f" Jun 11 22:54:40.537095 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:54:40.537056 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vnrbb" podUID="9d904fc7-7dff-47ab-9ed8-d804c2aa6688" Jun 11 22:54:40.622005 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:54:40.621963 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5smcr" podUID="f2093b4d-bc7b-46b4-b79a-032b54a323b6" Jun 11 22:54:41.085101 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:54:41.085071 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vnrbb" Jun 11 22:54:41.085101 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:54:41.085100 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:54:45.418324 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:54:45.418231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:54:45.418324 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:54:45.418273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:54:45.418883 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:54:45.418373 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 22:54:45.418883 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:54:45.418418 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 22:54:45.418883 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:54:45.418431 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls podName:9d904fc7-7dff-47ab-9ed8-d804c2aa6688 nodeName:}" failed. No retries permitted until 2026-06-11 22:56:47.418415824 +0000 UTC m=+285.301738634 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls") pod "dns-default-vnrbb" (UID: "9d904fc7-7dff-47ab-9ed8-d804c2aa6688") : secret "dns-default-metrics-tls" not found Jun 11 22:54:45.418883 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:54:45.418432 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654696cff6-lxh9s: secret "image-registry-tls" not found Jun 11 22:54:45.418883 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:54:45.418496 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls podName:9c612aab-e5f2-47c2-b34d-59df79068b8f nodeName:}" failed. No retries permitted until 2026-06-11 22:56:47.418479882 +0000 UTC m=+285.301802694 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls") pod "image-registry-654696cff6-lxh9s" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f") : secret "image-registry-tls" not found Jun 11 22:54:51.605728 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:54:51.605686 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:55:42.449462 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.449423 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r8bg7"] Jun 11 22:55:42.452206 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.452188 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v"] Jun 11 22:55:42.452329 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.452308 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r8bg7" Jun 11 22:55:42.454735 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.454710 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n"] Jun 11 22:55:42.454863 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.454826 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 22:55:42.454928 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.454914 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" Jun 11 22:55:42.455088 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.455069 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-sd5pv\"" Jun 11 22:55:42.456344 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.456311 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 22:55:42.458395 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.458374 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7prhz\"" Jun 11 22:55:42.458618 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.458574 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 22:55:42.458693 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.458657 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 22:55:42.458957 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.458936 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 22:55:42.459302 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.459278 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 22:55:42.459935 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.459871 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:42.463411 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.463387 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r8bg7"] Jun 11 22:55:42.464193 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.464170 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 22:55:42.464286 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.464222 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 22:55:42.464286 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.464178 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 22:55:42.464390 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.464226 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v5bjn\"" Jun 11 22:55:42.464390 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.464344 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 22:55:42.469022 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.468980 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v"] Jun 11 22:55:42.471708 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.471687 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n"] Jun 11 22:55:42.541411 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.541377 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-fzs8p"] Jun 11 22:55:42.544296 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.544280 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:42.547004 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.546977 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 22:55:42.547004 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.546988 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 22:55:42.547156 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.546989 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ssvcq\"" Jun 11 22:55:42.558717 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.558669 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 22:55:42.558717 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.558714 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 22:55:42.559775 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.559757 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp"] Jun 11 22:55:42.562602 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.562572 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" Jun 11 22:55:42.565160 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.565105 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 22:55:42.565279 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.565192 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 22:55:42.565279 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.565213 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7sppw\"" Jun 11 22:55:42.565537 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.565506 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 22:55:42.565899 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.565881 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 22:55:42.566020 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.566002 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 22:55:42.566346 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.566332 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-fzs8p"] Jun 11 22:55:42.572408 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.572384 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp"] Jun 11 22:55:42.629211 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.629172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q76sz\" (UniqueName: \"kubernetes.io/projected/14fdc6e8-2048-458f-8ce4-8508053b86f1-kube-api-access-q76sz\") pod \"service-ca-operator-7ccbfd59dc-vgx7v\" (UID: \"14fdc6e8-2048-458f-8ce4-8508053b86f1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" Jun 11 22:55:42.629360 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.629229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b330625a-5360-4ad2-81b0-de7293b79ed5-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-dr45n\" (UID: \"b330625a-5360-4ad2-81b0-de7293b79ed5\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:42.629360 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.629247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsq9r\" (UniqueName: \"kubernetes.io/projected/b330625a-5360-4ad2-81b0-de7293b79ed5-kube-api-access-wsq9r\") pod \"cluster-monitoring-operator-f9d7df769-dr45n\" (UID: \"b330625a-5360-4ad2-81b0-de7293b79ed5\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:42.629360 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.629318 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22tbl\" (UniqueName: \"kubernetes.io/projected/9f9e5ef6-32b9-4a73-ae95-84dbf9a1285a-kube-api-access-22tbl\") pod \"volume-data-source-validator-bd4ccd799-r8bg7\" (UID: \"9f9e5ef6-32b9-4a73-ae95-84dbf9a1285a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r8bg7" Jun 11 22:55:42.629497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.629379 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/14fdc6e8-2048-458f-8ce4-8508053b86f1-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-vgx7v\" (UID: \"14fdc6e8-2048-458f-8ce4-8508053b86f1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" Jun 11 22:55:42.629497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.629397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14fdc6e8-2048-458f-8ce4-8508053b86f1-config\") pod \"service-ca-operator-7ccbfd59dc-vgx7v\" (UID: \"14fdc6e8-2048-458f-8ce4-8508053b86f1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" Jun 11 22:55:42.629497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.629416 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dr45n\" (UID: \"b330625a-5360-4ad2-81b0-de7293b79ed5\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:42.643787 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.643759 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-xztxx"] Jun 11 22:55:42.646618 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.646582 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-xztxx" Jun 11 22:55:42.649425 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.649398 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kfvsf\"" Jun 11 22:55:42.659977 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.659944 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-xztxx"] Jun 11 22:55:42.730249 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b330625a-5360-4ad2-81b0-de7293b79ed5-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-dr45n\" (UID: \"b330625a-5360-4ad2-81b0-de7293b79ed5\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:42.730249 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22tbl\" (UniqueName: \"kubernetes.io/projected/9f9e5ef6-32b9-4a73-ae95-84dbf9a1285a-kube-api-access-22tbl\") pod \"volume-data-source-validator-bd4ccd799-r8bg7\" (UID: \"9f9e5ef6-32b9-4a73-ae95-84dbf9a1285a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r8bg7" Jun 11 22:55:42.730249 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb-trusted-ca\") pod \"console-operator-5dbbb5d744-fzs8p\" (UID: \"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:42.730249 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14fdc6e8-2048-458f-8ce4-8508053b86f1-config\") pod \"service-ca-operator-7ccbfd59dc-vgx7v\" (UID: \"14fdc6e8-2048-458f-8ce4-8508053b86f1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" Jun 11 22:55:42.730620 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q76sz\" (UniqueName: \"kubernetes.io/projected/14fdc6e8-2048-458f-8ce4-8508053b86f1-kube-api-access-q76sz\") pod \"service-ca-operator-7ccbfd59dc-vgx7v\" (UID: \"14fdc6e8-2048-458f-8ce4-8508053b86f1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" Jun 11 22:55:42.730620 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68547bb5-ac97-4739-a039-ca0eb1ec5520-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9cqpp\" (UID: \"68547bb5-ac97-4739-a039-ca0eb1ec5520\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" Jun 11 22:55:42.730620 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dr45n\" (UID: \"b330625a-5360-4ad2-81b0-de7293b79ed5\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:42.730620 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb-serving-cert\") pod \"console-operator-5dbbb5d744-fzs8p\" (UID: \"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:42.730620 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85znr\" (UniqueName: \"kubernetes.io/projected/68547bb5-ac97-4739-a039-ca0eb1ec5520-kube-api-access-85znr\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9cqpp\" (UID: \"68547bb5-ac97-4739-a039-ca0eb1ec5520\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" Jun 11 22:55:42.730620 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:42.730421 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 22:55:42.730620 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsq9r\" (UniqueName: \"kubernetes.io/projected/b330625a-5360-4ad2-81b0-de7293b79ed5-kube-api-access-wsq9r\") pod \"cluster-monitoring-operator-f9d7df769-dr45n\" (UID: \"b330625a-5360-4ad2-81b0-de7293b79ed5\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:42.730620 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb-config\") pod \"console-operator-5dbbb5d744-fzs8p\" (UID: \"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:42.730620 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:42.730498 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls podName:b330625a-5360-4ad2-81b0-de7293b79ed5 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:43.230479381 +0000 UTC m=+221.113802193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-dr45n" (UID: "b330625a-5360-4ad2-81b0-de7293b79ed5") : secret "cluster-monitoring-operator-tls" not found Jun 11 22:55:42.731179 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68547bb5-ac97-4739-a039-ca0eb1ec5520-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9cqpp\" (UID: \"68547bb5-ac97-4739-a039-ca0eb1ec5520\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" Jun 11 22:55:42.731179 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/14fdc6e8-2048-458f-8ce4-8508053b86f1-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-vgx7v\" (UID: \"14fdc6e8-2048-458f-8ce4-8508053b86f1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" Jun 11 22:55:42.731179 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g99gg\" (UniqueName: \"kubernetes.io/projected/ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb-kube-api-access-g99gg\") pod \"console-operator-5dbbb5d744-fzs8p\" (UID: \"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:42.731179 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.730853 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14fdc6e8-2048-458f-8ce4-8508053b86f1-config\") pod \"service-ca-operator-7ccbfd59dc-vgx7v\" (UID: \"14fdc6e8-2048-458f-8ce4-8508053b86f1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" Jun 11 22:55:42.731179 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.731045 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b330625a-5360-4ad2-81b0-de7293b79ed5-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-dr45n\" (UID: \"b330625a-5360-4ad2-81b0-de7293b79ed5\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:42.733016 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.732999 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/14fdc6e8-2048-458f-8ce4-8508053b86f1-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-vgx7v\" (UID: \"14fdc6e8-2048-458f-8ce4-8508053b86f1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" Jun 11 22:55:42.739342 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.739310 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22tbl\" (UniqueName: \"kubernetes.io/projected/9f9e5ef6-32b9-4a73-ae95-84dbf9a1285a-kube-api-access-22tbl\") pod \"volume-data-source-validator-bd4ccd799-r8bg7\" (UID: \"9f9e5ef6-32b9-4a73-ae95-84dbf9a1285a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r8bg7" Jun 11 22:55:42.739553 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.739537 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q76sz\" (UniqueName: \"kubernetes.io/projected/14fdc6e8-2048-458f-8ce4-8508053b86f1-kube-api-access-q76sz\") pod \"service-ca-operator-7ccbfd59dc-vgx7v\" (UID: \"14fdc6e8-2048-458f-8ce4-8508053b86f1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" Jun 11 22:55:42.739703 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.739685 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsq9r\" (UniqueName: \"kubernetes.io/projected/b330625a-5360-4ad2-81b0-de7293b79ed5-kube-api-access-wsq9r\") pod \"cluster-monitoring-operator-f9d7df769-dr45n\" (UID: \"b330625a-5360-4ad2-81b0-de7293b79ed5\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:42.765061 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.765030 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r8bg7" Jun 11 22:55:42.772985 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.772966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" Jun 11 22:55:42.832248 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.832207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb-trusted-ca\") pod \"console-operator-5dbbb5d744-fzs8p\" (UID: \"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:42.832410 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.832276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75zdw\" (UniqueName: \"kubernetes.io/projected/cc82a72d-5036-4932-a6b1-d2e433d0260e-kube-api-access-75zdw\") pod \"network-check-source-6947749cfc-xztxx\" (UID: \"cc82a72d-5036-4932-a6b1-d2e433d0260e\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-xztxx" Jun 11 22:55:42.832410 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.832315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68547bb5-ac97-4739-a039-ca0eb1ec5520-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9cqpp\" (UID: \"68547bb5-ac97-4739-a039-ca0eb1ec5520\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" Jun 11 22:55:42.832410 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.832357 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb-serving-cert\") pod \"console-operator-5dbbb5d744-fzs8p\" (UID: \"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:42.832568 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.832411 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85znr\" (UniqueName: \"kubernetes.io/projected/68547bb5-ac97-4739-a039-ca0eb1ec5520-kube-api-access-85znr\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9cqpp\" (UID: \"68547bb5-ac97-4739-a039-ca0eb1ec5520\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" Jun 11 22:55:42.832568 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.832438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb-config\") pod \"console-operator-5dbbb5d744-fzs8p\" (UID: \"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:42.832568 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.832477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68547bb5-ac97-4739-a039-ca0eb1ec5520-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9cqpp\" (UID: \"68547bb5-ac97-4739-a039-ca0eb1ec5520\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" Jun 11 22:55:42.832568 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.832518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g99gg\" (UniqueName: \"kubernetes.io/projected/ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb-kube-api-access-g99gg\") pod \"console-operator-5dbbb5d744-fzs8p\" (UID: \"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:42.835330 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.835298 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb-config\") pod \"console-operator-5dbbb5d744-fzs8p\" (UID: \"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:42.835450 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.835386 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68547bb5-ac97-4739-a039-ca0eb1ec5520-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9cqpp\" (UID: \"68547bb5-ac97-4739-a039-ca0eb1ec5520\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" Jun 11 22:55:42.835940 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.835910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb-trusted-ca\") pod \"console-operator-5dbbb5d744-fzs8p\" (UID: \"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:42.838912 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.838867 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb-serving-cert\") pod \"console-operator-5dbbb5d744-fzs8p\" (UID: \"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:42.839583 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.839259 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68547bb5-ac97-4739-a039-ca0eb1ec5520-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9cqpp\" (UID: \"68547bb5-ac97-4739-a039-ca0eb1ec5520\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" Jun 11 22:55:42.846807 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.846776 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85znr\" (UniqueName: \"kubernetes.io/projected/68547bb5-ac97-4739-a039-ca0eb1ec5520-kube-api-access-85znr\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9cqpp\" (UID: \"68547bb5-ac97-4739-a039-ca0eb1ec5520\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" Jun 11 22:55:42.846930 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.846864 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g99gg\" (UniqueName: \"kubernetes.io/projected/ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb-kube-api-access-g99gg\") pod \"console-operator-5dbbb5d744-fzs8p\" (UID: \"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb\") " pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:42.852554 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.852523 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:42.871816 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.871725 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" Jun 11 22:55:42.906140 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.906103 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r8bg7"] Jun 11 22:55:42.909628 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:55:42.909476 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f9e5ef6_32b9_4a73_ae95_84dbf9a1285a.slice/crio-ad0bc6e384d2b4f18be8d536b99942ae26c1482cced50f15832266aa3202506a WatchSource:0}: Error finding container ad0bc6e384d2b4f18be8d536b99942ae26c1482cced50f15832266aa3202506a: Status 404 returned error can't find the container with id ad0bc6e384d2b4f18be8d536b99942ae26c1482cced50f15832266aa3202506a Jun 11 22:55:42.927054 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.927013 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v"] Jun 11 22:55:42.934093 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.932971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75zdw\" (UniqueName: \"kubernetes.io/projected/cc82a72d-5036-4932-a6b1-d2e433d0260e-kube-api-access-75zdw\") pod \"network-check-source-6947749cfc-xztxx\" (UID: \"cc82a72d-5036-4932-a6b1-d2e433d0260e\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-xztxx" Jun 11 22:55:42.943843 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.943815 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75zdw\" (UniqueName: \"kubernetes.io/projected/cc82a72d-5036-4932-a6b1-d2e433d0260e-kube-api-access-75zdw\") pod \"network-check-source-6947749cfc-xztxx\" (UID: \"cc82a72d-5036-4932-a6b1-d2e433d0260e\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-xztxx" Jun 11 22:55:42.955037 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:42.954793 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-xztxx" Jun 11 22:55:43.007541 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:43.007408 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-fzs8p"] Jun 11 22:55:43.015358 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:55:43.015327 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca5beba5_4b57_40ba_94e3_cccf5cc2a5bb.slice/crio-a381525b4759058269e58244f039c2f8ae645f3477621e779e779135fe06b8a7 WatchSource:0}: Error finding container a381525b4759058269e58244f039c2f8ae645f3477621e779e779135fe06b8a7: Status 404 returned error can't find the container with id a381525b4759058269e58244f039c2f8ae645f3477621e779e779135fe06b8a7 Jun 11 22:55:43.029361 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:43.029330 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp"] Jun 11 22:55:43.032598 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:55:43.032550 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68547bb5_ac97_4739_a039_ca0eb1ec5520.slice/crio-d4864a3fb85d1fb97a14796a18070ac121f34da76dcef14f9b6c04328efd6613 WatchSource:0}: Error finding container d4864a3fb85d1fb97a14796a18070ac121f34da76dcef14f9b6c04328efd6613: Status 404 returned error can't find the container with id d4864a3fb85d1fb97a14796a18070ac121f34da76dcef14f9b6c04328efd6613 Jun 11 22:55:43.094274 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:43.094235 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-xztxx"] Jun 11 22:55:43.097070 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:55:43.097033 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc82a72d_5036_4932_a6b1_d2e433d0260e.slice/crio-f873e642dc6094b4a9718556b7d3ef238ef849c22ca16b7f451fff9b9286de9f WatchSource:0}: Error finding container f873e642dc6094b4a9718556b7d3ef238ef849c22ca16b7f451fff9b9286de9f: Status 404 returned error can't find the container with id f873e642dc6094b4a9718556b7d3ef238ef849c22ca16b7f451fff9b9286de9f Jun 11 22:55:43.226304 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:43.226264 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r8bg7" event={"ID":"9f9e5ef6-32b9-4a73-ae95-84dbf9a1285a","Type":"ContainerStarted","Data":"ad0bc6e384d2b4f18be8d536b99942ae26c1482cced50f15832266aa3202506a"} Jun 11 22:55:43.227763 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:43.227730 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-xztxx" event={"ID":"cc82a72d-5036-4932-a6b1-d2e433d0260e","Type":"ContainerStarted","Data":"a85efaf4daba4ada93c6ef8e96c7286318e3b71f2401e08cab6a0f361089a866"} Jun 11 22:55:43.227894 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:43.227774 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-xztxx" event={"ID":"cc82a72d-5036-4932-a6b1-d2e433d0260e","Type":"ContainerStarted","Data":"f873e642dc6094b4a9718556b7d3ef238ef849c22ca16b7f451fff9b9286de9f"} Jun 11 22:55:43.229016 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:43.228984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" event={"ID":"68547bb5-ac97-4739-a039-ca0eb1ec5520","Type":"ContainerStarted","Data":"d4864a3fb85d1fb97a14796a18070ac121f34da76dcef14f9b6c04328efd6613"} Jun 11 22:55:43.230034 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:43.230014 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" event={"ID":"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb","Type":"ContainerStarted","Data":"a381525b4759058269e58244f039c2f8ae645f3477621e779e779135fe06b8a7"} Jun 11 22:55:43.231010 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:43.230980 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" event={"ID":"14fdc6e8-2048-458f-8ce4-8508053b86f1","Type":"ContainerStarted","Data":"47e05abc9e2559b529baa7fbb1c1ab020510b6411675d586dbc344bcdfc8f679"} Jun 11 22:55:43.234929 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:43.234890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dr45n\" (UID: \"b330625a-5360-4ad2-81b0-de7293b79ed5\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:43.235035 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:43.235022 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 22:55:43.235092 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:43.235086 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls podName:b330625a-5360-4ad2-81b0-de7293b79ed5 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:44.235068249 +0000 UTC m=+222.118391063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-dr45n" (UID: "b330625a-5360-4ad2-81b0-de7293b79ed5") : secret "cluster-monitoring-operator-tls" not found Jun 11 22:55:43.255264 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:43.255214 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-xztxx" podStartSLOduration=1.2551990530000001 podStartE2EDuration="1.255199053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:55:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:55:43.253996287 +0000 UTC m=+221.137319118" watchObservedRunningTime="2026-06-11 22:55:43.255199053 +0000 UTC m=+221.138521863" Jun 11 22:55:44.242828 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:44.242776 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dr45n\" (UID: \"b330625a-5360-4ad2-81b0-de7293b79ed5\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:44.243298 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:44.242918 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 22:55:44.243298 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:44.242978 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls podName:b330625a-5360-4ad2-81b0-de7293b79ed5 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:46.242961084 +0000 UTC m=+224.126283900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-dr45n" (UID: "b330625a-5360-4ad2-81b0-de7293b79ed5") : secret "cluster-monitoring-operator-tls" not found Jun 11 22:55:45.239579 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:45.239506 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r8bg7" event={"ID":"9f9e5ef6-32b9-4a73-ae95-84dbf9a1285a","Type":"ContainerStarted","Data":"b0098b0caedf66e014c60d211f03f2cba07b51082bcc73fb5733bee92c4d41da"} Jun 11 22:55:45.256138 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:45.256088 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r8bg7" podStartSLOduration=1.852655 podStartE2EDuration="3.25607164s" totalImagesPullingTime="1.40341664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:55:45.254834989 +0000 UTC m=+223.138157878" watchObservedRunningTime="2026-06-11 22:55:45.25607164 +0000 UTC m=+223.139394472" Jun 11 22:55:46.116966 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.116933 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gxtz5"] Jun 11 22:55:46.120663 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.120644 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.123093 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.123069 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 22:55:46.123093 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.123069 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 22:55:46.123259 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.123111 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 22:55:46.124260 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.124239 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kfbj2\"" Jun 11 22:55:46.124359 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.124263 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 22:55:46.133525 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.133500 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gxtz5"] Jun 11 22:55:46.158262 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.158238 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp794\" (UniqueName: \"kubernetes.io/projected/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-api-access-vp794\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.158360 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.158269 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-crio-socket\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.158360 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.158310 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-data-volume\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.158360 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.158341 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.158486 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.158369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.245579 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.245537 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" event={"ID":"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb","Type":"ContainerStarted","Data":"755d930eb4a93ed197a0dcb08fe7f493bd60f04d0033866a5e1f33d25cbab33a"} Jun 11 22:55:46.246150 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.245936 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:46.248054 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.247286 2578 patch_prober.go:28] interesting pod/console-operator-5dbbb5d744-fzs8p container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" start-of-body= Jun 11 22:55:46.248054 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.247336 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" podUID="ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" Jun 11 22:55:46.248054 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.247618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" event={"ID":"14fdc6e8-2048-458f-8ce4-8508053b86f1","Type":"ContainerStarted","Data":"eafaa725305f926975522ddb4a09399d0b418a52b89b5375915d7aa75b231014"} Jun 11 22:55:46.250241 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.250216 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" event={"ID":"68547bb5-ac97-4739-a039-ca0eb1ec5520","Type":"ContainerStarted","Data":"183b16ee494994809759ac9e289d8f50035e17685b90a083accb96d83030e6c3"} Jun 11 22:55:46.260161 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.258927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-data-volume\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.260161 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.258993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.260161 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.259073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dr45n\" (UID: \"b330625a-5360-4ad2-81b0-de7293b79ed5\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:46.260161 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.259101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.260161 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:46.259140 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 22:55:46.260161 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:46.259190 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls podName:5f8f6ce8-ecca-462d-a232-b0fbefa4e63f nodeName:}" failed. No retries permitted until 2026-06-11 22:55:46.759176353 +0000 UTC m=+224.642499163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gxtz5" (UID: "5f8f6ce8-ecca-462d-a232-b0fbefa4e63f") : secret "insights-runtime-extractor-tls" not found Jun 11 22:55:46.260161 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.259221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp794\" (UniqueName: \"kubernetes.io/projected/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-api-access-vp794\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.260161 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.259244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-crio-socket\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.260161 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.259310 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-crio-socket\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.260161 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:46.259859 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 22:55:46.260161 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:46.259911 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls podName:b330625a-5360-4ad2-81b0-de7293b79ed5 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:50.259895188 +0000 UTC m=+228.143218001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-dr45n" (UID: "b330625a-5360-4ad2-81b0-de7293b79ed5") : secret "cluster-monitoring-operator-tls" not found Jun 11 22:55:46.260161 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:46.259956 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 22:55:46.260161 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.259953 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-data-volume\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.260161 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:46.259993 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm podName:5f8f6ce8-ecca-462d-a232-b0fbefa4e63f nodeName:}" failed. No retries permitted until 2026-06-11 22:55:46.759981483 +0000 UTC m=+224.643304330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gxtz5" (UID: "5f8f6ce8-ecca-462d-a232-b0fbefa4e63f") : configmap "kube-rbac-proxy" not found Jun 11 22:55:46.263480 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.263087 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" podStartSLOduration=1.134646793 podStartE2EDuration="4.263074s" totalImagesPullingTime="3.128427207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:55:46.262849678 +0000 UTC m=+224.146172507" watchObservedRunningTime="2026-06-11 22:55:46.263074 +0000 UTC m=+224.146396828" Jun 11 22:55:46.271978 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.271951 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp794\" (UniqueName: \"kubernetes.io/projected/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-api-access-vp794\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.283946 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.283889 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" podStartSLOduration=1.078202702 podStartE2EDuration="4.283872961s" totalImagesPullingTime="3.205670259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:55:46.283631194 +0000 UTC m=+224.166954029" watchObservedRunningTime="2026-06-11 22:55:46.283872961 +0000 UTC m=+224.167195792" Jun 11 22:55:46.300465 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.300414 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" podStartSLOduration=1.190954175 podStartE2EDuration="4.300396995s" totalImagesPullingTime="3.10944282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:55:46.299813849 +0000 UTC m=+224.183136681" watchObservedRunningTime="2026-06-11 22:55:46.300396995 +0000 UTC m=+224.183719826" Jun 11 22:55:46.763606 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.763544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.763782 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:46.763688 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:46.763782 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:46.763689 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 22:55:46.763782 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:46.763771 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm podName:5f8f6ce8-ecca-462d-a232-b0fbefa4e63f nodeName:}" failed. No retries permitted until 2026-06-11 22:55:47.763752416 +0000 UTC m=+225.647075225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gxtz5" (UID: "5f8f6ce8-ecca-462d-a232-b0fbefa4e63f") : configmap "kube-rbac-proxy" not found Jun 11 22:55:46.763917 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:46.763838 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 22:55:46.763917 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:46.763889 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls podName:5f8f6ce8-ecca-462d-a232-b0fbefa4e63f nodeName:}" failed. No retries permitted until 2026-06-11 22:55:47.763876192 +0000 UTC m=+225.647199008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gxtz5" (UID: "5f8f6ce8-ecca-462d-a232-b0fbefa4e63f") : secret "insights-runtime-extractor-tls" not found Jun 11 22:55:47.255451 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:47.255423 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/0.log" Jun 11 22:55:47.255637 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:47.255461 2578 generic.go:356] "Generic (PLEG): container finished" podID="ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb" containerID="755d930eb4a93ed197a0dcb08fe7f493bd60f04d0033866a5e1f33d25cbab33a" exitCode=255 Jun 11 22:55:47.255637 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:47.255540 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" event={"ID":"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb","Type":"ContainerDied","Data":"755d930eb4a93ed197a0dcb08fe7f493bd60f04d0033866a5e1f33d25cbab33a"} Jun 11 22:55:47.255822 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:47.255809 2578 scope.go:117] "RemoveContainer" containerID="755d930eb4a93ed197a0dcb08fe7f493bd60f04d0033866a5e1f33d25cbab33a" Jun 11 22:55:47.773630 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:47.773561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:47.774038 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:47.773705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:47.774038 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:47.773721 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 22:55:47.774038 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:47.773801 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 22:55:47.774038 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:47.773803 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm podName:5f8f6ce8-ecca-462d-a232-b0fbefa4e63f nodeName:}" failed. No retries permitted until 2026-06-11 22:55:49.773783257 +0000 UTC m=+227.657106084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gxtz5" (UID: "5f8f6ce8-ecca-462d-a232-b0fbefa4e63f") : configmap "kube-rbac-proxy" not found Jun 11 22:55:47.774038 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:47.773863 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls podName:5f8f6ce8-ecca-462d-a232-b0fbefa4e63f nodeName:}" failed. No retries permitted until 2026-06-11 22:55:49.773836846 +0000 UTC m=+227.657159657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gxtz5" (UID: "5f8f6ce8-ecca-462d-a232-b0fbefa4e63f") : secret "insights-runtime-extractor-tls" not found Jun 11 22:55:47.897509 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:47.897479 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gxzlc_54366c51-87c6-4077-b5f1-b4513f516370/dns-node-resolver/0.log" Jun 11 22:55:48.263758 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.263729 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/1.log" Jun 11 22:55:48.264158 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.264144 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/0.log" Jun 11 22:55:48.264231 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.264178 2578 generic.go:356] "Generic (PLEG): container finished" podID="ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb" containerID="b3939017a01d97a1f3ce1dafe5668b6924fa05c67761a69d30f150ed9464d5cd" exitCode=255 Jun 11 22:55:48.264231 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.264203 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" event={"ID":"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb","Type":"ContainerDied","Data":"b3939017a01d97a1f3ce1dafe5668b6924fa05c67761a69d30f150ed9464d5cd"} Jun 11 22:55:48.264321 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.264263 2578 scope.go:117] "RemoveContainer" containerID="755d930eb4a93ed197a0dcb08fe7f493bd60f04d0033866a5e1f33d25cbab33a" Jun 11 22:55:48.264509 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.264493 2578 scope.go:117] "RemoveContainer" containerID="b3939017a01d97a1f3ce1dafe5668b6924fa05c67761a69d30f150ed9464d5cd" Jun 11 22:55:48.264725 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:48.264706 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-fzs8p_openshift-console-operator(ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" podUID="ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb" Jun 11 22:55:48.764530 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.764489 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-xkpzk"] Jun 11 22:55:48.768990 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.768964 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-xkpzk" Jun 11 22:55:48.771745 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.771722 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 22:55:48.771873 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.771759 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jkzcb\"" Jun 11 22:55:48.772880 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.772861 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 22:55:48.775404 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.775379 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-xkpzk"] Jun 11 22:55:48.782396 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.782363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlsnk\" (UniqueName: \"kubernetes.io/projected/db92962e-82f0-43eb-97ce-f33917f114a6-kube-api-access-mlsnk\") pod \"migrator-d4bcd4867-xkpzk\" (UID: \"db92962e-82f0-43eb-97ce-f33917f114a6\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-xkpzk" Jun 11 22:55:48.883298 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.883261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlsnk\" (UniqueName: \"kubernetes.io/projected/db92962e-82f0-43eb-97ce-f33917f114a6-kube-api-access-mlsnk\") pod \"migrator-d4bcd4867-xkpzk\" (UID: \"db92962e-82f0-43eb-97ce-f33917f114a6\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-xkpzk" Jun 11 22:55:48.891707 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.891678 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlsnk\" (UniqueName: \"kubernetes.io/projected/db92962e-82f0-43eb-97ce-f33917f114a6-kube-api-access-mlsnk\") pod \"migrator-d4bcd4867-xkpzk\" (UID: \"db92962e-82f0-43eb-97ce-f33917f114a6\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-xkpzk" Jun 11 22:55:48.899636 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:48.899614 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b5jz4_f01823b1-ec0f-4636-bb5d-1d25a7e91152/node-ca/0.log" Jun 11 22:55:49.078779 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.078696 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-xkpzk" Jun 11 22:55:49.120850 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.120810 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-t652t"] Jun 11 22:55:49.124860 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.124841 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-t652t" Jun 11 22:55:49.127968 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.127713 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 22:55:49.127968 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.127758 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 22:55:49.127968 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.127813 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 22:55:49.127968 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.127852 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-t8z99\"" Jun 11 22:55:49.129185 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.128797 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 22:55:49.133073 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.133039 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-t652t"] Jun 11 22:55:49.186320 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.186290 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f25be812-7e0f-4e38-98ee-80e38a47ce3c-signing-cabundle\") pod \"service-ca-7b994bc59-t652t\" (UID: \"f25be812-7e0f-4e38-98ee-80e38a47ce3c\") " pod="openshift-service-ca/service-ca-7b994bc59-t652t" Jun 11 22:55:49.186465 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.186327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f25be812-7e0f-4e38-98ee-80e38a47ce3c-signing-key\") pod \"service-ca-7b994bc59-t652t\" (UID: \"f25be812-7e0f-4e38-98ee-80e38a47ce3c\") " pod="openshift-service-ca/service-ca-7b994bc59-t652t" Jun 11 22:55:49.186465 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.186410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9tgv\" (UniqueName: \"kubernetes.io/projected/f25be812-7e0f-4e38-98ee-80e38a47ce3c-kube-api-access-q9tgv\") pod \"service-ca-7b994bc59-t652t\" (UID: \"f25be812-7e0f-4e38-98ee-80e38a47ce3c\") " pod="openshift-service-ca/service-ca-7b994bc59-t652t" Jun 11 22:55:49.213248 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.213216 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-xkpzk"] Jun 11 22:55:49.215946 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:55:49.215920 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb92962e_82f0_43eb_97ce_f33917f114a6.slice/crio-d986787d240d6641d18ce3442b8376cb5c5bf97ef5ba87e9e536340a150a441d WatchSource:0}: Error finding container d986787d240d6641d18ce3442b8376cb5c5bf97ef5ba87e9e536340a150a441d: Status 404 returned error can't find the container with id d986787d240d6641d18ce3442b8376cb5c5bf97ef5ba87e9e536340a150a441d Jun 11 22:55:49.268665 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.268617 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-xkpzk" event={"ID":"db92962e-82f0-43eb-97ce-f33917f114a6","Type":"ContainerStarted","Data":"d986787d240d6641d18ce3442b8376cb5c5bf97ef5ba87e9e536340a150a441d"} Jun 11 22:55:49.269898 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.269880 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/1.log" Jun 11 22:55:49.270344 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.270323 2578 scope.go:117] "RemoveContainer" containerID="b3939017a01d97a1f3ce1dafe5668b6924fa05c67761a69d30f150ed9464d5cd" Jun 11 22:55:49.270494 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:49.270462 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-fzs8p_openshift-console-operator(ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" podUID="ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb" Jun 11 22:55:49.287428 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.287392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f25be812-7e0f-4e38-98ee-80e38a47ce3c-signing-cabundle\") pod \"service-ca-7b994bc59-t652t\" (UID: \"f25be812-7e0f-4e38-98ee-80e38a47ce3c\") " pod="openshift-service-ca/service-ca-7b994bc59-t652t" Jun 11 22:55:49.287665 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.287472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f25be812-7e0f-4e38-98ee-80e38a47ce3c-signing-key\") pod \"service-ca-7b994bc59-t652t\" (UID: \"f25be812-7e0f-4e38-98ee-80e38a47ce3c\") " pod="openshift-service-ca/service-ca-7b994bc59-t652t" Jun 11 22:55:49.287665 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.287538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9tgv\" (UniqueName: \"kubernetes.io/projected/f25be812-7e0f-4e38-98ee-80e38a47ce3c-kube-api-access-q9tgv\") pod \"service-ca-7b994bc59-t652t\" (UID: \"f25be812-7e0f-4e38-98ee-80e38a47ce3c\") " pod="openshift-service-ca/service-ca-7b994bc59-t652t" Jun 11 22:55:49.288189 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.288153 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f25be812-7e0f-4e38-98ee-80e38a47ce3c-signing-cabundle\") pod \"service-ca-7b994bc59-t652t\" (UID: \"f25be812-7e0f-4e38-98ee-80e38a47ce3c\") " pod="openshift-service-ca/service-ca-7b994bc59-t652t" Jun 11 22:55:49.290259 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.290240 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f25be812-7e0f-4e38-98ee-80e38a47ce3c-signing-key\") pod \"service-ca-7b994bc59-t652t\" (UID: \"f25be812-7e0f-4e38-98ee-80e38a47ce3c\") " pod="openshift-service-ca/service-ca-7b994bc59-t652t" Jun 11 22:55:49.296647 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.296621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9tgv\" (UniqueName: \"kubernetes.io/projected/f25be812-7e0f-4e38-98ee-80e38a47ce3c-kube-api-access-q9tgv\") pod \"service-ca-7b994bc59-t652t\" (UID: \"f25be812-7e0f-4e38-98ee-80e38a47ce3c\") " pod="openshift-service-ca/service-ca-7b994bc59-t652t" Jun 11 22:55:49.437862 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.437816 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-t652t" Jun 11 22:55:49.570166 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.570131 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-t652t"] Jun 11 22:55:49.574690 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:55:49.574655 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25be812_7e0f_4e38_98ee_80e38a47ce3c.slice/crio-78497cf45002758c2f69d0fb2850f6892b512e96e68cc050caade44ef704b303 WatchSource:0}: Error finding container 78497cf45002758c2f69d0fb2850f6892b512e96e68cc050caade44ef704b303: Status 404 returned error can't find the container with id 78497cf45002758c2f69d0fb2850f6892b512e96e68cc050caade44ef704b303 Jun 11 22:55:49.792631 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.792524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:49.792631 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:49.792605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:49.793127 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:49.792706 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 22:55:49.793127 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:49.792729 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 22:55:49.793127 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:49.792784 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls podName:5f8f6ce8-ecca-462d-a232-b0fbefa4e63f nodeName:}" failed. No retries permitted until 2026-06-11 22:55:53.792761284 +0000 UTC m=+231.676084099 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gxtz5" (UID: "5f8f6ce8-ecca-462d-a232-b0fbefa4e63f") : secret "insights-runtime-extractor-tls" not found Jun 11 22:55:49.793127 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:49.792806 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm podName:5f8f6ce8-ecca-462d-a232-b0fbefa4e63f nodeName:}" failed. No retries permitted until 2026-06-11 22:55:53.792795567 +0000 UTC m=+231.676118381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gxtz5" (UID: "5f8f6ce8-ecca-462d-a232-b0fbefa4e63f") : configmap "kube-rbac-proxy" not found Jun 11 22:55:50.096482 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:50.096397 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r857s_669cf1be-fd7f-4d0e-a42a-52f85ed2b337/serve-healthcheck-canary/0.log" Jun 11 22:55:50.275451 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:50.275414 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-t652t" event={"ID":"f25be812-7e0f-4e38-98ee-80e38a47ce3c","Type":"ContainerStarted","Data":"c912cd78fe2fb8d7832f435119c22b0b047d91a75bfa5c75dcd5d8a5aaa144da"} Jun 11 22:55:50.275451 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:50.275461 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-t652t" event={"ID":"f25be812-7e0f-4e38-98ee-80e38a47ce3c","Type":"ContainerStarted","Data":"78497cf45002758c2f69d0fb2850f6892b512e96e68cc050caade44ef704b303"} Jun 11 22:55:50.295844 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:50.295780 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-t652t" podStartSLOduration=1.2957562280000001 podStartE2EDuration="1.295756228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:55:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:55:50.293226223 +0000 UTC m=+228.176549057" watchObservedRunningTime="2026-06-11 22:55:50.295756228 +0000 UTC m=+228.179079061" Jun 11 22:55:50.296504 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:50.296483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dr45n\" (UID: \"b330625a-5360-4ad2-81b0-de7293b79ed5\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:50.296658 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:50.296638 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 22:55:50.296749 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:50.296696 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls podName:b330625a-5360-4ad2-81b0-de7293b79ed5 nodeName:}" failed. No retries permitted until 2026-06-11 22:55:58.296683338 +0000 UTC m=+236.180006148 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-dr45n" (UID: "b330625a-5360-4ad2-81b0-de7293b79ed5") : secret "cluster-monitoring-operator-tls" not found Jun 11 22:55:51.282828 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:51.282789 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-xkpzk" event={"ID":"db92962e-82f0-43eb-97ce-f33917f114a6","Type":"ContainerStarted","Data":"5bce0eace6477cbb6d609c44155ec2fee721927d4898319a01fa335ac0bb23e0"} Jun 11 22:55:51.283294 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:51.282889 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-xkpzk" event={"ID":"db92962e-82f0-43eb-97ce-f33917f114a6","Type":"ContainerStarted","Data":"f74a61cf4f9fb960921b212fc0d493edb34f78cf86c671d36009a98186aa4983"} Jun 11 22:55:51.322447 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:51.322381 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-xkpzk" podStartSLOduration=1.6893900450000001 podStartE2EDuration="3.322358634s" totalImagesPullingTime="1.632968589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:55:51.319580457 +0000 UTC m=+229.202903291" watchObservedRunningTime="2026-06-11 22:55:51.322358634 +0000 UTC m=+229.205681467" Jun 11 22:55:52.853926 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:52.853831 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:52.854281 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:52.854254 2578 scope.go:117] "RemoveContainer" containerID="b3939017a01d97a1f3ce1dafe5668b6924fa05c67761a69d30f150ed9464d5cd" Jun 11 22:55:52.854416 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:52.854396 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-fzs8p_openshift-console-operator(ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" podUID="ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb" Jun 11 22:55:53.829257 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:53.829212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:53.829257 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:53.829263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:55:53.829479 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:53.829330 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 22:55:53.829479 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:53.829385 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 22:55:53.829479 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:53.829439 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm podName:5f8f6ce8-ecca-462d-a232-b0fbefa4e63f nodeName:}" failed. No retries permitted until 2026-06-11 22:56:01.829417622 +0000 UTC m=+239.712740436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gxtz5" (UID: "5f8f6ce8-ecca-462d-a232-b0fbefa4e63f") : configmap "kube-rbac-proxy" not found Jun 11 22:55:53.829479 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:53.829470 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls podName:5f8f6ce8-ecca-462d-a232-b0fbefa4e63f nodeName:}" failed. No retries permitted until 2026-06-11 22:56:01.829460609 +0000 UTC m=+239.712783422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gxtz5" (UID: "5f8f6ce8-ecca-462d-a232-b0fbefa4e63f") : secret "insights-runtime-extractor-tls" not found Jun 11 22:55:56.246147 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:56.246099 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:55:56.246528 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:56.246505 2578 scope.go:117] "RemoveContainer" containerID="b3939017a01d97a1f3ce1dafe5668b6924fa05c67761a69d30f150ed9464d5cd" Jun 11 22:55:56.246706 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:55:56.246685 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-fzs8p_openshift-console-operator(ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" podUID="ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb" Jun 11 22:55:58.367566 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:58.367526 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dr45n\" (UID: \"b330625a-5360-4ad2-81b0-de7293b79ed5\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:58.370124 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:58.370096 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b330625a-5360-4ad2-81b0-de7293b79ed5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dr45n\" (UID: \"b330625a-5360-4ad2-81b0-de7293b79ed5\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:58.377940 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:58.377920 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" Jun 11 22:55:58.508798 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:58.508765 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n"] Jun 11 22:55:58.511901 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:55:58.511875 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb330625a_5360_4ad2_81b0_de7293b79ed5.slice/crio-ba5ae8ede6ed7c25ae48a75b676d28550a19bfe1842fa2190d38d698865a3f58 WatchSource:0}: Error finding container ba5ae8ede6ed7c25ae48a75b676d28550a19bfe1842fa2190d38d698865a3f58: Status 404 returned error can't find the container with id ba5ae8ede6ed7c25ae48a75b676d28550a19bfe1842fa2190d38d698865a3f58 Jun 11 22:55:59.309821 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:55:59.309782 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" event={"ID":"b330625a-5360-4ad2-81b0-de7293b79ed5","Type":"ContainerStarted","Data":"ba5ae8ede6ed7c25ae48a75b676d28550a19bfe1842fa2190d38d698865a3f58"} Jun 11 22:56:00.316927 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:00.316890 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" event={"ID":"b330625a-5360-4ad2-81b0-de7293b79ed5","Type":"ContainerStarted","Data":"c0c4a8e8b85bc5802dd72876c0126a6b50e69fb1e2c9a24d837dd1bd1d1e78a1"} Jun 11 22:56:00.335030 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:00.334982 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dr45n" podStartSLOduration=16.628684477 podStartE2EDuration="18.334965731s" totalImagesPullingTime="1.706281254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:00.333964483 +0000 UTC m=+238.217287315" watchObservedRunningTime="2026-06-11 22:56:00.334965731 +0000 UTC m=+238.218288565" Jun 11 22:56:01.897322 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:01.897278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:56:01.897322 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:01.897321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:56:01.897899 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:01.897825 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:56:01.899871 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:01.899851 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f8f6ce8-ecca-462d-a232-b0fbefa4e63f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gxtz5\" (UID: \"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f\") " pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:56:02.033316 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:02.033277 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gxtz5" Jun 11 22:56:02.162078 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:02.162050 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gxtz5"] Jun 11 22:56:02.164418 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:56:02.164390 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8f6ce8_ecca_462d_a232_b0fbefa4e63f.slice/crio-9956e8dfe9c721054c2e18a6924b29b923eeb631ec852df2790667706aa7ae3b WatchSource:0}: Error finding container 9956e8dfe9c721054c2e18a6924b29b923eeb631ec852df2790667706aa7ae3b: Status 404 returned error can't find the container with id 9956e8dfe9c721054c2e18a6924b29b923eeb631ec852df2790667706aa7ae3b Jun 11 22:56:02.324459 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:02.324419 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gxtz5" event={"ID":"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f","Type":"ContainerStarted","Data":"9956e8dfe9c721054c2e18a6924b29b923eeb631ec852df2790667706aa7ae3b"} Jun 11 22:56:06.365514 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:06.365480 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gxtz5" event={"ID":"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f","Type":"ContainerStarted","Data":"d949aaac3f19e2524de8b0d61ee6757a431ff7bc1ef625e3fae428767ef7ac7e"} Jun 11 22:56:07.370882 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:07.370846 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gxtz5" event={"ID":"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f","Type":"ContainerStarted","Data":"92117814ff565af672d39cd5f47d84fd11a4ffd9b01459fbca7bdd9c10a404d0"} Jun 11 22:56:08.376204 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:08.376108 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gxtz5" event={"ID":"5f8f6ce8-ecca-462d-a232-b0fbefa4e63f","Type":"ContainerStarted","Data":"f5a6f05586974de22e81e287a32677f8403c9ad0717e6bb602feefdfb0fd134a"} Jun 11 22:56:08.395428 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:08.395377 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gxtz5" podStartSLOduration=16.662298578 podStartE2EDuration="22.395361221s" totalImagesPullingTime="5.733062643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:55:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:08.394302849 +0000 UTC m=+246.277625682" watchObservedRunningTime="2026-06-11 22:56:08.395361221 +0000 UTC m=+246.278684090" Jun 11 22:56:08.606083 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:08.606044 2578 scope.go:117] "RemoveContainer" containerID="b3939017a01d97a1f3ce1dafe5668b6924fa05c67761a69d30f150ed9464d5cd" Jun 11 22:56:09.381075 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:09.381047 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/1.log" Jun 11 22:56:09.381466 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:09.381165 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" event={"ID":"ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb","Type":"ContainerStarted","Data":"cf25a49fb880e137d18fbc92655ff8947791399b6dc318e8f685c847e503e37a"} Jun 11 22:56:09.381662 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:09.381644 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:56:09.386186 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:09.386163 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-fzs8p" Jun 11 22:56:11.766742 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.766705 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm"] Jun 11 22:56:11.770122 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.770099 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:11.774142 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.774117 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 22:56:11.774142 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.774140 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 22:56:11.774283 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.774172 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-f2xsf\"" Jun 11 22:56:11.774283 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.774115 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 22:56:11.778667 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.778642 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm"] Jun 11 22:56:11.887415 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.887371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6c9951a-f300-4081-a614-ba550cd566ff-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-2sztm\" (UID: \"f6c9951a-f300-4081-a614-ba550cd566ff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:11.887565 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.887495 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tgvg\" (UniqueName: \"kubernetes.io/projected/f6c9951a-f300-4081-a614-ba550cd566ff-kube-api-access-2tgvg\") pod \"prometheus-operator-864fcfc6f9-2sztm\" (UID: \"f6c9951a-f300-4081-a614-ba550cd566ff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:11.887565 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.887552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6c9951a-f300-4081-a614-ba550cd566ff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-2sztm\" (UID: \"f6c9951a-f300-4081-a614-ba550cd566ff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:11.887693 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.887606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6c9951a-f300-4081-a614-ba550cd566ff-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-2sztm\" (UID: \"f6c9951a-f300-4081-a614-ba550cd566ff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:11.987982 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.987940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6c9951a-f300-4081-a614-ba550cd566ff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-2sztm\" (UID: \"f6c9951a-f300-4081-a614-ba550cd566ff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:11.987982 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.987994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6c9951a-f300-4081-a614-ba550cd566ff-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-2sztm\" (UID: \"f6c9951a-f300-4081-a614-ba550cd566ff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:11.988314 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.988025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6c9951a-f300-4081-a614-ba550cd566ff-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-2sztm\" (UID: \"f6c9951a-f300-4081-a614-ba550cd566ff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:11.988314 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.988064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tgvg\" (UniqueName: \"kubernetes.io/projected/f6c9951a-f300-4081-a614-ba550cd566ff-kube-api-access-2tgvg\") pod \"prometheus-operator-864fcfc6f9-2sztm\" (UID: \"f6c9951a-f300-4081-a614-ba550cd566ff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:11.988314 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:56:11.988163 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 22:56:11.988314 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:56:11.988223 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c9951a-f300-4081-a614-ba550cd566ff-prometheus-operator-tls podName:f6c9951a-f300-4081-a614-ba550cd566ff nodeName:}" failed. No retries permitted until 2026-06-11 22:56:12.488208579 +0000 UTC m=+250.371531389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/f6c9951a-f300-4081-a614-ba550cd566ff-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-2sztm" (UID: "f6c9951a-f300-4081-a614-ba550cd566ff") : secret "prometheus-operator-tls" not found Jun 11 22:56:11.988939 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.988916 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6c9951a-f300-4081-a614-ba550cd566ff-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-2sztm\" (UID: \"f6c9951a-f300-4081-a614-ba550cd566ff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:11.990643 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.990622 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6c9951a-f300-4081-a614-ba550cd566ff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-2sztm\" (UID: \"f6c9951a-f300-4081-a614-ba550cd566ff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:11.997050 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:11.997029 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tgvg\" (UniqueName: \"kubernetes.io/projected/f6c9951a-f300-4081-a614-ba550cd566ff-kube-api-access-2tgvg\") pod \"prometheus-operator-864fcfc6f9-2sztm\" (UID: \"f6c9951a-f300-4081-a614-ba550cd566ff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:12.490757 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:12.490714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6c9951a-f300-4081-a614-ba550cd566ff-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-2sztm\" (UID: \"f6c9951a-f300-4081-a614-ba550cd566ff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:12.493247 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:12.493224 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6c9951a-f300-4081-a614-ba550cd566ff-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-2sztm\" (UID: \"f6c9951a-f300-4081-a614-ba550cd566ff\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:12.681155 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:12.681083 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" Jun 11 22:56:12.807670 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:12.807618 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm"] Jun 11 22:56:12.811125 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:56:12.811098 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6c9951a_f300_4081_a614_ba550cd566ff.slice/crio-a1145b43cf87458b5d9d4b48019ce5ef7a55693013551010051068c58db5aaa1 WatchSource:0}: Error finding container a1145b43cf87458b5d9d4b48019ce5ef7a55693013551010051068c58db5aaa1: Status 404 returned error can't find the container with id a1145b43cf87458b5d9d4b48019ce5ef7a55693013551010051068c58db5aaa1 Jun 11 22:56:13.397911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:13.397870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" event={"ID":"f6c9951a-f300-4081-a614-ba550cd566ff","Type":"ContainerStarted","Data":"a1145b43cf87458b5d9d4b48019ce5ef7a55693013551010051068c58db5aaa1"} Jun 11 22:56:14.403365 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:14.403325 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" event={"ID":"f6c9951a-f300-4081-a614-ba550cd566ff","Type":"ContainerStarted","Data":"75fa79afeaa4adfcbae5e15a6c8b6e860554415d0ddac9a45dde14fcfc73a744"} Jun 11 22:56:14.403836 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:14.403376 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" event={"ID":"f6c9951a-f300-4081-a614-ba550cd566ff","Type":"ContainerStarted","Data":"04d44de6492d798c13cfe7f84163fbda50b19599341f4564c80219396499eee6"} Jun 11 22:56:14.422331 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:14.422277 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-2sztm" podStartSLOduration=2.058928367 podStartE2EDuration="3.422260415s" totalImagesPullingTime="1.363332048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:14.420616975 +0000 UTC m=+252.303939809" watchObservedRunningTime="2026-06-11 22:56:14.422260415 +0000 UTC m=+252.305583247" Jun 11 22:56:14.505369 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:14.505277 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:56:14.507854 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:14.507833 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2093b4d-bc7b-46b4-b79a-032b54a323b6-metrics-certs\") pod \"network-metrics-daemon-5smcr\" (UID: \"f2093b4d-bc7b-46b4-b79a-032b54a323b6\") " pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:56:14.709297 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:14.709272 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s94r6\"" Jun 11 22:56:14.717509 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:14.717490 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5smcr" Jun 11 22:56:14.844220 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:14.844196 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5smcr"] Jun 11 22:56:14.846688 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:56:14.846658 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2093b4d_bc7b_46b4_b79a_032b54a323b6.slice/crio-3412c98949cfead4fd7c2ad0496dcff3e5f7a02975453c63e864b284cb697f6b WatchSource:0}: Error finding container 3412c98949cfead4fd7c2ad0496dcff3e5f7a02975453c63e864b284cb697f6b: Status 404 returned error can't find the container with id 3412c98949cfead4fd7c2ad0496dcff3e5f7a02975453c63e864b284cb697f6b Jun 11 22:56:15.408986 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:15.408943 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5smcr" event={"ID":"f2093b4d-bc7b-46b4-b79a-032b54a323b6","Type":"ContainerStarted","Data":"3412c98949cfead4fd7c2ad0496dcff3e5f7a02975453c63e864b284cb697f6b"} Jun 11 22:56:16.089071 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.088983 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl"] Jun 11 22:56:16.092174 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.092153 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" Jun 11 22:56:16.094746 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.094723 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 22:56:16.095057 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.095036 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 22:56:16.095162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.095055 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5llrs\"" Jun 11 22:56:16.103264 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.103243 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl"] Jun 11 22:56:16.115935 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.115861 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5pjjk"] Jun 11 22:56:16.120047 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.120023 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz"] Jun 11 22:56:16.120215 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.120191 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.128191 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.124534 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9zjvk\"" Jun 11 22:56:16.128191 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.124949 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 22:56:16.128191 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.126369 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 22:56:16.128191 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.127714 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 22:56:16.135097 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.135033 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.135637 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.135615 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz"] Jun 11 22:56:16.137763 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.137745 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 22:56:16.138037 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.137749 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-p27f9\"" Jun 11 22:56:16.138371 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.137789 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 22:56:16.138935 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.138918 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 22:56:16.220847 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.220810 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-textfile\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.220847 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.220850 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-accelerators-collector-config\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.221086 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.220880 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1513612a-3638-4071-9df6-93cd56225718-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.221086 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.220900 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1513612a-3638-4071-9df6-93cd56225718-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.221086 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.220919 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1513612a-3638-4071-9df6-93cd56225718-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.221086 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.220958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e51efdc-a7f2-4891-8e9c-261ee134a1ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-4zmsl\" (UID: \"3e51efdc-a7f2-4891-8e9c-261ee134a1ea\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" Jun 11 22:56:16.221086 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.220972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1513612a-3638-4071-9df6-93cd56225718-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.221086 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.221006 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98ca2950-97dd-4e8e-86c2-55b234023438-metrics-client-ca\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.221086 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.221030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e51efdc-a7f2-4891-8e9c-261ee134a1ea-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-4zmsl\" (UID: \"3e51efdc-a7f2-4891-8e9c-261ee134a1ea\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" Jun 11 22:56:16.221086 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.221050 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqnj6\" (UniqueName: \"kubernetes.io/projected/3e51efdc-a7f2-4891-8e9c-261ee134a1ea-kube-api-access-zqnj6\") pod \"openshift-state-metrics-6b8d965dd5-4zmsl\" (UID: \"3e51efdc-a7f2-4891-8e9c-261ee134a1ea\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" Jun 11 22:56:16.221086 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.221075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98ca2950-97dd-4e8e-86c2-55b234023438-sys\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.221454 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.221145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbhsb\" (UniqueName: \"kubernetes.io/projected/98ca2950-97dd-4e8e-86c2-55b234023438-kube-api-access-rbhsb\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.221454 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.221171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-tls\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.221454 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.221203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1513612a-3638-4071-9df6-93cd56225718-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.221454 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.221220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.221454 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.221235 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-wtmp\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.221454 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.221271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbnmf\" (UniqueName: \"kubernetes.io/projected/1513612a-3638-4071-9df6-93cd56225718-kube-api-access-gbnmf\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.221454 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.221348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98ca2950-97dd-4e8e-86c2-55b234023438-root\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.221454 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.221396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e51efdc-a7f2-4891-8e9c-261ee134a1ea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-4zmsl\" (UID: \"3e51efdc-a7f2-4891-8e9c-261ee134a1ea\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" Jun 11 22:56:16.322172 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322133 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbnmf\" (UniqueName: \"kubernetes.io/projected/1513612a-3638-4071-9df6-93cd56225718-kube-api-access-gbnmf\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.322172 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98ca2950-97dd-4e8e-86c2-55b234023438-root\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.322438 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e51efdc-a7f2-4891-8e9c-261ee134a1ea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-4zmsl\" (UID: \"3e51efdc-a7f2-4891-8e9c-261ee134a1ea\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" Jun 11 22:56:16.322438 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-textfile\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.322438 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-accelerators-collector-config\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.322438 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322284 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98ca2950-97dd-4e8e-86c2-55b234023438-root\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.322438 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1513612a-3638-4071-9df6-93cd56225718-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.322438 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1513612a-3638-4071-9df6-93cd56225718-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.322438 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1513612a-3638-4071-9df6-93cd56225718-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.322438 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e51efdc-a7f2-4891-8e9c-261ee134a1ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-4zmsl\" (UID: \"3e51efdc-a7f2-4891-8e9c-261ee134a1ea\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" Jun 11 22:56:16.322438 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1513612a-3638-4071-9df6-93cd56225718-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.322438 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98ca2950-97dd-4e8e-86c2-55b234023438-metrics-client-ca\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.322940 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322458 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e51efdc-a7f2-4891-8e9c-261ee134a1ea-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-4zmsl\" (UID: \"3e51efdc-a7f2-4891-8e9c-261ee134a1ea\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" Jun 11 22:56:16.322940 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322480 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqnj6\" (UniqueName: \"kubernetes.io/projected/3e51efdc-a7f2-4891-8e9c-261ee134a1ea-kube-api-access-zqnj6\") pod \"openshift-state-metrics-6b8d965dd5-4zmsl\" (UID: \"3e51efdc-a7f2-4891-8e9c-261ee134a1ea\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" Jun 11 22:56:16.322940 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98ca2950-97dd-4e8e-86c2-55b234023438-sys\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.322940 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbhsb\" (UniqueName: \"kubernetes.io/projected/98ca2950-97dd-4e8e-86c2-55b234023438-kube-api-access-rbhsb\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.322940 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-tls\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.322940 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1513612a-3638-4071-9df6-93cd56225718-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.322940 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322630 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.322940 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-wtmp\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.322940 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322834 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-wtmp\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.322940 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.322853 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-textfile\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.323402 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:56:16.322969 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 22:56:16.323402 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:56:16.323025 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-tls podName:98ca2950-97dd-4e8e-86c2-55b234023438 nodeName:}" failed. No retries permitted until 2026-06-11 22:56:16.823003899 +0000 UTC m=+254.706326712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-tls") pod "node-exporter-5pjjk" (UID: "98ca2950-97dd-4e8e-86c2-55b234023438") : secret "node-exporter-tls" not found Jun 11 22:56:16.323402 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.323248 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98ca2950-97dd-4e8e-86c2-55b234023438-sys\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.323402 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.323373 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e51efdc-a7f2-4891-8e9c-261ee134a1ea-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-4zmsl\" (UID: \"3e51efdc-a7f2-4891-8e9c-261ee134a1ea\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" Jun 11 22:56:16.323402 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.323383 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1513612a-3638-4071-9df6-93cd56225718-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.324223 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.324191 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98ca2950-97dd-4e8e-86c2-55b234023438-metrics-client-ca\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.324322 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.324227 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1513612a-3638-4071-9df6-93cd56225718-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.324322 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:56:16.324287 2578 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 22:56:16.324433 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:56:16.324349 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1513612a-3638-4071-9df6-93cd56225718-kube-state-metrics-tls podName:1513612a-3638-4071-9df6-93cd56225718 nodeName:}" failed. No retries permitted until 2026-06-11 22:56:16.824334952 +0000 UTC m=+254.707657770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1513612a-3638-4071-9df6-93cd56225718-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-hgsqz" (UID: "1513612a-3638-4071-9df6-93cd56225718") : secret "kube-state-metrics-tls" not found Jun 11 22:56:16.324663 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.324641 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-accelerators-collector-config\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.324778 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.324759 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1513612a-3638-4071-9df6-93cd56225718-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.325641 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.325619 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e51efdc-a7f2-4891-8e9c-261ee134a1ea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-4zmsl\" (UID: \"3e51efdc-a7f2-4891-8e9c-261ee134a1ea\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" Jun 11 22:56:16.325720 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.325619 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1513612a-3638-4071-9df6-93cd56225718-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.326283 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.326268 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.326726 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.326709 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e51efdc-a7f2-4891-8e9c-261ee134a1ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-4zmsl\" (UID: \"3e51efdc-a7f2-4891-8e9c-261ee134a1ea\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" Jun 11 22:56:16.340926 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.340847 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbhsb\" (UniqueName: \"kubernetes.io/projected/98ca2950-97dd-4e8e-86c2-55b234023438-kube-api-access-rbhsb\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.342592 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.342567 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqnj6\" (UniqueName: \"kubernetes.io/projected/3e51efdc-a7f2-4891-8e9c-261ee134a1ea-kube-api-access-zqnj6\") pod \"openshift-state-metrics-6b8d965dd5-4zmsl\" (UID: \"3e51efdc-a7f2-4891-8e9c-261ee134a1ea\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" Jun 11 22:56:16.343313 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.343284 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbnmf\" (UniqueName: \"kubernetes.io/projected/1513612a-3638-4071-9df6-93cd56225718-kube-api-access-gbnmf\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.403608 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.403562 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" Jun 11 22:56:16.415394 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.415354 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5smcr" event={"ID":"f2093b4d-bc7b-46b4-b79a-032b54a323b6","Type":"ContainerStarted","Data":"ee3ae0e66f5e7ed372a038b360d7abc86e79ee3e94f33b92a63ecb7308022616"} Jun 11 22:56:16.415816 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.415417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5smcr" event={"ID":"f2093b4d-bc7b-46b4-b79a-032b54a323b6","Type":"ContainerStarted","Data":"7b932db1203140a21ea717bcc4672b2cf57d1d49cb873a9853edad0960150329"} Jun 11 22:56:16.441971 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.441908 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5smcr" podStartSLOduration=253.536560336 podStartE2EDuration="4m14.441886322s" totalImagesPullingTime="905.325986ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:16.44079504 +0000 UTC m=+254.324117953" watchObservedRunningTime="2026-06-11 22:56:16.441886322 +0000 UTC m=+254.325209155" Jun 11 22:56:16.563060 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.563037 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl"] Jun 11 22:56:16.564956 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:56:16.564924 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e51efdc_a7f2_4891_8e9c_261ee134a1ea.slice/crio-2154c8aefb3d55a635f008f3cb3ff259275974884883a68a0ecbcfb6b2457678 WatchSource:0}: Error finding container 2154c8aefb3d55a635f008f3cb3ff259275974884883a68a0ecbcfb6b2457678: Status 404 returned error can't find the container with id 2154c8aefb3d55a635f008f3cb3ff259275974884883a68a0ecbcfb6b2457678 Jun 11 22:56:16.827103 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.827068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-tls\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.827276 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.827148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1513612a-3638-4071-9df6-93cd56225718-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:16.830892 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.830860 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98ca2950-97dd-4e8e-86c2-55b234023438-node-exporter-tls\") pod \"node-exporter-5pjjk\" (UID: \"98ca2950-97dd-4e8e-86c2-55b234023438\") " pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:16.831040 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:16.830939 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1513612a-3638-4071-9df6-93cd56225718-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-hgsqz\" (UID: \"1513612a-3638-4071-9df6-93cd56225718\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:17.042926 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.042895 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5pjjk" Jun 11 22:56:17.048944 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.048922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" Jun 11 22:56:17.054191 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:56:17.054167 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98ca2950_97dd_4e8e_86c2_55b234023438.slice/crio-596b697b778de3582d5beb871b4eaac6fcc2144a8f9974c74a108af245089851 WatchSource:0}: Error finding container 596b697b778de3582d5beb871b4eaac6fcc2144a8f9974c74a108af245089851: Status 404 returned error can't find the container with id 596b697b778de3582d5beb871b4eaac6fcc2144a8f9974c74a108af245089851 Jun 11 22:56:17.185496 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.185458 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 22:56:17.190891 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.190869 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.194326 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.194300 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 22:56:17.194807 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.194782 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-278nv\"" Jun 11 22:56:17.194807 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.194802 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 22:56:17.194807 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.194809 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 22:56:17.195054 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.194834 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 22:56:17.195054 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.194864 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 22:56:17.195054 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.194812 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 22:56:17.195054 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.194785 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 22:56:17.195248 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.195231 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 22:56:17.195321 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.195231 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 22:56:17.198680 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.198615 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz"] Jun 11 22:56:17.201673 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:56:17.201650 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1513612a_3638_4071_9df6_93cd56225718.slice/crio-a47eaecc96761f1b184ec3419ae129eee6ddce77cd908283bbd25cb73f9cfed5 WatchSource:0}: Error finding container a47eaecc96761f1b184ec3419ae129eee6ddce77cd908283bbd25cb73f9cfed5: Status 404 returned error can't find the container with id a47eaecc96761f1b184ec3419ae129eee6ddce77cd908283bbd25cb73f9cfed5 Jun 11 22:56:17.208728 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.208680 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 22:56:17.332107 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.332009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-web-config\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.332107 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.332056 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.332107 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.332086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp4b6\" (UniqueName: \"kubernetes.io/projected/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-kube-api-access-fp4b6\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.332691 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.332609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.332765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.332731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.332825 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.332767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.332825 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.332794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.332932 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.332840 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-config-volume\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.338264 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.333070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.338264 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.333143 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.338264 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.333177 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.338264 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.333220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.338264 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.333246 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-config-out\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.423443 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.423395 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" event={"ID":"1513612a-3638-4071-9df6-93cd56225718","Type":"ContainerStarted","Data":"a47eaecc96761f1b184ec3419ae129eee6ddce77cd908283bbd25cb73f9cfed5"} Jun 11 22:56:17.424693 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.424639 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5pjjk" event={"ID":"98ca2950-97dd-4e8e-86c2-55b234023438","Type":"ContainerStarted","Data":"596b697b778de3582d5beb871b4eaac6fcc2144a8f9974c74a108af245089851"} Jun 11 22:56:17.426407 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.426377 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" event={"ID":"3e51efdc-a7f2-4891-8e9c-261ee134a1ea","Type":"ContainerStarted","Data":"b4681671ba9a07d4e0a7b499088e81d4626ab3a54f7853b4a11fba5016934cd5"} Jun 11 22:56:17.426516 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.426434 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" event={"ID":"3e51efdc-a7f2-4891-8e9c-261ee134a1ea","Type":"ContainerStarted","Data":"b5b8046231d90053d13161fec51c121408b2b2fa8e35f1a0de8f5be9ed58d48e"} Jun 11 22:56:17.426516 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.426462 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" event={"ID":"3e51efdc-a7f2-4891-8e9c-261ee134a1ea","Type":"ContainerStarted","Data":"2154c8aefb3d55a635f008f3cb3ff259275974884883a68a0ecbcfb6b2457678"} Jun 11 22:56:17.433995 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.433971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.434103 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.434010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.434103 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.434041 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.434103 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.434065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.434266 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.434239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-config-out\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.435462 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.434332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-web-config\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.435462 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.434371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.435462 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.434397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp4b6\" (UniqueName: \"kubernetes.io/projected/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-kube-api-access-fp4b6\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.435462 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.434456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.435462 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.434489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.435462 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.434515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.435462 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.434537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.435462 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.434580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-config-volume\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.437296 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.437267 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-config-out\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.437384 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.437328 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.437646 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.437623 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.437735 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.437654 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.437876 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.437842 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.438424 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.438379 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.438511 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.438435 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.439345 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.439300 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-web-config\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.440146 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.440090 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-config-volume\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.440146 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.440100 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.440497 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.440470 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.440668 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.440645 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.448682 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.448619 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp4b6\" (UniqueName: \"kubernetes.io/projected/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-kube-api-access-fp4b6\") pod \"alertmanager-main-0\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.503108 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.503070 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:56:17.831137 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:17.831031 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 22:56:18.076067 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:56:18.075996 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0f3cb9_a8e6_4da9_ae28_d1f71888d364.slice/crio-a07ec234b3801e8cf736f0b8488ecdc182b955dc556f4fecb0128ae92c94f792 WatchSource:0}: Error finding container a07ec234b3801e8cf736f0b8488ecdc182b955dc556f4fecb0128ae92c94f792: Status 404 returned error can't find the container with id a07ec234b3801e8cf736f0b8488ecdc182b955dc556f4fecb0128ae92c94f792 Jun 11 22:56:18.432801 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:18.432769 2578 generic.go:356] "Generic (PLEG): container finished" podID="98ca2950-97dd-4e8e-86c2-55b234023438" containerID="9669724fbe329cbd73cf5a1b3671d4fd02f7a2b7ae4d1dd413a1a55bbee2305e" exitCode=0 Jun 11 22:56:18.433278 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:18.432863 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5pjjk" event={"ID":"98ca2950-97dd-4e8e-86c2-55b234023438","Type":"ContainerDied","Data":"9669724fbe329cbd73cf5a1b3671d4fd02f7a2b7ae4d1dd413a1a55bbee2305e"} Jun 11 22:56:18.434400 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:18.434370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerStarted","Data":"a07ec234b3801e8cf736f0b8488ecdc182b955dc556f4fecb0128ae92c94f792"} Jun 11 22:56:18.436544 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:18.436524 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" event={"ID":"3e51efdc-a7f2-4891-8e9c-261ee134a1ea","Type":"ContainerStarted","Data":"c6a48fa298364475a75ffcaf95d7518b70265cd16581fb6b9fdb89391a18e23b"} Jun 11 22:56:18.473990 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:18.473935 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4zmsl" podStartSLOduration=1.419082644 podStartE2EDuration="2.47391794s" totalImagesPullingTime="1.054835296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:18.4725114 +0000 UTC m=+256.355834233" watchObservedRunningTime="2026-06-11 22:56:18.47391794 +0000 UTC m=+256.357240771" Jun 11 22:56:19.444515 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:19.444473 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" event={"ID":"1513612a-3638-4071-9df6-93cd56225718","Type":"ContainerStarted","Data":"f205846fabe0c8b684957e648c203fb969b3d23b2a83b98d64d5eea21df38664"} Jun 11 22:56:19.445022 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:19.444548 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" event={"ID":"1513612a-3638-4071-9df6-93cd56225718","Type":"ContainerStarted","Data":"04b7677e55a210306ccfbc9257ef614c6c1f642527a77e65e65fa2f97cdfe7dd"} Jun 11 22:56:19.445022 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:19.444577 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" event={"ID":"1513612a-3638-4071-9df6-93cd56225718","Type":"ContainerStarted","Data":"bf58a19e20668302691b23a36289c97e6df71988f70978a690e72f878aab8cd8"} Jun 11 22:56:19.447220 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:19.447190 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5pjjk" event={"ID":"98ca2950-97dd-4e8e-86c2-55b234023438","Type":"ContainerStarted","Data":"920c6e4fbb9214ec64a5dd12e8ede0deb10a3c6c0eeb0d600f3f596882cd9d99"} Jun 11 22:56:19.447341 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:19.447241 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5pjjk" event={"ID":"98ca2950-97dd-4e8e-86c2-55b234023438","Type":"ContainerStarted","Data":"b13b2f8c83a48a56c6151d709778edb92e9f0995370dbbd046b46e6d3a758d5e"} Jun 11 22:56:19.464822 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:19.464720 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-hgsqz" podStartSLOduration=1.982681409 podStartE2EDuration="3.464699103s" totalImagesPullingTime="1.482017694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:19.463437648 +0000 UTC m=+257.346760481" watchObservedRunningTime="2026-06-11 22:56:19.464699103 +0000 UTC m=+257.348021942" Jun 11 22:56:19.483260 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:19.483074 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5pjjk" podStartSLOduration=2.337084171 podStartE2EDuration="3.483058522s" totalImagesPullingTime="1.067208843s" totalInitContainerRuntime="78.765508ms" isStatefulPod=true podCreationTimestamp="2026-06-11 22:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:19.481504053 +0000 UTC m=+257.364826887" watchObservedRunningTime="2026-06-11 22:56:19.483058522 +0000 UTC m=+257.366381354" Jun 11 22:56:20.452902 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:20.452867 2578 generic.go:356] "Generic (PLEG): container finished" podID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerID="4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb" exitCode=0 Jun 11 22:56:20.453351 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:20.452967 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerDied","Data":"4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb"} Jun 11 22:56:22.466312 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:22.466165 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerStarted","Data":"6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9"} Jun 11 22:56:22.466312 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:22.466250 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerStarted","Data":"7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82"} Jun 11 22:56:23.472886 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:23.472854 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerStarted","Data":"e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9"} Jun 11 22:56:23.473256 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:23.472918 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerStarted","Data":"e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c"} Jun 11 22:56:23.473256 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:23.472943 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerStarted","Data":"0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be"} Jun 11 22:56:23.473256 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:23.472967 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerStarted","Data":"2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa"} Jun 11 22:56:23.507898 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:23.507844 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.088113883 podStartE2EDuration="6.507828198s" totalImagesPullingTime="4.399544361s" totalInitContainerRuntime="20.169954ms" isStatefulPod=false podCreationTimestamp="2026-06-11 22:56:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:23.505202293 +0000 UTC m=+261.388525124" watchObservedRunningTime="2026-06-11 22:56:23.507828198 +0000 UTC m=+261.391151030" Jun 11 22:56:28.496952 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.496919 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f69959748-7w7nn"] Jun 11 22:56:28.500448 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.500430 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.503600 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.503571 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 22:56:28.504383 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.504362 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 22:56:28.504499 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.504380 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lr9tq\"" Jun 11 22:56:28.504499 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.504371 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 22:56:28.504924 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.504908 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 22:56:28.505674 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.505648 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 22:56:28.505674 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.505657 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 22:56:28.505813 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.505711 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 22:56:28.509312 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.509294 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 22:56:28.512075 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.512056 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f69959748-7w7nn"] Jun 11 22:56:28.537111 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.537082 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-oauth-config\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.537254 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.537133 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-trusted-ca-bundle\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.537254 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.537156 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-serving-cert\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.537254 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.537171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-oauth-serving-cert\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.537254 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.537217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-config\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.537432 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.537283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-service-ca\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.537432 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.537322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzb25\" (UniqueName: \"kubernetes.io/projected/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-kube-api-access-kzb25\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.637656 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.637626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-trusted-ca-bundle\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.637656 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.637660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-serving-cert\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.637901 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.637676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-oauth-serving-cert\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.637901 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.637698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-config\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.637901 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.637778 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-service-ca\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.637901 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.637834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzb25\" (UniqueName: \"kubernetes.io/projected/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-kube-api-access-kzb25\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.637901 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.637857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-oauth-config\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.638513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.638481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-oauth-serving-cert\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.638614 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.638489 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-config\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.638663 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.638630 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-service-ca\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.638702 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.638689 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-trusted-ca-bundle\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.640977 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.640957 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-oauth-config\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.640977 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.640967 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-serving-cert\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.645856 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.645834 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzb25\" (UniqueName: \"kubernetes.io/projected/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-kube-api-access-kzb25\") pod \"console-f69959748-7w7nn\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.811018 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.810937 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:28.943529 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:28.943503 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f69959748-7w7nn"] Jun 11 22:56:28.946121 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:56:28.946098 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0b2fdd_8baa_47eb_b2a6_e5ea465a4fc5.slice/crio-0a4681f12e08d3848be07282f6a4e7a75b0f15c05791e9a56c400c3a136ae12a WatchSource:0}: Error finding container 0a4681f12e08d3848be07282f6a4e7a75b0f15c05791e9a56c400c3a136ae12a: Status 404 returned error can't find the container with id 0a4681f12e08d3848be07282f6a4e7a75b0f15c05791e9a56c400c3a136ae12a Jun 11 22:56:29.498922 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:29.498881 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f69959748-7w7nn" event={"ID":"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5","Type":"ContainerStarted","Data":"0a4681f12e08d3848be07282f6a4e7a75b0f15c05791e9a56c400c3a136ae12a"} Jun 11 22:56:32.514836 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:32.514799 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f69959748-7w7nn" event={"ID":"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5","Type":"ContainerStarted","Data":"4fd7bb0083bd2d7bf93a04d08b929868d44111e0b81c18c7a31e05f4f84cf764"} Jun 11 22:56:32.534562 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:32.534508 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f69959748-7w7nn" podStartSLOduration=1.967152006 podStartE2EDuration="4.534492419s" totalImagesPullingTime="2.567340413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:32.533251708 +0000 UTC m=+270.416574539" watchObservedRunningTime="2026-06-11 22:56:32.534492419 +0000 UTC m=+270.417815250" Jun 11 22:56:38.811858 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:38.811815 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:38.812229 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:38.811891 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:56:38.813362 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:38.813337 2578 patch_prober.go:28] interesting pod/console-f69959748-7w7nn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 11 22:56:38.813475 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:38.813383 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-f69959748-7w7nn" podUID="4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 11 22:56:44.085675 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:56:44.085616 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vnrbb" podUID="9d904fc7-7dff-47ab-9ed8-d804c2aa6688" Jun 11 22:56:44.085675 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:56:44.085616 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" podUID="9c612aab-e5f2-47c2-b34d-59df79068b8f" Jun 11 22:56:44.561315 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:44.561287 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:56:44.561498 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:44.561291 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vnrbb" Jun 11 22:56:47.516864 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:47.516810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:56:47.517278 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:47.516897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:56:47.519508 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:47.519475 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d904fc7-7dff-47ab-9ed8-d804c2aa6688-metrics-tls\") pod \"dns-default-vnrbb\" (UID: \"9d904fc7-7dff-47ab-9ed8-d804c2aa6688\") " pod="openshift-dns/dns-default-vnrbb" Jun 11 22:56:47.519638 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:47.519529 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls\") pod \"image-registry-654696cff6-lxh9s\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:56:47.569252 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:47.569220 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m9z2n\"" Jun 11 22:56:47.569252 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:47.569243 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rjskh\"" Jun 11 22:56:47.572445 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:47.572421 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:56:47.572576 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:47.572456 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vnrbb" Jun 11 22:56:47.743849 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:47.743821 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vnrbb"] Jun 11 22:56:47.746050 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:56:47.746024 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d904fc7_7dff_47ab_9ed8_d804c2aa6688.slice/crio-49c3b4979e62e1477d5aaeb22026e548df520679cac1472f334f5b48999ae6f0 WatchSource:0}: Error finding container 49c3b4979e62e1477d5aaeb22026e548df520679cac1472f334f5b48999ae6f0: Status 404 returned error can't find the container with id 49c3b4979e62e1477d5aaeb22026e548df520679cac1472f334f5b48999ae6f0 Jun 11 22:56:47.766431 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:47.766408 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-654696cff6-lxh9s"] Jun 11 22:56:47.768804 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:56:47.768732 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c612aab_e5f2_47c2_b34d_59df79068b8f.slice/crio-7780ce7b93ce665d64b7e1e50ceb7bc1ff179e751c44fb4b34bce474cf67e0de WatchSource:0}: Error finding container 7780ce7b93ce665d64b7e1e50ceb7bc1ff179e751c44fb4b34bce474cf67e0de: Status 404 returned error can't find the container with id 7780ce7b93ce665d64b7e1e50ceb7bc1ff179e751c44fb4b34bce474cf67e0de Jun 11 22:56:48.580281 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:48.580240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" event={"ID":"9c612aab-e5f2-47c2-b34d-59df79068b8f","Type":"ContainerStarted","Data":"c25f4029f635f5b97efcefbf45d7babd7c39e697363f18def959f999f54b40bf"} Jun 11 22:56:48.580792 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:48.580306 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" event={"ID":"9c612aab-e5f2-47c2-b34d-59df79068b8f","Type":"ContainerStarted","Data":"7780ce7b93ce665d64b7e1e50ceb7bc1ff179e751c44fb4b34bce474cf67e0de"} Jun 11 22:56:48.580792 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:48.580405 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:56:48.581769 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:48.581738 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vnrbb" event={"ID":"9d904fc7-7dff-47ab-9ed8-d804c2aa6688","Type":"ContainerStarted","Data":"49c3b4979e62e1477d5aaeb22026e548df520679cac1472f334f5b48999ae6f0"} Jun 11 22:56:48.601798 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:48.601721 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" podStartSLOduration=263.601703096 podStartE2EDuration="4m23.601703096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:52:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:48.601270862 +0000 UTC m=+286.484593693" watchObservedRunningTime="2026-06-11 22:56:48.601703096 +0000 UTC m=+286.485025928" Jun 11 22:56:48.812248 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:48.812206 2578 patch_prober.go:28] interesting pod/console-f69959748-7w7nn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 11 22:56:48.812441 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:48.812261 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-f69959748-7w7nn" podUID="4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 11 22:56:49.587903 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:49.587867 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vnrbb" event={"ID":"9d904fc7-7dff-47ab-9ed8-d804c2aa6688","Type":"ContainerStarted","Data":"060adcbe3e3756974a2fbe2210a54ab40d0bb4bb5cd13a420d8db1b3a0976a78"} Jun 11 22:56:49.588365 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:49.587969 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vnrbb" Jun 11 22:56:49.588365 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:49.587995 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vnrbb" event={"ID":"9d904fc7-7dff-47ab-9ed8-d804c2aa6688","Type":"ContainerStarted","Data":"fd3e62c629965d3465b00edbbd0810d61561c99688371f57f09a8fc7436152cf"} Jun 11 22:56:49.606520 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:49.606466 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vnrbb" podStartSLOduration=250.975158685 podStartE2EDuration="4m12.6064493s" totalImagesPullingTime="1.631290615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:56:49.605652501 +0000 UTC m=+287.488975329" watchObservedRunningTime="2026-06-11 22:56:49.6064493 +0000 UTC m=+287.489772132" Jun 11 22:56:53.419499 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:53.419470 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d0f3cb9-a8e6-4da9-ae28-d1f71888d364/init-config-reloader/0.log" Jun 11 22:56:53.619162 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:53.619131 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d0f3cb9-a8e6-4da9-ae28-d1f71888d364/alertmanager/0.log" Jun 11 22:56:53.821606 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:53.821502 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d0f3cb9-a8e6-4da9-ae28-d1f71888d364/config-reloader/0.log" Jun 11 22:56:54.018906 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:54.018873 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d0f3cb9-a8e6-4da9-ae28-d1f71888d364/kube-rbac-proxy-web/0.log" Jun 11 22:56:54.219755 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:54.219729 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d0f3cb9-a8e6-4da9-ae28-d1f71888d364/kube-rbac-proxy/0.log" Jun 11 22:56:54.419471 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:54.419435 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d0f3cb9-a8e6-4da9-ae28-d1f71888d364/kube-rbac-proxy-metric/0.log" Jun 11 22:56:54.618698 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:54.618620 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d0f3cb9-a8e6-4da9-ae28-d1f71888d364/prom-label-proxy/0.log" Jun 11 22:56:54.821807 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:54.821780 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-dr45n_b330625a-5360-4ad2-81b0-de7293b79ed5/cluster-monitoring-operator/0.log" Jun 11 22:56:55.019659 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:55.019629 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-hgsqz_1513612a-3638-4071-9df6-93cd56225718/kube-state-metrics/0.log" Jun 11 22:56:55.218385 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:55.218355 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-hgsqz_1513612a-3638-4071-9df6-93cd56225718/kube-rbac-proxy-main/0.log" Jun 11 22:56:55.419917 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:55.419892 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-hgsqz_1513612a-3638-4071-9df6-93cd56225718/kube-rbac-proxy-self/0.log" Jun 11 22:56:56.018550 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:56.018523 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5pjjk_98ca2950-97dd-4e8e-86c2-55b234023438/init-textfile/0.log" Jun 11 22:56:56.221580 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:56.221550 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5pjjk_98ca2950-97dd-4e8e-86c2-55b234023438/node-exporter/0.log" Jun 11 22:56:56.418256 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:56.418232 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5pjjk_98ca2950-97dd-4e8e-86c2-55b234023438/kube-rbac-proxy/0.log" Jun 11 22:56:57.822286 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:57.822254 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-4zmsl_3e51efdc-a7f2-4891-8e9c-261ee134a1ea/kube-rbac-proxy-main/0.log" Jun 11 22:56:58.019651 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:58.019616 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-4zmsl_3e51efdc-a7f2-4891-8e9c-261ee134a1ea/kube-rbac-proxy-self/0.log" Jun 11 22:56:58.219181 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:58.219137 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-4zmsl_3e51efdc-a7f2-4891-8e9c-261ee134a1ea/openshift-state-metrics/0.log" Jun 11 22:56:58.811727 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:58.811692 2578 patch_prober.go:28] interesting pod/console-f69959748-7w7nn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 11 22:56:58.811900 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:58.811751 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-f69959748-7w7nn" podUID="4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 11 22:56:59.595176 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:59.595141 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vnrbb" Jun 11 22:56:59.821435 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:56:59.821401 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-2sztm_f6c9951a-f300-4081-a614-ba550cd566ff/prometheus-operator/0.log" Jun 11 22:57:00.018454 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:00.018419 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-2sztm_f6c9951a-f300-4081-a614-ba550cd566ff/kube-rbac-proxy/0.log" Jun 11 22:57:01.819713 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:01.819686 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/1.log" Jun 11 22:57:02.024204 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:02.024174 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/2.log" Jun 11 22:57:02.419576 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:02.419481 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f69959748-7w7nn_4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5/console/0.log" Jun 11 22:57:02.544399 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:02.544372 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/1.log" Jun 11 22:57:02.549025 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:02.548998 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/1.log" Jun 11 22:57:02.556211 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:02.556189 2578 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 22:57:03.619137 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:03.619104 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vnrbb_9d904fc7-7dff-47ab-9ed8-d804c2aa6688/dns/0.log" Jun 11 22:57:03.820948 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:03.820918 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vnrbb_9d904fc7-7dff-47ab-9ed8-d804c2aa6688/kube-rbac-proxy/0.log" Jun 11 22:57:04.018539 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:04.018509 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gxzlc_54366c51-87c6-4077-b5f1-b4513f516370/dns-node-resolver/0.log" Jun 11 22:57:04.619178 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:04.619148 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-654696cff6-lxh9s_9c612aab-e5f2-47c2-b34d-59df79068b8f/registry/0.log" Jun 11 22:57:05.025997 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:05.025967 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b5jz4_f01823b1-ec0f-4636-bb5d-1d25a7e91152/node-ca/0.log" Jun 11 22:57:06.220195 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:06.220167 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r857s_669cf1be-fd7f-4d0e-a42a-52f85ed2b337/serve-healthcheck-canary/0.log" Jun 11 22:57:06.666873 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:06.666843 2578 generic.go:356] "Generic (PLEG): container finished" podID="68547bb5-ac97-4739-a039-ca0eb1ec5520" containerID="183b16ee494994809759ac9e289d8f50035e17685b90a083accb96d83030e6c3" exitCode=0 Jun 11 22:57:06.667045 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:06.666914 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" event={"ID":"68547bb5-ac97-4739-a039-ca0eb1ec5520","Type":"ContainerDied","Data":"183b16ee494994809759ac9e289d8f50035e17685b90a083accb96d83030e6c3"} Jun 11 22:57:06.667282 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:06.667262 2578 scope.go:117] "RemoveContainer" containerID="183b16ee494994809759ac9e289d8f50035e17685b90a083accb96d83030e6c3" Jun 11 22:57:06.668727 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:06.668708 2578 generic.go:356] "Generic (PLEG): container finished" podID="14fdc6e8-2048-458f-8ce4-8508053b86f1" containerID="eafaa725305f926975522ddb4a09399d0b418a52b89b5375915d7aa75b231014" exitCode=0 Jun 11 22:57:06.668797 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:06.668737 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" event={"ID":"14fdc6e8-2048-458f-8ce4-8508053b86f1","Type":"ContainerDied","Data":"eafaa725305f926975522ddb4a09399d0b418a52b89b5375915d7aa75b231014"} Jun 11 22:57:06.669004 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:06.668991 2578 scope.go:117] "RemoveContainer" containerID="eafaa725305f926975522ddb4a09399d0b418a52b89b5375915d7aa75b231014" Jun 11 22:57:07.579533 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:07.579209 2578 patch_prober.go:28] interesting pod/image-registry-654696cff6-lxh9s container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 22:57:07.579533 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:07.579273 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" podUID="9c612aab-e5f2-47c2-b34d-59df79068b8f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 22:57:07.676695 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:07.676644 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9cqpp" event={"ID":"68547bb5-ac97-4739-a039-ca0eb1ec5520","Type":"ContainerStarted","Data":"a6c72f7d54ef65d83bb77e1c362e320e17c36f383e1b7bf0a302cd4f1d3490b4"} Jun 11 22:57:07.678744 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:07.678715 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vgx7v" event={"ID":"14fdc6e8-2048-458f-8ce4-8508053b86f1","Type":"ContainerStarted","Data":"f2e81980ef1cf888ac9cb099bfe7eaa98a8a77ed04d67cd7a6e1008ccd090c26"} Jun 11 22:57:08.815859 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:08.815826 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:57:08.820209 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:08.820185 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:57:09.413435 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:09.413401 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-654696cff6-lxh9s"] Jun 11 22:57:09.418659 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:09.418635 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:57:34.443629 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.443560 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" podUID="9c612aab-e5f2-47c2-b34d-59df79068b8f" containerName="registry" containerID="cri-o://c25f4029f635f5b97efcefbf45d7babd7c39e697363f18def959f999f54b40bf" gracePeriod=30 Jun 11 22:57:34.696165 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.696101 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:57:34.771338 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.771300 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls\") pod \"9c612aab-e5f2-47c2-b34d-59df79068b8f\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " Jun 11 22:57:34.771516 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.771358 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pcjl\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-kube-api-access-5pcjl\") pod \"9c612aab-e5f2-47c2-b34d-59df79068b8f\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " Jun 11 22:57:34.771516 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.771389 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c612aab-e5f2-47c2-b34d-59df79068b8f-image-registry-private-configuration\") pod \"9c612aab-e5f2-47c2-b34d-59df79068b8f\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " Jun 11 22:57:34.771516 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.771416 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c612aab-e5f2-47c2-b34d-59df79068b8f-installation-pull-secrets\") pod \"9c612aab-e5f2-47c2-b34d-59df79068b8f\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " Jun 11 22:57:34.771516 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.771446 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c612aab-e5f2-47c2-b34d-59df79068b8f-ca-trust-extracted\") pod \"9c612aab-e5f2-47c2-b34d-59df79068b8f\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " Jun 11 22:57:34.771749 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.771530 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c612aab-e5f2-47c2-b34d-59df79068b8f-trusted-ca\") pod \"9c612aab-e5f2-47c2-b34d-59df79068b8f\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " Jun 11 22:57:34.771749 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.771603 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-bound-sa-token\") pod \"9c612aab-e5f2-47c2-b34d-59df79068b8f\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " Jun 11 22:57:34.772527 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.772456 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c612aab-e5f2-47c2-b34d-59df79068b8f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9c612aab-e5f2-47c2-b34d-59df79068b8f" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:57:34.774524 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.774489 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9c612aab-e5f2-47c2-b34d-59df79068b8f" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 22:57:34.774690 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.774545 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c612aab-e5f2-47c2-b34d-59df79068b8f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9c612aab-e5f2-47c2-b34d-59df79068b8f" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:34.774768 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.774702 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c612aab-e5f2-47c2-b34d-59df79068b8f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9c612aab-e5f2-47c2-b34d-59df79068b8f" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:34.774768 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.774710 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9c612aab-e5f2-47c2-b34d-59df79068b8f" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 22:57:34.774768 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.774727 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-kube-api-access-5pcjl" (OuterVolumeSpecName: "kube-api-access-5pcjl") pod "9c612aab-e5f2-47c2-b34d-59df79068b8f" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f"). InnerVolumeSpecName "kube-api-access-5pcjl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 22:57:34.782797 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.782770 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c612aab-e5f2-47c2-b34d-59df79068b8f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9c612aab-e5f2-47c2-b34d-59df79068b8f" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 22:57:34.791632 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.791604 2578 generic.go:356] "Generic (PLEG): container finished" podID="9c612aab-e5f2-47c2-b34d-59df79068b8f" containerID="c25f4029f635f5b97efcefbf45d7babd7c39e697363f18def959f999f54b40bf" exitCode=0 Jun 11 22:57:34.791737 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.791656 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" event={"ID":"9c612aab-e5f2-47c2-b34d-59df79068b8f","Type":"ContainerDied","Data":"c25f4029f635f5b97efcefbf45d7babd7c39e697363f18def959f999f54b40bf"} Jun 11 22:57:34.791737 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.791659 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" Jun 11 22:57:34.791737 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.791697 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654696cff6-lxh9s" event={"ID":"9c612aab-e5f2-47c2-b34d-59df79068b8f","Type":"ContainerDied","Data":"7780ce7b93ce665d64b7e1e50ceb7bc1ff179e751c44fb4b34bce474cf67e0de"} Jun 11 22:57:34.791737 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.791716 2578 scope.go:117] "RemoveContainer" containerID="c25f4029f635f5b97efcefbf45d7babd7c39e697363f18def959f999f54b40bf" Jun 11 22:57:34.799777 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.799760 2578 scope.go:117] "RemoveContainer" containerID="c25f4029f635f5b97efcefbf45d7babd7c39e697363f18def959f999f54b40bf" Jun 11 22:57:34.800037 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:57:34.800016 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c25f4029f635f5b97efcefbf45d7babd7c39e697363f18def959f999f54b40bf\": container with ID starting with c25f4029f635f5b97efcefbf45d7babd7c39e697363f18def959f999f54b40bf not found: ID does not exist" containerID="c25f4029f635f5b97efcefbf45d7babd7c39e697363f18def959f999f54b40bf" Jun 11 22:57:34.800106 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.800052 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25f4029f635f5b97efcefbf45d7babd7c39e697363f18def959f999f54b40bf"} err="failed to get container status \"c25f4029f635f5b97efcefbf45d7babd7c39e697363f18def959f999f54b40bf\": rpc error: code = NotFound desc = could not find container \"c25f4029f635f5b97efcefbf45d7babd7c39e697363f18def959f999f54b40bf\": container with ID starting with c25f4029f635f5b97efcefbf45d7babd7c39e697363f18def959f999f54b40bf not found: ID does not exist" Jun 11 22:57:34.872469 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.872426 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-certificates\") pod \"9c612aab-e5f2-47c2-b34d-59df79068b8f\" (UID: \"9c612aab-e5f2-47c2-b34d-59df79068b8f\") " Jun 11 22:57:34.872679 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.872660 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c612aab-e5f2-47c2-b34d-59df79068b8f-installation-pull-secrets\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:34.872750 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.872680 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c612aab-e5f2-47c2-b34d-59df79068b8f-ca-trust-extracted\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:34.872750 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.872693 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c612aab-e5f2-47c2-b34d-59df79068b8f-trusted-ca\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:34.872750 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.872706 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-bound-sa-token\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:34.872750 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.872718 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-tls\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:34.872750 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.872731 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pcjl\" (UniqueName: \"kubernetes.io/projected/9c612aab-e5f2-47c2-b34d-59df79068b8f-kube-api-access-5pcjl\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:34.872750 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.872745 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c612aab-e5f2-47c2-b34d-59df79068b8f-image-registry-private-configuration\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:34.872932 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.872793 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9c612aab-e5f2-47c2-b34d-59df79068b8f" (UID: "9c612aab-e5f2-47c2-b34d-59df79068b8f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:57:34.973787 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:34.973709 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c612aab-e5f2-47c2-b34d-59df79068b8f-registry-certificates\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:35.117401 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:35.117367 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-654696cff6-lxh9s"] Jun 11 22:57:35.121223 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:35.121196 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-654696cff6-lxh9s"] Jun 11 22:57:36.320318 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.320280 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 22:57:36.320752 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.320581 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="alertmanager" containerID="cri-o://7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82" gracePeriod=120 Jun 11 22:57:36.320752 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.320641 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="kube-rbac-proxy-metric" containerID="cri-o://e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c" gracePeriod=120 Jun 11 22:57:36.320752 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.320663 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="kube-rbac-proxy-web" containerID="cri-o://2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa" gracePeriod=120 Jun 11 22:57:36.320752 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.320699 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="kube-rbac-proxy" containerID="cri-o://0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be" gracePeriod=120 Jun 11 22:57:36.321022 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.320730 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="config-reloader" containerID="cri-o://6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9" gracePeriod=120 Jun 11 22:57:36.321022 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.320783 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="prom-label-proxy" containerID="cri-o://e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9" gracePeriod=120 Jun 11 22:57:36.615888 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.615802 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c612aab-e5f2-47c2-b34d-59df79068b8f" path="/var/lib/kubelet/pods/9c612aab-e5f2-47c2-b34d-59df79068b8f/volumes" Jun 11 22:57:36.804623 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.804568 2578 generic.go:356] "Generic (PLEG): container finished" podID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerID="e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9" exitCode=0 Jun 11 22:57:36.804623 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.804622 2578 generic.go:356] "Generic (PLEG): container finished" podID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerID="0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be" exitCode=0 Jun 11 22:57:36.804623 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.804620 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerDied","Data":"e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9"} Jun 11 22:57:36.804886 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.804691 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerDied","Data":"0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be"} Jun 11 22:57:36.804886 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.804633 2578 generic.go:356] "Generic (PLEG): container finished" podID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerID="6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9" exitCode=0 Jun 11 22:57:36.804886 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.804717 2578 generic.go:356] "Generic (PLEG): container finished" podID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerID="7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82" exitCode=0 Jun 11 22:57:36.804886 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.804719 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerDied","Data":"6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9"} Jun 11 22:57:36.804886 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:36.804743 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerDied","Data":"7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82"} Jun 11 22:57:37.577424 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.577399 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.593436 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.593401 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-tls-assets\") pod \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " Jun 11 22:57:37.593436 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.593436 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-web-config\") pod \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " Jun 11 22:57:37.593677 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.593462 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-alertmanager-trusted-ca-bundle\") pod \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " Jun 11 22:57:37.593677 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.593485 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy-web\") pod \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " Jun 11 22:57:37.593677 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.593514 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-main-tls\") pod \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " Jun 11 22:57:37.593819 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.593762 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-config-volume\") pod \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " Jun 11 22:57:37.593819 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.593807 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-config-out\") pod \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " Jun 11 22:57:37.593933 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.593865 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp4b6\" (UniqueName: \"kubernetes.io/projected/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-kube-api-access-fp4b6\") pod \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " Jun 11 22:57:37.593933 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.593893 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" (UID: "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:57:37.593933 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.593897 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy\") pod \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " Jun 11 22:57:37.594081 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.594020 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-alertmanager-main-db\") pod \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " Jun 11 22:57:37.594081 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.594049 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-cluster-tls-config\") pod \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " Jun 11 22:57:37.594179 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.594081 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " Jun 11 22:57:37.594179 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.594138 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-metrics-client-ca\") pod \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\" (UID: \"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364\") " Jun 11 22:57:37.595035 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.594391 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:37.595035 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.594955 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" (UID: "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 22:57:37.595035 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.594983 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" (UID: "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:57:37.596515 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.596480 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" (UID: "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 22:57:37.597578 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.597554 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-config-out" (OuterVolumeSpecName: "config-out") pod "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" (UID: "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 22:57:37.597724 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.597653 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" (UID: "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:37.597793 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.597753 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" (UID: "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:37.598308 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.598281 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" (UID: "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:37.598415 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.598308 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-kube-api-access-fp4b6" (OuterVolumeSpecName: "kube-api-access-fp4b6") pod "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" (UID: "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364"). InnerVolumeSpecName "kube-api-access-fp4b6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 22:57:37.598603 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.598566 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" (UID: "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:37.598911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.598883 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-config-volume" (OuterVolumeSpecName: "config-volume") pod "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" (UID: "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:37.602302 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.602257 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" (UID: "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:37.609501 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.609479 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-web-config" (OuterVolumeSpecName: "web-config") pod "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" (UID: "5d0f3cb9-a8e6-4da9-ae28-d1f71888d364"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:57:37.695644 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.695515 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-tls-assets\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:37.695644 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.695554 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-web-config\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:37.695644 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.695570 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:37.695644 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.695610 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-main-tls\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:37.695644 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.695625 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-config-volume\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:37.695644 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.695640 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-config-out\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:37.695975 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.695653 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp4b6\" (UniqueName: \"kubernetes.io/projected/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-kube-api-access-fp4b6\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:37.695975 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.695667 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:37.695975 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.695684 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-alertmanager-main-db\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:37.695975 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.695700 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-cluster-tls-config\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:37.695975 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.695719 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:37.695975 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.695734 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364-metrics-client-ca\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:57:37.811415 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.811379 2578 generic.go:356] "Generic (PLEG): container finished" podID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerID="e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c" exitCode=0 Jun 11 22:57:37.811415 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.811403 2578 generic.go:356] "Generic (PLEG): container finished" podID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerID="2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa" exitCode=0 Jun 11 22:57:37.811634 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.811462 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.811634 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.811464 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerDied","Data":"e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c"} Jun 11 22:57:37.811634 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.811533 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerDied","Data":"2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa"} Jun 11 22:57:37.811634 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.811560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d0f3cb9-a8e6-4da9-ae28-d1f71888d364","Type":"ContainerDied","Data":"a07ec234b3801e8cf736f0b8488ecdc182b955dc556f4fecb0128ae92c94f792"} Jun 11 22:57:37.811634 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.811613 2578 scope.go:117] "RemoveContainer" containerID="e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9" Jun 11 22:57:37.820455 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.820436 2578 scope.go:117] "RemoveContainer" containerID="e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c" Jun 11 22:57:37.827656 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.827640 2578 scope.go:117] "RemoveContainer" containerID="0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be" Jun 11 22:57:37.835417 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.835398 2578 scope.go:117] "RemoveContainer" containerID="2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa" Jun 11 22:57:37.836836 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.836807 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 22:57:37.842725 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.842702 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 22:57:37.844285 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.844267 2578 scope.go:117] "RemoveContainer" containerID="6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9" Jun 11 22:57:37.851566 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.851551 2578 scope.go:117] "RemoveContainer" containerID="7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82" Jun 11 22:57:37.859208 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.859188 2578 scope.go:117] "RemoveContainer" containerID="4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb" Jun 11 22:57:37.866775 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.866753 2578 scope.go:117] "RemoveContainer" containerID="e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9" Jun 11 22:57:37.867041 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:57:37.867021 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9\": container with ID starting with e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9 not found: ID does not exist" containerID="e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9" Jun 11 22:57:37.867086 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.867049 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9"} err="failed to get container status \"e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9\": rpc error: code = NotFound desc = could not find container \"e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9\": container with ID starting with e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9 not found: ID does not exist" Jun 11 22:57:37.867086 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.867071 2578 scope.go:117] "RemoveContainer" containerID="e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c" Jun 11 22:57:37.867327 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:57:37.867309 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c\": container with ID starting with e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c not found: ID does not exist" containerID="e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c" Jun 11 22:57:37.867370 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.867333 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c"} err="failed to get container status \"e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c\": rpc error: code = NotFound desc = could not find container \"e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c\": container with ID starting with e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c not found: ID does not exist" Jun 11 22:57:37.867370 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.867348 2578 scope.go:117] "RemoveContainer" containerID="0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be" Jun 11 22:57:37.867581 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:57:37.867563 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be\": container with ID starting with 0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be not found: ID does not exist" containerID="0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be" Jun 11 22:57:37.867655 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.867599 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be"} err="failed to get container status \"0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be\": rpc error: code = NotFound desc = could not find container \"0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be\": container with ID starting with 0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be not found: ID does not exist" Jun 11 22:57:37.867655 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.867614 2578 scope.go:117] "RemoveContainer" containerID="2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa" Jun 11 22:57:37.867991 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:57:37.867911 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa\": container with ID starting with 2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa not found: ID does not exist" containerID="2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa" Jun 11 22:57:37.868113 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.868010 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa"} err="failed to get container status \"2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa\": rpc error: code = NotFound desc = could not find container \"2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa\": container with ID starting with 2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa not found: ID does not exist" Jun 11 22:57:37.868113 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.868074 2578 scope.go:117] "RemoveContainer" containerID="6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9" Jun 11 22:57:37.868751 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:57:37.868623 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9\": container with ID starting with 6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9 not found: ID does not exist" containerID="6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9" Jun 11 22:57:37.868751 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.868652 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9"} err="failed to get container status \"6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9\": rpc error: code = NotFound desc = could not find container \"6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9\": container with ID starting with 6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9 not found: ID does not exist" Jun 11 22:57:37.868751 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.868670 2578 scope.go:117] "RemoveContainer" containerID="7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82" Jun 11 22:57:37.869005 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:57:37.868984 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82\": container with ID starting with 7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82 not found: ID does not exist" containerID="7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82" Jun 11 22:57:37.869045 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.869013 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82"} err="failed to get container status \"7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82\": rpc error: code = NotFound desc = could not find container \"7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82\": container with ID starting with 7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82 not found: ID does not exist" Jun 11 22:57:37.869045 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.869026 2578 scope.go:117] "RemoveContainer" containerID="4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb" Jun 11 22:57:37.869325 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:57:37.869306 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb\": container with ID starting with 4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb not found: ID does not exist" containerID="4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb" Jun 11 22:57:37.869401 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.869331 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb"} err="failed to get container status \"4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb\": rpc error: code = NotFound desc = could not find container \"4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb\": container with ID starting with 4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb not found: ID does not exist" Jun 11 22:57:37.869401 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.869352 2578 scope.go:117] "RemoveContainer" containerID="e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9" Jun 11 22:57:37.869623 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.869581 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9"} err="failed to get container status \"e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9\": rpc error: code = NotFound desc = could not find container \"e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9\": container with ID starting with e2d49f11b4f40e8cd91542b4f79aaa017f1b5b748cf7532fccc02d4c16e1adf9 not found: ID does not exist" Jun 11 22:57:37.869700 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.869625 2578 scope.go:117] "RemoveContainer" containerID="e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c" Jun 11 22:57:37.869887 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.869869 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c"} err="failed to get container status \"e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c\": rpc error: code = NotFound desc = could not find container \"e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c\": container with ID starting with e86105da7cf169fdfa68bd77b3fa718dcb23d369d57994f69be914401e1fdf3c not found: ID does not exist" Jun 11 22:57:37.869994 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.869887 2578 scope.go:117] "RemoveContainer" containerID="0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be" Jun 11 22:57:37.870141 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870101 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be"} err="failed to get container status \"0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be\": rpc error: code = NotFound desc = could not find container \"0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be\": container with ID starting with 0fb2998bece943aea6e835ac824e6132676b75cab36e1196bf5a8ef63594f7be not found: ID does not exist" Jun 11 22:57:37.870212 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870148 2578 scope.go:117] "RemoveContainer" containerID="2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa" Jun 11 22:57:37.870212 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870123 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 22:57:37.870417 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870397 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa"} err="failed to get container status \"2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa\": rpc error: code = NotFound desc = could not find container \"2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa\": container with ID starting with 2cd39438cddbf4bae23791fbb9312a77e9e041deb23fd0bedb7b50f0bc1db8fa not found: ID does not exist" Jun 11 22:57:37.870474 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870417 2578 scope.go:117] "RemoveContainer" containerID="6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9" Jun 11 22:57:37.870718 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870523 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="prom-label-proxy" Jun 11 22:57:37.870718 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870538 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="prom-label-proxy" Jun 11 22:57:37.870718 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870551 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c612aab-e5f2-47c2-b34d-59df79068b8f" containerName="registry" Jun 11 22:57:37.870718 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870560 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c612aab-e5f2-47c2-b34d-59df79068b8f" containerName="registry" Jun 11 22:57:37.870718 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870571 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="kube-rbac-proxy-metric" Jun 11 22:57:37.870718 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870654 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9"} err="failed to get container status \"6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9\": rpc error: code = NotFound desc = could not find container \"6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9\": container with ID starting with 6616e95e6f93fb2f7c7caa8013726997ce725531ab05fd233f2bdddaa723b0f9 not found: ID does not exist" Jun 11 22:57:37.870718 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870580 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="kube-rbac-proxy-metric" Jun 11 22:57:37.870718 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870682 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="init-config-reloader" Jun 11 22:57:37.870718 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870673 2578 scope.go:117] "RemoveContainer" containerID="7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82" Jun 11 22:57:37.870718 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870690 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="init-config-reloader" Jun 11 22:57:37.870718 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870716 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="config-reloader" Jun 11 22:57:37.870718 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870724 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="config-reloader" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870784 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="alertmanager" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870795 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="alertmanager" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870807 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="kube-rbac-proxy" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870816 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="kube-rbac-proxy" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870846 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="kube-rbac-proxy-web" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870855 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="kube-rbac-proxy-web" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870901 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82"} err="failed to get container status \"7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82\": rpc error: code = NotFound desc = could not find container \"7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82\": container with ID starting with 7c1622a9a39077b6137260ba5a82935e13d2f1e2134c3a1417ae00566b917a82 not found: ID does not exist" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.870934 2578 scope.go:117] "RemoveContainer" containerID="4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.871033 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="kube-rbac-proxy-web" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.871050 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="kube-rbac-proxy" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.871060 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="kube-rbac-proxy-metric" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.871070 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="config-reloader" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.871080 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c612aab-e5f2-47c2-b34d-59df79068b8f" containerName="registry" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.871089 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="alertmanager" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.871096 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" containerName="prom-label-proxy" Jun 11 22:57:37.873513 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.871287 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb"} err="failed to get container status \"4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb\": rpc error: code = NotFound desc = could not find container \"4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb\": container with ID starting with 4b578347e6cc022239bd62ac3df771f95558fc1b78f7f0cfe72edcab04b8f3eb not found: ID does not exist" Jun 11 22:57:37.877943 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.877915 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.880883 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.880861 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-278nv\"" Jun 11 22:57:37.881018 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.880980 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 22:57:37.881018 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.881011 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 22:57:37.881177 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.881135 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 22:57:37.881177 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.881148 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 22:57:37.881283 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.881244 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 22:57:37.881283 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.881270 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 22:57:37.881381 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.881257 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 22:57:37.881381 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.881245 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 22:57:37.887188 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.887165 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 22:57:37.890902 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.890882 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 22:57:37.897751 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.897732 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/361faa5b-9dcb-4310-920a-28d9db4a3bf1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.897857 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.897760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/361faa5b-9dcb-4310-920a-28d9db4a3bf1-config-out\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.897857 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.897778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.897857 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.897795 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/361faa5b-9dcb-4310-920a-28d9db4a3bf1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.897857 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.897818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/361faa5b-9dcb-4310-920a-28d9db4a3bf1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.898012 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.897905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.898012 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.897953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rxmv\" (UniqueName: \"kubernetes.io/projected/361faa5b-9dcb-4310-920a-28d9db4a3bf1-kube-api-access-6rxmv\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.898012 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.897996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.898114 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.898037 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-web-config\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.898114 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.898072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.898114 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.898103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-config-volume\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.898222 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.898130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/361faa5b-9dcb-4310-920a-28d9db4a3bf1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.898222 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.898172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.998639 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.998510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.998639 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.998550 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/361faa5b-9dcb-4310-920a-28d9db4a3bf1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.998639 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.998572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/361faa5b-9dcb-4310-920a-28d9db4a3bf1-config-out\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.998924 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.998716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.998924 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.998756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/361faa5b-9dcb-4310-920a-28d9db4a3bf1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.998924 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.998798 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/361faa5b-9dcb-4310-920a-28d9db4a3bf1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.998924 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.998832 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.998924 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.998862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rxmv\" (UniqueName: \"kubernetes.io/projected/361faa5b-9dcb-4310-920a-28d9db4a3bf1-kube-api-access-6rxmv\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.998924 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.998910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.999217 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.998956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-web-config\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.999217 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.998993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.999217 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.999021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-config-volume\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.999217 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.999041 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/361faa5b-9dcb-4310-920a-28d9db4a3bf1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:37.999217 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:37.999052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/361faa5b-9dcb-4310-920a-28d9db4a3bf1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:38.000067 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.000039 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/361faa5b-9dcb-4310-920a-28d9db4a3bf1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:38.001239 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.001209 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/361faa5b-9dcb-4310-920a-28d9db4a3bf1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:38.001639 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.001610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/361faa5b-9dcb-4310-920a-28d9db4a3bf1-config-out\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:38.001911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.001884 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:38.002161 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.002140 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:38.002386 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.002364 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/361faa5b-9dcb-4310-920a-28d9db4a3bf1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:38.002546 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.002518 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:38.002833 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.002816 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:38.003108 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.003081 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-web-config\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:38.003412 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.003396 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-config-volume\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:38.003449 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.003402 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/361faa5b-9dcb-4310-920a-28d9db4a3bf1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:38.006745 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.006728 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rxmv\" (UniqueName: \"kubernetes.io/projected/361faa5b-9dcb-4310-920a-28d9db4a3bf1-kube-api-access-6rxmv\") pod \"alertmanager-main-0\" (UID: \"361faa5b-9dcb-4310-920a-28d9db4a3bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:38.187346 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.187312 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 22:57:38.328160 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.328124 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 22:57:38.330938 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:57:38.330915 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361faa5b_9dcb_4310_920a_28d9db4a3bf1.slice/crio-d47a2152849e692c847809a91602157c892b2cbfccab36374b3bfce4d775ddd1 WatchSource:0}: Error finding container d47a2152849e692c847809a91602157c892b2cbfccab36374b3bfce4d775ddd1: Status 404 returned error can't find the container with id d47a2152849e692c847809a91602157c892b2cbfccab36374b3bfce4d775ddd1 Jun 11 22:57:38.610933 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.610850 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d0f3cb9-a8e6-4da9-ae28-d1f71888d364" path="/var/lib/kubelet/pods/5d0f3cb9-a8e6-4da9-ae28-d1f71888d364/volumes" Jun 11 22:57:38.817765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.817727 2578 generic.go:356] "Generic (PLEG): container finished" podID="361faa5b-9dcb-4310-920a-28d9db4a3bf1" containerID="1ddec2adec1ce06c8019f85db4b070ce23fd35a5dd4d692c2839566f42306555" exitCode=0 Jun 11 22:57:38.817974 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.817805 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"361faa5b-9dcb-4310-920a-28d9db4a3bf1","Type":"ContainerDied","Data":"1ddec2adec1ce06c8019f85db4b070ce23fd35a5dd4d692c2839566f42306555"} Jun 11 22:57:38.817974 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:38.817885 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"361faa5b-9dcb-4310-920a-28d9db4a3bf1","Type":"ContainerStarted","Data":"d47a2152849e692c847809a91602157c892b2cbfccab36374b3bfce4d775ddd1"} Jun 11 22:57:39.824415 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:39.824376 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"361faa5b-9dcb-4310-920a-28d9db4a3bf1","Type":"ContainerStarted","Data":"579780181b282686f102e78d47868ac392a2a26720e859303cd5d7e0a15354f6"} Jun 11 22:57:39.824937 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:39.824493 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"361faa5b-9dcb-4310-920a-28d9db4a3bf1","Type":"ContainerStarted","Data":"3e763cbf6b580f505e8bad3e4271166937d0e816f9cf6deeed364ea1fb6ff490"} Jun 11 22:57:39.824937 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:39.824537 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"361faa5b-9dcb-4310-920a-28d9db4a3bf1","Type":"ContainerStarted","Data":"0b771a1bcd34fffebf180452acc47337f29521d4260a2e004099495d869f2fd5"} Jun 11 22:57:39.824937 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:39.824582 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"361faa5b-9dcb-4310-920a-28d9db4a3bf1","Type":"ContainerStarted","Data":"b9e3694906226c4f158e0c7c7bf478bf2897d724db8847b58246a945123d57d9"} Jun 11 22:57:39.824937 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:39.824643 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"361faa5b-9dcb-4310-920a-28d9db4a3bf1","Type":"ContainerStarted","Data":"ed780a5e5524a3e6545bc787f6db817fd0ff08dd41892ffe2693fb947d65b612"} Jun 11 22:57:39.824937 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:39.824688 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"361faa5b-9dcb-4310-920a-28d9db4a3bf1","Type":"ContainerStarted","Data":"9825e2b7ba0c6f1abf5955d7617e99bf1d3d1a7499ba2f5a1a63b0af48dc76f7"} Jun 11 22:57:39.868738 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:39.868685 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8521351360000002 podStartE2EDuration="2.868669541s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.534405ms" isStatefulPod=false podCreationTimestamp="2026-06-11 22:57:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:57:39.863123973 +0000 UTC m=+337.746446806" watchObservedRunningTime="2026-06-11 22:57:39.868669541 +0000 UTC m=+337.751992374" Jun 11 22:57:40.337868 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.337826 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8476db5d59-d7x9h"] Jun 11 22:57:40.342138 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.342102 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.347179 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.346684 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 22:57:40.347179 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.346710 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5rf9s\"" Jun 11 22:57:40.347179 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.346927 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 22:57:40.347441 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.347187 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 22:57:40.347441 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.347402 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 22:57:40.347688 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.347667 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 22:57:40.354925 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.354828 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8476db5d59-d7x9h"] Jun 11 22:57:40.357485 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.357458 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 22:57:40.417516 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.417472 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/96746c7f-0dbc-4a73-aba3-d34ae123d492-telemeter-client-tls\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.417516 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.417509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4qgp\" (UniqueName: \"kubernetes.io/projected/96746c7f-0dbc-4a73-aba3-d34ae123d492-kube-api-access-m4qgp\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.417754 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.417532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/96746c7f-0dbc-4a73-aba3-d34ae123d492-secret-telemeter-client\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.417754 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.417635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/96746c7f-0dbc-4a73-aba3-d34ae123d492-federate-client-tls\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.417754 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.417663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96746c7f-0dbc-4a73-aba3-d34ae123d492-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.417754 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.417692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96746c7f-0dbc-4a73-aba3-d34ae123d492-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.417754 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.417710 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96746c7f-0dbc-4a73-aba3-d34ae123d492-metrics-client-ca\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.417907 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.417771 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96746c7f-0dbc-4a73-aba3-d34ae123d492-serving-certs-ca-bundle\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.519048 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.519002 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96746c7f-0dbc-4a73-aba3-d34ae123d492-serving-certs-ca-bundle\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.519253 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.519088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/96746c7f-0dbc-4a73-aba3-d34ae123d492-telemeter-client-tls\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.519253 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.519118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4qgp\" (UniqueName: \"kubernetes.io/projected/96746c7f-0dbc-4a73-aba3-d34ae123d492-kube-api-access-m4qgp\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.519253 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.519145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/96746c7f-0dbc-4a73-aba3-d34ae123d492-secret-telemeter-client\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.519253 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.519178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/96746c7f-0dbc-4a73-aba3-d34ae123d492-federate-client-tls\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.519253 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.519212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96746c7f-0dbc-4a73-aba3-d34ae123d492-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.519253 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.519238 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96746c7f-0dbc-4a73-aba3-d34ae123d492-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.519566 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.519264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96746c7f-0dbc-4a73-aba3-d34ae123d492-metrics-client-ca\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.520014 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.519978 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96746c7f-0dbc-4a73-aba3-d34ae123d492-serving-certs-ca-bundle\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.520158 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.520132 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96746c7f-0dbc-4a73-aba3-d34ae123d492-metrics-client-ca\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.520391 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.520159 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96746c7f-0dbc-4a73-aba3-d34ae123d492-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.522166 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.522145 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/96746c7f-0dbc-4a73-aba3-d34ae123d492-telemeter-client-tls\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.522256 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.522234 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96746c7f-0dbc-4a73-aba3-d34ae123d492-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.522423 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.522408 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/96746c7f-0dbc-4a73-aba3-d34ae123d492-secret-telemeter-client\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.522478 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.522461 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/96746c7f-0dbc-4a73-aba3-d34ae123d492-federate-client-tls\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.532264 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.532232 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4qgp\" (UniqueName: \"kubernetes.io/projected/96746c7f-0dbc-4a73-aba3-d34ae123d492-kube-api-access-m4qgp\") pod \"telemeter-client-8476db5d59-d7x9h\" (UID: \"96746c7f-0dbc-4a73-aba3-d34ae123d492\") " pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.662174 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.661853 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" Jun 11 22:57:40.820175 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.820146 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8476db5d59-d7x9h"] Jun 11 22:57:40.821778 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:57:40.821745 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96746c7f_0dbc_4a73_aba3_d34ae123d492.slice/crio-25c82decd06a7660badcc6c168f1efe296f22ecad4a39c913bc3b8f741e4a779 WatchSource:0}: Error finding container 25c82decd06a7660badcc6c168f1efe296f22ecad4a39c913bc3b8f741e4a779: Status 404 returned error can't find the container with id 25c82decd06a7660badcc6c168f1efe296f22ecad4a39c913bc3b8f741e4a779 Jun 11 22:57:40.824268 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.824251 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 22:57:40.831311 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:40.831259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" event={"ID":"96746c7f-0dbc-4a73-aba3-d34ae123d492","Type":"ContainerStarted","Data":"25c82decd06a7660badcc6c168f1efe296f22ecad4a39c913bc3b8f741e4a779"} Jun 11 22:57:43.851245 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:43.851206 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" event={"ID":"96746c7f-0dbc-4a73-aba3-d34ae123d492","Type":"ContainerStarted","Data":"09af852282418e524cc08eb0c402f213852ec9ad81ba3bd8939a621a0b1a72b2"} Jun 11 22:57:43.851734 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:43.851262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" event={"ID":"96746c7f-0dbc-4a73-aba3-d34ae123d492","Type":"ContainerStarted","Data":"2712f7e58a6508fe394acecaf63e389b9c2fcf412aa83297adf1b25f53c5ca22"} Jun 11 22:57:43.851734 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:43.851282 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" event={"ID":"96746c7f-0dbc-4a73-aba3-d34ae123d492","Type":"ContainerStarted","Data":"780baea4fbdbec619dd2cc507fa34e4a70ff57c9aeabf5e0d919ffddfdccc7ed"} Jun 11 22:57:43.883651 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:43.883573 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8476db5d59-d7x9h" podStartSLOduration=1.918950063 podStartE2EDuration="3.883558131s" totalImagesPullingTime="1.964608068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:57:43.883000869 +0000 UTC m=+341.766323702" watchObservedRunningTime="2026-06-11 22:57:43.883558131 +0000 UTC m=+341.766880963" Jun 11 22:57:44.679924 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.679888 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c4bfcb99-bffjn"] Jun 11 22:57:44.683474 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.683446 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.701086 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.701052 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c4bfcb99-bffjn"] Jun 11 22:57:44.760201 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.760155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-service-ca\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.760358 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.760246 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5b9g\" (UniqueName: \"kubernetes.io/projected/7e0c8a86-68d4-4887-a665-451554a0c2e6-kube-api-access-d5b9g\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.760358 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.760281 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-trusted-ca-bundle\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.760358 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.760338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-oauth-serving-cert\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.760494 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.760377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-config\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.760494 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.760430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-oauth-config\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.760494 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.760455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-serving-cert\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.861814 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.861778 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-service-ca\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.861814 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.861820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5b9g\" (UniqueName: \"kubernetes.io/projected/7e0c8a86-68d4-4887-a665-451554a0c2e6-kube-api-access-d5b9g\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.862439 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.861840 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-trusted-ca-bundle\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.862439 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.861901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-oauth-serving-cert\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.862439 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.861966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-config\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.862439 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.862027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-oauth-config\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.862439 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.862058 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-serving-cert\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.862781 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.862753 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-oauth-serving-cert\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.862947 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.862919 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-service-ca\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.863070 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.862981 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-trusted-ca-bundle\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.863070 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.863011 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-config\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.864640 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.864621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-serving-cert\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.864829 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.864809 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-oauth-config\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.870740 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.870709 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5b9g\" (UniqueName: \"kubernetes.io/projected/7e0c8a86-68d4-4887-a665-451554a0c2e6-kube-api-access-d5b9g\") pod \"console-c4bfcb99-bffjn\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:44.993410 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:44.993310 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:45.133759 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:45.133725 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c4bfcb99-bffjn"] Jun 11 22:57:45.136887 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:57:45.136851 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0c8a86_68d4_4887_a665_451554a0c2e6.slice/crio-801e4cfb9a5f095f2a48f14de51874d16a9ef8b35431eb1655d943362d5f7bf2 WatchSource:0}: Error finding container 801e4cfb9a5f095f2a48f14de51874d16a9ef8b35431eb1655d943362d5f7bf2: Status 404 returned error can't find the container with id 801e4cfb9a5f095f2a48f14de51874d16a9ef8b35431eb1655d943362d5f7bf2 Jun 11 22:57:45.861893 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:45.861849 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4bfcb99-bffjn" event={"ID":"7e0c8a86-68d4-4887-a665-451554a0c2e6","Type":"ContainerStarted","Data":"1bf166577b698f87805039264751738586e1470378b01c5516cc6289418df9c0"} Jun 11 22:57:45.862262 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:45.861957 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4bfcb99-bffjn" event={"ID":"7e0c8a86-68d4-4887-a665-451554a0c2e6","Type":"ContainerStarted","Data":"801e4cfb9a5f095f2a48f14de51874d16a9ef8b35431eb1655d943362d5f7bf2"} Jun 11 22:57:45.879436 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:45.879387 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c4bfcb99-bffjn" podStartSLOduration=1.879371801 podStartE2EDuration="1.879371801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 22:57:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:57:45.879370447 +0000 UTC m=+343.762693281" watchObservedRunningTime="2026-06-11 22:57:45.879371801 +0000 UTC m=+343.762694634" Jun 11 22:57:54.994305 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:54.994261 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:54.994696 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:54.994331 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:54.999289 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:54.999264 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:55.920409 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:55.920381 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:57:55.967807 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:57:55.967771 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f69959748-7w7nn"] Jun 11 22:58:20.991098 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:20.991049 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f69959748-7w7nn" podUID="4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" containerName="console" containerID="cri-o://4fd7bb0083bd2d7bf93a04d08b929868d44111e0b81c18c7a31e05f4f84cf764" gracePeriod=15 Jun 11 22:58:21.237127 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.237099 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:58:21.281365 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.281268 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-oauth-serving-cert\") pod \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " Jun 11 22:58:21.281365 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.281331 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzb25\" (UniqueName: \"kubernetes.io/projected/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-kube-api-access-kzb25\") pod \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " Jun 11 22:58:21.281616 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.281379 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-config\") pod \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " Jun 11 22:58:21.281616 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.281438 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-service-ca\") pod \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " Jun 11 22:58:21.281616 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.281466 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-oauth-config\") pod \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " Jun 11 22:58:21.281616 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.281489 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-serving-cert\") pod \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " Jun 11 22:58:21.281616 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.281508 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-trusted-ca-bundle\") pod \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\" (UID: \"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5\") " Jun 11 22:58:21.281844 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.281688 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" (UID: "4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:58:21.281901 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.281887 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-oauth-serving-cert\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:58:21.282023 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.281918 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-service-ca" (OuterVolumeSpecName: "service-ca") pod "4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" (UID: "4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:58:21.282083 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.281995 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" (UID: "4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:58:21.282139 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.282090 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-config" (OuterVolumeSpecName: "console-config") pod "4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" (UID: "4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:58:21.284025 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.283996 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" (UID: "4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:58:21.284025 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.284007 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-kube-api-access-kzb25" (OuterVolumeSpecName: "kube-api-access-kzb25") pod "4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" (UID: "4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5"). InnerVolumeSpecName "kube-api-access-kzb25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 22:58:21.284183 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.284031 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" (UID: "4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:58:21.382530 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.382488 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-config\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:58:21.382530 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.382519 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-service-ca\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:58:21.382530 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.382530 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-oauth-config\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:58:21.382530 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.382539 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-console-serving-cert\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:58:21.382819 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.382547 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-trusted-ca-bundle\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:58:21.382819 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:21.382556 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzb25\" (UniqueName: \"kubernetes.io/projected/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5-kube-api-access-kzb25\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:58:22.024249 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:22.024216 2578 generic.go:356] "Generic (PLEG): container finished" podID="4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" containerID="4fd7bb0083bd2d7bf93a04d08b929868d44111e0b81c18c7a31e05f4f84cf764" exitCode=0 Jun 11 22:58:22.024685 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:22.024262 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f69959748-7w7nn" Jun 11 22:58:22.024685 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:22.024273 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f69959748-7w7nn" event={"ID":"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5","Type":"ContainerDied","Data":"4fd7bb0083bd2d7bf93a04d08b929868d44111e0b81c18c7a31e05f4f84cf764"} Jun 11 22:58:22.024685 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:22.024313 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f69959748-7w7nn" event={"ID":"4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5","Type":"ContainerDied","Data":"0a4681f12e08d3848be07282f6a4e7a75b0f15c05791e9a56c400c3a136ae12a"} Jun 11 22:58:22.024685 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:22.024332 2578 scope.go:117] "RemoveContainer" containerID="4fd7bb0083bd2d7bf93a04d08b929868d44111e0b81c18c7a31e05f4f84cf764" Jun 11 22:58:22.033956 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:22.033922 2578 scope.go:117] "RemoveContainer" containerID="4fd7bb0083bd2d7bf93a04d08b929868d44111e0b81c18c7a31e05f4f84cf764" Jun 11 22:58:22.037157 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:58:22.034524 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fd7bb0083bd2d7bf93a04d08b929868d44111e0b81c18c7a31e05f4f84cf764\": container with ID starting with 4fd7bb0083bd2d7bf93a04d08b929868d44111e0b81c18c7a31e05f4f84cf764 not found: ID does not exist" containerID="4fd7bb0083bd2d7bf93a04d08b929868d44111e0b81c18c7a31e05f4f84cf764" Jun 11 22:58:22.037157 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:22.034560 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fd7bb0083bd2d7bf93a04d08b929868d44111e0b81c18c7a31e05f4f84cf764"} err="failed to get container status \"4fd7bb0083bd2d7bf93a04d08b929868d44111e0b81c18c7a31e05f4f84cf764\": rpc error: code = NotFound desc = could not find container \"4fd7bb0083bd2d7bf93a04d08b929868d44111e0b81c18c7a31e05f4f84cf764\": container with ID starting with 4fd7bb0083bd2d7bf93a04d08b929868d44111e0b81c18c7a31e05f4f84cf764 not found: ID does not exist" Jun 11 22:58:22.047310 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:22.047280 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f69959748-7w7nn"] Jun 11 22:58:22.051118 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:22.051087 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f69959748-7w7nn"] Jun 11 22:58:22.610660 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:58:22.610624 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" path="/var/lib/kubelet/pods/4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5/volumes" Jun 11 22:59:20.904377 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:20.904295 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c4bfcb99-bffjn"] Jun 11 22:59:35.028766 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.028730 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw"] Jun 11 22:59:35.029233 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.029090 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" containerName="console" Jun 11 22:59:35.029233 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.029107 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" containerName="console" Jun 11 22:59:35.029233 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.029181 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b0b2fdd-8baa-47eb-b2a6-e5ea465a4fc5" containerName="console" Jun 11 22:59:35.032413 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.032395 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" Jun 11 22:59:35.035731 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.035703 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 22:59:35.035875 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.035848 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x7mqc\"" Jun 11 22:59:35.036816 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.036801 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 22:59:35.049344 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.049316 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw"] Jun 11 22:59:35.169714 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.169677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcrzn\" (UniqueName: \"kubernetes.io/projected/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-kube-api-access-vcrzn\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw\" (UID: \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" Jun 11 22:59:35.169895 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.169735 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw\" (UID: \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" Jun 11 22:59:35.169895 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.169853 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw\" (UID: \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" Jun 11 22:59:35.271040 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.270993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw\" (UID: \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" Jun 11 22:59:35.271210 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.271054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcrzn\" (UniqueName: \"kubernetes.io/projected/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-kube-api-access-vcrzn\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw\" (UID: \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" Jun 11 22:59:35.271210 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.271104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw\" (UID: \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" Jun 11 22:59:35.271398 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.271378 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw\" (UID: \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" Jun 11 22:59:35.271456 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.271436 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw\" (UID: \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" Jun 11 22:59:35.284021 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.283963 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcrzn\" (UniqueName: \"kubernetes.io/projected/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-kube-api-access-vcrzn\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw\" (UID: \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" Jun 11 22:59:35.341448 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.341417 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" Jun 11 22:59:35.477731 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:35.477694 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw"] Jun 11 22:59:35.480872 ip-10-0-128-179 kubenswrapper[2578]: W0611 22:59:35.480833 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7c7a6a_4a61_4042_8a6a_76acfa97acaa.slice/crio-3e2933ac7634d6c25c80b85197ca919a5ae155107c654ef5d2892d3c7fcdedf2 WatchSource:0}: Error finding container 3e2933ac7634d6c25c80b85197ca919a5ae155107c654ef5d2892d3c7fcdedf2: Status 404 returned error can't find the container with id 3e2933ac7634d6c25c80b85197ca919a5ae155107c654ef5d2892d3c7fcdedf2 Jun 11 22:59:36.328518 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:36.328477 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" event={"ID":"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa","Type":"ContainerStarted","Data":"3e2933ac7634d6c25c80b85197ca919a5ae155107c654ef5d2892d3c7fcdedf2"} Jun 11 22:59:42.358381 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:42.358343 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c7c7a6a-4a61-4042-8a6a-76acfa97acaa" containerID="a38152199e73b480f0e80014c7c0527df90a765812d104a753ec99e960e9a47c" exitCode=0 Jun 11 22:59:42.358381 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:42.358386 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" event={"ID":"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa","Type":"ContainerDied","Data":"a38152199e73b480f0e80014c7c0527df90a765812d104a753ec99e960e9a47c"} Jun 11 22:59:45.374750 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:45.374712 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c7c7a6a-4a61-4042-8a6a-76acfa97acaa" containerID="559f0bf46acff0b18751b46124ceb91253eb8573428a09bd25a7e889188d58b3" exitCode=0 Jun 11 22:59:45.375121 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:45.374762 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" event={"ID":"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa","Type":"ContainerDied","Data":"559f0bf46acff0b18751b46124ceb91253eb8573428a09bd25a7e889188d58b3"} Jun 11 22:59:45.925911 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:45.925873 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c4bfcb99-bffjn" podUID="7e0c8a86-68d4-4887-a665-451554a0c2e6" containerName="console" containerID="cri-o://1bf166577b698f87805039264751738586e1470378b01c5516cc6289418df9c0" gracePeriod=15 Jun 11 22:59:46.193636 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.193606 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:59:46.271219 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.271186 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-oauth-serving-cert\") pod \"7e0c8a86-68d4-4887-a665-451554a0c2e6\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " Jun 11 22:59:46.271409 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.271245 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5b9g\" (UniqueName: \"kubernetes.io/projected/7e0c8a86-68d4-4887-a665-451554a0c2e6-kube-api-access-d5b9g\") pod \"7e0c8a86-68d4-4887-a665-451554a0c2e6\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " Jun 11 22:59:46.271409 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.271286 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-oauth-config\") pod \"7e0c8a86-68d4-4887-a665-451554a0c2e6\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " Jun 11 22:59:46.271409 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.271309 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-serving-cert\") pod \"7e0c8a86-68d4-4887-a665-451554a0c2e6\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " Jun 11 22:59:46.271409 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.271344 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-trusted-ca-bundle\") pod \"7e0c8a86-68d4-4887-a665-451554a0c2e6\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " Jun 11 22:59:46.271409 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.271382 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-service-ca\") pod \"7e0c8a86-68d4-4887-a665-451554a0c2e6\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " Jun 11 22:59:46.271702 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.271443 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-config\") pod \"7e0c8a86-68d4-4887-a665-451554a0c2e6\" (UID: \"7e0c8a86-68d4-4887-a665-451554a0c2e6\") " Jun 11 22:59:46.271702 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.271663 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7e0c8a86-68d4-4887-a665-451554a0c2e6" (UID: "7e0c8a86-68d4-4887-a665-451554a0c2e6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:59:46.271805 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.271794 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-oauth-serving-cert\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:59:46.272081 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.271985 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-config" (OuterVolumeSpecName: "console-config") pod "7e0c8a86-68d4-4887-a665-451554a0c2e6" (UID: "7e0c8a86-68d4-4887-a665-451554a0c2e6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:59:46.272213 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.272132 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7e0c8a86-68d4-4887-a665-451554a0c2e6" (UID: "7e0c8a86-68d4-4887-a665-451554a0c2e6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:59:46.272406 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.272366 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-service-ca" (OuterVolumeSpecName: "service-ca") pod "7e0c8a86-68d4-4887-a665-451554a0c2e6" (UID: "7e0c8a86-68d4-4887-a665-451554a0c2e6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 22:59:46.273993 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.273958 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7e0c8a86-68d4-4887-a665-451554a0c2e6" (UID: "7e0c8a86-68d4-4887-a665-451554a0c2e6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:59:46.274100 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.273989 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e0c8a86-68d4-4887-a665-451554a0c2e6-kube-api-access-d5b9g" (OuterVolumeSpecName: "kube-api-access-d5b9g") pod "7e0c8a86-68d4-4887-a665-451554a0c2e6" (UID: "7e0c8a86-68d4-4887-a665-451554a0c2e6"). InnerVolumeSpecName "kube-api-access-d5b9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 22:59:46.274204 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.274173 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7e0c8a86-68d4-4887-a665-451554a0c2e6" (UID: "7e0c8a86-68d4-4887-a665-451554a0c2e6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 22:59:46.372544 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.372509 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-config\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:59:46.372544 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.372550 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5b9g\" (UniqueName: \"kubernetes.io/projected/7e0c8a86-68d4-4887-a665-451554a0c2e6-kube-api-access-d5b9g\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:59:46.372753 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.372561 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-oauth-config\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:59:46.372753 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.372569 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e0c8a86-68d4-4887-a665-451554a0c2e6-console-serving-cert\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:59:46.372753 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.372581 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-trusted-ca-bundle\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:59:46.377824 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.372615 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0c8a86-68d4-4887-a665-451554a0c2e6-service-ca\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:59:46.384813 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.384780 2578 generic.go:356] "Generic (PLEG): container finished" podID="7e0c8a86-68d4-4887-a665-451554a0c2e6" containerID="1bf166577b698f87805039264751738586e1470378b01c5516cc6289418df9c0" exitCode=0 Jun 11 22:59:46.385017 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.384848 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4bfcb99-bffjn" Jun 11 22:59:46.385017 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.384887 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4bfcb99-bffjn" event={"ID":"7e0c8a86-68d4-4887-a665-451554a0c2e6","Type":"ContainerDied","Data":"1bf166577b698f87805039264751738586e1470378b01c5516cc6289418df9c0"} Jun 11 22:59:46.385163 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.385000 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4bfcb99-bffjn" event={"ID":"7e0c8a86-68d4-4887-a665-451554a0c2e6","Type":"ContainerDied","Data":"801e4cfb9a5f095f2a48f14de51874d16a9ef8b35431eb1655d943362d5f7bf2"} Jun 11 22:59:46.385163 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.385068 2578 scope.go:117] "RemoveContainer" containerID="1bf166577b698f87805039264751738586e1470378b01c5516cc6289418df9c0" Jun 11 22:59:46.396765 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.396744 2578 scope.go:117] "RemoveContainer" containerID="1bf166577b698f87805039264751738586e1470378b01c5516cc6289418df9c0" Jun 11 22:59:46.397090 ip-10-0-128-179 kubenswrapper[2578]: E0611 22:59:46.397066 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bf166577b698f87805039264751738586e1470378b01c5516cc6289418df9c0\": container with ID starting with 1bf166577b698f87805039264751738586e1470378b01c5516cc6289418df9c0 not found: ID does not exist" containerID="1bf166577b698f87805039264751738586e1470378b01c5516cc6289418df9c0" Jun 11 22:59:46.397160 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.397098 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bf166577b698f87805039264751738586e1470378b01c5516cc6289418df9c0"} err="failed to get container status \"1bf166577b698f87805039264751738586e1470378b01c5516cc6289418df9c0\": rpc error: code = NotFound desc = could not find container \"1bf166577b698f87805039264751738586e1470378b01c5516cc6289418df9c0\": container with ID starting with 1bf166577b698f87805039264751738586e1470378b01c5516cc6289418df9c0 not found: ID does not exist" Jun 11 22:59:46.409149 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.409114 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c4bfcb99-bffjn"] Jun 11 22:59:46.413850 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.413804 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c4bfcb99-bffjn"] Jun 11 22:59:46.611468 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:46.611384 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e0c8a86-68d4-4887-a665-451554a0c2e6" path="/var/lib/kubelet/pods/7e0c8a86-68d4-4887-a665-451554a0c2e6/volumes" Jun 11 22:59:54.425994 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:54.425952 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c7c7a6a-4a61-4042-8a6a-76acfa97acaa" containerID="22e2d0e052c489293070ea5b6943eebbbe74b312fb604bd19902b056cbf8fdea" exitCode=0 Jun 11 22:59:54.426403 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:54.426040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" event={"ID":"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa","Type":"ContainerDied","Data":"22e2d0e052c489293070ea5b6943eebbbe74b312fb604bd19902b056cbf8fdea"} Jun 11 22:59:55.559696 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:55.559673 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" Jun 11 22:59:55.652818 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:55.652782 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-util\") pod \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\" (UID: \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\") " Jun 11 22:59:55.652971 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:55.652884 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-bundle\") pod \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\" (UID: \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\") " Jun 11 22:59:55.652971 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:55.652917 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcrzn\" (UniqueName: \"kubernetes.io/projected/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-kube-api-access-vcrzn\") pod \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\" (UID: \"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa\") " Jun 11 22:59:55.653663 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:55.653635 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-bundle" (OuterVolumeSpecName: "bundle") pod "8c7c7a6a-4a61-4042-8a6a-76acfa97acaa" (UID: "8c7c7a6a-4a61-4042-8a6a-76acfa97acaa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 22:59:55.655339 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:55.655309 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-kube-api-access-vcrzn" (OuterVolumeSpecName: "kube-api-access-vcrzn") pod "8c7c7a6a-4a61-4042-8a6a-76acfa97acaa" (UID: "8c7c7a6a-4a61-4042-8a6a-76acfa97acaa"). InnerVolumeSpecName "kube-api-access-vcrzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 22:59:55.657397 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:55.657371 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-util" (OuterVolumeSpecName: "util") pod "8c7c7a6a-4a61-4042-8a6a-76acfa97acaa" (UID: "8c7c7a6a-4a61-4042-8a6a-76acfa97acaa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 22:59:55.754072 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:55.753982 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-bundle\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:59:55.754072 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:55.754012 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcrzn\" (UniqueName: \"kubernetes.io/projected/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-kube-api-access-vcrzn\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:59:55.754072 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:55.754022 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c7c7a6a-4a61-4042-8a6a-76acfa97acaa-util\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 22:59:56.435619 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:56.435577 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" Jun 11 22:59:56.435797 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:56.435571 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwmdjw" event={"ID":"8c7c7a6a-4a61-4042-8a6a-76acfa97acaa","Type":"ContainerDied","Data":"3e2933ac7634d6c25c80b85197ca919a5ae155107c654ef5d2892d3c7fcdedf2"} Jun 11 22:59:56.435797 ip-10-0-128-179 kubenswrapper[2578]: I0611 22:59:56.435772 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e2933ac7634d6c25c80b85197ca919a5ae155107c654ef5d2892d3c7fcdedf2" Jun 11 23:00:03.204339 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.204297 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2xj55"] Jun 11 23:00:03.204748 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.204674 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7c7a6a-4a61-4042-8a6a-76acfa97acaa" containerName="util" Jun 11 23:00:03.204748 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.204688 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7c7a6a-4a61-4042-8a6a-76acfa97acaa" containerName="util" Jun 11 23:00:03.204748 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.204699 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7c7a6a-4a61-4042-8a6a-76acfa97acaa" containerName="pull" Jun 11 23:00:03.204748 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.204704 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7c7a6a-4a61-4042-8a6a-76acfa97acaa" containerName="pull" Jun 11 23:00:03.204748 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.204713 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7c7a6a-4a61-4042-8a6a-76acfa97acaa" containerName="extract" Jun 11 23:00:03.204748 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.204719 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7c7a6a-4a61-4042-8a6a-76acfa97acaa" containerName="extract" Jun 11 23:00:03.204748 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.204727 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0c8a86-68d4-4887-a665-451554a0c2e6" containerName="console" Jun 11 23:00:03.204748 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.204733 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0c8a86-68d4-4887-a665-451554a0c2e6" containerName="console" Jun 11 23:00:03.204997 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.204815 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c7c7a6a-4a61-4042-8a6a-76acfa97acaa" containerName="extract" Jun 11 23:00:03.204997 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.204828 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e0c8a86-68d4-4887-a665-451554a0c2e6" containerName="console" Jun 11 23:00:03.207349 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.207328 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2xj55" Jun 11 23:00:03.210699 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.210680 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:00:03.211576 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.211561 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 23:00:03.211941 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.211923 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zzxw2\"" Jun 11 23:00:03.219854 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.219830 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2xj55"] Jun 11 23:00:03.316623 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.316565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baaf88f0-c7fa-4148-aa01-754f126a5da3-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2xj55\" (UID: \"baaf88f0-c7fa-4148-aa01-754f126a5da3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2xj55" Jun 11 23:00:03.316802 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.316644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rlr8\" (UniqueName: \"kubernetes.io/projected/baaf88f0-c7fa-4148-aa01-754f126a5da3-kube-api-access-5rlr8\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2xj55\" (UID: \"baaf88f0-c7fa-4148-aa01-754f126a5da3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2xj55" Jun 11 23:00:03.418019 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.417987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rlr8\" (UniqueName: \"kubernetes.io/projected/baaf88f0-c7fa-4148-aa01-754f126a5da3-kube-api-access-5rlr8\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2xj55\" (UID: \"baaf88f0-c7fa-4148-aa01-754f126a5da3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2xj55" Jun 11 23:00:03.418199 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.418050 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baaf88f0-c7fa-4148-aa01-754f126a5da3-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2xj55\" (UID: \"baaf88f0-c7fa-4148-aa01-754f126a5da3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2xj55" Jun 11 23:00:03.418363 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.418348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baaf88f0-c7fa-4148-aa01-754f126a5da3-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2xj55\" (UID: \"baaf88f0-c7fa-4148-aa01-754f126a5da3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2xj55" Jun 11 23:00:03.427839 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.427822 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rlr8\" (UniqueName: \"kubernetes.io/projected/baaf88f0-c7fa-4148-aa01-754f126a5da3-kube-api-access-5rlr8\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2xj55\" (UID: \"baaf88f0-c7fa-4148-aa01-754f126a5da3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2xj55" Jun 11 23:00:03.517033 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.516939 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2xj55" Jun 11 23:00:03.684882 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:03.684857 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2xj55"] Jun 11 23:00:03.687901 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:00:03.687871 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaaf88f0_c7fa_4148_aa01_754f126a5da3.slice/crio-d05100ee27abc6fc23fa528c3bd121d0522a82a630b64d3c64be921bc361e2d5 WatchSource:0}: Error finding container d05100ee27abc6fc23fa528c3bd121d0522a82a630b64d3c64be921bc361e2d5: Status 404 returned error can't find the container with id d05100ee27abc6fc23fa528c3bd121d0522a82a630b64d3c64be921bc361e2d5 Jun 11 23:00:04.474034 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:04.473995 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2xj55" event={"ID":"baaf88f0-c7fa-4148-aa01-754f126a5da3","Type":"ContainerStarted","Data":"d05100ee27abc6fc23fa528c3bd121d0522a82a630b64d3c64be921bc361e2d5"} Jun 11 23:00:10.504898 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:10.504794 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2xj55" event={"ID":"baaf88f0-c7fa-4148-aa01-754f126a5da3","Type":"ContainerStarted","Data":"df59d2704a8e1a586229bd26b07c53f46566d236e3dfd01ddd423ffaf7ae1489"} Jun 11 23:00:10.526390 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:10.526324 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2xj55" podStartSLOduration=0.979698179 podStartE2EDuration="7.526305198s" totalImagesPullingTime="6.546607019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:00:10.523948406 +0000 UTC m=+488.407271238" watchObservedRunningTime="2026-06-11 23:00:10.526305198 +0000 UTC m=+488.409628029" Jun 11 23:00:11.136515 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.136483 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq"] Jun 11 23:00:11.140250 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.140230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" Jun 11 23:00:11.145713 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.145679 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x7mqc\"" Jun 11 23:00:11.145878 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.145715 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:00:11.147035 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.146959 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:00:11.151387 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.151355 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq"] Jun 11 23:00:11.294175 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.294142 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c40b8ac-13cb-49b3-89af-458dba677f2f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq\" (UID: \"8c40b8ac-13cb-49b3-89af-458dba677f2f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" Jun 11 23:00:11.294368 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.294228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c40b8ac-13cb-49b3-89af-458dba677f2f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq\" (UID: \"8c40b8ac-13cb-49b3-89af-458dba677f2f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" Jun 11 23:00:11.294368 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.294266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dfjk\" (UniqueName: \"kubernetes.io/projected/8c40b8ac-13cb-49b3-89af-458dba677f2f-kube-api-access-5dfjk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq\" (UID: \"8c40b8ac-13cb-49b3-89af-458dba677f2f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" Jun 11 23:00:11.395575 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.395479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c40b8ac-13cb-49b3-89af-458dba677f2f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq\" (UID: \"8c40b8ac-13cb-49b3-89af-458dba677f2f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" Jun 11 23:00:11.395575 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.395540 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c40b8ac-13cb-49b3-89af-458dba677f2f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq\" (UID: \"8c40b8ac-13cb-49b3-89af-458dba677f2f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" Jun 11 23:00:11.395575 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.395567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dfjk\" (UniqueName: \"kubernetes.io/projected/8c40b8ac-13cb-49b3-89af-458dba677f2f-kube-api-access-5dfjk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq\" (UID: \"8c40b8ac-13cb-49b3-89af-458dba677f2f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" Jun 11 23:00:11.395981 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.395959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c40b8ac-13cb-49b3-89af-458dba677f2f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq\" (UID: \"8c40b8ac-13cb-49b3-89af-458dba677f2f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" Jun 11 23:00:11.396044 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.395983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c40b8ac-13cb-49b3-89af-458dba677f2f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq\" (UID: \"8c40b8ac-13cb-49b3-89af-458dba677f2f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" Jun 11 23:00:11.413609 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.413554 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dfjk\" (UniqueName: \"kubernetes.io/projected/8c40b8ac-13cb-49b3-89af-458dba677f2f-kube-api-access-5dfjk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq\" (UID: \"8c40b8ac-13cb-49b3-89af-458dba677f2f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" Jun 11 23:00:11.450371 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.450334 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" Jun 11 23:00:11.585011 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:11.584986 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq"] Jun 11 23:00:11.587554 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:00:11.587525 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c40b8ac_13cb_49b3_89af_458dba677f2f.slice/crio-cdb957cdc59890df11f84c5d4e15d0b82cadab97adafe984067d30b218622deb WatchSource:0}: Error finding container cdb957cdc59890df11f84c5d4e15d0b82cadab97adafe984067d30b218622deb: Status 404 returned error can't find the container with id cdb957cdc59890df11f84c5d4e15d0b82cadab97adafe984067d30b218622deb Jun 11 23:00:12.516667 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.516632 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c40b8ac-13cb-49b3-89af-458dba677f2f" containerID="1846b7cabf400eed8fa98b17cca4fd1b7b543ce75f3b9779eb849c94326cee2f" exitCode=0 Jun 11 23:00:12.516843 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.516724 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" event={"ID":"8c40b8ac-13cb-49b3-89af-458dba677f2f","Type":"ContainerDied","Data":"1846b7cabf400eed8fa98b17cca4fd1b7b543ce75f3b9779eb849c94326cee2f"} Jun 11 23:00:12.516843 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.516782 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" event={"ID":"8c40b8ac-13cb-49b3-89af-458dba677f2f","Type":"ContainerStarted","Data":"cdb957cdc59890df11f84c5d4e15d0b82cadab97adafe984067d30b218622deb"} Jun 11 23:00:12.692476 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.692391 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx"] Jun 11 23:00:12.696112 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.696086 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx" Jun 11 23:00:12.698710 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.698669 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 23:00:12.698710 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.698705 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wcfpg\"" Jun 11 23:00:12.698920 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.698721 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 23:00:12.706427 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.706402 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx"] Jun 11 23:00:12.807067 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.807024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf88q\" (UniqueName: \"kubernetes.io/projected/e4ba592a-5bfe-4ce9-97c0-6f137f587e44-kube-api-access-hf88q\") pod \"cert-manager-webhook-7dc76cbb94-6gvrx\" (UID: \"e4ba592a-5bfe-4ce9-97c0-6f137f587e44\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx" Jun 11 23:00:12.807067 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.807076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4ba592a-5bfe-4ce9-97c0-6f137f587e44-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6gvrx\" (UID: \"e4ba592a-5bfe-4ce9-97c0-6f137f587e44\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx" Jun 11 23:00:12.908387 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.908328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf88q\" (UniqueName: \"kubernetes.io/projected/e4ba592a-5bfe-4ce9-97c0-6f137f587e44-kube-api-access-hf88q\") pod \"cert-manager-webhook-7dc76cbb94-6gvrx\" (UID: \"e4ba592a-5bfe-4ce9-97c0-6f137f587e44\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx" Jun 11 23:00:12.908639 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.908428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4ba592a-5bfe-4ce9-97c0-6f137f587e44-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6gvrx\" (UID: \"e4ba592a-5bfe-4ce9-97c0-6f137f587e44\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx" Jun 11 23:00:12.916740 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.916698 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4ba592a-5bfe-4ce9-97c0-6f137f587e44-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6gvrx\" (UID: \"e4ba592a-5bfe-4ce9-97c0-6f137f587e44\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx" Jun 11 23:00:12.916885 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:12.916810 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf88q\" (UniqueName: \"kubernetes.io/projected/e4ba592a-5bfe-4ce9-97c0-6f137f587e44-kube-api-access-hf88q\") pod \"cert-manager-webhook-7dc76cbb94-6gvrx\" (UID: \"e4ba592a-5bfe-4ce9-97c0-6f137f587e44\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx" Jun 11 23:00:13.017157 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:13.017041 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx" Jun 11 23:00:13.154309 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:13.154281 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx"] Jun 11 23:00:13.156628 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:00:13.156602 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4ba592a_5bfe_4ce9_97c0_6f137f587e44.slice/crio-14ae2e40b3495c243c5414c5a97dc30f7d2a5aead3c8ae6df212dfe314c4de4a WatchSource:0}: Error finding container 14ae2e40b3495c243c5414c5a97dc30f7d2a5aead3c8ae6df212dfe314c4de4a: Status 404 returned error can't find the container with id 14ae2e40b3495c243c5414c5a97dc30f7d2a5aead3c8ae6df212dfe314c4de4a Jun 11 23:00:13.524047 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:13.524008 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx" event={"ID":"e4ba592a-5bfe-4ce9-97c0-6f137f587e44","Type":"ContainerStarted","Data":"14ae2e40b3495c243c5414c5a97dc30f7d2a5aead3c8ae6df212dfe314c4de4a"} Jun 11 23:00:15.538079 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:15.538042 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c40b8ac-13cb-49b3-89af-458dba677f2f" containerID="57c26001c891e64552262ab5c704d9f2281481bcd5e2158d7d803d989db7bdd5" exitCode=0 Jun 11 23:00:15.538529 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:15.538139 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" event={"ID":"8c40b8ac-13cb-49b3-89af-458dba677f2f","Type":"ContainerDied","Data":"57c26001c891e64552262ab5c704d9f2281481bcd5e2158d7d803d989db7bdd5"} Jun 11 23:00:16.546159 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:16.546118 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c40b8ac-13cb-49b3-89af-458dba677f2f" containerID="c84bc52380012929b4be3899c896622f5a20a47c583a8374a6718196eba724b1" exitCode=0 Jun 11 23:00:16.546617 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:16.546187 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" event={"ID":"8c40b8ac-13cb-49b3-89af-458dba677f2f","Type":"ContainerDied","Data":"c84bc52380012929b4be3899c896622f5a20a47c583a8374a6718196eba724b1"} Jun 11 23:00:17.552152 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:17.552109 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx" event={"ID":"e4ba592a-5bfe-4ce9-97c0-6f137f587e44","Type":"ContainerStarted","Data":"2bed17e42bc2573d0c742d7bf38a70607196c091213f718b714c1956969af5da"} Jun 11 23:00:17.552645 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:17.552377 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx" Jun 11 23:00:17.570273 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:17.570201 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx" podStartSLOduration=2.091978507 podStartE2EDuration="5.570183284s" totalImagesPullingTime="3.478204777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:00:17.569568047 +0000 UTC m=+495.452890871" watchObservedRunningTime="2026-06-11 23:00:17.570183284 +0000 UTC m=+495.453506115" Jun 11 23:00:17.697863 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:17.697823 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" Jun 11 23:00:17.854914 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:17.854824 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dfjk\" (UniqueName: \"kubernetes.io/projected/8c40b8ac-13cb-49b3-89af-458dba677f2f-kube-api-access-5dfjk\") pod \"8c40b8ac-13cb-49b3-89af-458dba677f2f\" (UID: \"8c40b8ac-13cb-49b3-89af-458dba677f2f\") " Jun 11 23:00:17.854914 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:17.854891 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c40b8ac-13cb-49b3-89af-458dba677f2f-util\") pod \"8c40b8ac-13cb-49b3-89af-458dba677f2f\" (UID: \"8c40b8ac-13cb-49b3-89af-458dba677f2f\") " Jun 11 23:00:17.855203 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:17.854927 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c40b8ac-13cb-49b3-89af-458dba677f2f-bundle\") pod \"8c40b8ac-13cb-49b3-89af-458dba677f2f\" (UID: \"8c40b8ac-13cb-49b3-89af-458dba677f2f\") " Jun 11 23:00:17.855404 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:17.855378 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c40b8ac-13cb-49b3-89af-458dba677f2f-bundle" (OuterVolumeSpecName: "bundle") pod "8c40b8ac-13cb-49b3-89af-458dba677f2f" (UID: "8c40b8ac-13cb-49b3-89af-458dba677f2f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:00:17.857109 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:17.857082 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c40b8ac-13cb-49b3-89af-458dba677f2f-kube-api-access-5dfjk" (OuterVolumeSpecName: "kube-api-access-5dfjk") pod "8c40b8ac-13cb-49b3-89af-458dba677f2f" (UID: "8c40b8ac-13cb-49b3-89af-458dba677f2f"). InnerVolumeSpecName "kube-api-access-5dfjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:00:17.861430 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:17.861398 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c40b8ac-13cb-49b3-89af-458dba677f2f-util" (OuterVolumeSpecName: "util") pod "8c40b8ac-13cb-49b3-89af-458dba677f2f" (UID: "8c40b8ac-13cb-49b3-89af-458dba677f2f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:00:17.955772 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:17.955736 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c40b8ac-13cb-49b3-89af-458dba677f2f-util\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:00:17.955772 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:17.955767 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c40b8ac-13cb-49b3-89af-458dba677f2f-bundle\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:00:17.955772 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:17.955777 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dfjk\" (UniqueName: \"kubernetes.io/projected/8c40b8ac-13cb-49b3-89af-458dba677f2f-kube-api-access-5dfjk\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:00:18.559296 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.559267 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" Jun 11 23:00:18.559713 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.559303 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4vbwq" event={"ID":"8c40b8ac-13cb-49b3-89af-458dba677f2f","Type":"ContainerDied","Data":"cdb957cdc59890df11f84c5d4e15d0b82cadab97adafe984067d30b218622deb"} Jun 11 23:00:18.559713 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.559393 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdb957cdc59890df11f84c5d4e15d0b82cadab97adafe984067d30b218622deb" Jun 11 23:00:18.767392 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.767355 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-bmmk5"] Jun 11 23:00:18.767741 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.767726 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c40b8ac-13cb-49b3-89af-458dba677f2f" containerName="util" Jun 11 23:00:18.767784 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.767746 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c40b8ac-13cb-49b3-89af-458dba677f2f" containerName="util" Jun 11 23:00:18.767784 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.767765 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c40b8ac-13cb-49b3-89af-458dba677f2f" containerName="pull" Jun 11 23:00:18.767848 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.767786 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c40b8ac-13cb-49b3-89af-458dba677f2f" containerName="pull" Jun 11 23:00:18.767848 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.767798 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c40b8ac-13cb-49b3-89af-458dba677f2f" containerName="extract" Jun 11 23:00:18.767848 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.767803 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c40b8ac-13cb-49b3-89af-458dba677f2f" containerName="extract" Jun 11 23:00:18.767932 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.767862 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c40b8ac-13cb-49b3-89af-458dba677f2f" containerName="extract" Jun 11 23:00:18.772138 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.772115 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bmmk5" Jun 11 23:00:18.775754 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.775733 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4vx68\"" Jun 11 23:00:18.780858 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.780833 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-bmmk5"] Jun 11 23:00:18.863062 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.862965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2qn7\" (UniqueName: \"kubernetes.io/projected/030c1ab6-8ff9-4666-a42c-1926c9d4d349-kube-api-access-b2qn7\") pod \"cert-manager-cainjector-5d99449ffd-bmmk5\" (UID: \"030c1ab6-8ff9-4666-a42c-1926c9d4d349\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bmmk5" Jun 11 23:00:18.863062 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.863022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/030c1ab6-8ff9-4666-a42c-1926c9d4d349-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-bmmk5\" (UID: \"030c1ab6-8ff9-4666-a42c-1926c9d4d349\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bmmk5" Jun 11 23:00:18.964159 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.964119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2qn7\" (UniqueName: \"kubernetes.io/projected/030c1ab6-8ff9-4666-a42c-1926c9d4d349-kube-api-access-b2qn7\") pod \"cert-manager-cainjector-5d99449ffd-bmmk5\" (UID: \"030c1ab6-8ff9-4666-a42c-1926c9d4d349\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bmmk5" Jun 11 23:00:18.964336 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.964169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/030c1ab6-8ff9-4666-a42c-1926c9d4d349-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-bmmk5\" (UID: \"030c1ab6-8ff9-4666-a42c-1926c9d4d349\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bmmk5" Jun 11 23:00:18.977576 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.977543 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/030c1ab6-8ff9-4666-a42c-1926c9d4d349-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-bmmk5\" (UID: \"030c1ab6-8ff9-4666-a42c-1926c9d4d349\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bmmk5" Jun 11 23:00:18.977733 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:18.977674 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2qn7\" (UniqueName: \"kubernetes.io/projected/030c1ab6-8ff9-4666-a42c-1926c9d4d349-kube-api-access-b2qn7\") pod \"cert-manager-cainjector-5d99449ffd-bmmk5\" (UID: \"030c1ab6-8ff9-4666-a42c-1926c9d4d349\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bmmk5" Jun 11 23:00:19.081977 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:19.081934 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bmmk5" Jun 11 23:00:19.229285 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:19.229259 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-bmmk5"] Jun 11 23:00:19.235029 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:00:19.234998 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod030c1ab6_8ff9_4666_a42c_1926c9d4d349.slice/crio-184ff0c9e6ffd499e42e96fe29ef1cf5554a73d91b1958a83f0d6efca48d0503 WatchSource:0}: Error finding container 184ff0c9e6ffd499e42e96fe29ef1cf5554a73d91b1958a83f0d6efca48d0503: Status 404 returned error can't find the container with id 184ff0c9e6ffd499e42e96fe29ef1cf5554a73d91b1958a83f0d6efca48d0503 Jun 11 23:00:19.566604 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:19.566497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bmmk5" event={"ID":"030c1ab6-8ff9-4666-a42c-1926c9d4d349","Type":"ContainerStarted","Data":"b3d4388ad958ff9a043339f4a54d22bc64c6c242b74c8a0ec7dd87e3851a72fa"} Jun 11 23:00:19.566604 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:19.566540 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bmmk5" event={"ID":"030c1ab6-8ff9-4666-a42c-1926c9d4d349","Type":"ContainerStarted","Data":"184ff0c9e6ffd499e42e96fe29ef1cf5554a73d91b1958a83f0d6efca48d0503"} Jun 11 23:00:19.582689 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:19.582642 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bmmk5" podStartSLOduration=1.5826233539999999 podStartE2EDuration="1.582623354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:00:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:00:19.582219521 +0000 UTC m=+497.465542353" watchObservedRunningTime="2026-06-11 23:00:19.582623354 +0000 UTC m=+497.465946186" Jun 11 23:00:22.629969 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:22.629926 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-6n6jv"] Jun 11 23:00:22.635049 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:22.635020 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-6n6jv" Jun 11 23:00:22.637632 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:22.637609 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-z7m27\"" Jun 11 23:00:22.641143 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:22.641119 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-6n6jv"] Jun 11 23:00:22.797951 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:22.797916 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfqsv\" (UniqueName: \"kubernetes.io/projected/be8d5027-61cb-4c6c-ac23-5b19d5e2c5a5-kube-api-access-kfqsv\") pod \"cert-manager-59c77684cc-6n6jv\" (UID: \"be8d5027-61cb-4c6c-ac23-5b19d5e2c5a5\") " pod="cert-manager/cert-manager-59c77684cc-6n6jv" Jun 11 23:00:22.798138 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:22.797987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be8d5027-61cb-4c6c-ac23-5b19d5e2c5a5-bound-sa-token\") pod \"cert-manager-59c77684cc-6n6jv\" (UID: \"be8d5027-61cb-4c6c-ac23-5b19d5e2c5a5\") " pod="cert-manager/cert-manager-59c77684cc-6n6jv" Jun 11 23:00:22.899101 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:22.899011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be8d5027-61cb-4c6c-ac23-5b19d5e2c5a5-bound-sa-token\") pod \"cert-manager-59c77684cc-6n6jv\" (UID: \"be8d5027-61cb-4c6c-ac23-5b19d5e2c5a5\") " pod="cert-manager/cert-manager-59c77684cc-6n6jv" Jun 11 23:00:22.899101 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:22.899070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfqsv\" (UniqueName: \"kubernetes.io/projected/be8d5027-61cb-4c6c-ac23-5b19d5e2c5a5-kube-api-access-kfqsv\") pod \"cert-manager-59c77684cc-6n6jv\" (UID: \"be8d5027-61cb-4c6c-ac23-5b19d5e2c5a5\") " pod="cert-manager/cert-manager-59c77684cc-6n6jv" Jun 11 23:00:22.907306 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:22.907278 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be8d5027-61cb-4c6c-ac23-5b19d5e2c5a5-bound-sa-token\") pod \"cert-manager-59c77684cc-6n6jv\" (UID: \"be8d5027-61cb-4c6c-ac23-5b19d5e2c5a5\") " pod="cert-manager/cert-manager-59c77684cc-6n6jv" Jun 11 23:00:22.907433 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:22.907369 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfqsv\" (UniqueName: \"kubernetes.io/projected/be8d5027-61cb-4c6c-ac23-5b19d5e2c5a5-kube-api-access-kfqsv\") pod \"cert-manager-59c77684cc-6n6jv\" (UID: \"be8d5027-61cb-4c6c-ac23-5b19d5e2c5a5\") " pod="cert-manager/cert-manager-59c77684cc-6n6jv" Jun 11 23:00:22.946866 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:22.946829 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-6n6jv" Jun 11 23:00:23.084798 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:23.084618 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-6n6jv"] Jun 11 23:00:23.087479 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:00:23.087444 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe8d5027_61cb_4c6c_ac23_5b19d5e2c5a5.slice/crio-02495e6f04b28fa1e678df9651414f697e592d68491fdf7be8b7f276ec69e239 WatchSource:0}: Error finding container 02495e6f04b28fa1e678df9651414f697e592d68491fdf7be8b7f276ec69e239: Status 404 returned error can't find the container with id 02495e6f04b28fa1e678df9651414f697e592d68491fdf7be8b7f276ec69e239 Jun 11 23:00:23.561544 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:23.561460 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6gvrx" Jun 11 23:00:23.587040 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:23.587007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-6n6jv" event={"ID":"be8d5027-61cb-4c6c-ac23-5b19d5e2c5a5","Type":"ContainerStarted","Data":"e2b6ede3b0b53945cfdaa23eb5bee8032a08cf3fde8747e909832900fb0114b2"} Jun 11 23:00:23.587040 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:23.587044 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-6n6jv" event={"ID":"be8d5027-61cb-4c6c-ac23-5b19d5e2c5a5","Type":"ContainerStarted","Data":"02495e6f04b28fa1e678df9651414f697e592d68491fdf7be8b7f276ec69e239"} Jun 11 23:00:23.620242 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:23.620188 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-6n6jv" podStartSLOduration=1.620170671 podStartE2EDuration="1.620170671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:00:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:00:23.618265477 +0000 UTC m=+501.501588309" watchObservedRunningTime="2026-06-11 23:00:23.620170671 +0000 UTC m=+501.503493502" Jun 11 23:00:30.248211 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.248173 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s"] Jun 11 23:00:30.250742 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.250724 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" Jun 11 23:00:30.253325 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.253303 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:00:30.253471 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.253363 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:00:30.254642 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.254623 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x7mqc\"" Jun 11 23:00:30.256885 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.256857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm85r\" (UniqueName: \"kubernetes.io/projected/1201546d-ed3e-4b6f-ba9a-5f2ded326678-kube-api-access-dm85r\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s\" (UID: \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" Jun 11 23:00:30.256991 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.256928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1201546d-ed3e-4b6f-ba9a-5f2ded326678-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s\" (UID: \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" Jun 11 23:00:30.256991 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.256960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1201546d-ed3e-4b6f-ba9a-5f2ded326678-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s\" (UID: \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" Jun 11 23:00:30.259510 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.259490 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s"] Jun 11 23:00:30.358051 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.358014 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1201546d-ed3e-4b6f-ba9a-5f2ded326678-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s\" (UID: \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" Jun 11 23:00:30.358051 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.358054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1201546d-ed3e-4b6f-ba9a-5f2ded326678-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s\" (UID: \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" Jun 11 23:00:30.358308 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.358134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm85r\" (UniqueName: \"kubernetes.io/projected/1201546d-ed3e-4b6f-ba9a-5f2ded326678-kube-api-access-dm85r\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s\" (UID: \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" Jun 11 23:00:30.358449 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.358428 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1201546d-ed3e-4b6f-ba9a-5f2ded326678-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s\" (UID: \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" Jun 11 23:00:30.358519 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.358444 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1201546d-ed3e-4b6f-ba9a-5f2ded326678-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s\" (UID: \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" Jun 11 23:00:30.366732 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.366707 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm85r\" (UniqueName: \"kubernetes.io/projected/1201546d-ed3e-4b6f-ba9a-5f2ded326678-kube-api-access-dm85r\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s\" (UID: \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" Jun 11 23:00:30.561734 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.561650 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" Jun 11 23:00:30.696373 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:30.696348 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s"] Jun 11 23:00:30.698998 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:00:30.698968 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1201546d_ed3e_4b6f_ba9a_5f2ded326678.slice/crio-c40445d64c2083da09033cf4cce3babdae39ddb9375d69b7e542850cb36b7c7b WatchSource:0}: Error finding container c40445d64c2083da09033cf4cce3babdae39ddb9375d69b7e542850cb36b7c7b: Status 404 returned error can't find the container with id c40445d64c2083da09033cf4cce3babdae39ddb9375d69b7e542850cb36b7c7b Jun 11 23:00:31.626420 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:31.626338 2578 generic.go:356] "Generic (PLEG): container finished" podID="1201546d-ed3e-4b6f-ba9a-5f2ded326678" containerID="e253f49dd5fb744e987eeb84de0e8612743f5eb6cf4bf4a1995b00c39de0df7c" exitCode=0 Jun 11 23:00:31.626810 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:31.626422 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" event={"ID":"1201546d-ed3e-4b6f-ba9a-5f2ded326678","Type":"ContainerDied","Data":"e253f49dd5fb744e987eeb84de0e8612743f5eb6cf4bf4a1995b00c39de0df7c"} Jun 11 23:00:31.626810 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:31.626465 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" event={"ID":"1201546d-ed3e-4b6f-ba9a-5f2ded326678","Type":"ContainerStarted","Data":"c40445d64c2083da09033cf4cce3babdae39ddb9375d69b7e542850cb36b7c7b"} Jun 11 23:00:32.638449 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:32.638411 2578 generic.go:356] "Generic (PLEG): container finished" podID="1201546d-ed3e-4b6f-ba9a-5f2ded326678" containerID="e4ca8bed64b6773b3dbdcfddd2159cba65060e4d17e1338c7ad89ab8295e7dfd" exitCode=0 Jun 11 23:00:32.638854 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:32.638471 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" event={"ID":"1201546d-ed3e-4b6f-ba9a-5f2ded326678","Type":"ContainerDied","Data":"e4ca8bed64b6773b3dbdcfddd2159cba65060e4d17e1338c7ad89ab8295e7dfd"} Jun 11 23:00:33.647235 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:33.647200 2578 generic.go:356] "Generic (PLEG): container finished" podID="1201546d-ed3e-4b6f-ba9a-5f2ded326678" containerID="2b8eaee9fcfbcfb0a22c6451aa1cebfba039d442b15dcd6de275eb13480b7b29" exitCode=0 Jun 11 23:00:33.647621 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:33.647249 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" event={"ID":"1201546d-ed3e-4b6f-ba9a-5f2ded326678","Type":"ContainerDied","Data":"2b8eaee9fcfbcfb0a22c6451aa1cebfba039d442b15dcd6de275eb13480b7b29"} Jun 11 23:00:34.784876 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:34.784850 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" Jun 11 23:00:34.787141 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:34.787123 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1201546d-ed3e-4b6f-ba9a-5f2ded326678-util\") pod \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\" (UID: \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\") " Jun 11 23:00:34.787195 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:34.787168 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm85r\" (UniqueName: \"kubernetes.io/projected/1201546d-ed3e-4b6f-ba9a-5f2ded326678-kube-api-access-dm85r\") pod \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\" (UID: \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\") " Jun 11 23:00:34.787230 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:34.787203 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1201546d-ed3e-4b6f-ba9a-5f2ded326678-bundle\") pod \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\" (UID: \"1201546d-ed3e-4b6f-ba9a-5f2ded326678\") " Jun 11 23:00:34.788054 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:34.788027 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1201546d-ed3e-4b6f-ba9a-5f2ded326678-bundle" (OuterVolumeSpecName: "bundle") pod "1201546d-ed3e-4b6f-ba9a-5f2ded326678" (UID: "1201546d-ed3e-4b6f-ba9a-5f2ded326678"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:00:34.789521 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:34.789495 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1201546d-ed3e-4b6f-ba9a-5f2ded326678-kube-api-access-dm85r" (OuterVolumeSpecName: "kube-api-access-dm85r") pod "1201546d-ed3e-4b6f-ba9a-5f2ded326678" (UID: "1201546d-ed3e-4b6f-ba9a-5f2ded326678"). InnerVolumeSpecName "kube-api-access-dm85r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:00:34.792895 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:34.792872 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1201546d-ed3e-4b6f-ba9a-5f2ded326678-util" (OuterVolumeSpecName: "util") pod "1201546d-ed3e-4b6f-ba9a-5f2ded326678" (UID: "1201546d-ed3e-4b6f-ba9a-5f2ded326678"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:00:34.888646 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:34.888613 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1201546d-ed3e-4b6f-ba9a-5f2ded326678-util\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:00:34.888646 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:34.888642 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm85r\" (UniqueName: \"kubernetes.io/projected/1201546d-ed3e-4b6f-ba9a-5f2ded326678-kube-api-access-dm85r\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:00:34.888646 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:34.888654 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1201546d-ed3e-4b6f-ba9a-5f2ded326678-bundle\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:00:35.658506 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:35.658466 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" event={"ID":"1201546d-ed3e-4b6f-ba9a-5f2ded326678","Type":"ContainerDied","Data":"c40445d64c2083da09033cf4cce3babdae39ddb9375d69b7e542850cb36b7c7b"} Jun 11 23:00:35.658506 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:35.658509 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfjc6s" Jun 11 23:00:35.658722 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:35.658521 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c40445d64c2083da09033cf4cce3babdae39ddb9375d69b7e542850cb36b7c7b" Jun 11 23:00:43.123899 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.123823 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2"] Jun 11 23:00:43.124342 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.124156 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1201546d-ed3e-4b6f-ba9a-5f2ded326678" containerName="pull" Jun 11 23:00:43.124342 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.124170 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1201546d-ed3e-4b6f-ba9a-5f2ded326678" containerName="pull" Jun 11 23:00:43.124342 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.124194 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1201546d-ed3e-4b6f-ba9a-5f2ded326678" containerName="extract" Jun 11 23:00:43.124342 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.124200 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1201546d-ed3e-4b6f-ba9a-5f2ded326678" containerName="extract" Jun 11 23:00:43.124342 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.124206 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1201546d-ed3e-4b6f-ba9a-5f2ded326678" containerName="util" Jun 11 23:00:43.124342 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.124211 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1201546d-ed3e-4b6f-ba9a-5f2ded326678" containerName="util" Jun 11 23:00:43.124342 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.124285 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1201546d-ed3e-4b6f-ba9a-5f2ded326678" containerName="extract" Jun 11 23:00:43.128749 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.128731 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.132819 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.132794 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 23:00:43.136632 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.136607 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 23:00:43.136632 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.136616 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bv85g\"" Jun 11 23:00:43.136791 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.136614 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 23:00:43.136837 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.136782 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 23:00:43.146618 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.146556 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2"] Jun 11 23:00:43.159806 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.159775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.159970 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.159813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.159970 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.159830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t98tt\" (UniqueName: \"kubernetes.io/projected/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-kube-api-access-t98tt\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.160088 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.159990 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-tmp\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.160088 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.160063 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-manifests\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.261340 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.261303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-tmp\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.261560 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.261362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-manifests\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.261560 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.261391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.261560 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.261409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.261560 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.261425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t98tt\" (UniqueName: \"kubernetes.io/projected/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-kube-api-access-t98tt\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.261960 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.261930 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-manifests\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.263996 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.263966 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-tmp\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.264082 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.264035 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.264082 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.264061 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.273400 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.273377 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t98tt\" (UniqueName: \"kubernetes.io/projected/73dc3edf-7b5f-440e-8ee9-a75694e97cb6-kube-api-access-t98tt\") pod \"opendatahub-operator-controller-manager-74f864d649-2xlc2\" (UID: \"73dc3edf-7b5f-440e-8ee9-a75694e97cb6\") " pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.439771 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.439734 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:43.586380 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.586347 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2"] Jun 11 23:00:43.590055 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:00:43.590026 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73dc3edf_7b5f_440e_8ee9_a75694e97cb6.slice/crio-d73c8856eb9363001b9e0022d0bf8c9ed7a4d5eb85facd5389e847ae21173cfb WatchSource:0}: Error finding container d73c8856eb9363001b9e0022d0bf8c9ed7a4d5eb85facd5389e847ae21173cfb: Status 404 returned error can't find the container with id d73c8856eb9363001b9e0022d0bf8c9ed7a4d5eb85facd5389e847ae21173cfb Jun 11 23:00:43.697742 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:43.697651 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" event={"ID":"73dc3edf-7b5f-440e-8ee9-a75694e97cb6","Type":"ContainerStarted","Data":"d73c8856eb9363001b9e0022d0bf8c9ed7a4d5eb85facd5389e847ae21173cfb"} Jun 11 23:00:46.717705 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:46.717668 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" event={"ID":"73dc3edf-7b5f-440e-8ee9-a75694e97cb6","Type":"ContainerStarted","Data":"679bbf46d0f755b420dbd3ab497032a3304d32486132163a25185a54f30080c5"} Jun 11 23:00:47.724344 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:47.724312 2578 generic.go:356] "Generic (PLEG): container finished" podID="73dc3edf-7b5f-440e-8ee9-a75694e97cb6" containerID="679bbf46d0f755b420dbd3ab497032a3304d32486132163a25185a54f30080c5" exitCode=0 Jun 11 23:00:47.724893 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:47.724412 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" event={"ID":"73dc3edf-7b5f-440e-8ee9-a75694e97cb6","Type":"ContainerDied","Data":"679bbf46d0f755b420dbd3ab497032a3304d32486132163a25185a54f30080c5"} Jun 11 23:00:48.731971 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:48.731929 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" event={"ID":"73dc3edf-7b5f-440e-8ee9-a75694e97cb6","Type":"ContainerStarted","Data":"acd93d138784b64025bf01c43fa24af8044f9beebc801e9973648ca5f9dcef57"} Jun 11 23:00:48.732382 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:48.732066 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:00:48.754923 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:48.754865 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" podStartSLOduration=1.330267405 podStartE2EDuration="5.754846759s" totalImagesPullingTime="3.353147461s" totalInitContainerRuntime="1.071431893s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:00:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:00:48.754414425 +0000 UTC m=+526.637737260" watchObservedRunningTime="2026-06-11 23:00:48.754846759 +0000 UTC m=+526.638169591" Jun 11 23:00:59.739328 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:00:59.739298 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74f864d649-2xlc2" Jun 11 23:01:02.593221 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.593184 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2"] Jun 11 23:01:02.602909 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.602842 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" Jun 11 23:01:02.606304 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.606270 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:01:02.606565 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.606542 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x7mqc\"" Jun 11 23:01:02.607844 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.607821 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:01:02.614871 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.614840 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2"] Jun 11 23:01:02.742436 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.742399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30f77aff-fac4-464b-bf64-00748ed51c3f-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2\" (UID: \"30f77aff-fac4-464b-bf64-00748ed51c3f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" Jun 11 23:01:02.742436 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.742441 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30f77aff-fac4-464b-bf64-00748ed51c3f-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2\" (UID: \"30f77aff-fac4-464b-bf64-00748ed51c3f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" Jun 11 23:01:02.742707 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.742464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnt74\" (UniqueName: \"kubernetes.io/projected/30f77aff-fac4-464b-bf64-00748ed51c3f-kube-api-access-wnt74\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2\" (UID: \"30f77aff-fac4-464b-bf64-00748ed51c3f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" Jun 11 23:01:02.844079 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.843248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30f77aff-fac4-464b-bf64-00748ed51c3f-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2\" (UID: \"30f77aff-fac4-464b-bf64-00748ed51c3f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" Jun 11 23:01:02.844079 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.843696 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30f77aff-fac4-464b-bf64-00748ed51c3f-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2\" (UID: \"30f77aff-fac4-464b-bf64-00748ed51c3f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" Jun 11 23:01:02.844079 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.843777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30f77aff-fac4-464b-bf64-00748ed51c3f-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2\" (UID: \"30f77aff-fac4-464b-bf64-00748ed51c3f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" Jun 11 23:01:02.844079 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.843823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnt74\" (UniqueName: \"kubernetes.io/projected/30f77aff-fac4-464b-bf64-00748ed51c3f-kube-api-access-wnt74\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2\" (UID: \"30f77aff-fac4-464b-bf64-00748ed51c3f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" Jun 11 23:01:02.844399 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.844149 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30f77aff-fac4-464b-bf64-00748ed51c3f-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2\" (UID: \"30f77aff-fac4-464b-bf64-00748ed51c3f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" Jun 11 23:01:02.854778 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.854745 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnt74\" (UniqueName: \"kubernetes.io/projected/30f77aff-fac4-464b-bf64-00748ed51c3f-kube-api-access-wnt74\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2\" (UID: \"30f77aff-fac4-464b-bf64-00748ed51c3f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" Jun 11 23:01:02.919301 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:02.919264 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" Jun 11 23:01:03.075567 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.075525 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2"] Jun 11 23:01:03.077921 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:01:03.077888 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f77aff_fac4_464b_bf64_00748ed51c3f.slice/crio-4d43f2ac72d1f4d65ace1ea8416837ba02b49df29196318ae1e3a575179b0c8b WatchSource:0}: Error finding container 4d43f2ac72d1f4d65ace1ea8416837ba02b49df29196318ae1e3a575179b0c8b: Status 404 returned error can't find the container with id 4d43f2ac72d1f4d65ace1ea8416837ba02b49df29196318ae1e3a575179b0c8b Jun 11 23:01:03.355831 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.355749 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-856696d794-wthbz"] Jun 11 23:01:03.359068 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.359047 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:03.361995 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.361972 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 23:01:03.362108 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.361992 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vtzkl\"" Jun 11 23:01:03.362108 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.362013 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 23:01:03.362108 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.362022 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 23:01:03.362108 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.362084 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:01:03.362401 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.362385 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 23:01:03.368986 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.368963 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-856696d794-wthbz"] Jun 11 23:01:03.450895 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.450860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fa71520-6a00-4a38-82dd-8987ddc881cc-cert\") pod \"lws-controller-manager-856696d794-wthbz\" (UID: \"4fa71520-6a00-4a38-82dd-8987ddc881cc\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:03.451069 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.450948 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr9vv\" (UniqueName: \"kubernetes.io/projected/4fa71520-6a00-4a38-82dd-8987ddc881cc-kube-api-access-nr9vv\") pod \"lws-controller-manager-856696d794-wthbz\" (UID: \"4fa71520-6a00-4a38-82dd-8987ddc881cc\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:03.451069 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.451026 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fa71520-6a00-4a38-82dd-8987ddc881cc-metrics-cert\") pod \"lws-controller-manager-856696d794-wthbz\" (UID: \"4fa71520-6a00-4a38-82dd-8987ddc881cc\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:03.451160 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.451090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4fa71520-6a00-4a38-82dd-8987ddc881cc-manager-config\") pod \"lws-controller-manager-856696d794-wthbz\" (UID: \"4fa71520-6a00-4a38-82dd-8987ddc881cc\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:03.552284 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.552239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fa71520-6a00-4a38-82dd-8987ddc881cc-cert\") pod \"lws-controller-manager-856696d794-wthbz\" (UID: \"4fa71520-6a00-4a38-82dd-8987ddc881cc\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:03.552554 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.552307 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr9vv\" (UniqueName: \"kubernetes.io/projected/4fa71520-6a00-4a38-82dd-8987ddc881cc-kube-api-access-nr9vv\") pod \"lws-controller-manager-856696d794-wthbz\" (UID: \"4fa71520-6a00-4a38-82dd-8987ddc881cc\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:03.552554 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.552366 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fa71520-6a00-4a38-82dd-8987ddc881cc-metrics-cert\") pod \"lws-controller-manager-856696d794-wthbz\" (UID: \"4fa71520-6a00-4a38-82dd-8987ddc881cc\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:03.552554 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.552435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4fa71520-6a00-4a38-82dd-8987ddc881cc-manager-config\") pod \"lws-controller-manager-856696d794-wthbz\" (UID: \"4fa71520-6a00-4a38-82dd-8987ddc881cc\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:03.553112 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.553089 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4fa71520-6a00-4a38-82dd-8987ddc881cc-manager-config\") pod \"lws-controller-manager-856696d794-wthbz\" (UID: \"4fa71520-6a00-4a38-82dd-8987ddc881cc\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:03.555070 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.555047 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fa71520-6a00-4a38-82dd-8987ddc881cc-cert\") pod \"lws-controller-manager-856696d794-wthbz\" (UID: \"4fa71520-6a00-4a38-82dd-8987ddc881cc\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:03.555180 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.555108 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fa71520-6a00-4a38-82dd-8987ddc881cc-metrics-cert\") pod \"lws-controller-manager-856696d794-wthbz\" (UID: \"4fa71520-6a00-4a38-82dd-8987ddc881cc\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:03.562912 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.562885 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr9vv\" (UniqueName: \"kubernetes.io/projected/4fa71520-6a00-4a38-82dd-8987ddc881cc-kube-api-access-nr9vv\") pod \"lws-controller-manager-856696d794-wthbz\" (UID: \"4fa71520-6a00-4a38-82dd-8987ddc881cc\") " pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:03.669349 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.669311 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:03.815358 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.815326 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-856696d794-wthbz"] Jun 11 23:01:03.816363 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.816330 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" event={"ID":"30f77aff-fac4-464b-bf64-00748ed51c3f","Type":"ContainerDied","Data":"7cbfcf369f078eb8da9ab54a263a6a8599cb5cd1eb71b972890051dbe7a25174"} Jun 11 23:01:03.816572 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.815733 2578 generic.go:356] "Generic (PLEG): container finished" podID="30f77aff-fac4-464b-bf64-00748ed51c3f" containerID="7cbfcf369f078eb8da9ab54a263a6a8599cb5cd1eb71b972890051dbe7a25174" exitCode=0 Jun 11 23:01:03.816856 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:03.816830 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" event={"ID":"30f77aff-fac4-464b-bf64-00748ed51c3f","Type":"ContainerStarted","Data":"4d43f2ac72d1f4d65ace1ea8416837ba02b49df29196318ae1e3a575179b0c8b"} Jun 11 23:01:04.825664 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:04.825620 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" event={"ID":"4fa71520-6a00-4a38-82dd-8987ddc881cc","Type":"ContainerStarted","Data":"4c43fa614597d1d9e5d17a6a2d7ab5d7756492e889211499acc6251acff35c75"} Jun 11 23:01:05.833381 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:05.833281 2578 generic.go:356] "Generic (PLEG): container finished" podID="30f77aff-fac4-464b-bf64-00748ed51c3f" containerID="157375f72d5e42dc4eedf678877983ac0e05fb51c20cde0f7a778690fe790a07" exitCode=0 Jun 11 23:01:05.833381 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:05.833369 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" event={"ID":"30f77aff-fac4-464b-bf64-00748ed51c3f","Type":"ContainerDied","Data":"157375f72d5e42dc4eedf678877983ac0e05fb51c20cde0f7a778690fe790a07"} Jun 11 23:01:05.835215 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:05.835110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" event={"ID":"4fa71520-6a00-4a38-82dd-8987ddc881cc","Type":"ContainerStarted","Data":"fb252546b3630284f2a5e571b9cfe5e7ed20d6816c5ee94ef63f6f571da211b6"} Jun 11 23:01:05.835297 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:05.835260 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:05.866183 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:05.866135 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" podStartSLOduration=1.273658488 podStartE2EDuration="2.866118682s" totalImagesPullingTime="1.592460194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:01:05.865139624 +0000 UTC m=+543.748462467" watchObservedRunningTime="2026-06-11 23:01:05.866118682 +0000 UTC m=+543.749441514" Jun 11 23:01:06.842504 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:06.842412 2578 generic.go:356] "Generic (PLEG): container finished" podID="30f77aff-fac4-464b-bf64-00748ed51c3f" containerID="625beed8512b4b8bfea13cf985871163021e3b21aa4b1edf78a953ef0d386784" exitCode=0 Jun 11 23:01:06.842504 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:06.842454 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" event={"ID":"30f77aff-fac4-464b-bf64-00748ed51c3f","Type":"ContainerDied","Data":"625beed8512b4b8bfea13cf985871163021e3b21aa4b1edf78a953ef0d386784"} Jun 11 23:01:07.982946 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:07.982921 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" Jun 11 23:01:08.093018 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:08.092964 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30f77aff-fac4-464b-bf64-00748ed51c3f-bundle\") pod \"30f77aff-fac4-464b-bf64-00748ed51c3f\" (UID: \"30f77aff-fac4-464b-bf64-00748ed51c3f\") " Jun 11 23:01:08.093197 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:08.093047 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30f77aff-fac4-464b-bf64-00748ed51c3f-util\") pod \"30f77aff-fac4-464b-bf64-00748ed51c3f\" (UID: \"30f77aff-fac4-464b-bf64-00748ed51c3f\") " Jun 11 23:01:08.093197 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:08.093161 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnt74\" (UniqueName: \"kubernetes.io/projected/30f77aff-fac4-464b-bf64-00748ed51c3f-kube-api-access-wnt74\") pod \"30f77aff-fac4-464b-bf64-00748ed51c3f\" (UID: \"30f77aff-fac4-464b-bf64-00748ed51c3f\") " Jun 11 23:01:08.094696 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:08.094637 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30f77aff-fac4-464b-bf64-00748ed51c3f-bundle" (OuterVolumeSpecName: "bundle") pod "30f77aff-fac4-464b-bf64-00748ed51c3f" (UID: "30f77aff-fac4-464b-bf64-00748ed51c3f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:01:08.095869 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:08.095834 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f77aff-fac4-464b-bf64-00748ed51c3f-kube-api-access-wnt74" (OuterVolumeSpecName: "kube-api-access-wnt74") pod "30f77aff-fac4-464b-bf64-00748ed51c3f" (UID: "30f77aff-fac4-464b-bf64-00748ed51c3f"). InnerVolumeSpecName "kube-api-access-wnt74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:01:08.099845 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:08.099781 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30f77aff-fac4-464b-bf64-00748ed51c3f-util" (OuterVolumeSpecName: "util") pod "30f77aff-fac4-464b-bf64-00748ed51c3f" (UID: "30f77aff-fac4-464b-bf64-00748ed51c3f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:01:08.193996 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:08.193955 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30f77aff-fac4-464b-bf64-00748ed51c3f-bundle\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:01:08.193996 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:08.193996 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30f77aff-fac4-464b-bf64-00748ed51c3f-util\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:01:08.194211 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:08.194010 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnt74\" (UniqueName: \"kubernetes.io/projected/30f77aff-fac4-464b-bf64-00748ed51c3f-kube-api-access-wnt74\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:01:08.854474 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:08.854443 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" event={"ID":"30f77aff-fac4-464b-bf64-00748ed51c3f","Type":"ContainerDied","Data":"4d43f2ac72d1f4d65ace1ea8416837ba02b49df29196318ae1e3a575179b0c8b"} Jun 11 23:01:08.854474 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:08.854476 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmhb2" Jun 11 23:01:08.854703 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:08.854488 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d43f2ac72d1f4d65ace1ea8416837ba02b49df29196318ae1e3a575179b0c8b" Jun 11 23:01:16.845718 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:16.845679 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-856696d794-wthbz" Jun 11 23:01:17.251095 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.251051 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q"] Jun 11 23:01:17.251494 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.251476 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f77aff-fac4-464b-bf64-00748ed51c3f" containerName="extract" Jun 11 23:01:17.251627 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.251498 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f77aff-fac4-464b-bf64-00748ed51c3f" containerName="extract" Jun 11 23:01:17.251627 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.251518 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f77aff-fac4-464b-bf64-00748ed51c3f" containerName="pull" Jun 11 23:01:17.251627 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.251526 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f77aff-fac4-464b-bf64-00748ed51c3f" containerName="pull" Jun 11 23:01:17.251627 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.251538 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f77aff-fac4-464b-bf64-00748ed51c3f" containerName="util" Jun 11 23:01:17.251627 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.251547 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f77aff-fac4-464b-bf64-00748ed51c3f" containerName="util" Jun 11 23:01:17.251886 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.251660 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f77aff-fac4-464b-bf64-00748ed51c3f" containerName="extract" Jun 11 23:01:17.271837 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.271806 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" Jun 11 23:01:17.279358 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.279041 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:01:17.279604 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.279547 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:01:17.279703 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.279550 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x7mqc\"" Jun 11 23:01:17.282292 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.282262 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q"] Jun 11 23:01:17.282428 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.282343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5da7876-db13-4e40-a67a-0f454e91ddfb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q\" (UID: \"b5da7876-db13-4e40-a67a-0f454e91ddfb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" Jun 11 23:01:17.282428 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.282409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5da7876-db13-4e40-a67a-0f454e91ddfb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q\" (UID: \"b5da7876-db13-4e40-a67a-0f454e91ddfb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" Jun 11 23:01:17.282521 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.282455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwlbz\" (UniqueName: \"kubernetes.io/projected/b5da7876-db13-4e40-a67a-0f454e91ddfb-kube-api-access-vwlbz\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q\" (UID: \"b5da7876-db13-4e40-a67a-0f454e91ddfb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" Jun 11 23:01:17.383725 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.383681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5da7876-db13-4e40-a67a-0f454e91ddfb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q\" (UID: \"b5da7876-db13-4e40-a67a-0f454e91ddfb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" Jun 11 23:01:17.383924 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.383746 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5da7876-db13-4e40-a67a-0f454e91ddfb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q\" (UID: \"b5da7876-db13-4e40-a67a-0f454e91ddfb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" Jun 11 23:01:17.383924 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.383780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwlbz\" (UniqueName: \"kubernetes.io/projected/b5da7876-db13-4e40-a67a-0f454e91ddfb-kube-api-access-vwlbz\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q\" (UID: \"b5da7876-db13-4e40-a67a-0f454e91ddfb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" Jun 11 23:01:17.384140 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.384115 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5da7876-db13-4e40-a67a-0f454e91ddfb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q\" (UID: \"b5da7876-db13-4e40-a67a-0f454e91ddfb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" Jun 11 23:01:17.384140 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.384131 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5da7876-db13-4e40-a67a-0f454e91ddfb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q\" (UID: \"b5da7876-db13-4e40-a67a-0f454e91ddfb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" Jun 11 23:01:17.423278 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.423246 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwlbz\" (UniqueName: \"kubernetes.io/projected/b5da7876-db13-4e40-a67a-0f454e91ddfb-kube-api-access-vwlbz\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q\" (UID: \"b5da7876-db13-4e40-a67a-0f454e91ddfb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" Jun 11 23:01:17.582546 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.582454 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" Jun 11 23:01:17.828776 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:01:17.828735 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5da7876_db13_4e40_a67a_0f454e91ddfb.slice/crio-a291a146f8ca8a9e7101a93feba5fb1f1292ccfa1f31cbe39589ca041bdb69fe WatchSource:0}: Error finding container a291a146f8ca8a9e7101a93feba5fb1f1292ccfa1f31cbe39589ca041bdb69fe: Status 404 returned error can't find the container with id a291a146f8ca8a9e7101a93feba5fb1f1292ccfa1f31cbe39589ca041bdb69fe Jun 11 23:01:17.830878 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.830853 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q"] Jun 11 23:01:17.909637 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.909597 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" event={"ID":"b5da7876-db13-4e40-a67a-0f454e91ddfb","Type":"ContainerStarted","Data":"fd5f38bf5904599f376009dbaa1823de4d290553257df1752d61604ad996ad05"} Jun 11 23:01:17.910042 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:17.909664 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" event={"ID":"b5da7876-db13-4e40-a67a-0f454e91ddfb","Type":"ContainerStarted","Data":"a291a146f8ca8a9e7101a93feba5fb1f1292ccfa1f31cbe39589ca041bdb69fe"} Jun 11 23:01:18.917930 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:18.917895 2578 generic.go:356] "Generic (PLEG): container finished" podID="b5da7876-db13-4e40-a67a-0f454e91ddfb" containerID="fd5f38bf5904599f376009dbaa1823de4d290553257df1752d61604ad996ad05" exitCode=0 Jun 11 23:01:18.918395 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:18.918021 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" event={"ID":"b5da7876-db13-4e40-a67a-0f454e91ddfb","Type":"ContainerDied","Data":"fd5f38bf5904599f376009dbaa1823de4d290553257df1752d61604ad996ad05"} Jun 11 23:01:19.193184 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:19.193104 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-784f85db5-d9rc9"] Jun 11 23:01:19.195441 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:19.195422 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-784f85db5-d9rc9" Jun 11 23:01:19.199154 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:19.199128 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2sth9\"" Jun 11 23:01:19.199487 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:19.199456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b787fd73-d10d-4032-9b5d-10f11a489669-redirect-config\") pod \"dashboard-redirect-784f85db5-d9rc9\" (UID: \"b787fd73-d10d-4032-9b5d-10f11a489669\") " pod="opendatahub/dashboard-redirect-784f85db5-d9rc9" Jun 11 23:01:19.199629 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:19.199513 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw682\" (UniqueName: \"kubernetes.io/projected/b787fd73-d10d-4032-9b5d-10f11a489669-kube-api-access-bw682\") pod \"dashboard-redirect-784f85db5-d9rc9\" (UID: \"b787fd73-d10d-4032-9b5d-10f11a489669\") " pod="opendatahub/dashboard-redirect-784f85db5-d9rc9" Jun 11 23:01:19.199629 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:19.199578 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 23:01:19.223274 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:19.223239 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-784f85db5-d9rc9"] Jun 11 23:01:19.300735 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:19.300698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b787fd73-d10d-4032-9b5d-10f11a489669-redirect-config\") pod \"dashboard-redirect-784f85db5-d9rc9\" (UID: \"b787fd73-d10d-4032-9b5d-10f11a489669\") " pod="opendatahub/dashboard-redirect-784f85db5-d9rc9" Jun 11 23:01:19.300878 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:19.300743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw682\" (UniqueName: \"kubernetes.io/projected/b787fd73-d10d-4032-9b5d-10f11a489669-kube-api-access-bw682\") pod \"dashboard-redirect-784f85db5-d9rc9\" (UID: \"b787fd73-d10d-4032-9b5d-10f11a489669\") " pod="opendatahub/dashboard-redirect-784f85db5-d9rc9" Jun 11 23:01:19.301388 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:19.301366 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b787fd73-d10d-4032-9b5d-10f11a489669-redirect-config\") pod \"dashboard-redirect-784f85db5-d9rc9\" (UID: \"b787fd73-d10d-4032-9b5d-10f11a489669\") " pod="opendatahub/dashboard-redirect-784f85db5-d9rc9" Jun 11 23:01:19.319615 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:19.319569 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw682\" (UniqueName: \"kubernetes.io/projected/b787fd73-d10d-4032-9b5d-10f11a489669-kube-api-access-bw682\") pod \"dashboard-redirect-784f85db5-d9rc9\" (UID: \"b787fd73-d10d-4032-9b5d-10f11a489669\") " pod="opendatahub/dashboard-redirect-784f85db5-d9rc9" Jun 11 23:01:19.505803 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:19.505710 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-784f85db5-d9rc9" Jun 11 23:01:19.648654 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:19.648626 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-784f85db5-d9rc9"] Jun 11 23:01:19.650454 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:01:19.650424 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb787fd73_d10d_4032_9b5d_10f11a489669.slice/crio-52da5367e39b6b368d7cfdba17934c7c68dc4f11c6ebeecaf4078575089aa02a WatchSource:0}: Error finding container 52da5367e39b6b368d7cfdba17934c7c68dc4f11c6ebeecaf4078575089aa02a: Status 404 returned error can't find the container with id 52da5367e39b6b368d7cfdba17934c7c68dc4f11c6ebeecaf4078575089aa02a Jun 11 23:01:19.924176 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:19.924115 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-784f85db5-d9rc9" event={"ID":"b787fd73-d10d-4032-9b5d-10f11a489669","Type":"ContainerStarted","Data":"52da5367e39b6b368d7cfdba17934c7c68dc4f11c6ebeecaf4078575089aa02a"} Jun 11 23:01:20.934446 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:20.934412 2578 generic.go:356] "Generic (PLEG): container finished" podID="b5da7876-db13-4e40-a67a-0f454e91ddfb" containerID="7648f3e4e502f38c37d0fbef3b9845a442059e55ff8576d5856d2294cae1a1e0" exitCode=0 Jun 11 23:01:20.934884 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:20.934474 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" event={"ID":"b5da7876-db13-4e40-a67a-0f454e91ddfb","Type":"ContainerDied","Data":"7648f3e4e502f38c37d0fbef3b9845a442059e55ff8576d5856d2294cae1a1e0"} Jun 11 23:01:21.942676 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:21.942638 2578 generic.go:356] "Generic (PLEG): container finished" podID="b5da7876-db13-4e40-a67a-0f454e91ddfb" containerID="fe4bcb9c13952ff274d4074d8a44b3dd06024485e79682a97eb63e054b2778de" exitCode=0 Jun 11 23:01:21.943105 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:21.942726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" event={"ID":"b5da7876-db13-4e40-a67a-0f454e91ddfb","Type":"ContainerDied","Data":"fe4bcb9c13952ff274d4074d8a44b3dd06024485e79682a97eb63e054b2778de"} Jun 11 23:01:21.944353 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:21.944327 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-784f85db5-d9rc9" event={"ID":"b787fd73-d10d-4032-9b5d-10f11a489669","Type":"ContainerStarted","Data":"12d0ebdae8b1c627fe3b67e7619d280cb34b1c4d0e05f5548b490ffd47324f8b"} Jun 11 23:01:21.985417 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:21.985304 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-784f85db5-d9rc9" podStartSLOduration=0.875542825 podStartE2EDuration="2.985288026s" totalImagesPullingTime="2.109745201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:01:21.984313828 +0000 UTC m=+559.867636659" watchObservedRunningTime="2026-06-11 23:01:21.985288026 +0000 UTC m=+559.868610891" Jun 11 23:01:23.081423 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:23.081399 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" Jun 11 23:01:23.132468 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:23.132442 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5da7876-db13-4e40-a67a-0f454e91ddfb-util\") pod \"b5da7876-db13-4e40-a67a-0f454e91ddfb\" (UID: \"b5da7876-db13-4e40-a67a-0f454e91ddfb\") " Jun 11 23:01:23.132635 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:23.132483 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5da7876-db13-4e40-a67a-0f454e91ddfb-bundle\") pod \"b5da7876-db13-4e40-a67a-0f454e91ddfb\" (UID: \"b5da7876-db13-4e40-a67a-0f454e91ddfb\") " Jun 11 23:01:23.132635 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:23.132542 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwlbz\" (UniqueName: \"kubernetes.io/projected/b5da7876-db13-4e40-a67a-0f454e91ddfb-kube-api-access-vwlbz\") pod \"b5da7876-db13-4e40-a67a-0f454e91ddfb\" (UID: \"b5da7876-db13-4e40-a67a-0f454e91ddfb\") " Jun 11 23:01:23.133378 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:23.133354 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5da7876-db13-4e40-a67a-0f454e91ddfb-bundle" (OuterVolumeSpecName: "bundle") pod "b5da7876-db13-4e40-a67a-0f454e91ddfb" (UID: "b5da7876-db13-4e40-a67a-0f454e91ddfb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:01:23.134858 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:23.134835 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5da7876-db13-4e40-a67a-0f454e91ddfb-kube-api-access-vwlbz" (OuterVolumeSpecName: "kube-api-access-vwlbz") pod "b5da7876-db13-4e40-a67a-0f454e91ddfb" (UID: "b5da7876-db13-4e40-a67a-0f454e91ddfb"). InnerVolumeSpecName "kube-api-access-vwlbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:01:23.137578 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:23.137558 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5da7876-db13-4e40-a67a-0f454e91ddfb-util" (OuterVolumeSpecName: "util") pod "b5da7876-db13-4e40-a67a-0f454e91ddfb" (UID: "b5da7876-db13-4e40-a67a-0f454e91ddfb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:01:23.234053 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:23.233949 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwlbz\" (UniqueName: \"kubernetes.io/projected/b5da7876-db13-4e40-a67a-0f454e91ddfb-kube-api-access-vwlbz\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:01:23.234053 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:23.233997 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5da7876-db13-4e40-a67a-0f454e91ddfb-util\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:01:23.234053 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:23.234007 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5da7876-db13-4e40-a67a-0f454e91ddfb-bundle\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:01:23.955326 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:23.955295 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" event={"ID":"b5da7876-db13-4e40-a67a-0f454e91ddfb","Type":"ContainerDied","Data":"a291a146f8ca8a9e7101a93feba5fb1f1292ccfa1f31cbe39589ca041bdb69fe"} Jun 11 23:01:23.955326 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:23.955323 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmx4q" Jun 11 23:01:23.955326 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:23.955340 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a291a146f8ca8a9e7101a93feba5fb1f1292ccfa1f31cbe39589ca041bdb69fe" Jun 11 23:01:34.332231 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.332188 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c"] Jun 11 23:01:34.332684 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.332641 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5da7876-db13-4e40-a67a-0f454e91ddfb" containerName="pull" Jun 11 23:01:34.332684 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.332661 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5da7876-db13-4e40-a67a-0f454e91ddfb" containerName="pull" Jun 11 23:01:34.332684 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.332680 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5da7876-db13-4e40-a67a-0f454e91ddfb" containerName="extract" Jun 11 23:01:34.332684 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.332686 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5da7876-db13-4e40-a67a-0f454e91ddfb" containerName="extract" Jun 11 23:01:34.332819 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.332701 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5da7876-db13-4e40-a67a-0f454e91ddfb" containerName="util" Jun 11 23:01:34.332819 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.332707 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5da7876-db13-4e40-a67a-0f454e91ddfb" containerName="util" Jun 11 23:01:34.332819 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.332773 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5da7876-db13-4e40-a67a-0f454e91ddfb" containerName="extract" Jun 11 23:01:34.335200 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.335176 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.338141 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.338072 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 23:01:34.338141 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.338103 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 23:01:34.338333 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.338072 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 23:01:34.338508 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.338490 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7d8jv\"" Jun 11 23:01:34.346925 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.346897 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c"] Jun 11 23:01:34.431107 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.431064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.431107 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.431110 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.431361 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.431139 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.431361 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.431164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ead864bb-409f-4b7c-b292-8bd8ac10106a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.431361 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.431203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.431361 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.431234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ead864bb-409f-4b7c-b292-8bd8ac10106a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.431361 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.431275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ead864bb-409f-4b7c-b292-8bd8ac10106a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.431549 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.431386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.431549 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.431432 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9qgp\" (UniqueName: \"kubernetes.io/projected/ead864bb-409f-4b7c-b292-8bd8ac10106a-kube-api-access-p9qgp\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.532767 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.532726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ead864bb-409f-4b7c-b292-8bd8ac10106a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.532979 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.532794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.532979 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.532820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9qgp\" (UniqueName: \"kubernetes.io/projected/ead864bb-409f-4b7c-b292-8bd8ac10106a-kube-api-access-p9qgp\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.532979 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.532877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.533142 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.533007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.533142 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.533049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.533142 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.533072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ead864bb-409f-4b7c-b292-8bd8ac10106a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.533142 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.533137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.533335 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.533179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ead864bb-409f-4b7c-b292-8bd8ac10106a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.533335 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.533288 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.533469 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.533450 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.533550 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.533527 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.533634 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.533615 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.533901 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.533878 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ead864bb-409f-4b7c-b292-8bd8ac10106a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.535801 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.535774 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ead864bb-409f-4b7c-b292-8bd8ac10106a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.535951 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.535934 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ead864bb-409f-4b7c-b292-8bd8ac10106a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.542685 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.542658 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9qgp\" (UniqueName: \"kubernetes.io/projected/ead864bb-409f-4b7c-b292-8bd8ac10106a-kube-api-access-p9qgp\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.542900 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.542883 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ead864bb-409f-4b7c-b292-8bd8ac10106a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nx84c\" (UID: \"ead864bb-409f-4b7c-b292-8bd8ac10106a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.648042 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.648011 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:34.797727 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:34.797697 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c"] Jun 11 23:01:34.799651 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:01:34.799620 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead864bb_409f_4b7c_b292_8bd8ac10106a.slice/crio-f464250227dc2ac52432834cffe270810261b81acd2773e13062bdec6448b0a9 WatchSource:0}: Error finding container f464250227dc2ac52432834cffe270810261b81acd2773e13062bdec6448b0a9: Status 404 returned error can't find the container with id f464250227dc2ac52432834cffe270810261b81acd2773e13062bdec6448b0a9 Jun 11 23:01:35.016372 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:35.016268 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" event={"ID":"ead864bb-409f-4b7c-b292-8bd8ac10106a","Type":"ContainerStarted","Data":"f464250227dc2ac52432834cffe270810261b81acd2773e13062bdec6448b0a9"} Jun 11 23:01:37.682360 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:37.682319 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 23:01:37.682688 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:37.682409 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 23:01:37.682688 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:37.682443 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 23:01:38.043492 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:38.043392 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" event={"ID":"ead864bb-409f-4b7c-b292-8bd8ac10106a","Type":"ContainerStarted","Data":"a75d1474a00723b7c08b0ed74f51c2939ad23d3757ae9eba52e51d664dea0aa9"} Jun 11 23:01:38.075993 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:38.075798 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" podStartSLOduration=1.195459682 podStartE2EDuration="4.075779163s" totalImagesPullingTime="2.880319481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:01:38.074792447 +0000 UTC m=+575.958115322" watchObservedRunningTime="2026-06-11 23:01:38.075779163 +0000 UTC m=+575.959101996" Jun 11 23:01:38.648965 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:38.648918 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:38.653714 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:38.653686 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:39.048780 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:39.048698 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:01:39.049839 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:01:39.049823 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nx84c" Jun 11 23:02:02.582510 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:02.582475 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/1.log" Jun 11 23:02:02.583006 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:02.582979 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/1.log" Jun 11 23:02:03.701157 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:03.701118 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cq8cb"] Jun 11 23:02:03.705092 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:03.705069 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cq8cb" Jun 11 23:02:03.707959 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:03.707932 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bcdz9\"" Jun 11 23:02:03.708086 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:03.707990 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 23:02:03.708086 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:03.707946 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 23:02:03.716296 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:03.716253 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cq8cb"] Jun 11 23:02:03.804016 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:03.803973 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4rn5\" (UniqueName: \"kubernetes.io/projected/f96190c6-5568-4a56-8feb-9e4ea3b46735-kube-api-access-j4rn5\") pod \"kuadrant-operator-catalog-cq8cb\" (UID: \"f96190c6-5568-4a56-8feb-9e4ea3b46735\") " pod="kuadrant-system/kuadrant-operator-catalog-cq8cb" Jun 11 23:02:03.905488 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:03.905441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4rn5\" (UniqueName: \"kubernetes.io/projected/f96190c6-5568-4a56-8feb-9e4ea3b46735-kube-api-access-j4rn5\") pod \"kuadrant-operator-catalog-cq8cb\" (UID: \"f96190c6-5568-4a56-8feb-9e4ea3b46735\") " pod="kuadrant-system/kuadrant-operator-catalog-cq8cb" Jun 11 23:02:03.914374 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:03.914340 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4rn5\" (UniqueName: \"kubernetes.io/projected/f96190c6-5568-4a56-8feb-9e4ea3b46735-kube-api-access-j4rn5\") pod \"kuadrant-operator-catalog-cq8cb\" (UID: \"f96190c6-5568-4a56-8feb-9e4ea3b46735\") " pod="kuadrant-system/kuadrant-operator-catalog-cq8cb" Jun 11 23:02:04.017327 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:04.017216 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cq8cb" Jun 11 23:02:04.067527 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:04.067460 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cq8cb"] Jun 11 23:02:04.160817 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:04.160787 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cq8cb"] Jun 11 23:02:04.162330 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:02:04.162294 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf96190c6_5568_4a56_8feb_9e4ea3b46735.slice/crio-6540053200ad30603301fab0ef91efcdc3f90b0ba6041900fe3022a634d46558 WatchSource:0}: Error finding container 6540053200ad30603301fab0ef91efcdc3f90b0ba6041900fe3022a634d46558: Status 404 returned error can't find the container with id 6540053200ad30603301fab0ef91efcdc3f90b0ba6041900fe3022a634d46558 Jun 11 23:02:04.180810 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:04.180771 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cq8cb" event={"ID":"f96190c6-5568-4a56-8feb-9e4ea3b46735","Type":"ContainerStarted","Data":"6540053200ad30603301fab0ef91efcdc3f90b0ba6041900fe3022a634d46558"} Jun 11 23:02:04.280139 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:04.280056 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hjpwl"] Jun 11 23:02:04.284811 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:04.284791 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hjpwl" Jun 11 23:02:04.292785 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:04.292635 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hjpwl"] Jun 11 23:02:04.408670 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:04.408626 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4w59\" (UniqueName: \"kubernetes.io/projected/f9969761-2cc2-46b6-be24-17e33bc149e0-kube-api-access-d4w59\") pod \"kuadrant-operator-catalog-hjpwl\" (UID: \"f9969761-2cc2-46b6-be24-17e33bc149e0\") " pod="kuadrant-system/kuadrant-operator-catalog-hjpwl" Jun 11 23:02:04.509945 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:04.509907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4w59\" (UniqueName: \"kubernetes.io/projected/f9969761-2cc2-46b6-be24-17e33bc149e0-kube-api-access-d4w59\") pod \"kuadrant-operator-catalog-hjpwl\" (UID: \"f9969761-2cc2-46b6-be24-17e33bc149e0\") " pod="kuadrant-system/kuadrant-operator-catalog-hjpwl" Jun 11 23:02:04.518529 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:04.518503 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4w59\" (UniqueName: \"kubernetes.io/projected/f9969761-2cc2-46b6-be24-17e33bc149e0-kube-api-access-d4w59\") pod \"kuadrant-operator-catalog-hjpwl\" (UID: \"f9969761-2cc2-46b6-be24-17e33bc149e0\") " pod="kuadrant-system/kuadrant-operator-catalog-hjpwl" Jun 11 23:02:04.596129 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:04.596037 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hjpwl" Jun 11 23:02:04.736405 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:04.736377 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hjpwl"] Jun 11 23:02:04.738647 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:02:04.738617 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9969761_2cc2_46b6_be24_17e33bc149e0.slice/crio-453c1496cc3aeccf8f3a0b5ff6542c8f384a55bc8b029d6affaa83212a011526 WatchSource:0}: Error finding container 453c1496cc3aeccf8f3a0b5ff6542c8f384a55bc8b029d6affaa83212a011526: Status 404 returned error can't find the container with id 453c1496cc3aeccf8f3a0b5ff6542c8f384a55bc8b029d6affaa83212a011526 Jun 11 23:02:05.192076 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:05.192046 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hjpwl" event={"ID":"f9969761-2cc2-46b6-be24-17e33bc149e0","Type":"ContainerStarted","Data":"453c1496cc3aeccf8f3a0b5ff6542c8f384a55bc8b029d6affaa83212a011526"} Jun 11 23:02:07.205823 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:07.205721 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cq8cb" event={"ID":"f96190c6-5568-4a56-8feb-9e4ea3b46735","Type":"ContainerStarted","Data":"ebc19814ee1d022899f33b306eaaf8538ee350a4b25f87de7c5fa9fabeb25fb2"} Jun 11 23:02:07.205823 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:07.205779 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-cq8cb" podUID="f96190c6-5568-4a56-8feb-9e4ea3b46735" containerName="registry-server" containerID="cri-o://ebc19814ee1d022899f33b306eaaf8538ee350a4b25f87de7c5fa9fabeb25fb2" gracePeriod=2 Jun 11 23:02:07.207379 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:07.207347 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hjpwl" event={"ID":"f9969761-2cc2-46b6-be24-17e33bc149e0","Type":"ContainerStarted","Data":"a364f15b54de316593152a9ff9f51360845dfd309e24a8db4caa791a7da81bd1"} Jun 11 23:02:07.221997 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:07.221943 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cq8cb" podStartSLOduration=1.4286358 podStartE2EDuration="4.221922654s" totalImagesPullingTime="2.793286854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:02:07.221513259 +0000 UTC m=+605.104836091" watchObservedRunningTime="2026-06-11 23:02:07.221922654 +0000 UTC m=+605.105245488" Jun 11 23:02:07.238780 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:07.238731 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hjpwl" podStartSLOduration=1.02549319 podStartE2EDuration="3.238714967s" totalImagesPullingTime="2.213221777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:02:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:02:07.23676373 +0000 UTC m=+605.120086562" watchObservedRunningTime="2026-06-11 23:02:07.238714967 +0000 UTC m=+605.122037816" Jun 11 23:02:07.462414 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:07.462349 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cq8cb" Jun 11 23:02:07.536351 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:07.536310 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4rn5\" (UniqueName: \"kubernetes.io/projected/f96190c6-5568-4a56-8feb-9e4ea3b46735-kube-api-access-j4rn5\") pod \"f96190c6-5568-4a56-8feb-9e4ea3b46735\" (UID: \"f96190c6-5568-4a56-8feb-9e4ea3b46735\") " Jun 11 23:02:07.538707 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:07.538682 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f96190c6-5568-4a56-8feb-9e4ea3b46735-kube-api-access-j4rn5" (OuterVolumeSpecName: "kube-api-access-j4rn5") pod "f96190c6-5568-4a56-8feb-9e4ea3b46735" (UID: "f96190c6-5568-4a56-8feb-9e4ea3b46735"). InnerVolumeSpecName "kube-api-access-j4rn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:02:07.637365 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:07.637332 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4rn5\" (UniqueName: \"kubernetes.io/projected/f96190c6-5568-4a56-8feb-9e4ea3b46735-kube-api-access-j4rn5\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:02:08.213442 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:08.213407 2578 generic.go:356] "Generic (PLEG): container finished" podID="f96190c6-5568-4a56-8feb-9e4ea3b46735" containerID="ebc19814ee1d022899f33b306eaaf8538ee350a4b25f87de7c5fa9fabeb25fb2" exitCode=0 Jun 11 23:02:08.213835 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:08.213452 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cq8cb" Jun 11 23:02:08.213835 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:08.213493 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cq8cb" event={"ID":"f96190c6-5568-4a56-8feb-9e4ea3b46735","Type":"ContainerDied","Data":"ebc19814ee1d022899f33b306eaaf8538ee350a4b25f87de7c5fa9fabeb25fb2"} Jun 11 23:02:08.213835 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:08.213545 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cq8cb" event={"ID":"f96190c6-5568-4a56-8feb-9e4ea3b46735","Type":"ContainerDied","Data":"6540053200ad30603301fab0ef91efcdc3f90b0ba6041900fe3022a634d46558"} Jun 11 23:02:08.213835 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:08.213565 2578 scope.go:117] "RemoveContainer" containerID="ebc19814ee1d022899f33b306eaaf8538ee350a4b25f87de7c5fa9fabeb25fb2" Jun 11 23:02:08.223437 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:08.223410 2578 scope.go:117] "RemoveContainer" containerID="ebc19814ee1d022899f33b306eaaf8538ee350a4b25f87de7c5fa9fabeb25fb2" Jun 11 23:02:08.223761 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:02:08.223738 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebc19814ee1d022899f33b306eaaf8538ee350a4b25f87de7c5fa9fabeb25fb2\": container with ID starting with ebc19814ee1d022899f33b306eaaf8538ee350a4b25f87de7c5fa9fabeb25fb2 not found: ID does not exist" containerID="ebc19814ee1d022899f33b306eaaf8538ee350a4b25f87de7c5fa9fabeb25fb2" Jun 11 23:02:08.223820 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:08.223775 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebc19814ee1d022899f33b306eaaf8538ee350a4b25f87de7c5fa9fabeb25fb2"} err="failed to get container status \"ebc19814ee1d022899f33b306eaaf8538ee350a4b25f87de7c5fa9fabeb25fb2\": rpc error: code = NotFound desc = could not find container \"ebc19814ee1d022899f33b306eaaf8538ee350a4b25f87de7c5fa9fabeb25fb2\": container with ID starting with ebc19814ee1d022899f33b306eaaf8538ee350a4b25f87de7c5fa9fabeb25fb2 not found: ID does not exist" Jun 11 23:02:08.237926 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:08.237843 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cq8cb"] Jun 11 23:02:08.241679 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:08.241654 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cq8cb"] Jun 11 23:02:08.617796 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:08.617717 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f96190c6-5568-4a56-8feb-9e4ea3b46735" path="/var/lib/kubelet/pods/f96190c6-5568-4a56-8feb-9e4ea3b46735/volumes" Jun 11 23:02:14.596532 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:14.596445 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hjpwl" Jun 11 23:02:14.596532 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:14.596521 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hjpwl" Jun 11 23:02:14.620710 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:14.620681 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hjpwl" Jun 11 23:02:15.273184 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:15.273157 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hjpwl" Jun 11 23:02:19.319208 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.319166 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7"] Jun 11 23:02:19.319757 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.319738 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f96190c6-5568-4a56-8feb-9e4ea3b46735" containerName="registry-server" Jun 11 23:02:19.319838 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.319759 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f96190c6-5568-4a56-8feb-9e4ea3b46735" containerName="registry-server" Jun 11 23:02:19.319892 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.319877 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f96190c6-5568-4a56-8feb-9e4ea3b46735" containerName="registry-server" Jun 11 23:02:19.323258 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.323238 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" Jun 11 23:02:19.326074 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.326054 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jzsps\"" Jun 11 23:02:19.333199 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.333172 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7"] Jun 11 23:02:19.443852 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.443810 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8fb35c6-d05d-4514-a116-7776736d10b8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7\" (UID: \"a8fb35c6-d05d-4514-a116-7776736d10b8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" Jun 11 23:02:19.444028 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.443932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8fb35c6-d05d-4514-a116-7776736d10b8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7\" (UID: \"a8fb35c6-d05d-4514-a116-7776736d10b8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" Jun 11 23:02:19.444028 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.444014 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nqqb\" (UniqueName: \"kubernetes.io/projected/a8fb35c6-d05d-4514-a116-7776736d10b8-kube-api-access-2nqqb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7\" (UID: \"a8fb35c6-d05d-4514-a116-7776736d10b8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" Jun 11 23:02:19.545530 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.545488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8fb35c6-d05d-4514-a116-7776736d10b8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7\" (UID: \"a8fb35c6-d05d-4514-a116-7776736d10b8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" Jun 11 23:02:19.545762 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.545544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nqqb\" (UniqueName: \"kubernetes.io/projected/a8fb35c6-d05d-4514-a116-7776736d10b8-kube-api-access-2nqqb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7\" (UID: \"a8fb35c6-d05d-4514-a116-7776736d10b8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" Jun 11 23:02:19.545762 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.545571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8fb35c6-d05d-4514-a116-7776736d10b8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7\" (UID: \"a8fb35c6-d05d-4514-a116-7776736d10b8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" Jun 11 23:02:19.546199 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.545956 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8fb35c6-d05d-4514-a116-7776736d10b8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7\" (UID: \"a8fb35c6-d05d-4514-a116-7776736d10b8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" Jun 11 23:02:19.546199 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.545965 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8fb35c6-d05d-4514-a116-7776736d10b8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7\" (UID: \"a8fb35c6-d05d-4514-a116-7776736d10b8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" Jun 11 23:02:19.554695 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.554672 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nqqb\" (UniqueName: \"kubernetes.io/projected/a8fb35c6-d05d-4514-a116-7776736d10b8-kube-api-access-2nqqb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7\" (UID: \"a8fb35c6-d05d-4514-a116-7776736d10b8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" Jun 11 23:02:19.634043 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.634011 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" Jun 11 23:02:19.768888 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.768851 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7"] Jun 11 23:02:19.771880 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:02:19.771852 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8fb35c6_d05d_4514_a116_7776736d10b8.slice/crio-01603da8471d97fbf925097b3831931b8448513f2487bcc43b69f83159eab56f WatchSource:0}: Error finding container 01603da8471d97fbf925097b3831931b8448513f2487bcc43b69f83159eab56f: Status 404 returned error can't find the container with id 01603da8471d97fbf925097b3831931b8448513f2487bcc43b69f83159eab56f Jun 11 23:02:19.909607 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.909559 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2"] Jun 11 23:02:19.913166 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.913148 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" Jun 11 23:02:19.921291 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.921225 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2"] Jun 11 23:02:19.949636 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.949569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/407ab369-537e-4a88-ae5e-e4dabfb1fc33-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2\" (UID: \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" Jun 11 23:02:19.949890 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.949673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sds2c\" (UniqueName: \"kubernetes.io/projected/407ab369-537e-4a88-ae5e-e4dabfb1fc33-kube-api-access-sds2c\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2\" (UID: \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" Jun 11 23:02:19.949890 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:19.949727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/407ab369-537e-4a88-ae5e-e4dabfb1fc33-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2\" (UID: \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" Jun 11 23:02:20.050436 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.050401 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/407ab369-537e-4a88-ae5e-e4dabfb1fc33-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2\" (UID: \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" Jun 11 23:02:20.050436 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.050454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sds2c\" (UniqueName: \"kubernetes.io/projected/407ab369-537e-4a88-ae5e-e4dabfb1fc33-kube-api-access-sds2c\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2\" (UID: \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" Jun 11 23:02:20.050709 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.050487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/407ab369-537e-4a88-ae5e-e4dabfb1fc33-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2\" (UID: \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" Jun 11 23:02:20.050844 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.050826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/407ab369-537e-4a88-ae5e-e4dabfb1fc33-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2\" (UID: \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" Jun 11 23:02:20.050895 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.050879 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/407ab369-537e-4a88-ae5e-e4dabfb1fc33-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2\" (UID: \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" Jun 11 23:02:20.061726 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.061690 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sds2c\" (UniqueName: \"kubernetes.io/projected/407ab369-537e-4a88-ae5e-e4dabfb1fc33-kube-api-access-sds2c\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2\" (UID: \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" Jun 11 23:02:20.257786 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.257685 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" Jun 11 23:02:20.285345 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.285308 2578 generic.go:356] "Generic (PLEG): container finished" podID="a8fb35c6-d05d-4514-a116-7776736d10b8" containerID="07f43fb38e613b116d960bd0d0e0c9bc270cf145693d69cef4df02eb3a1cb15e" exitCode=0 Jun 11 23:02:20.285554 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.285386 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" event={"ID":"a8fb35c6-d05d-4514-a116-7776736d10b8","Type":"ContainerDied","Data":"07f43fb38e613b116d960bd0d0e0c9bc270cf145693d69cef4df02eb3a1cb15e"} Jun 11 23:02:20.285554 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.285469 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" event={"ID":"a8fb35c6-d05d-4514-a116-7776736d10b8","Type":"ContainerStarted","Data":"01603da8471d97fbf925097b3831931b8448513f2487bcc43b69f83159eab56f"} Jun 11 23:02:20.402290 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.402261 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2"] Jun 11 23:02:20.403493 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:02:20.403468 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod407ab369_537e_4a88_ae5e_e4dabfb1fc33.slice/crio-8b9cbb97bf58d2487abb7d922c7165bbf83e601a1737c9d28dfcbe43acd4f214 WatchSource:0}: Error finding container 8b9cbb97bf58d2487abb7d922c7165bbf83e601a1737c9d28dfcbe43acd4f214: Status 404 returned error can't find the container with id 8b9cbb97bf58d2487abb7d922c7165bbf83e601a1737c9d28dfcbe43acd4f214 Jun 11 23:02:20.515181 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.515142 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf"] Jun 11 23:02:20.518890 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.518864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" Jun 11 23:02:20.527050 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.527018 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf"] Jun 11 23:02:20.555267 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.555234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b20b679-42ba-43c1-9e8f-e62903aafec0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf\" (UID: \"3b20b679-42ba-43c1-9e8f-e62903aafec0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" Jun 11 23:02:20.555418 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.555301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr79g\" (UniqueName: \"kubernetes.io/projected/3b20b679-42ba-43c1-9e8f-e62903aafec0-kube-api-access-kr79g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf\" (UID: \"3b20b679-42ba-43c1-9e8f-e62903aafec0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" Jun 11 23:02:20.555418 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.555325 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b20b679-42ba-43c1-9e8f-e62903aafec0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf\" (UID: \"3b20b679-42ba-43c1-9e8f-e62903aafec0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" Jun 11 23:02:20.656063 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.656026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b20b679-42ba-43c1-9e8f-e62903aafec0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf\" (UID: \"3b20b679-42ba-43c1-9e8f-e62903aafec0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" Jun 11 23:02:20.656243 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.656089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr79g\" (UniqueName: \"kubernetes.io/projected/3b20b679-42ba-43c1-9e8f-e62903aafec0-kube-api-access-kr79g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf\" (UID: \"3b20b679-42ba-43c1-9e8f-e62903aafec0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" Jun 11 23:02:20.656243 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.656113 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b20b679-42ba-43c1-9e8f-e62903aafec0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf\" (UID: \"3b20b679-42ba-43c1-9e8f-e62903aafec0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" Jun 11 23:02:20.656418 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.656399 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b20b679-42ba-43c1-9e8f-e62903aafec0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf\" (UID: \"3b20b679-42ba-43c1-9e8f-e62903aafec0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" Jun 11 23:02:20.656464 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.656428 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b20b679-42ba-43c1-9e8f-e62903aafec0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf\" (UID: \"3b20b679-42ba-43c1-9e8f-e62903aafec0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" Jun 11 23:02:20.667699 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.667666 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr79g\" (UniqueName: \"kubernetes.io/projected/3b20b679-42ba-43c1-9e8f-e62903aafec0-kube-api-access-kr79g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf\" (UID: \"3b20b679-42ba-43c1-9e8f-e62903aafec0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" Jun 11 23:02:20.875502 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.875415 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" Jun 11 23:02:20.985629 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.985523 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt"] Jun 11 23:02:20.989356 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:20.989328 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" Jun 11 23:02:21.018973 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.018938 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt"] Jun 11 23:02:21.033423 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.033389 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf"] Jun 11 23:02:21.034985 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:02:21.034958 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b20b679_42ba_43c1_9e8f_e62903aafec0.slice/crio-a46e74630568dbbb095d7aa44e4d3f85869be394436538787fc64e53bdd79e04 WatchSource:0}: Error finding container a46e74630568dbbb095d7aa44e4d3f85869be394436538787fc64e53bdd79e04: Status 404 returned error can't find the container with id a46e74630568dbbb095d7aa44e4d3f85869be394436538787fc64e53bdd79e04 Jun 11 23:02:21.060686 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.060649 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt\" (UID: \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" Jun 11 23:02:21.060820 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.060689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt\" (UID: \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" Jun 11 23:02:21.060886 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.060815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzrml\" (UniqueName: \"kubernetes.io/projected/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-kube-api-access-gzrml\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt\" (UID: \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" Jun 11 23:02:21.162363 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.162320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzrml\" (UniqueName: \"kubernetes.io/projected/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-kube-api-access-gzrml\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt\" (UID: \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" Jun 11 23:02:21.162543 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.162404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt\" (UID: \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" Jun 11 23:02:21.162543 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.162422 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt\" (UID: \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" Jun 11 23:02:21.162846 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.162820 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt\" (UID: \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" Jun 11 23:02:21.162894 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.162849 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt\" (UID: \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" Jun 11 23:02:21.171224 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.171201 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzrml\" (UniqueName: \"kubernetes.io/projected/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-kube-api-access-gzrml\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt\" (UID: \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" Jun 11 23:02:21.292731 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.292700 2578 generic.go:356] "Generic (PLEG): container finished" podID="407ab369-537e-4a88-ae5e-e4dabfb1fc33" containerID="94371af351189b7dbb1f81cd5ceb4d63188321549b514eed04aee7ac1f9bc86c" exitCode=0 Jun 11 23:02:21.292918 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.292786 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" event={"ID":"407ab369-537e-4a88-ae5e-e4dabfb1fc33","Type":"ContainerDied","Data":"94371af351189b7dbb1f81cd5ceb4d63188321549b514eed04aee7ac1f9bc86c"} Jun 11 23:02:21.292918 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.292842 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" event={"ID":"407ab369-537e-4a88-ae5e-e4dabfb1fc33","Type":"ContainerStarted","Data":"8b9cbb97bf58d2487abb7d922c7165bbf83e601a1737c9d28dfcbe43acd4f214"} Jun 11 23:02:21.294752 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.294730 2578 generic.go:356] "Generic (PLEG): container finished" podID="a8fb35c6-d05d-4514-a116-7776736d10b8" containerID="870c773f4c7f26ba154ac7f98e7d16fe36d43bac001e1e7595c0b2d0937e58e9" exitCode=0 Jun 11 23:02:21.294879 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.294799 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" event={"ID":"a8fb35c6-d05d-4514-a116-7776736d10b8","Type":"ContainerDied","Data":"870c773f4c7f26ba154ac7f98e7d16fe36d43bac001e1e7595c0b2d0937e58e9"} Jun 11 23:02:21.296471 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.296446 2578 generic.go:356] "Generic (PLEG): container finished" podID="3b20b679-42ba-43c1-9e8f-e62903aafec0" containerID="7a80636447e2e2bc95d28ccf673006070c1698941f00f49354b47a0fd2af737f" exitCode=0 Jun 11 23:02:21.296577 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.296505 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" event={"ID":"3b20b679-42ba-43c1-9e8f-e62903aafec0","Type":"ContainerDied","Data":"7a80636447e2e2bc95d28ccf673006070c1698941f00f49354b47a0fd2af737f"} Jun 11 23:02:21.296577 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.296550 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" event={"ID":"3b20b679-42ba-43c1-9e8f-e62903aafec0","Type":"ContainerStarted","Data":"a46e74630568dbbb095d7aa44e4d3f85869be394436538787fc64e53bdd79e04"} Jun 11 23:02:21.302217 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.302198 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" Jun 11 23:02:21.458125 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:21.458097 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt"] Jun 11 23:02:21.487696 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:02:21.487663 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657cd2ad_91fb_44c8_ba0c_1a82a732a15c.slice/crio-6f1142172998e9baa7188435784823d471ac2c405f4e462be530177045d0f8f3 WatchSource:0}: Error finding container 6f1142172998e9baa7188435784823d471ac2c405f4e462be530177045d0f8f3: Status 404 returned error can't find the container with id 6f1142172998e9baa7188435784823d471ac2c405f4e462be530177045d0f8f3 Jun 11 23:02:22.304344 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:22.304309 2578 generic.go:356] "Generic (PLEG): container finished" podID="a8fb35c6-d05d-4514-a116-7776736d10b8" containerID="7fb207d06d7404203f01fc5130ba94ae78c0cf43788f888e95a6831f2010cdae" exitCode=0 Jun 11 23:02:22.304510 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:22.304395 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" event={"ID":"a8fb35c6-d05d-4514-a116-7776736d10b8","Type":"ContainerDied","Data":"7fb207d06d7404203f01fc5130ba94ae78c0cf43788f888e95a6831f2010cdae"} Jun 11 23:02:22.306282 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:22.306259 2578 generic.go:356] "Generic (PLEG): container finished" podID="3b20b679-42ba-43c1-9e8f-e62903aafec0" containerID="8bba98ae2ca042f24c7d23fa0b09f8563b9f92214c9f2d28f8fd6557e914a51d" exitCode=0 Jun 11 23:02:22.306408 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:22.306352 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" event={"ID":"3b20b679-42ba-43c1-9e8f-e62903aafec0","Type":"ContainerDied","Data":"8bba98ae2ca042f24c7d23fa0b09f8563b9f92214c9f2d28f8fd6557e914a51d"} Jun 11 23:02:22.307827 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:22.307793 2578 generic.go:356] "Generic (PLEG): container finished" podID="657cd2ad-91fb-44c8-ba0c-1a82a732a15c" containerID="55bf6008ae464aad441eaa227bbb30c9fa365fdb38625b1c16ad71b0969484dd" exitCode=0 Jun 11 23:02:22.307901 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:22.307836 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" event={"ID":"657cd2ad-91fb-44c8-ba0c-1a82a732a15c","Type":"ContainerDied","Data":"55bf6008ae464aad441eaa227bbb30c9fa365fdb38625b1c16ad71b0969484dd"} Jun 11 23:02:22.307901 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:22.307863 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" event={"ID":"657cd2ad-91fb-44c8-ba0c-1a82a732a15c","Type":"ContainerStarted","Data":"6f1142172998e9baa7188435784823d471ac2c405f4e462be530177045d0f8f3"} Jun 11 23:02:23.314868 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.314777 2578 generic.go:356] "Generic (PLEG): container finished" podID="657cd2ad-91fb-44c8-ba0c-1a82a732a15c" containerID="4f1a32286e7670af9c37b22cc7635ab3ce63eb8150636c9290c9f7cde772562d" exitCode=0 Jun 11 23:02:23.314868 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.314824 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" event={"ID":"657cd2ad-91fb-44c8-ba0c-1a82a732a15c","Type":"ContainerDied","Data":"4f1a32286e7670af9c37b22cc7635ab3ce63eb8150636c9290c9f7cde772562d"} Jun 11 23:02:23.316985 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.316961 2578 generic.go:356] "Generic (PLEG): container finished" podID="407ab369-537e-4a88-ae5e-e4dabfb1fc33" containerID="dfd01c4feeeb9b843dc77d234159be097536dd3d711535026403b04032006b4d" exitCode=0 Jun 11 23:02:23.317099 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.317030 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" event={"ID":"407ab369-537e-4a88-ae5e-e4dabfb1fc33","Type":"ContainerDied","Data":"dfd01c4feeeb9b843dc77d234159be097536dd3d711535026403b04032006b4d"} Jun 11 23:02:23.319408 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.319387 2578 generic.go:356] "Generic (PLEG): container finished" podID="3b20b679-42ba-43c1-9e8f-e62903aafec0" containerID="8ce5546610296f75bed17b0d641c310afbd569dd0bc44dd783841dbc4ffe1df8" exitCode=0 Jun 11 23:02:23.319498 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.319456 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" event={"ID":"3b20b679-42ba-43c1-9e8f-e62903aafec0","Type":"ContainerDied","Data":"8ce5546610296f75bed17b0d641c310afbd569dd0bc44dd783841dbc4ffe1df8"} Jun 11 23:02:23.453259 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.453229 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" Jun 11 23:02:23.585440 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.585352 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nqqb\" (UniqueName: \"kubernetes.io/projected/a8fb35c6-d05d-4514-a116-7776736d10b8-kube-api-access-2nqqb\") pod \"a8fb35c6-d05d-4514-a116-7776736d10b8\" (UID: \"a8fb35c6-d05d-4514-a116-7776736d10b8\") " Jun 11 23:02:23.585440 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.585416 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8fb35c6-d05d-4514-a116-7776736d10b8-util\") pod \"a8fb35c6-d05d-4514-a116-7776736d10b8\" (UID: \"a8fb35c6-d05d-4514-a116-7776736d10b8\") " Jun 11 23:02:23.585670 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.585462 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8fb35c6-d05d-4514-a116-7776736d10b8-bundle\") pod \"a8fb35c6-d05d-4514-a116-7776736d10b8\" (UID: \"a8fb35c6-d05d-4514-a116-7776736d10b8\") " Jun 11 23:02:23.586019 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.585997 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8fb35c6-d05d-4514-a116-7776736d10b8-bundle" (OuterVolumeSpecName: "bundle") pod "a8fb35c6-d05d-4514-a116-7776736d10b8" (UID: "a8fb35c6-d05d-4514-a116-7776736d10b8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:02:23.587567 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.587549 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8fb35c6-d05d-4514-a116-7776736d10b8-kube-api-access-2nqqb" (OuterVolumeSpecName: "kube-api-access-2nqqb") pod "a8fb35c6-d05d-4514-a116-7776736d10b8" (UID: "a8fb35c6-d05d-4514-a116-7776736d10b8"). InnerVolumeSpecName "kube-api-access-2nqqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:02:23.590967 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.590913 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8fb35c6-d05d-4514-a116-7776736d10b8-util" (OuterVolumeSpecName: "util") pod "a8fb35c6-d05d-4514-a116-7776736d10b8" (UID: "a8fb35c6-d05d-4514-a116-7776736d10b8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:02:23.687089 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.687048 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nqqb\" (UniqueName: \"kubernetes.io/projected/a8fb35c6-d05d-4514-a116-7776736d10b8-kube-api-access-2nqqb\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:02:23.687089 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.687082 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8fb35c6-d05d-4514-a116-7776736d10b8-util\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:02:23.687089 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:23.687093 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8fb35c6-d05d-4514-a116-7776736d10b8-bundle\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:02:24.326984 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.326951 2578 generic.go:356] "Generic (PLEG): container finished" podID="407ab369-537e-4a88-ae5e-e4dabfb1fc33" containerID="70e860d5e5dcebdf1cc6e5629c7e653bf17634ab96f24ec09324dcaf891e69cf" exitCode=0 Jun 11 23:02:24.327417 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.327039 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" event={"ID":"407ab369-537e-4a88-ae5e-e4dabfb1fc33","Type":"ContainerDied","Data":"70e860d5e5dcebdf1cc6e5629c7e653bf17634ab96f24ec09324dcaf891e69cf"} Jun 11 23:02:24.328996 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.328971 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" Jun 11 23:02:24.329096 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.329000 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7" event={"ID":"a8fb35c6-d05d-4514-a116-7776736d10b8","Type":"ContainerDied","Data":"01603da8471d97fbf925097b3831931b8448513f2487bcc43b69f83159eab56f"} Jun 11 23:02:24.329096 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.329039 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01603da8471d97fbf925097b3831931b8448513f2487bcc43b69f83159eab56f" Jun 11 23:02:24.331265 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.331241 2578 generic.go:356] "Generic (PLEG): container finished" podID="657cd2ad-91fb-44c8-ba0c-1a82a732a15c" containerID="4b4c68af8fa49255fbf42deed3b793ebd5499904e1884a1ad38ddea57142e2b9" exitCode=0 Jun 11 23:02:24.331367 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.331293 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" event={"ID":"657cd2ad-91fb-44c8-ba0c-1a82a732a15c","Type":"ContainerDied","Data":"4b4c68af8fa49255fbf42deed3b793ebd5499904e1884a1ad38ddea57142e2b9"} Jun 11 23:02:24.471075 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.471045 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" Jun 11 23:02:24.594732 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.594635 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr79g\" (UniqueName: \"kubernetes.io/projected/3b20b679-42ba-43c1-9e8f-e62903aafec0-kube-api-access-kr79g\") pod \"3b20b679-42ba-43c1-9e8f-e62903aafec0\" (UID: \"3b20b679-42ba-43c1-9e8f-e62903aafec0\") " Jun 11 23:02:24.594732 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.594730 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b20b679-42ba-43c1-9e8f-e62903aafec0-bundle\") pod \"3b20b679-42ba-43c1-9e8f-e62903aafec0\" (UID: \"3b20b679-42ba-43c1-9e8f-e62903aafec0\") " Jun 11 23:02:24.594935 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.594762 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b20b679-42ba-43c1-9e8f-e62903aafec0-util\") pod \"3b20b679-42ba-43c1-9e8f-e62903aafec0\" (UID: \"3b20b679-42ba-43c1-9e8f-e62903aafec0\") " Jun 11 23:02:24.595268 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.595231 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b20b679-42ba-43c1-9e8f-e62903aafec0-bundle" (OuterVolumeSpecName: "bundle") pod "3b20b679-42ba-43c1-9e8f-e62903aafec0" (UID: "3b20b679-42ba-43c1-9e8f-e62903aafec0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:02:24.596914 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.596880 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b20b679-42ba-43c1-9e8f-e62903aafec0-kube-api-access-kr79g" (OuterVolumeSpecName: "kube-api-access-kr79g") pod "3b20b679-42ba-43c1-9e8f-e62903aafec0" (UID: "3b20b679-42ba-43c1-9e8f-e62903aafec0"). InnerVolumeSpecName "kube-api-access-kr79g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:02:24.600870 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.600847 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b20b679-42ba-43c1-9e8f-e62903aafec0-util" (OuterVolumeSpecName: "util") pod "3b20b679-42ba-43c1-9e8f-e62903aafec0" (UID: "3b20b679-42ba-43c1-9e8f-e62903aafec0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:02:24.696253 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.696217 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b20b679-42ba-43c1-9e8f-e62903aafec0-util\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:02:24.696253 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.696248 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr79g\" (UniqueName: \"kubernetes.io/projected/3b20b679-42ba-43c1-9e8f-e62903aafec0-kube-api-access-kr79g\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:02:24.696253 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:24.696261 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b20b679-42ba-43c1-9e8f-e62903aafec0-bundle\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:02:25.339207 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.339171 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" event={"ID":"3b20b679-42ba-43c1-9e8f-e62903aafec0","Type":"ContainerDied","Data":"a46e74630568dbbb095d7aa44e4d3f85869be394436538787fc64e53bdd79e04"} Jun 11 23:02:25.339207 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.339190 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf" Jun 11 23:02:25.339727 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.339225 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a46e74630568dbbb095d7aa44e4d3f85869be394436538787fc64e53bdd79e04" Jun 11 23:02:25.478046 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.478018 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" Jun 11 23:02:25.515997 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.515972 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" Jun 11 23:02:25.603231 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.603136 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-bundle\") pod \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\" (UID: \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\") " Jun 11 23:02:25.603231 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.603180 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/407ab369-537e-4a88-ae5e-e4dabfb1fc33-bundle\") pod \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\" (UID: \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\") " Jun 11 23:02:25.603231 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.603226 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/407ab369-537e-4a88-ae5e-e4dabfb1fc33-util\") pod \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\" (UID: \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\") " Jun 11 23:02:25.603528 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.603254 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sds2c\" (UniqueName: \"kubernetes.io/projected/407ab369-537e-4a88-ae5e-e4dabfb1fc33-kube-api-access-sds2c\") pod \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\" (UID: \"407ab369-537e-4a88-ae5e-e4dabfb1fc33\") " Jun 11 23:02:25.603528 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.603323 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-util\") pod \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\" (UID: \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\") " Jun 11 23:02:25.603528 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.603374 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzrml\" (UniqueName: \"kubernetes.io/projected/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-kube-api-access-gzrml\") pod \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\" (UID: \"657cd2ad-91fb-44c8-ba0c-1a82a732a15c\") " Jun 11 23:02:25.603886 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.603858 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/407ab369-537e-4a88-ae5e-e4dabfb1fc33-bundle" (OuterVolumeSpecName: "bundle") pod "407ab369-537e-4a88-ae5e-e4dabfb1fc33" (UID: "407ab369-537e-4a88-ae5e-e4dabfb1fc33"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:02:25.603990 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.603967 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-bundle" (OuterVolumeSpecName: "bundle") pod "657cd2ad-91fb-44c8-ba0c-1a82a732a15c" (UID: "657cd2ad-91fb-44c8-ba0c-1a82a732a15c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:02:25.605636 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.605614 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/407ab369-537e-4a88-ae5e-e4dabfb1fc33-kube-api-access-sds2c" (OuterVolumeSpecName: "kube-api-access-sds2c") pod "407ab369-537e-4a88-ae5e-e4dabfb1fc33" (UID: "407ab369-537e-4a88-ae5e-e4dabfb1fc33"). InnerVolumeSpecName "kube-api-access-sds2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:02:25.606059 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.606031 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-kube-api-access-gzrml" (OuterVolumeSpecName: "kube-api-access-gzrml") pod "657cd2ad-91fb-44c8-ba0c-1a82a732a15c" (UID: "657cd2ad-91fb-44c8-ba0c-1a82a732a15c"). InnerVolumeSpecName "kube-api-access-gzrml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:02:25.612200 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.612164 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-util" (OuterVolumeSpecName: "util") pod "657cd2ad-91fb-44c8-ba0c-1a82a732a15c" (UID: "657cd2ad-91fb-44c8-ba0c-1a82a732a15c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:02:25.612784 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.612748 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/407ab369-537e-4a88-ae5e-e4dabfb1fc33-util" (OuterVolumeSpecName: "util") pod "407ab369-537e-4a88-ae5e-e4dabfb1fc33" (UID: "407ab369-537e-4a88-ae5e-e4dabfb1fc33"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:02:25.704568 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.704513 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-bundle\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:02:25.704568 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.704555 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/407ab369-537e-4a88-ae5e-e4dabfb1fc33-bundle\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:02:25.704568 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.704568 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/407ab369-537e-4a88-ae5e-e4dabfb1fc33-util\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:02:25.704869 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.704580 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sds2c\" (UniqueName: \"kubernetes.io/projected/407ab369-537e-4a88-ae5e-e4dabfb1fc33-kube-api-access-sds2c\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:02:25.704869 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.704624 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-util\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:02:25.704869 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:25.704636 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzrml\" (UniqueName: \"kubernetes.io/projected/657cd2ad-91fb-44c8-ba0c-1a82a732a15c-kube-api-access-gzrml\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:02:26.346305 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:26.346275 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" Jun 11 23:02:26.346869 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:26.346384 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt" event={"ID":"657cd2ad-91fb-44c8-ba0c-1a82a732a15c","Type":"ContainerDied","Data":"6f1142172998e9baa7188435784823d471ac2c405f4e462be530177045d0f8f3"} Jun 11 23:02:26.346869 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:26.346578 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f1142172998e9baa7188435784823d471ac2c405f4e462be530177045d0f8f3" Jun 11 23:02:26.348619 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:26.348573 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" event={"ID":"407ab369-537e-4a88-ae5e-e4dabfb1fc33","Type":"ContainerDied","Data":"8b9cbb97bf58d2487abb7d922c7165bbf83e601a1737c9d28dfcbe43acd4f214"} Jun 11 23:02:26.348737 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:26.348637 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2" Jun 11 23:02:26.348737 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:26.348641 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b9cbb97bf58d2487abb7d922c7165bbf83e601a1737c9d28dfcbe43acd4f214" Jun 11 23:02:38.146922 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.146881 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m9ns5"] Jun 11 23:02:38.147298 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147249 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b20b679-42ba-43c1-9e8f-e62903aafec0" containerName="extract" Jun 11 23:02:38.147298 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147262 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b20b679-42ba-43c1-9e8f-e62903aafec0" containerName="extract" Jun 11 23:02:38.147298 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147272 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="407ab369-537e-4a88-ae5e-e4dabfb1fc33" containerName="util" Jun 11 23:02:38.147298 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147278 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="407ab369-537e-4a88-ae5e-e4dabfb1fc33" containerName="util" Jun 11 23:02:38.147298 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147285 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="407ab369-537e-4a88-ae5e-e4dabfb1fc33" containerName="extract" Jun 11 23:02:38.147298 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147290 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="407ab369-537e-4a88-ae5e-e4dabfb1fc33" containerName="extract" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147302 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8fb35c6-d05d-4514-a116-7776736d10b8" containerName="util" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147307 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8fb35c6-d05d-4514-a116-7776736d10b8" containerName="util" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147315 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="657cd2ad-91fb-44c8-ba0c-1a82a732a15c" containerName="pull" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147320 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="657cd2ad-91fb-44c8-ba0c-1a82a732a15c" containerName="pull" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147327 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="657cd2ad-91fb-44c8-ba0c-1a82a732a15c" containerName="extract" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147332 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="657cd2ad-91fb-44c8-ba0c-1a82a732a15c" containerName="extract" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147340 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b20b679-42ba-43c1-9e8f-e62903aafec0" containerName="pull" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147345 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b20b679-42ba-43c1-9e8f-e62903aafec0" containerName="pull" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147355 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b20b679-42ba-43c1-9e8f-e62903aafec0" containerName="util" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147359 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b20b679-42ba-43c1-9e8f-e62903aafec0" containerName="util" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147366 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8fb35c6-d05d-4514-a116-7776736d10b8" containerName="pull" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147371 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8fb35c6-d05d-4514-a116-7776736d10b8" containerName="pull" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147377 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8fb35c6-d05d-4514-a116-7776736d10b8" containerName="extract" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147383 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8fb35c6-d05d-4514-a116-7776736d10b8" containerName="extract" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147388 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="657cd2ad-91fb-44c8-ba0c-1a82a732a15c" containerName="util" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147392 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="657cd2ad-91fb-44c8-ba0c-1a82a732a15c" containerName="util" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147400 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="407ab369-537e-4a88-ae5e-e4dabfb1fc33" containerName="pull" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147405 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="407ab369-537e-4a88-ae5e-e4dabfb1fc33" containerName="pull" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147471 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8fb35c6-d05d-4514-a116-7776736d10b8" containerName="extract" Jun 11 23:02:38.147479 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147481 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="657cd2ad-91fb-44c8-ba0c-1a82a732a15c" containerName="extract" Jun 11 23:02:38.148078 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147488 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="407ab369-537e-4a88-ae5e-e4dabfb1fc33" containerName="extract" Jun 11 23:02:38.148078 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.147495 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b20b679-42ba-43c1-9e8f-e62903aafec0" containerName="extract" Jun 11 23:02:38.155190 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.155159 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9ns5" Jun 11 23:02:38.159173 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.159141 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dwxr7\"" Jun 11 23:02:38.168481 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.168454 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m9ns5"] Jun 11 23:02:38.222869 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.222833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9xbt\" (UniqueName: \"kubernetes.io/projected/791ed49a-6e68-4579-aa7d-472e68dafa1d-kube-api-access-z9xbt\") pod \"authorino-operator-75cc8d5cb7-m9ns5\" (UID: \"791ed49a-6e68-4579-aa7d-472e68dafa1d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9ns5" Jun 11 23:02:38.323618 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.323545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9xbt\" (UniqueName: \"kubernetes.io/projected/791ed49a-6e68-4579-aa7d-472e68dafa1d-kube-api-access-z9xbt\") pod \"authorino-operator-75cc8d5cb7-m9ns5\" (UID: \"791ed49a-6e68-4579-aa7d-472e68dafa1d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9ns5" Jun 11 23:02:38.335393 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.335362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9xbt\" (UniqueName: \"kubernetes.io/projected/791ed49a-6e68-4579-aa7d-472e68dafa1d-kube-api-access-z9xbt\") pod \"authorino-operator-75cc8d5cb7-m9ns5\" (UID: \"791ed49a-6e68-4579-aa7d-472e68dafa1d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9ns5" Jun 11 23:02:38.466226 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.466125 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9ns5" Jun 11 23:02:38.612671 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:38.612647 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m9ns5"] Jun 11 23:02:38.613628 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:02:38.613604 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791ed49a_6e68_4579_aa7d_472e68dafa1d.slice/crio-03947a54bf6662253e58d1bc42cded7b7056615712d16c61244b45defcc19a9c WatchSource:0}: Error finding container 03947a54bf6662253e58d1bc42cded7b7056615712d16c61244b45defcc19a9c: Status 404 returned error can't find the container with id 03947a54bf6662253e58d1bc42cded7b7056615712d16c61244b45defcc19a9c Jun 11 23:02:39.427094 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:39.427004 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9ns5" event={"ID":"791ed49a-6e68-4579-aa7d-472e68dafa1d","Type":"ContainerStarted","Data":"03947a54bf6662253e58d1bc42cded7b7056615712d16c61244b45defcc19a9c"} Jun 11 23:02:41.439784 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:41.439743 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9ns5" event={"ID":"791ed49a-6e68-4579-aa7d-472e68dafa1d","Type":"ContainerStarted","Data":"d5579bbd09e72390f2b7c0d49555960176dbd03324d20f06724caae498feff64"} Jun 11 23:02:41.440166 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:41.439888 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9ns5" Jun 11 23:02:41.457711 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:41.457656 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9ns5" podStartSLOduration=1.038453329 podStartE2EDuration="3.457638612s" totalImagesPullingTime="2.419185283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:02:41.457182193 +0000 UTC m=+639.340505036" watchObservedRunningTime="2026-06-11 23:02:41.457638612 +0000 UTC m=+639.340961444" Jun 11 23:02:42.305758 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:42.305722 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj"] Jun 11 23:02:42.310502 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:42.310484 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:02:42.313222 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:42.313201 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zqzsf\"" Jun 11 23:02:42.321200 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:42.321172 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj"] Jun 11 23:02:42.458203 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:42.458171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkfr5\" (UniqueName: \"kubernetes.io/projected/b858fdc4-4bf1-4156-b9f4-d2dfa4528725-kube-api-access-bkfr5\") pod \"limitador-operator-controller-manager-859d7b78bd-ctcfj\" (UID: \"b858fdc4-4bf1-4156-b9f4-d2dfa4528725\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:02:42.559238 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:42.559144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkfr5\" (UniqueName: \"kubernetes.io/projected/b858fdc4-4bf1-4156-b9f4-d2dfa4528725-kube-api-access-bkfr5\") pod \"limitador-operator-controller-manager-859d7b78bd-ctcfj\" (UID: \"b858fdc4-4bf1-4156-b9f4-d2dfa4528725\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:02:42.568295 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:42.568259 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkfr5\" (UniqueName: \"kubernetes.io/projected/b858fdc4-4bf1-4156-b9f4-d2dfa4528725-kube-api-access-bkfr5\") pod \"limitador-operator-controller-manager-859d7b78bd-ctcfj\" (UID: \"b858fdc4-4bf1-4156-b9f4-d2dfa4528725\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:02:42.622271 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:42.622240 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:02:42.773954 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:42.773930 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj"] Jun 11 23:02:42.775936 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:02:42.775906 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb858fdc4_4bf1_4156_b9f4_d2dfa4528725.slice/crio-4c52378af4af402a229ce1375e736f244a99b4b7ddea3b5dd88f4e571dd66dd1 WatchSource:0}: Error finding container 4c52378af4af402a229ce1375e736f244a99b4b7ddea3b5dd88f4e571dd66dd1: Status 404 returned error can't find the container with id 4c52378af4af402a229ce1375e736f244a99b4b7ddea3b5dd88f4e571dd66dd1 Jun 11 23:02:42.777993 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:42.777975 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:02:43.455734 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:43.455701 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" event={"ID":"b858fdc4-4bf1-4156-b9f4-d2dfa4528725","Type":"ContainerStarted","Data":"4c52378af4af402a229ce1375e736f244a99b4b7ddea3b5dd88f4e571dd66dd1"} Jun 11 23:02:45.471366 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:45.471323 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" event={"ID":"b858fdc4-4bf1-4156-b9f4-d2dfa4528725","Type":"ContainerStarted","Data":"92293dfce8044009046356e9e3385c051a8ba96cd680bcbde7fa8e5182b4b309"} Jun 11 23:02:45.471774 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:45.471401 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:02:45.498468 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:45.498413 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" podStartSLOduration=1.56534727 podStartE2EDuration="3.498396242s" totalImagesPullingTime="1.933048972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:02:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:02:45.495747496 +0000 UTC m=+643.379070326" watchObservedRunningTime="2026-06-11 23:02:45.498396242 +0000 UTC m=+643.381719073" Jun 11 23:02:52.447932 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:52.447900 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9ns5" Jun 11 23:02:56.479411 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:02:56.479380 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:03:10.490464 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.490415 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb"] Jun 11 23:03:10.496010 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.495990 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb" Jun 11 23:03:10.499182 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.499161 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fhlt6\"" Jun 11 23:03:10.514436 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.514400 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb"] Jun 11 23:03:10.614004 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.613976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64tzg\" (UniqueName: \"kubernetes.io/projected/c37f921e-91ea-4303-a5ce-3a9fa40d90a5-kube-api-access-64tzg\") pod \"kuadrant-operator-controller-manager-55467d9f7-75pfb\" (UID: \"c37f921e-91ea-4303-a5ce-3a9fa40d90a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb" Jun 11 23:03:10.614197 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.614022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c37f921e-91ea-4303-a5ce-3a9fa40d90a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-75pfb\" (UID: \"c37f921e-91ea-4303-a5ce-3a9fa40d90a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb" Jun 11 23:03:10.629236 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.629204 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb"] Jun 11 23:03:10.629531 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:10.629513 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-64tzg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb" podUID="c37f921e-91ea-4303-a5ce-3a9fa40d90a5" Jun 11 23:03:10.692575 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.692531 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb"] Jun 11 23:03:10.703924 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.703894 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb"] Jun 11 23:03:10.724117 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.724069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64tzg\" (UniqueName: \"kubernetes.io/projected/c37f921e-91ea-4303-a5ce-3a9fa40d90a5-kube-api-access-64tzg\") pod \"kuadrant-operator-controller-manager-55467d9f7-75pfb\" (UID: \"c37f921e-91ea-4303-a5ce-3a9fa40d90a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb" Jun 11 23:03:10.724305 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.724154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c37f921e-91ea-4303-a5ce-3a9fa40d90a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-75pfb\" (UID: \"c37f921e-91ea-4303-a5ce-3a9fa40d90a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb" Jun 11 23:03:10.724535 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.724515 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c37f921e-91ea-4303-a5ce-3a9fa40d90a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-75pfb\" (UID: \"c37f921e-91ea-4303-a5ce-3a9fa40d90a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb" Jun 11 23:03:10.729976 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:10.729952 2578 projected.go:196] Error preparing data for projected volume kube-api-access-64tzg for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-128-179.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-128-179.ec2.internal' and this object Jun 11 23:03:10.730130 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:10.730028 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c37f921e-91ea-4303-a5ce-3a9fa40d90a5-kube-api-access-64tzg podName:c37f921e-91ea-4303-a5ce-3a9fa40d90a5 nodeName:}" failed. No retries permitted until 2026-06-11 23:03:11.230010678 +0000 UTC m=+669.113333487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-64tzg" (UniqueName: "kubernetes.io/projected/c37f921e-91ea-4303-a5ce-3a9fa40d90a5-kube-api-access-64tzg") pod "kuadrant-operator-controller-manager-55467d9f7-75pfb" (UID: "c37f921e-91ea-4303-a5ce-3a9fa40d90a5") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-128-179.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-128-179.ec2.internal' and this object Jun 11 23:03:10.771884 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.771734 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj"] Jun 11 23:03:10.772088 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.772025 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" podUID="b858fdc4-4bf1-4156-b9f4-d2dfa4528725" containerName="manager" containerID="cri-o://92293dfce8044009046356e9e3385c051a8ba96cd680bcbde7fa8e5182b4b309" gracePeriod=2 Jun 11 23:03:10.796710 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.796675 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj"] Jun 11 23:03:10.810501 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:10.810450 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b858fdc4-4bf1-4156-b9f4-d2dfa4528725\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-ctcfj\": pods \"limitador-operator-controller-manager-859d7b78bd-ctcfj\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:03:10.814165 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.814139 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m7bwg"] Jun 11 23:03:10.814515 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.814503 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b858fdc4-4bf1-4156-b9f4-d2dfa4528725" containerName="manager" Jun 11 23:03:10.814560 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.814517 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b858fdc4-4bf1-4156-b9f4-d2dfa4528725" containerName="manager" Jun 11 23:03:10.814621 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.814579 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b858fdc4-4bf1-4156-b9f4-d2dfa4528725" containerName="manager" Jun 11 23:03:10.818693 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.818668 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m7bwg" Jun 11 23:03:10.821210 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:10.821179 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ctcfj\" is forbidden: User \"system:node:ip-10-0-128-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-179.ec2.internal' and this object" podUID="b858fdc4-4bf1-4156-b9f4-d2dfa4528725" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:03:10.839024 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.838995 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m7bwg"] Jun 11 23:03:10.926578 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:10.926532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjvmr\" (UniqueName: \"kubernetes.io/projected/80c2def4-b498-41c2-a376-228853d1ef00-kube-api-access-tjvmr\") pod \"limitador-operator-controller-manager-859d7b78bd-m7bwg\" (UID: \"80c2def4-b498-41c2-a376-228853d1ef00\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m7bwg" Jun 11 23:03:11.020258 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.020231 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:03:11.023708 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:11.023636 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ctcfj\" is forbidden: User \"system:node:ip-10-0-128-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-179.ec2.internal' and this object" podUID="b858fdc4-4bf1-4156-b9f4-d2dfa4528725" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:03:11.028080 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.028059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjvmr\" (UniqueName: \"kubernetes.io/projected/80c2def4-b498-41c2-a376-228853d1ef00-kube-api-access-tjvmr\") pod \"limitador-operator-controller-manager-859d7b78bd-m7bwg\" (UID: \"80c2def4-b498-41c2-a376-228853d1ef00\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m7bwg" Jun 11 23:03:11.041700 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.041674 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjvmr\" (UniqueName: \"kubernetes.io/projected/80c2def4-b498-41c2-a376-228853d1ef00-kube-api-access-tjvmr\") pod \"limitador-operator-controller-manager-859d7b78bd-m7bwg\" (UID: \"80c2def4-b498-41c2-a376-228853d1ef00\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m7bwg" Jun 11 23:03:11.128869 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.128835 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkfr5\" (UniqueName: \"kubernetes.io/projected/b858fdc4-4bf1-4156-b9f4-d2dfa4528725-kube-api-access-bkfr5\") pod \"b858fdc4-4bf1-4156-b9f4-d2dfa4528725\" (UID: \"b858fdc4-4bf1-4156-b9f4-d2dfa4528725\") " Jun 11 23:03:11.131053 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.131022 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b858fdc4-4bf1-4156-b9f4-d2dfa4528725-kube-api-access-bkfr5" (OuterVolumeSpecName: "kube-api-access-bkfr5") pod "b858fdc4-4bf1-4156-b9f4-d2dfa4528725" (UID: "b858fdc4-4bf1-4156-b9f4-d2dfa4528725"). InnerVolumeSpecName "kube-api-access-bkfr5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:03:11.140235 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.140208 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m7bwg" Jun 11 23:03:11.230424 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.230389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64tzg\" (UniqueName: \"kubernetes.io/projected/c37f921e-91ea-4303-a5ce-3a9fa40d90a5-kube-api-access-64tzg\") pod \"kuadrant-operator-controller-manager-55467d9f7-75pfb\" (UID: \"c37f921e-91ea-4303-a5ce-3a9fa40d90a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb" Jun 11 23:03:11.230564 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.230465 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkfr5\" (UniqueName: \"kubernetes.io/projected/b858fdc4-4bf1-4156-b9f4-d2dfa4528725-kube-api-access-bkfr5\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:03:11.233224 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:11.233200 2578 projected.go:196] Error preparing data for projected volume kube-api-access-64tzg for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-128-179.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-128-179.ec2.internal' and this object Jun 11 23:03:11.233338 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:11.233286 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c37f921e-91ea-4303-a5ce-3a9fa40d90a5-kube-api-access-64tzg podName:c37f921e-91ea-4303-a5ce-3a9fa40d90a5 nodeName:}" failed. No retries permitted until 2026-06-11 23:03:12.233263015 +0000 UTC m=+670.116585827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-64tzg" (UniqueName: "kubernetes.io/projected/c37f921e-91ea-4303-a5ce-3a9fa40d90a5-kube-api-access-64tzg") pod "kuadrant-operator-controller-manager-55467d9f7-75pfb" (UID: "c37f921e-91ea-4303-a5ce-3a9fa40d90a5") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-128-179.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-128-179.ec2.internal' and this object Jun 11 23:03:11.294680 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.294650 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m7bwg"] Jun 11 23:03:11.295754 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:03:11.295727 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c2def4_b498_41c2_a376_228853d1ef00.slice/crio-560d262ee280d9c04de56bea57f7ecd6e3639c0e546ad4be2dadf1e2913170e6 WatchSource:0}: Error finding container 560d262ee280d9c04de56bea57f7ecd6e3639c0e546ad4be2dadf1e2913170e6: Status 404 returned error can't find the container with id 560d262ee280d9c04de56bea57f7ecd6e3639c0e546ad4be2dadf1e2913170e6 Jun 11 23:03:11.623428 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.623337 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m7bwg" event={"ID":"80c2def4-b498-41c2-a376-228853d1ef00","Type":"ContainerStarted","Data":"d718e0c996a1601e065b79e495833b0e234bd327d325857c1cd516244cdd9b5f"} Jun 11 23:03:11.623428 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.623387 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m7bwg" event={"ID":"80c2def4-b498-41c2-a376-228853d1ef00","Type":"ContainerStarted","Data":"560d262ee280d9c04de56bea57f7ecd6e3639c0e546ad4be2dadf1e2913170e6"} Jun 11 23:03:11.623965 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.623446 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m7bwg" Jun 11 23:03:11.624783 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.624760 2578 generic.go:356] "Generic (PLEG): container finished" podID="b858fdc4-4bf1-4156-b9f4-d2dfa4528725" containerID="92293dfce8044009046356e9e3385c051a8ba96cd680bcbde7fa8e5182b4b309" exitCode=0 Jun 11 23:03:11.624875 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.624797 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:03:11.624875 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.624860 2578 scope.go:117] "RemoveContainer" containerID="92293dfce8044009046356e9e3385c051a8ba96cd680bcbde7fa8e5182b4b309" Jun 11 23:03:11.625017 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.625002 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb" Jun 11 23:03:11.626039 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:11.626016 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ctcfj\" is forbidden: User \"system:node:ip-10-0-128-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-179.ec2.internal' and this object" podUID="b858fdc4-4bf1-4156-b9f4-d2dfa4528725" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:03:11.632336 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.632312 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb" Jun 11 23:03:11.634730 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.634715 2578 scope.go:117] "RemoveContainer" containerID="92293dfce8044009046356e9e3385c051a8ba96cd680bcbde7fa8e5182b4b309" Jun 11 23:03:11.634954 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:11.634933 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92293dfce8044009046356e9e3385c051a8ba96cd680bcbde7fa8e5182b4b309\": container with ID starting with 92293dfce8044009046356e9e3385c051a8ba96cd680bcbde7fa8e5182b4b309 not found: ID does not exist" containerID="92293dfce8044009046356e9e3385c051a8ba96cd680bcbde7fa8e5182b4b309" Jun 11 23:03:11.635016 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.634966 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92293dfce8044009046356e9e3385c051a8ba96cd680bcbde7fa8e5182b4b309"} err="failed to get container status \"92293dfce8044009046356e9e3385c051a8ba96cd680bcbde7fa8e5182b4b309\": rpc error: code = NotFound desc = could not find container \"92293dfce8044009046356e9e3385c051a8ba96cd680bcbde7fa8e5182b4b309\": container with ID starting with 92293dfce8044009046356e9e3385c051a8ba96cd680bcbde7fa8e5182b4b309 not found: ID does not exist" Jun 11 23:03:11.654451 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.654397 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m7bwg" podStartSLOduration=1.6543790440000001 podStartE2EDuration="1.654379044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:03:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:03:11.653437655 +0000 UTC m=+669.536760486" watchObservedRunningTime="2026-06-11 23:03:11.654379044 +0000 UTC m=+669.537701870" Jun 11 23:03:11.658851 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:11.658808 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-75pfb\" is forbidden: User \"system:node:ip-10-0-128-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-179.ec2.internal' and this object" podUID="c37f921e-91ea-4303-a5ce-3a9fa40d90a5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb" Jun 11 23:03:11.660907 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:11.660863 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ctcfj\" is forbidden: User \"system:node:ip-10-0-128-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-179.ec2.internal' and this object" podUID="b858fdc4-4bf1-4156-b9f4-d2dfa4528725" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:03:11.734226 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.734191 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c37f921e-91ea-4303-a5ce-3a9fa40d90a5-extensions-socket-volume\") pod \"c37f921e-91ea-4303-a5ce-3a9fa40d90a5\" (UID: \"c37f921e-91ea-4303-a5ce-3a9fa40d90a5\") " Jun 11 23:03:11.734511 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.734482 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c37f921e-91ea-4303-a5ce-3a9fa40d90a5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c37f921e-91ea-4303-a5ce-3a9fa40d90a5" (UID: "c37f921e-91ea-4303-a5ce-3a9fa40d90a5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:03:11.734718 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.734698 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c37f921e-91ea-4303-a5ce-3a9fa40d90a5-extensions-socket-volume\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:03:11.734789 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:11.734724 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64tzg\" (UniqueName: \"kubernetes.io/projected/c37f921e-91ea-4303-a5ce-3a9fa40d90a5-kube-api-access-64tzg\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:03:12.610726 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:12.610682 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ctcfj\" is forbidden: User \"system:node:ip-10-0-128-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-179.ec2.internal' and this object" podUID="b858fdc4-4bf1-4156-b9f4-d2dfa4528725" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ctcfj" Jun 11 23:03:12.611352 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:12.611330 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b858fdc4-4bf1-4156-b9f4-d2dfa4528725" path="/var/lib/kubelet/pods/b858fdc4-4bf1-4156-b9f4-d2dfa4528725/volumes" Jun 11 23:03:12.611685 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:12.611673 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c37f921e-91ea-4303-a5ce-3a9fa40d90a5" path="/var/lib/kubelet/pods/c37f921e-91ea-4303-a5ce-3a9fa40d90a5/volumes" Jun 11 23:03:12.613011 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:12.612987 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-75pfb\" is forbidden: User \"system:node:ip-10-0-128-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-179.ec2.internal' and this object" podUID="c37f921e-91ea-4303-a5ce-3a9fa40d90a5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb" Jun 11 23:03:12.631943 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:12.631914 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb" Jun 11 23:03:12.636733 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:03:12.636699 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-75pfb\" is forbidden: User \"system:node:ip-10-0-128-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-179.ec2.internal' and this object" podUID="c37f921e-91ea-4303-a5ce-3a9fa40d90a5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-75pfb" Jun 11 23:03:22.635227 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:03:22.635192 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m7bwg" Jun 11 23:04:00.510414 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.510374 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb"] Jun 11 23:04:00.514381 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.514359 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.517761 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.517738 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5mnsg\"" Jun 11 23:04:00.540135 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.540105 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb"] Jun 11 23:04:00.586074 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.586040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.586294 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.586090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.586294 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.586173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.586294 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.586202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.586294 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.586233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.586294 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.586270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.586294 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.586287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.586641 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.586307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmr5l\" (UniqueName: \"kubernetes.io/projected/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-kube-api-access-xmr5l\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.586641 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.586378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.687897 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.687854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.687897 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.687902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.688161 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.687922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.688161 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.687950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmr5l\" (UniqueName: \"kubernetes.io/projected/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-kube-api-access-xmr5l\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.688161 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.687999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.688161 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.688050 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.688161 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.688109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.688405 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.688162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.688405 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.688189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.688405 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.688327 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.688659 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.688636 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.688916 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.688882 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.689041 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.688990 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.689134 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.689116 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.690701 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.690676 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.690809 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.690719 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.698971 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.698935 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmr5l\" (UniqueName: \"kubernetes.io/projected/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-kube-api-access-xmr5l\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.713743 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.713723 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e1809c6-6f65-49c0-93dc-5b30e1acb33f-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-h7gbb\" (UID: \"7e1809c6-6f65-49c0-93dc-5b30e1acb33f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.824845 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.824476 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:00.978262 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.978232 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb"] Jun 11 23:04:00.979890 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:04:00.979865 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1809c6_6f65_49c0_93dc_5b30e1acb33f.slice/crio-c88ecdaaf3bf38f88b60b1db0342fdc02f3bb1afc0267f7e865368abc86527c2 WatchSource:0}: Error finding container c88ecdaaf3bf38f88b60b1db0342fdc02f3bb1afc0267f7e865368abc86527c2: Status 404 returned error can't find the container with id c88ecdaaf3bf38f88b60b1db0342fdc02f3bb1afc0267f7e865368abc86527c2 Jun 11 23:04:00.981975 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.981947 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 23:04:00.982052 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.982013 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 23:04:00.982052 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:00.982045 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 23:04:01.911912 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:01.911872 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" event={"ID":"7e1809c6-6f65-49c0-93dc-5b30e1acb33f","Type":"ContainerStarted","Data":"2c6ed0b5789978894583e4d3ed14612b061b5a1e1650ea6ff512380292eaf429"} Jun 11 23:04:01.912302 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:01.911961 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" event={"ID":"7e1809c6-6f65-49c0-93dc-5b30e1acb33f","Type":"ContainerStarted","Data":"c88ecdaaf3bf38f88b60b1db0342fdc02f3bb1afc0267f7e865368abc86527c2"} Jun 11 23:04:01.939663 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:01.939608 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" podStartSLOduration=1.9395772839999998 podStartE2EDuration="1.939577284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:04:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:04:01.937008618 +0000 UTC m=+719.820331451" watchObservedRunningTime="2026-06-11 23:04:01.939577284 +0000 UTC m=+719.822900183" Jun 11 23:04:02.824974 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:02.824943 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:02.829876 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:02.829845 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:02.917658 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:02.917620 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:02.918716 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:02.918692 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:04:03.380992 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.380962 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nc27t"] Jun 11 23:04:03.385785 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.385761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nc27t" Jun 11 23:04:03.388663 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.388638 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jzsps\"" Jun 11 23:04:03.388663 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.388651 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 23:04:03.398114 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.398086 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nc27t"] Jun 11 23:04:03.431883 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.431844 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nc27t"] Jun 11 23:04:03.515818 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.515786 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2da21598-fd92-4774-9c1a-51d26fc88965-config-file\") pod \"limitador-limitador-54d6d988d5-nc27t\" (UID: \"2da21598-fd92-4774-9c1a-51d26fc88965\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nc27t" Jun 11 23:04:03.516001 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.515871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb8px\" (UniqueName: \"kubernetes.io/projected/2da21598-fd92-4774-9c1a-51d26fc88965-kube-api-access-jb8px\") pod \"limitador-limitador-54d6d988d5-nc27t\" (UID: \"2da21598-fd92-4774-9c1a-51d26fc88965\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nc27t" Jun 11 23:04:03.617107 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.617072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb8px\" (UniqueName: \"kubernetes.io/projected/2da21598-fd92-4774-9c1a-51d26fc88965-kube-api-access-jb8px\") pod \"limitador-limitador-54d6d988d5-nc27t\" (UID: \"2da21598-fd92-4774-9c1a-51d26fc88965\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nc27t" Jun 11 23:04:03.617276 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.617145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2da21598-fd92-4774-9c1a-51d26fc88965-config-file\") pod \"limitador-limitador-54d6d988d5-nc27t\" (UID: \"2da21598-fd92-4774-9c1a-51d26fc88965\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nc27t" Jun 11 23:04:03.617845 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.617822 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2da21598-fd92-4774-9c1a-51d26fc88965-config-file\") pod \"limitador-limitador-54d6d988d5-nc27t\" (UID: \"2da21598-fd92-4774-9c1a-51d26fc88965\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nc27t" Jun 11 23:04:03.626912 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.626880 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb8px\" (UniqueName: \"kubernetes.io/projected/2da21598-fd92-4774-9c1a-51d26fc88965-kube-api-access-jb8px\") pod \"limitador-limitador-54d6d988d5-nc27t\" (UID: \"2da21598-fd92-4774-9c1a-51d26fc88965\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nc27t" Jun 11 23:04:03.697867 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.697768 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nc27t" Jun 11 23:04:03.858147 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.858115 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nc27t"] Jun 11 23:04:03.859872 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:04:03.859843 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da21598_fd92_4774_9c1a_51d26fc88965.slice/crio-cacabcc62bd563332d888d08888f29a6d8320c0a6727295f2de3144e0e5b8ac8 WatchSource:0}: Error finding container cacabcc62bd563332d888d08888f29a6d8320c0a6727295f2de3144e0e5b8ac8: Status 404 returned error can't find the container with id cacabcc62bd563332d888d08888f29a6d8320c0a6727295f2de3144e0e5b8ac8 Jun 11 23:04:03.915033 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.915000 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-rbqb7"] Jun 11 23:04:03.919934 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.919916 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rbqb7" Jun 11 23:04:03.922855 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.922831 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m779d\"" Jun 11 23:04:03.925746 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.925723 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nc27t" event={"ID":"2da21598-fd92-4774-9c1a-51d26fc88965","Type":"ContainerStarted","Data":"cacabcc62bd563332d888d08888f29a6d8320c0a6727295f2de3144e0e5b8ac8"} Jun 11 23:04:03.928010 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:03.927950 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rbqb7"] Jun 11 23:04:04.021763 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:04.021673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnfsk\" (UniqueName: \"kubernetes.io/projected/cb53639f-4f59-48fb-b427-e265cf728d72-kube-api-access-cnfsk\") pod \"authorino-75d556bd77-rbqb7\" (UID: \"cb53639f-4f59-48fb-b427-e265cf728d72\") " pod="kuadrant-system/authorino-75d556bd77-rbqb7" Jun 11 23:04:04.122435 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:04.122397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnfsk\" (UniqueName: \"kubernetes.io/projected/cb53639f-4f59-48fb-b427-e265cf728d72-kube-api-access-cnfsk\") pod \"authorino-75d556bd77-rbqb7\" (UID: \"cb53639f-4f59-48fb-b427-e265cf728d72\") " pod="kuadrant-system/authorino-75d556bd77-rbqb7" Jun 11 23:04:04.131387 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:04.131357 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnfsk\" (UniqueName: \"kubernetes.io/projected/cb53639f-4f59-48fb-b427-e265cf728d72-kube-api-access-cnfsk\") pod \"authorino-75d556bd77-rbqb7\" (UID: \"cb53639f-4f59-48fb-b427-e265cf728d72\") " pod="kuadrant-system/authorino-75d556bd77-rbqb7" Jun 11 23:04:04.230933 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:04.230900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rbqb7" Jun 11 23:04:04.404492 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:04.404460 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rbqb7"] Jun 11 23:04:04.411036 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:04:04.411000 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb53639f_4f59_48fb_b427_e265cf728d72.slice/crio-34a9233c52e0cf56da0b151952841a6fcf2b8183160a702f7f8816e520b308f7 WatchSource:0}: Error finding container 34a9233c52e0cf56da0b151952841a6fcf2b8183160a702f7f8816e520b308f7: Status 404 returned error can't find the container with id 34a9233c52e0cf56da0b151952841a6fcf2b8183160a702f7f8816e520b308f7 Jun 11 23:04:04.936177 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:04.936137 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rbqb7" event={"ID":"cb53639f-4f59-48fb-b427-e265cf728d72","Type":"ContainerStarted","Data":"34a9233c52e0cf56da0b151952841a6fcf2b8183160a702f7f8816e520b308f7"} Jun 11 23:04:08.963992 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:08.963951 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nc27t" event={"ID":"2da21598-fd92-4774-9c1a-51d26fc88965","Type":"ContainerStarted","Data":"443e2e1c47c4b1be8e6ec69c1f469ddeac16bf900ffe93091e8f8f40a6ae1e5e"} Jun 11 23:04:08.964445 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:08.964121 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nc27t" Jun 11 23:04:08.965462 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:08.965439 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rbqb7" event={"ID":"cb53639f-4f59-48fb-b427-e265cf728d72","Type":"ContainerStarted","Data":"9d1e6649ddcc0e634acac804fab07c01a7e1c2172adc1fd91b8c6eb3e68c6cfa"} Jun 11 23:04:08.982727 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:08.982681 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-nc27t" podStartSLOduration=1.535020437 podStartE2EDuration="5.982663987s" totalImagesPullingTime="4.44764355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:04:08.97968317 +0000 UTC m=+726.863006002" watchObservedRunningTime="2026-06-11 23:04:08.982663987 +0000 UTC m=+726.865986819" Jun 11 23:04:08.995293 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:08.995240 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-rbqb7" podStartSLOduration=2.098675522 podStartE2EDuration="5.99522437s" totalImagesPullingTime="3.896548848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:04:08.992768374 +0000 UTC m=+726.876091209" watchObservedRunningTime="2026-06-11 23:04:08.99522437 +0000 UTC m=+726.878547203" Jun 11 23:04:19.972768 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:19.972733 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nc27t" Jun 11 23:04:35.785550 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:35.785514 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q"] Jun 11 23:04:35.792359 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:35.792334 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" Jun 11 23:04:35.795632 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:35.795580 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x7mqc\"" Jun 11 23:04:35.795768 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:35.795731 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:04:35.796763 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:35.796744 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:04:35.803458 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:35.803433 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q"] Jun 11 23:04:35.931019 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:35.930968 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx9qg\" (UniqueName: \"kubernetes.io/projected/e60ed475-33fe-475c-be21-dd5fa7d2b737-kube-api-access-mx9qg\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q\" (UID: \"e60ed475-33fe-475c-be21-dd5fa7d2b737\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" Jun 11 23:04:35.931202 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:35.931078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e60ed475-33fe-475c-be21-dd5fa7d2b737-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q\" (UID: \"e60ed475-33fe-475c-be21-dd5fa7d2b737\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" Jun 11 23:04:35.931202 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:35.931162 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e60ed475-33fe-475c-be21-dd5fa7d2b737-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q\" (UID: \"e60ed475-33fe-475c-be21-dd5fa7d2b737\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" Jun 11 23:04:36.032213 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:36.032164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e60ed475-33fe-475c-be21-dd5fa7d2b737-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q\" (UID: \"e60ed475-33fe-475c-be21-dd5fa7d2b737\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" Jun 11 23:04:36.032384 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:36.032274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx9qg\" (UniqueName: \"kubernetes.io/projected/e60ed475-33fe-475c-be21-dd5fa7d2b737-kube-api-access-mx9qg\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q\" (UID: \"e60ed475-33fe-475c-be21-dd5fa7d2b737\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" Jun 11 23:04:36.032384 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:36.032318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e60ed475-33fe-475c-be21-dd5fa7d2b737-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q\" (UID: \"e60ed475-33fe-475c-be21-dd5fa7d2b737\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" Jun 11 23:04:36.032659 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:36.032640 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e60ed475-33fe-475c-be21-dd5fa7d2b737-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q\" (UID: \"e60ed475-33fe-475c-be21-dd5fa7d2b737\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" Jun 11 23:04:36.032741 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:36.032724 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e60ed475-33fe-475c-be21-dd5fa7d2b737-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q\" (UID: \"e60ed475-33fe-475c-be21-dd5fa7d2b737\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" Jun 11 23:04:36.042266 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:36.042201 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx9qg\" (UniqueName: \"kubernetes.io/projected/e60ed475-33fe-475c-be21-dd5fa7d2b737-kube-api-access-mx9qg\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q\" (UID: \"e60ed475-33fe-475c-be21-dd5fa7d2b737\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" Jun 11 23:04:36.102356 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:36.102323 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" Jun 11 23:04:36.246724 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:36.246697 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q"] Jun 11 23:04:36.249223 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:04:36.249171 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode60ed475_33fe_475c_be21_dd5fa7d2b737.slice/crio-bddf0f0b8d9dc5554344f3c58d2284ba263559285cde4210d05c70a52e92a756 WatchSource:0}: Error finding container bddf0f0b8d9dc5554344f3c58d2284ba263559285cde4210d05c70a52e92a756: Status 404 returned error can't find the container with id bddf0f0b8d9dc5554344f3c58d2284ba263559285cde4210d05c70a52e92a756 Jun 11 23:04:37.135841 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:37.135806 2578 generic.go:356] "Generic (PLEG): container finished" podID="e60ed475-33fe-475c-be21-dd5fa7d2b737" containerID="a47b0e06de0fcc4dbe6405954808933305eb65ed1b28fa818a709d36abe850f5" exitCode=0 Jun 11 23:04:37.136244 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:37.135908 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" event={"ID":"e60ed475-33fe-475c-be21-dd5fa7d2b737","Type":"ContainerDied","Data":"a47b0e06de0fcc4dbe6405954808933305eb65ed1b28fa818a709d36abe850f5"} Jun 11 23:04:37.136244 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:37.135956 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" event={"ID":"e60ed475-33fe-475c-be21-dd5fa7d2b737","Type":"ContainerStarted","Data":"bddf0f0b8d9dc5554344f3c58d2284ba263559285cde4210d05c70a52e92a756"} Jun 11 23:04:38.144942 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:38.144905 2578 generic.go:356] "Generic (PLEG): container finished" podID="e60ed475-33fe-475c-be21-dd5fa7d2b737" containerID="c71e2e1c7c23df5f1a2bda687a6146e70e5786f94d166e55476bef73d4ee1b76" exitCode=0 Jun 11 23:04:38.145316 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:38.144995 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" event={"ID":"e60ed475-33fe-475c-be21-dd5fa7d2b737","Type":"ContainerDied","Data":"c71e2e1c7c23df5f1a2bda687a6146e70e5786f94d166e55476bef73d4ee1b76"} Jun 11 23:04:39.152533 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:39.152499 2578 generic.go:356] "Generic (PLEG): container finished" podID="e60ed475-33fe-475c-be21-dd5fa7d2b737" containerID="58506be6416be5957c4ef39b2d322bb3bd6a9d0d8ed2151d14085ce129fa316d" exitCode=0 Jun 11 23:04:39.153102 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:39.152606 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" event={"ID":"e60ed475-33fe-475c-be21-dd5fa7d2b737","Type":"ContainerDied","Data":"58506be6416be5957c4ef39b2d322bb3bd6a9d0d8ed2151d14085ce129fa316d"} Jun 11 23:04:40.302122 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:40.302097 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" Jun 11 23:04:40.375767 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:40.375729 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e60ed475-33fe-475c-be21-dd5fa7d2b737-bundle\") pod \"e60ed475-33fe-475c-be21-dd5fa7d2b737\" (UID: \"e60ed475-33fe-475c-be21-dd5fa7d2b737\") " Jun 11 23:04:40.375767 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:40.375765 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e60ed475-33fe-475c-be21-dd5fa7d2b737-util\") pod \"e60ed475-33fe-475c-be21-dd5fa7d2b737\" (UID: \"e60ed475-33fe-475c-be21-dd5fa7d2b737\") " Jun 11 23:04:40.375983 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:40.375828 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx9qg\" (UniqueName: \"kubernetes.io/projected/e60ed475-33fe-475c-be21-dd5fa7d2b737-kube-api-access-mx9qg\") pod \"e60ed475-33fe-475c-be21-dd5fa7d2b737\" (UID: \"e60ed475-33fe-475c-be21-dd5fa7d2b737\") " Jun 11 23:04:40.376383 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:40.376343 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e60ed475-33fe-475c-be21-dd5fa7d2b737-bundle" (OuterVolumeSpecName: "bundle") pod "e60ed475-33fe-475c-be21-dd5fa7d2b737" (UID: "e60ed475-33fe-475c-be21-dd5fa7d2b737"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:04:40.378142 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:40.378116 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e60ed475-33fe-475c-be21-dd5fa7d2b737-kube-api-access-mx9qg" (OuterVolumeSpecName: "kube-api-access-mx9qg") pod "e60ed475-33fe-475c-be21-dd5fa7d2b737" (UID: "e60ed475-33fe-475c-be21-dd5fa7d2b737"). InnerVolumeSpecName "kube-api-access-mx9qg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:04:40.381857 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:40.381833 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e60ed475-33fe-475c-be21-dd5fa7d2b737-util" (OuterVolumeSpecName: "util") pod "e60ed475-33fe-475c-be21-dd5fa7d2b737" (UID: "e60ed475-33fe-475c-be21-dd5fa7d2b737"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:04:40.477517 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:40.477427 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e60ed475-33fe-475c-be21-dd5fa7d2b737-bundle\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:04:40.477517 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:40.477457 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e60ed475-33fe-475c-be21-dd5fa7d2b737-util\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:04:40.477517 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:40.477466 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx9qg\" (UniqueName: \"kubernetes.io/projected/e60ed475-33fe-475c-be21-dd5fa7d2b737-kube-api-access-mx9qg\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:04:41.166410 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:41.166381 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" Jun 11 23:04:41.166410 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:41.166405 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wrn4q" event={"ID":"e60ed475-33fe-475c-be21-dd5fa7d2b737","Type":"ContainerDied","Data":"bddf0f0b8d9dc5554344f3c58d2284ba263559285cde4210d05c70a52e92a756"} Jun 11 23:04:41.166760 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:04:41.166447 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bddf0f0b8d9dc5554344f3c58d2284ba263559285cde4210d05c70a52e92a756" Jun 11 23:05:32.192203 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.192118 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jkk9c"] Jun 11 23:05:32.192686 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.192576 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e60ed475-33fe-475c-be21-dd5fa7d2b737" containerName="util" Jun 11 23:05:32.192686 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.192609 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e60ed475-33fe-475c-be21-dd5fa7d2b737" containerName="util" Jun 11 23:05:32.192686 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.192622 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e60ed475-33fe-475c-be21-dd5fa7d2b737" containerName="pull" Jun 11 23:05:32.192686 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.192628 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e60ed475-33fe-475c-be21-dd5fa7d2b737" containerName="pull" Jun 11 23:05:32.192686 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.192646 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e60ed475-33fe-475c-be21-dd5fa7d2b737" containerName="extract" Jun 11 23:05:32.192686 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.192651 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e60ed475-33fe-475c-be21-dd5fa7d2b737" containerName="extract" Jun 11 23:05:32.192883 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.192719 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e60ed475-33fe-475c-be21-dd5fa7d2b737" containerName="extract" Jun 11 23:05:32.196213 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.196191 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jkk9c" Jun 11 23:05:32.203551 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.203349 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jkk9c"] Jun 11 23:05:32.374835 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.374792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9qhs\" (UniqueName: \"kubernetes.io/projected/f82080aa-d8c8-473f-a5c5-1f6cc3005a14-kube-api-access-t9qhs\") pod \"authorino-5d4b67c446-jkk9c\" (UID: \"f82080aa-d8c8-473f-a5c5-1f6cc3005a14\") " pod="kuadrant-system/authorino-5d4b67c446-jkk9c" Jun 11 23:05:32.417581 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.417539 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jkk9c"] Jun 11 23:05:32.417884 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:05:32.417860 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-t9qhs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-jkk9c" podUID="f82080aa-d8c8-473f-a5c5-1f6cc3005a14" Jun 11 23:05:32.441318 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.441274 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cb76677f8-n5v8b"] Jun 11 23:05:32.444931 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.444869 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cb76677f8-n5v8b" Jun 11 23:05:32.453725 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.453694 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cb76677f8-n5v8b"] Jun 11 23:05:32.473255 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.473220 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jkk9c" Jun 11 23:05:32.475828 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.475801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9qhs\" (UniqueName: \"kubernetes.io/projected/f82080aa-d8c8-473f-a5c5-1f6cc3005a14-kube-api-access-t9qhs\") pod \"authorino-5d4b67c446-jkk9c\" (UID: \"f82080aa-d8c8-473f-a5c5-1f6cc3005a14\") " pod="kuadrant-system/authorino-5d4b67c446-jkk9c" Jun 11 23:05:32.480436 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.480413 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jkk9c" Jun 11 23:05:32.486627 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.486581 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9qhs\" (UniqueName: \"kubernetes.io/projected/f82080aa-d8c8-473f-a5c5-1f6cc3005a14-kube-api-access-t9qhs\") pod \"authorino-5d4b67c446-jkk9c\" (UID: \"f82080aa-d8c8-473f-a5c5-1f6cc3005a14\") " pod="kuadrant-system/authorino-5d4b67c446-jkk9c" Jun 11 23:05:32.495959 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.495928 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cb76677f8-n5v8b"] Jun 11 23:05:32.496286 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:05:32.496266 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nkl6b], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5cb76677f8-n5v8b" podUID="839c1cac-100c-47e1-acf1-2d060393a50d" Jun 11 23:05:32.577047 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.576997 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkl6b\" (UniqueName: \"kubernetes.io/projected/839c1cac-100c-47e1-acf1-2d060393a50d-kube-api-access-nkl6b\") pod \"authorino-5cb76677f8-n5v8b\" (UID: \"839c1cac-100c-47e1-acf1-2d060393a50d\") " pod="kuadrant-system/authorino-5cb76677f8-n5v8b" Jun 11 23:05:32.677704 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.677668 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9qhs\" (UniqueName: \"kubernetes.io/projected/f82080aa-d8c8-473f-a5c5-1f6cc3005a14-kube-api-access-t9qhs\") pod \"f82080aa-d8c8-473f-a5c5-1f6cc3005a14\" (UID: \"f82080aa-d8c8-473f-a5c5-1f6cc3005a14\") " Jun 11 23:05:32.677895 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.677881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkl6b\" (UniqueName: \"kubernetes.io/projected/839c1cac-100c-47e1-acf1-2d060393a50d-kube-api-access-nkl6b\") pod \"authorino-5cb76677f8-n5v8b\" (UID: \"839c1cac-100c-47e1-acf1-2d060393a50d\") " pod="kuadrant-system/authorino-5cb76677f8-n5v8b" Jun 11 23:05:32.679912 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.679888 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f82080aa-d8c8-473f-a5c5-1f6cc3005a14-kube-api-access-t9qhs" (OuterVolumeSpecName: "kube-api-access-t9qhs") pod "f82080aa-d8c8-473f-a5c5-1f6cc3005a14" (UID: "f82080aa-d8c8-473f-a5c5-1f6cc3005a14"). InnerVolumeSpecName "kube-api-access-t9qhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:05:32.687043 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.687025 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkl6b\" (UniqueName: \"kubernetes.io/projected/839c1cac-100c-47e1-acf1-2d060393a50d-kube-api-access-nkl6b\") pod \"authorino-5cb76677f8-n5v8b\" (UID: \"839c1cac-100c-47e1-acf1-2d060393a50d\") " pod="kuadrant-system/authorino-5cb76677f8-n5v8b" Jun 11 23:05:32.778861 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:32.778764 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9qhs\" (UniqueName: \"kubernetes.io/projected/f82080aa-d8c8-473f-a5c5-1f6cc3005a14-kube-api-access-t9qhs\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:05:33.478790 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:33.478759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cb76677f8-n5v8b" Jun 11 23:05:33.478790 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:33.478798 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jkk9c" Jun 11 23:05:33.486745 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:33.486723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cb76677f8-n5v8b" Jun 11 23:05:33.522111 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:33.522073 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jkk9c"] Jun 11 23:05:33.526182 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:33.526148 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jkk9c"] Jun 11 23:05:33.584621 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:33.584548 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkl6b\" (UniqueName: \"kubernetes.io/projected/839c1cac-100c-47e1-acf1-2d060393a50d-kube-api-access-nkl6b\") pod \"839c1cac-100c-47e1-acf1-2d060393a50d\" (UID: \"839c1cac-100c-47e1-acf1-2d060393a50d\") " Jun 11 23:05:33.586814 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:33.586779 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/839c1cac-100c-47e1-acf1-2d060393a50d-kube-api-access-nkl6b" (OuterVolumeSpecName: "kube-api-access-nkl6b") pod "839c1cac-100c-47e1-acf1-2d060393a50d" (UID: "839c1cac-100c-47e1-acf1-2d060393a50d"). InnerVolumeSpecName "kube-api-access-nkl6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:05:33.685286 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:33.685243 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkl6b\" (UniqueName: \"kubernetes.io/projected/839c1cac-100c-47e1-acf1-2d060393a50d-kube-api-access-nkl6b\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:05:33.724690 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:33.724652 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rbqb7"] Jun 11 23:05:33.724915 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:33.724886 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-rbqb7" podUID="cb53639f-4f59-48fb-b427-e265cf728d72" containerName="authorino" containerID="cri-o://9d1e6649ddcc0e634acac804fab07c01a7e1c2172adc1fd91b8c6eb3e68c6cfa" gracePeriod=30 Jun 11 23:05:33.981271 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:33.981186 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rbqb7" Jun 11 23:05:33.988315 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:33.988288 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnfsk\" (UniqueName: \"kubernetes.io/projected/cb53639f-4f59-48fb-b427-e265cf728d72-kube-api-access-cnfsk\") pod \"cb53639f-4f59-48fb-b427-e265cf728d72\" (UID: \"cb53639f-4f59-48fb-b427-e265cf728d72\") " Jun 11 23:05:33.990617 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:33.990567 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb53639f-4f59-48fb-b427-e265cf728d72-kube-api-access-cnfsk" (OuterVolumeSpecName: "kube-api-access-cnfsk") pod "cb53639f-4f59-48fb-b427-e265cf728d72" (UID: "cb53639f-4f59-48fb-b427-e265cf728d72"). InnerVolumeSpecName "kube-api-access-cnfsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:05:34.089250 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.089208 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnfsk\" (UniqueName: \"kubernetes.io/projected/cb53639f-4f59-48fb-b427-e265cf728d72-kube-api-access-cnfsk\") on node \"ip-10-0-128-179.ec2.internal\" DevicePath \"\"" Jun 11 23:05:34.485867 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.485835 2578 generic.go:356] "Generic (PLEG): container finished" podID="cb53639f-4f59-48fb-b427-e265cf728d72" containerID="9d1e6649ddcc0e634acac804fab07c01a7e1c2172adc1fd91b8c6eb3e68c6cfa" exitCode=0 Jun 11 23:05:34.486315 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.485881 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rbqb7" Jun 11 23:05:34.486315 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.485924 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rbqb7" event={"ID":"cb53639f-4f59-48fb-b427-e265cf728d72","Type":"ContainerDied","Data":"9d1e6649ddcc0e634acac804fab07c01a7e1c2172adc1fd91b8c6eb3e68c6cfa"} Jun 11 23:05:34.486315 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.485975 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rbqb7" event={"ID":"cb53639f-4f59-48fb-b427-e265cf728d72","Type":"ContainerDied","Data":"34a9233c52e0cf56da0b151952841a6fcf2b8183160a702f7f8816e520b308f7"} Jun 11 23:05:34.486315 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.485991 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cb76677f8-n5v8b" Jun 11 23:05:34.486315 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.485994 2578 scope.go:117] "RemoveContainer" containerID="9d1e6649ddcc0e634acac804fab07c01a7e1c2172adc1fd91b8c6eb3e68c6cfa" Jun 11 23:05:34.497181 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.497158 2578 scope.go:117] "RemoveContainer" containerID="9d1e6649ddcc0e634acac804fab07c01a7e1c2172adc1fd91b8c6eb3e68c6cfa" Jun 11 23:05:34.497504 ip-10-0-128-179 kubenswrapper[2578]: E0611 23:05:34.497485 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d1e6649ddcc0e634acac804fab07c01a7e1c2172adc1fd91b8c6eb3e68c6cfa\": container with ID starting with 9d1e6649ddcc0e634acac804fab07c01a7e1c2172adc1fd91b8c6eb3e68c6cfa not found: ID does not exist" containerID="9d1e6649ddcc0e634acac804fab07c01a7e1c2172adc1fd91b8c6eb3e68c6cfa" Jun 11 23:05:34.497578 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.497512 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d1e6649ddcc0e634acac804fab07c01a7e1c2172adc1fd91b8c6eb3e68c6cfa"} err="failed to get container status \"9d1e6649ddcc0e634acac804fab07c01a7e1c2172adc1fd91b8c6eb3e68c6cfa\": rpc error: code = NotFound desc = could not find container \"9d1e6649ddcc0e634acac804fab07c01a7e1c2172adc1fd91b8c6eb3e68c6cfa\": container with ID starting with 9d1e6649ddcc0e634acac804fab07c01a7e1c2172adc1fd91b8c6eb3e68c6cfa not found: ID does not exist" Jun 11 23:05:34.519197 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.519163 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cb76677f8-n5v8b"] Jun 11 23:05:34.522988 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.522958 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5cb76677f8-n5v8b"] Jun 11 23:05:34.534304 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.534269 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rbqb7"] Jun 11 23:05:34.539650 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.539619 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rbqb7"] Jun 11 23:05:34.613006 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.612974 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="839c1cac-100c-47e1-acf1-2d060393a50d" path="/var/lib/kubelet/pods/839c1cac-100c-47e1-acf1-2d060393a50d/volumes" Jun 11 23:05:34.613244 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.613231 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb53639f-4f59-48fb-b427-e265cf728d72" path="/var/lib/kubelet/pods/cb53639f-4f59-48fb-b427-e265cf728d72/volumes" Jun 11 23:05:34.613549 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:05:34.613537 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f82080aa-d8c8-473f-a5c5-1f6cc3005a14" path="/var/lib/kubelet/pods/f82080aa-d8c8-473f-a5c5-1f6cc3005a14/volumes" Jun 11 23:06:11.353050 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:11.352994 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nc27t"] Jun 11 23:06:18.959803 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:18.959759 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-h7gbb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 11 23:06:18.961551 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:18.959854 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" podUID="7e1809c6-6f65-49c0-93dc-5b30e1acb33f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 11 23:06:19.756766 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:19.756730 2578 generic.go:356] "Generic (PLEG): container finished" podID="7e1809c6-6f65-49c0-93dc-5b30e1acb33f" containerID="2c6ed0b5789978894583e4d3ed14612b061b5a1e1650ea6ff512380292eaf429" exitCode=0 Jun 11 23:06:19.756954 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:19.756809 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" event={"ID":"7e1809c6-6f65-49c0-93dc-5b30e1acb33f","Type":"ContainerDied","Data":"2c6ed0b5789978894583e4d3ed14612b061b5a1e1650ea6ff512380292eaf429"} Jun 11 23:06:19.757229 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:19.757215 2578 scope.go:117] "RemoveContainer" containerID="2c6ed0b5789978894583e4d3ed14612b061b5a1e1650ea6ff512380292eaf429" Jun 11 23:06:19.758242 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:19.758214 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 23:06:19.758353 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:19.758301 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 23:06:19.758423 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:19.758350 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 23:06:20.765224 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:20.765192 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" event={"ID":"7e1809c6-6f65-49c0-93dc-5b30e1acb33f","Type":"ContainerStarted","Data":"3125bc95260f927b299b6d756276e992ad0930f8b51121d14338b9703c1a2cae"} Jun 11 23:06:20.824883 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:20.824839 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:06:20.825066 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:20.825032 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-h7gbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jun 11 23:06:20.825115 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:20.825078 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" podUID="7e1809c6-6f65-49c0-93dc-5b30e1acb33f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jun 11 23:06:21.825096 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:21.825057 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-h7gbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jun 11 23:06:21.825634 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:21.825129 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" podUID="7e1809c6-6f65-49c0-93dc-5b30e1acb33f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jun 11 23:06:22.830360 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:22.830322 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-h7gbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jun 11 23:06:22.830876 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:22.830379 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" podUID="7e1809c6-6f65-49c0-93dc-5b30e1acb33f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jun 11 23:06:23.825379 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:23.825339 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-h7gbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jun 11 23:06:23.825578 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:23.825413 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" podUID="7e1809c6-6f65-49c0-93dc-5b30e1acb33f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jun 11 23:06:24.828886 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:24.828852 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:06:24.829333 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:24.829270 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:06:24.829949 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:06:24.829926 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7gbb" Jun 11 23:07:02.627670 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:02.627635 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/1.log" Jun 11 23:07:02.629704 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:02.629682 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/1.log" Jun 11 23:07:09.058658 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.058622 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66748cc7bd-9xlbh"] Jun 11 23:07:09.059037 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.059023 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb53639f-4f59-48fb-b427-e265cf728d72" containerName="authorino" Jun 11 23:07:09.059037 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.059035 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb53639f-4f59-48fb-b427-e265cf728d72" containerName="authorino" Jun 11 23:07:09.059129 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.059117 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb53639f-4f59-48fb-b427-e265cf728d72" containerName="authorino" Jun 11 23:07:09.062650 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.062628 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66748cc7bd-9xlbh" Jun 11 23:07:09.067962 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.067345 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 23:07:09.067962 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.067385 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 23:07:09.067962 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.067421 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m779d\"" Jun 11 23:07:09.070953 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.070928 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66748cc7bd-9xlbh"] Jun 11 23:07:09.190258 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.190224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjgj8\" (UniqueName: \"kubernetes.io/projected/fa4a88bb-14a2-4f17-928a-2a08863ca490-kube-api-access-wjgj8\") pod \"authorino-66748cc7bd-9xlbh\" (UID: \"fa4a88bb-14a2-4f17-928a-2a08863ca490\") " pod="kuadrant-system/authorino-66748cc7bd-9xlbh" Jun 11 23:07:09.190470 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.190277 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fa4a88bb-14a2-4f17-928a-2a08863ca490-oidc-ca\") pod \"authorino-66748cc7bd-9xlbh\" (UID: \"fa4a88bb-14a2-4f17-928a-2a08863ca490\") " pod="kuadrant-system/authorino-66748cc7bd-9xlbh" Jun 11 23:07:09.190470 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.190302 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fa4a88bb-14a2-4f17-928a-2a08863ca490-tls-cert\") pod \"authorino-66748cc7bd-9xlbh\" (UID: \"fa4a88bb-14a2-4f17-928a-2a08863ca490\") " pod="kuadrant-system/authorino-66748cc7bd-9xlbh" Jun 11 23:07:09.290951 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.290915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjgj8\" (UniqueName: \"kubernetes.io/projected/fa4a88bb-14a2-4f17-928a-2a08863ca490-kube-api-access-wjgj8\") pod \"authorino-66748cc7bd-9xlbh\" (UID: \"fa4a88bb-14a2-4f17-928a-2a08863ca490\") " pod="kuadrant-system/authorino-66748cc7bd-9xlbh" Jun 11 23:07:09.291146 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.290974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fa4a88bb-14a2-4f17-928a-2a08863ca490-oidc-ca\") pod \"authorino-66748cc7bd-9xlbh\" (UID: \"fa4a88bb-14a2-4f17-928a-2a08863ca490\") " pod="kuadrant-system/authorino-66748cc7bd-9xlbh" Jun 11 23:07:09.291146 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.291012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fa4a88bb-14a2-4f17-928a-2a08863ca490-tls-cert\") pod \"authorino-66748cc7bd-9xlbh\" (UID: \"fa4a88bb-14a2-4f17-928a-2a08863ca490\") " pod="kuadrant-system/authorino-66748cc7bd-9xlbh" Jun 11 23:07:09.291664 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.291641 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fa4a88bb-14a2-4f17-928a-2a08863ca490-oidc-ca\") pod \"authorino-66748cc7bd-9xlbh\" (UID: \"fa4a88bb-14a2-4f17-928a-2a08863ca490\") " pod="kuadrant-system/authorino-66748cc7bd-9xlbh" Jun 11 23:07:09.293616 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.293578 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fa4a88bb-14a2-4f17-928a-2a08863ca490-tls-cert\") pod \"authorino-66748cc7bd-9xlbh\" (UID: \"fa4a88bb-14a2-4f17-928a-2a08863ca490\") " pod="kuadrant-system/authorino-66748cc7bd-9xlbh" Jun 11 23:07:09.300148 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.300121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjgj8\" (UniqueName: \"kubernetes.io/projected/fa4a88bb-14a2-4f17-928a-2a08863ca490-kube-api-access-wjgj8\") pod \"authorino-66748cc7bd-9xlbh\" (UID: \"fa4a88bb-14a2-4f17-928a-2a08863ca490\") " pod="kuadrant-system/authorino-66748cc7bd-9xlbh" Jun 11 23:07:09.373741 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.373648 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66748cc7bd-9xlbh" Jun 11 23:07:09.523248 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:09.523215 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66748cc7bd-9xlbh"] Jun 11 23:07:09.524570 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:07:09.524543 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa4a88bb_14a2_4f17_928a_2a08863ca490.slice/crio-955fdd8e03d24eccabbfe7827b2d3602938c6d15ca71f4b55a4771f38f45897b WatchSource:0}: Error finding container 955fdd8e03d24eccabbfe7827b2d3602938c6d15ca71f4b55a4771f38f45897b: Status 404 returned error can't find the container with id 955fdd8e03d24eccabbfe7827b2d3602938c6d15ca71f4b55a4771f38f45897b Jun 11 23:07:10.061476 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:10.061433 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66748cc7bd-9xlbh" event={"ID":"fa4a88bb-14a2-4f17-928a-2a08863ca490","Type":"ContainerStarted","Data":"79f823d40a0077da691b349955c44489fe205f1ddabe49bf87d65cbfd6ef2299"} Jun 11 23:07:10.061987 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:10.061497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66748cc7bd-9xlbh" event={"ID":"fa4a88bb-14a2-4f17-928a-2a08863ca490","Type":"ContainerStarted","Data":"955fdd8e03d24eccabbfe7827b2d3602938c6d15ca71f4b55a4771f38f45897b"} Jun 11 23:07:10.078946 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:10.078889 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66748cc7bd-9xlbh" podStartSLOduration=0.705148369 podStartE2EDuration="1.07887269s" totalImagesPullingTime="373.724321ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:10.078405536 +0000 UTC m=+907.961728397" watchObservedRunningTime="2026-06-11 23:07:10.07887269 +0000 UTC m=+907.962195523" Jun 11 23:07:16.486141 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:16.486096 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nc27t"] Jun 11 23:07:26.219126 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:26.219083 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nc27t"] Jun 11 23:07:35.495329 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:35.495288 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nc27t"] Jun 11 23:07:41.093950 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:41.093896 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nc27t"] Jun 11 23:07:50.100034 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:50.099995 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nc27t"] Jun 11 23:07:57.397450 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:07:57.397409 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nc27t"] Jun 11 23:12:02.676941 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:12:02.676910 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/1.log" Jun 11 23:12:02.679392 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:12:02.678565 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/1.log" Jun 11 23:14:20.706037 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:20.705953 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66748cc7bd-9xlbh_fa4a88bb-14a2-4f17-928a-2a08863ca490/authorino/0.log" Jun 11 23:14:25.104112 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:25.104073 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-784f85db5-d9rc9_b787fd73-d10d-4032-9b5d-10f11a489669/nginx/0.log" Jun 11 23:14:26.117720 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:26.117689 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f864d649-2xlc2_73dc3edf-7b5f-440e-8ee9-a75694e97cb6/manager/0.log" Jun 11 23:14:26.126134 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:26.126109 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f864d649-2xlc2_73dc3edf-7b5f-440e-8ee9-a75694e97cb6/copy-manifests/0.log" Jun 11 23:14:27.122264 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:27.122238 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf_3b20b679-42ba-43c1-9e8f-e62903aafec0/util/0.log" Jun 11 23:14:27.128761 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:27.128734 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf_3b20b679-42ba-43c1-9e8f-e62903aafec0/pull/0.log" Jun 11 23:14:27.135068 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:27.135044 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf_3b20b679-42ba-43c1-9e8f-e62903aafec0/extract/0.log" Jun 11 23:14:27.241784 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:27.241754 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7_a8fb35c6-d05d-4514-a116-7776736d10b8/util/0.log" Jun 11 23:14:27.248475 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:27.248456 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7_a8fb35c6-d05d-4514-a116-7776736d10b8/pull/0.log" Jun 11 23:14:27.255032 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:27.255018 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7_a8fb35c6-d05d-4514-a116-7776736d10b8/extract/0.log" Jun 11 23:14:27.365037 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:27.365011 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt_657cd2ad-91fb-44c8-ba0c-1a82a732a15c/util/0.log" Jun 11 23:14:27.374672 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:27.374579 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt_657cd2ad-91fb-44c8-ba0c-1a82a732a15c/pull/0.log" Jun 11 23:14:27.383137 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:27.383114 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt_657cd2ad-91fb-44c8-ba0c-1a82a732a15c/extract/0.log" Jun 11 23:14:27.494098 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:27.494073 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2_407ab369-537e-4a88-ae5e-e4dabfb1fc33/util/0.log" Jun 11 23:14:27.504076 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:27.504052 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2_407ab369-537e-4a88-ae5e-e4dabfb1fc33/pull/0.log" Jun 11 23:14:27.516867 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:27.516846 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2_407ab369-537e-4a88-ae5e-e4dabfb1fc33/extract/0.log" Jun 11 23:14:27.636778 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:27.636750 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66748cc7bd-9xlbh_fa4a88bb-14a2-4f17-928a-2a08863ca490/authorino/0.log" Jun 11 23:14:27.772450 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:27.772420 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-m9ns5_791ed49a-6e68-4579-aa7d-472e68dafa1d/manager/0.log" Jun 11 23:14:28.107562 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:28.107484 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hjpwl_f9969761-2cc2-46b6-be24-17e33bc149e0/registry-server/0.log" Jun 11 23:14:28.403832 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:28.403805 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nc27t_2da21598-fd92-4774-9c1a-51d26fc88965/limitador/0.log" Jun 11 23:14:28.518157 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:28.518124 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-m7bwg_80c2def4-b498-41c2-a376-228853d1ef00/manager/0.log" Jun 11 23:14:28.862779 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:28.862710 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795nx84c_ead864bb-409f-4b7c-b292-8bd8ac10106a/istio-proxy/0.log" Jun 11 23:14:29.312516 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:29.312484 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7gbb_7e1809c6-6f65-49c0-93dc-5b30e1acb33f/istio-proxy/1.log" Jun 11 23:14:35.045095 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.045059 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b88td/must-gather-85bn8"] Jun 11 23:14:35.054182 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.054153 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b88td/must-gather-85bn8" Jun 11 23:14:35.057550 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.057529 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b88td\"/\"openshift-service-ca.crt\"" Jun 11 23:14:35.058857 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.058836 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b88td\"/\"kube-root-ca.crt\"" Jun 11 23:14:35.058990 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.058838 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b88td\"/\"default-dockercfg-bfjln\"" Jun 11 23:14:35.064953 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.064928 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b88td/must-gather-85bn8"] Jun 11 23:14:35.113211 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.113173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/62420260-e633-4aae-b339-8fdd124f5e95-must-gather-output\") pod \"must-gather-85bn8\" (UID: \"62420260-e633-4aae-b339-8fdd124f5e95\") " pod="openshift-must-gather-b88td/must-gather-85bn8" Jun 11 23:14:35.113211 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.113223 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhphq\" (UniqueName: \"kubernetes.io/projected/62420260-e633-4aae-b339-8fdd124f5e95-kube-api-access-xhphq\") pod \"must-gather-85bn8\" (UID: \"62420260-e633-4aae-b339-8fdd124f5e95\") " pod="openshift-must-gather-b88td/must-gather-85bn8" Jun 11 23:14:35.213734 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.213699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhphq\" (UniqueName: \"kubernetes.io/projected/62420260-e633-4aae-b339-8fdd124f5e95-kube-api-access-xhphq\") pod \"must-gather-85bn8\" (UID: \"62420260-e633-4aae-b339-8fdd124f5e95\") " pod="openshift-must-gather-b88td/must-gather-85bn8" Jun 11 23:14:35.213941 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.213827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/62420260-e633-4aae-b339-8fdd124f5e95-must-gather-output\") pod \"must-gather-85bn8\" (UID: \"62420260-e633-4aae-b339-8fdd124f5e95\") " pod="openshift-must-gather-b88td/must-gather-85bn8" Jun 11 23:14:35.214170 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.214155 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/62420260-e633-4aae-b339-8fdd124f5e95-must-gather-output\") pod \"must-gather-85bn8\" (UID: \"62420260-e633-4aae-b339-8fdd124f5e95\") " pod="openshift-must-gather-b88td/must-gather-85bn8" Jun 11 23:14:35.222210 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.222180 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhphq\" (UniqueName: \"kubernetes.io/projected/62420260-e633-4aae-b339-8fdd124f5e95-kube-api-access-xhphq\") pod \"must-gather-85bn8\" (UID: \"62420260-e633-4aae-b339-8fdd124f5e95\") " pod="openshift-must-gather-b88td/must-gather-85bn8" Jun 11 23:14:35.364101 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.364000 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b88td/must-gather-85bn8" Jun 11 23:14:35.501311 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.501278 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b88td/must-gather-85bn8"] Jun 11 23:14:35.502618 ip-10-0-128-179 kubenswrapper[2578]: W0611 23:14:35.502562 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62420260_e633_4aae_b339_8fdd124f5e95.slice/crio-803b2675a0b0f1e205baa749116f593a31d9f8ae438c3c2442fe2a66f421950a WatchSource:0}: Error finding container 803b2675a0b0f1e205baa749116f593a31d9f8ae438c3c2442fe2a66f421950a: Status 404 returned error can't find the container with id 803b2675a0b0f1e205baa749116f593a31d9f8ae438c3c2442fe2a66f421950a Jun 11 23:14:35.504505 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.504488 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:14:35.676816 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:35.676776 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b88td/must-gather-85bn8" event={"ID":"62420260-e633-4aae-b339-8fdd124f5e95","Type":"ContainerStarted","Data":"803b2675a0b0f1e205baa749116f593a31d9f8ae438c3c2442fe2a66f421950a"} Jun 11 23:14:36.687791 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:36.687107 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b88td/must-gather-85bn8" event={"ID":"62420260-e633-4aae-b339-8fdd124f5e95","Type":"ContainerStarted","Data":"b76022666db49e4bb3f08e1fe5ad71a310b31b4d2648d7ebc99c82f557bd938b"} Jun 11 23:14:36.687791 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:36.687163 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b88td/must-gather-85bn8" event={"ID":"62420260-e633-4aae-b339-8fdd124f5e95","Type":"ContainerStarted","Data":"2c81119956c72d345f40a8393f8ba3c60e950717d835db880e3bb1a4b249e52b"} Jun 11 23:14:36.708398 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:36.706626 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b88td/must-gather-85bn8" podStartSLOduration=1.114291433 podStartE2EDuration="1.706601127s" totalImagesPullingTime="592.309694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:14:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:14:36.703523613 +0000 UTC m=+1354.586846448" watchObservedRunningTime="2026-06-11 23:14:36.706601127 +0000 UTC m=+1354.589923952" Jun 11 23:14:37.722919 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:37.722885 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s452g_c752df24-652a-49ad-912b-e760b4a4cad7/global-pull-secret-syncer/0.log" Jun 11 23:14:37.838489 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:37.838457 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vxttp_8994707f-d5de-465f-be7c-61a9c4f7749d/konnectivity-agent/0.log" Jun 11 23:14:37.859938 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:37.859909 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-179.ec2.internal_0d4e299e57df85b5072453add22d52c7/haproxy/0.log" Jun 11 23:14:42.386381 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.386340 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf_3b20b679-42ba-43c1-9e8f-e62903aafec0/extract/0.log" Jun 11 23:14:42.421558 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.421525 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf_3b20b679-42ba-43c1-9e8f-e62903aafec0/util/0.log" Jun 11 23:14:42.458150 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.458074 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759plmnf_3b20b679-42ba-43c1-9e8f-e62903aafec0/pull/0.log" Jun 11 23:14:42.491757 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.491688 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7_a8fb35c6-d05d-4514-a116-7776736d10b8/extract/0.log" Jun 11 23:14:42.522748 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.522717 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7_a8fb35c6-d05d-4514-a116-7776736d10b8/util/0.log" Jun 11 23:14:42.547039 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.546996 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02cqw7_a8fb35c6-d05d-4514-a116-7776736d10b8/pull/0.log" Jun 11 23:14:42.580974 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.580950 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt_657cd2ad-91fb-44c8-ba0c-1a82a732a15c/extract/0.log" Jun 11 23:14:42.611977 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.611805 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt_657cd2ad-91fb-44c8-ba0c-1a82a732a15c/util/0.log" Jun 11 23:14:42.640269 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.640153 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735tzrt_657cd2ad-91fb-44c8-ba0c-1a82a732a15c/pull/0.log" Jun 11 23:14:42.687743 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.687705 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2_407ab369-537e-4a88-ae5e-e4dabfb1fc33/extract/0.log" Jun 11 23:14:42.711136 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.711085 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2_407ab369-537e-4a88-ae5e-e4dabfb1fc33/util/0.log" Jun 11 23:14:42.741518 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.741493 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lzsq2_407ab369-537e-4a88-ae5e-e4dabfb1fc33/pull/0.log" Jun 11 23:14:42.782990 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.782959 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66748cc7bd-9xlbh_fa4a88bb-14a2-4f17-928a-2a08863ca490/authorino/0.log" Jun 11 23:14:42.820313 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.820277 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-m9ns5_791ed49a-6e68-4579-aa7d-472e68dafa1d/manager/0.log" Jun 11 23:14:42.919297 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.919208 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hjpwl_f9969761-2cc2-46b6-be24-17e33bc149e0/registry-server/0.log" Jun 11 23:14:42.984985 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:42.984919 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nc27t_2da21598-fd92-4774-9c1a-51d26fc88965/limitador/0.log" Jun 11 23:14:43.034609 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:43.034150 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-m7bwg_80c2def4-b498-41c2-a376-228853d1ef00/manager/0.log" Jun 11 23:14:44.790064 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:44.790038 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_361faa5b-9dcb-4310-920a-28d9db4a3bf1/alertmanager/0.log" Jun 11 23:14:44.816370 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:44.816339 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_361faa5b-9dcb-4310-920a-28d9db4a3bf1/config-reloader/0.log" Jun 11 23:14:44.842302 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:44.842249 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_361faa5b-9dcb-4310-920a-28d9db4a3bf1/kube-rbac-proxy-web/0.log" Jun 11 23:14:44.871213 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:44.871181 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_361faa5b-9dcb-4310-920a-28d9db4a3bf1/kube-rbac-proxy/0.log" Jun 11 23:14:44.899513 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:44.899461 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_361faa5b-9dcb-4310-920a-28d9db4a3bf1/kube-rbac-proxy-metric/0.log" Jun 11 23:14:44.927735 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:44.927704 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_361faa5b-9dcb-4310-920a-28d9db4a3bf1/prom-label-proxy/0.log" Jun 11 23:14:44.953368 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:44.953339 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_361faa5b-9dcb-4310-920a-28d9db4a3bf1/init-config-reloader/0.log" Jun 11 23:14:44.998374 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:44.998089 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-dr45n_b330625a-5360-4ad2-81b0-de7293b79ed5/cluster-monitoring-operator/0.log" Jun 11 23:14:45.038493 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:45.038434 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-hgsqz_1513612a-3638-4071-9df6-93cd56225718/kube-state-metrics/0.log" Jun 11 23:14:45.057270 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:45.057161 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-hgsqz_1513612a-3638-4071-9df6-93cd56225718/kube-rbac-proxy-main/0.log" Jun 11 23:14:45.093081 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:45.093000 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-hgsqz_1513612a-3638-4071-9df6-93cd56225718/kube-rbac-proxy-self/0.log" Jun 11 23:14:45.217639 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:45.217613 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5pjjk_98ca2950-97dd-4e8e-86c2-55b234023438/node-exporter/0.log" Jun 11 23:14:45.255837 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:45.255814 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5pjjk_98ca2950-97dd-4e8e-86c2-55b234023438/kube-rbac-proxy/0.log" Jun 11 23:14:45.318377 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:45.318297 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5pjjk_98ca2950-97dd-4e8e-86c2-55b234023438/init-textfile/0.log" Jun 11 23:14:45.525535 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:45.525482 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-4zmsl_3e51efdc-a7f2-4891-8e9c-261ee134a1ea/kube-rbac-proxy-main/0.log" Jun 11 23:14:45.556077 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:45.556047 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-4zmsl_3e51efdc-a7f2-4891-8e9c-261ee134a1ea/kube-rbac-proxy-self/0.log" Jun 11 23:14:45.583261 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:45.583177 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-4zmsl_3e51efdc-a7f2-4891-8e9c-261ee134a1ea/openshift-state-metrics/0.log" Jun 11 23:14:45.833613 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:45.833510 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-2sztm_f6c9951a-f300-4081-a614-ba550cd566ff/prometheus-operator/0.log" Jun 11 23:14:45.855879 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:45.855850 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-2sztm_f6c9951a-f300-4081-a614-ba550cd566ff/kube-rbac-proxy/0.log" Jun 11 23:14:45.916474 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:45.916440 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8476db5d59-d7x9h_96746c7f-0dbc-4a73-aba3-d34ae123d492/telemeter-client/0.log" Jun 11 23:14:45.940019 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:45.939998 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8476db5d59-d7x9h_96746c7f-0dbc-4a73-aba3-d34ae123d492/reload/0.log" Jun 11 23:14:45.962768 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:45.962734 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8476db5d59-d7x9h_96746c7f-0dbc-4a73-aba3-d34ae123d492/kube-rbac-proxy/0.log" Jun 11 23:14:48.124809 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.124768 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/1.log" Jun 11 23:14:48.131942 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.131911 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-fzs8p_ca5beba5-4b57-40ba-94e3-cccf5cc2a5bb/console-operator/2.log" Jun 11 23:14:48.787176 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.787129 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db"] Jun 11 23:14:48.796275 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.796248 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.807546 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.807062 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db"] Jun 11 23:14:48.864744 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.864698 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07e80da4-f602-4e47-93a5-81e848be49fd-sys\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.864941 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.864775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07e80da4-f602-4e47-93a5-81e848be49fd-lib-modules\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.864941 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.864830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/07e80da4-f602-4e47-93a5-81e848be49fd-podres\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.864941 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.864895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jwx4\" (UniqueName: \"kubernetes.io/projected/07e80da4-f602-4e47-93a5-81e848be49fd-kube-api-access-8jwx4\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.864941 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.864936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/07e80da4-f602-4e47-93a5-81e848be49fd-proc\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.966293 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.966245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07e80da4-f602-4e47-93a5-81e848be49fd-sys\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.966470 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.966320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07e80da4-f602-4e47-93a5-81e848be49fd-lib-modules\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.966470 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.966377 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/07e80da4-f602-4e47-93a5-81e848be49fd-podres\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.966470 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.966408 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07e80da4-f602-4e47-93a5-81e848be49fd-sys\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.966470 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.966444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jwx4\" (UniqueName: \"kubernetes.io/projected/07e80da4-f602-4e47-93a5-81e848be49fd-kube-api-access-8jwx4\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.966666 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.966471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/07e80da4-f602-4e47-93a5-81e848be49fd-proc\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.966666 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.966520 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07e80da4-f602-4e47-93a5-81e848be49fd-lib-modules\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.966666 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.966534 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/07e80da4-f602-4e47-93a5-81e848be49fd-podres\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.966666 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.966578 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/07e80da4-f602-4e47-93a5-81e848be49fd-proc\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:48.976459 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:48.976392 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jwx4\" (UniqueName: \"kubernetes.io/projected/07e80da4-f602-4e47-93a5-81e848be49fd-kube-api-access-8jwx4\") pod \"perf-node-gather-daemonset-jf6db\" (UID: \"07e80da4-f602-4e47-93a5-81e848be49fd\") " pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:49.114976 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:49.114859 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:49.323296 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:49.323196 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db"] Jun 11 23:14:49.477846 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:49.477819 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-r8bg7_9f9e5ef6-32b9-4a73-ae95-84dbf9a1285a/volume-data-source-validator/0.log" Jun 11 23:14:49.808091 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:49.808043 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" event={"ID":"07e80da4-f602-4e47-93a5-81e848be49fd","Type":"ContainerStarted","Data":"d38b31fd03e3b97f1b1d895d27697c9a1450b5a832a4434c30838895813a586e"} Jun 11 23:14:49.808304 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:49.808110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" event={"ID":"07e80da4-f602-4e47-93a5-81e848be49fd","Type":"ContainerStarted","Data":"8fe703e1c77d6c7e22b8326b9d8f252caef1a849bd7f112395e3beee3d61fd13"} Jun 11 23:14:49.808304 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:49.808145 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:49.840879 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:49.840828 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" podStartSLOduration=1.840810488 podStartE2EDuration="1.840810488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:14:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:14:49.8392195 +0000 UTC m=+1367.722542340" watchObservedRunningTime="2026-06-11 23:14:49.840810488 +0000 UTC m=+1367.724133320" Jun 11 23:14:50.793511 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:50.793479 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vnrbb_9d904fc7-7dff-47ab-9ed8-d804c2aa6688/dns/0.log" Jun 11 23:14:50.818769 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:50.818733 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vnrbb_9d904fc7-7dff-47ab-9ed8-d804c2aa6688/kube-rbac-proxy/0.log" Jun 11 23:14:50.856179 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:50.856146 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gxzlc_54366c51-87c6-4077-b5f1-b4513f516370/dns-node-resolver/0.log" Jun 11 23:14:51.493122 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:51.493090 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b5jz4_f01823b1-ec0f-4636-bb5d-1d25a7e91152/node-ca/0.log" Jun 11 23:14:52.591110 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:52.591082 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795nx84c_ead864bb-409f-4b7c-b292-8bd8ac10106a/istio-proxy/0.log" Jun 11 23:14:52.816605 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:52.816551 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7gbb_7e1809c6-6f65-49c0-93dc-5b30e1acb33f/istio-proxy/1.log" Jun 11 23:14:52.817025 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:52.816995 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7gbb_7e1809c6-6f65-49c0-93dc-5b30e1acb33f/istio-proxy/0.log" Jun 11 23:14:53.768513 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:53.768463 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r857s_669cf1be-fd7f-4d0e-a42a-52f85ed2b337/serve-healthcheck-canary/0.log" Jun 11 23:14:54.428925 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:54.428902 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gxtz5_5f8f6ce8-ecca-462d-a232-b0fbefa4e63f/kube-rbac-proxy/0.log" Jun 11 23:14:54.454776 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:54.454742 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gxtz5_5f8f6ce8-ecca-462d-a232-b0fbefa4e63f/exporter/0.log" Jun 11 23:14:54.486002 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:54.485975 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gxtz5_5f8f6ce8-ecca-462d-a232-b0fbefa4e63f/extractor/0.log" Jun 11 23:14:55.827020 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:55.826991 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b88td/perf-node-gather-daemonset-jf6db" Jun 11 23:14:56.816793 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:56.816762 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-784f85db5-d9rc9_b787fd73-d10d-4032-9b5d-10f11a489669/nginx/0.log" Jun 11 23:14:57.196554 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:57.196515 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f864d649-2xlc2_73dc3edf-7b5f-440e-8ee9-a75694e97cb6/manager/0.log" Jun 11 23:14:57.214640 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:57.214471 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f864d649-2xlc2_73dc3edf-7b5f-440e-8ee9-a75694e97cb6/copy-manifests/0.log" Jun 11 23:14:59.127286 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:14:59.127258 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-856696d794-wthbz_4fa71520-6a00-4a38-82dd-8987ddc881cc/manager/0.log" Jun 11 23:15:02.923442 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:02.923410 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795nx84c_ead864bb-409f-4b7c-b292-8bd8ac10106a/istio-proxy/0.log" Jun 11 23:15:03.004895 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:03.004857 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7gbb_7e1809c6-6f65-49c0-93dc-5b30e1acb33f/istio-proxy/1.log" Jun 11 23:15:03.005340 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:03.005311 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7gbb_7e1809c6-6f65-49c0-93dc-5b30e1acb33f/istio-proxy/0.log" Jun 11 23:15:04.164029 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:04.163987 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795nx84c_ead864bb-409f-4b7c-b292-8bd8ac10106a/istio-proxy/0.log" Jun 11 23:15:04.254520 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:04.254482 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7gbb_7e1809c6-6f65-49c0-93dc-5b30e1acb33f/istio-proxy/1.log" Jun 11 23:15:04.254988 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:04.254945 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7gbb_7e1809c6-6f65-49c0-93dc-5b30e1acb33f/istio-proxy/0.log" Jun 11 23:15:04.428194 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:04.428114 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-xkpzk_db92962e-82f0-43eb-97ce-f33917f114a6/migrator/0.log" Jun 11 23:15:04.452219 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:04.452189 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-xkpzk_db92962e-82f0-43eb-97ce-f33917f114a6/graceful-termination/0.log" Jun 11 23:15:04.874024 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:04.873938 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-9cqpp_68547bb5-ac97-4739-a039-ca0eb1ec5520/kube-storage-version-migrator-operator/1.log" Jun 11 23:15:04.875231 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:04.875206 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-9cqpp_68547bb5-ac97-4739-a039-ca0eb1ec5520/kube-storage-version-migrator-operator/0.log" Jun 11 23:15:06.078364 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:06.078280 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795nx84c_ead864bb-409f-4b7c-b292-8bd8ac10106a/istio-proxy/0.log" Jun 11 23:15:06.156998 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:06.156950 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7gbb_7e1809c6-6f65-49c0-93dc-5b30e1acb33f/istio-proxy/1.log" Jun 11 23:15:06.157340 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:06.157322 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7gbb_7e1809c6-6f65-49c0-93dc-5b30e1acb33f/istio-proxy/0.log" Jun 11 23:15:06.269966 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:06.269937 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9r8c_3ca4a8ca-16e8-4e4f-b62e-b08ef861c251/kube-multus-additional-cni-plugins/0.log" Jun 11 23:15:06.301179 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:06.301147 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9r8c_3ca4a8ca-16e8-4e4f-b62e-b08ef861c251/egress-router-binary-copy/0.log" Jun 11 23:15:06.335757 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:06.335647 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9r8c_3ca4a8ca-16e8-4e4f-b62e-b08ef861c251/cni-plugins/0.log" Jun 11 23:15:06.375447 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:06.375423 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9r8c_3ca4a8ca-16e8-4e4f-b62e-b08ef861c251/bond-cni-plugin/0.log" Jun 11 23:15:06.402960 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:06.402933 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9r8c_3ca4a8ca-16e8-4e4f-b62e-b08ef861c251/routeoverride-cni/0.log" Jun 11 23:15:06.431848 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:06.431819 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9r8c_3ca4a8ca-16e8-4e4f-b62e-b08ef861c251/whereabouts-cni-bincopy/0.log" Jun 11 23:15:06.466859 ip-10-0-128-179 kubenswrapper[2578]: I0611 23:15:06.466829 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9r8c_3ca4a8ca-16e8-4e4f-b62e-b08ef861c251/whereabouts-cni/0.log"